00010000:00010000:3.0:1763333164.743218:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51552 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333164.743232:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c51559 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333164.743238:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c51559 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333164.743243:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c51559 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333164.743632:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51552 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333164.743644:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51552 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333164.743654:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51552 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333164.743661:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51552 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333164.743677:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46e42c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333164.743683:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51552 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333164.743691:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51552 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333164.743704:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff8016f200) 00010000:00010000:3.0:1763333164.743707:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333164.743711:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51552 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333164.743719:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51552 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333164.743735:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c51559 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333164.743744:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c51559 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333164.743754:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c51559 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333164.743759:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48191600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333164.743761:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c51559 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333164.743767:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c51559 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333164.743774:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43a31800) 00010000:00010000:3.0:1763333164.743777:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333164.743780:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c51559 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333164.743786:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c51559 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333164.743824:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c5154b lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967e1c expref: 209 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333164.743836:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff8016f200) 00010000:00010000:3.0:1763333164.743840:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333164.743845:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c5154b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967e1c expref: 209 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333164.743874:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46e42600, rc 0) 00000100:00100000:3.0:1763333164.743943:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+207:56707:x1848987613355648:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 999us (1346us total) trans 0 rc 301/301 00000100:00100000:3.0:1763333164.745148:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8394 00000001:00080000:3.0:1763333164.746673:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294971507 is committed 00000004:00080000:3.0:1763333164.746681:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 761 committed 00000004:00080000:3.0:1763333164.746695:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 764 committed 00000004:00080000:3.0:1763333164.746703:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 763 committed 00000004:00080000:3.0:1763333164.746706:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 760 committed 00000100:00100000:3.0:1763333164.746830:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4920df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627151104:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333164.746885:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333164.746950:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7400c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627151232:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333164.746974:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333164.747217:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763333164.747227:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7403a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627151360:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333164.747259:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1763333164.747606:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4920df80/2, rc 0, transno 21474838552 00000100:00100000:3.0:1763333164.747616:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4920df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627151104:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1763333164.747642:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7400c000/2, rc 0, transno 17179871247 00000100:00100000:3.0:1763333164.747649:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7400c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627151232:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763333164.747681:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7403a680/2, rc 0, transno 21474838553 00000100:00100000:3.0:1763333164.747692:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7403a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627151360:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333164.752706:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333164.760401:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333164.760434:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333164.816517:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333164.822072:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613358336 00000100:00100000:3.0:1763333164.822078:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613358336 00000100:00100000:3.0:1763333164.822128:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 5773 00000100:00100000:3.0:1763333164.822137:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2420:x1848987613358336:12345-192.168.204.28@tcp:23:lfs.0 00000100:00100000:3.0:1763333164.822233:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2420:x1848987613358336:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 95us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333164.822240:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 5773 00000100:00100000:3.0:1763333164.839886:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333164.852832:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613359232 00000100:00100000:3.0:1763333164.852838:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613359232 00000100:00100000:3.0:1763333164.852879:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 5780 00000100:00100000:3.0:1763333164.852887:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4b886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:55917:x1848987613359232:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333164.852897:0:8611:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333164.852912:0:8611:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe48190200/0xb32e3ef184c51624 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x1db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36967e70 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333164.852933:0:8611:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x1db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333164.852949:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333164.852951:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333164.852960:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe48190200/0xb32e3ef184c51624 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967e70 expref: 19 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333164.852974:0:8611:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe48190200/0xb32e3ef184c51624 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967e70 expref: 19 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333164.852985:0:8611:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48190200, rc 0) 00000100:00100000:3.0:1763333164.853032:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4b886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:55917:x1848987613359232:12345-192.168.204.28@tcp:101:bash.0 Request processed in 145us (1444us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333164.853038:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 5780 00000100:00100000:3.0:1763333164.864010:0:28429:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613359616 00000100:00100000:3.0:1763333164.864020:0:28429:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613359616 00000100:00100000:3.0:1763333164.864084:0:28429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1463 00000100:00100000:3.0:1763333164.864092:0:28429:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4b884700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+31:2421:x1848987613359616:12345-192.168.204.28@tcp:4:lfs.0 00010000:00010000:3.0:1763333164.864130:0:28429:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe48191600/0xb32e3ef184c5162b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333164.864148:0:28429:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46e43000/0xb32e3ef184c513bc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967d97 expref: 31 pid: 8407 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333164.864156:0:28429:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333164.864158:0:28429:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333164.864162:0:28429:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe48191600/0xb32e3ef184c5162b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1da:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333164.864195:0:28429:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe46e43000/0xb32e3ef184c513bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967d97 expref: 31 pid: 8407 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333164.864207:0:28429:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe46e43000/0xb32e3ef184c513bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967d97 expref: 31 pid: 8407 timeout: 1368 lvb_type: 1 00000100:00100000:3.0:1763333164.864221:0:28429:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff74023b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_013:lustre-OST0000_UUID:28429:1848987627152128:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333164.872962:0:28429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46e43000/0xb32e3ef184c513bc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967d97 expref: 31 pid: 8407 timeout: 1368 lvb_type: 1 00000100:00100000:3.0:1763333164.872982:0:28429:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff74023b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_013:lustre-OST0000_UUID:28429:1848987627152128:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333164.872999:0:28429:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe48191600/0xb32e3ef184c5162b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1da:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333164.873008:0:28429:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe48191600/0xb32e3ef184c5162b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1da:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333164.873015:0:28429:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe48191600/0xb32e3ef184c5162b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1da:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333164.877624:0:28429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x1da:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:3.0:1763333164.877629:0:28429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x1da:0x0] updating lvb mtime from disk: 0 -> 1763333165 00002000:00010000:3.0:1763333164.877632:0:28429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x1da:0x0] updating lvb ctime from disk: 0 -> 1763333165 00002000:00010000:3.0:1763333164.877634:0:28429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1da:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1763333164.877647:0:28429:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe48191600/0xb32e3ef184c5162b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1da:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333164.877659:0:28429:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe48191600/0xb32e3ef184c5162b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1da:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333164.877675:0:28429:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe48191600/0xb32e3ef184c5162b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1da:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333164.877682:0:28429:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48191600 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333164.877687:0:28429:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe48191600/0xb32e3ef184c5162b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1da:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333164.878135:0:28429:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe48191600/0xb32e3ef184c5162b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1da:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333164.878158:0:28429:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe48191600/0xb32e3ef184c5162b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1da:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333164.878167:0:28429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe48191600/0xb32e3ef184c5162b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1da:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333164.878977:0:28429:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4b884700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+11:2421:x1848987613359616:12345-192.168.204.28@tcp:4:lfs.0 Request processed in 14878us (15073us total) trans 21474838557 rc 0/0 00000100:00100000:3.0:1763333164.878989:0:28429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1463 00000100:00100000:3.0:1763333164.896273:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333164.908762:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 5782 00000100:00100000:3.0:1763333164.908777:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:56705:x1848987613360896:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333164.908798:0:8611:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333164.908818:0:8611:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe48191600/0xb32e3ef184c51678 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x1da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36967e85 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333164.908848:0:8611:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c513c3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967d9e expref: 21 pid: 8407 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333164.908856:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333164.908858:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333164.908862:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe48191600/0xb32e3ef184c51678 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967e85 expref: 21 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333164.908904:0:8611:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c513c3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967d9e expref: 21 pid: 8407 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333164.908918:0:8611:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c513c3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967d9e expref: 21 pid: 8407 timeout: 1368 lvb_type: 1 00000100:00100000:3.0:1763333164.908932:0:8611:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff74021880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8611:1848987627152256:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333164.909022:0:8611:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7ad02180 going to sleep for 11 seconds 00000100:00100000:3.0:1763333164.910730:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333164.917675:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613361536 00000100:00100000:3.0:1763333164.917681:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613361536 00000100:00100000:3.0:1763333164.917728:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8410 00000100:00100000:3.0:1763333164.917736:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+205:56709:x1848987613361536:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333164.917751:0:29240:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333164.917774:0:29240:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c51694 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36967e93 expref: -99 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333164.917841:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c5169b lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:3.0:1763333164.917856:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c5169b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333164.917868:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c5169b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333164.917880:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c516a2 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:3.0:1763333164.917888:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c516a2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333164.917894:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c516a2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333164.917933:0:29240:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c5169b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333164.917940:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c5169b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333164.917946:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c5169b lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333164.917953:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c5169b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333164.917959:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48190400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333164.917962:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c5169b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333164.917969:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c5169b lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333164.917980:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff8016f800) 00010000:00010000:3.0:1763333164.917983:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333164.917987:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c5169b lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333164.917993:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c5169b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333164.918005:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c516a2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333164.918011:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c516a2 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333164.918016:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c516a2 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333164.918021:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48190c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333164.918023:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c516a2 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333164.918028:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c516a2 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333164.918035:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b90600) 00010000:00010000:3.0:1763333164.918037:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333164.918040:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c516a2 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333164.918046:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c516a2 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333164.918070:0:29240:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c51694 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967e93 expref: 206 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333164.918079:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff8016f800) 00010000:00010000:3.0:1763333164.918081:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333164.918085:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c51694 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967e93 expref: 206 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333164.918097:0:29240:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48190e00, rc 0) 00000100:00100000:3.0:1763333164.918142:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+205:56709:x1848987613361536:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 406us (585us total) trans 0 rc 301/301 00000100:00100000:3.0:1763333164.918148:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8410 00000100:00100000:3.0:1763333164.932709:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8411 00000100:00100000:3.0:1763333164.932726:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+206:56705:x1848987613361792:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:3.0:1763333164.932810:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c516b0 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x169:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:3.0:1763333164.932827:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c516b0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x169:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333164.932849:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c516b0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x169:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00000004:00010000:3.0:1763333164.933017:0:29240:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000305e5dc3 reply state 00000000231a6669 transno 4294971519 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c516b0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x169:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333164.933029:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c516b0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x169:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333164.933037:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x169:0x0].0x0 (ffff92fe43ab5d00) 00010000:00010000:3.0:1763333164.933040:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763333164.933043:0:29240:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763333164.933137:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+209:56705:x1848987613361792:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 417us (4441us total) trans 4294971519 rc 0/0 00000100:00100000:3.0:1763333164.933144:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8411 00000100:00100000:3.0:1763333164.949900:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333164.955817:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333164.955852:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333164.955918:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613362688 00000100:00100000:3.0:1763333164.955932:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613362688 00000100:00100000:3.0:1763333164.955983:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 5784 00000100:00100000:3.0:1763333164.955994:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44a62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2421:x1848987613362688:12345-192.168.204.28@tcp:2:lfs.0 00002000:00010000:3.0:1763333164.956159:0:8611:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x1d9:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1763333164.956163:0:8611:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x1d9:0x0] updating lvb mtime from disk: 1763333164 -> 1763333164 00002000:00010000:3.0:1763333164.956166:0:8611:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x1d9:0x0] updating lvb atime from disk: 0 -> 1763333164 00002000:00010000:3.0:1763333164.956168:0:8611:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x1d9:0x0] updating lvb ctime from disk: 1763333164 -> 1763333165 00002000:00010000:3.0:1763333164.956170:0:8611:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x1d9:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763333164.956222:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44a62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2421:x1848987613362688:12345-192.168.204.28@tcp:2:lfs.0 Request processed in 229us (368us total) trans 17179871253 rc 0/0 00000100:00100000:3.0:1763333164.956230:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 5784 00000100:00100000:3.0:1763333164.971266:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613363456 00000100:00100000:3.0:1763333164.971275:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613363456 00010000:00010000:3.0:1763333164.971307:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c5158a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x169:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967e2a expref: 211 pid: 29240 timeout: 1369 lvb_type: 0 00000100:00100000:3.0:1763333164.971337:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2753 00000100:00100000:3.0:1763333164.971345:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+211:2420:x1848987613363456:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333164.971389:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333164.971395:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c5158a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x169:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967e2a expref: 211 pid: 29240 timeout: 1369 lvb_type: 0 00010000:00010000:3.0:1763333164.971406:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c5158a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x169:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967e2a expref: 211 pid: 29240 timeout: 1369 lvb_type: 0 00010000:00010000:3.0:1763333164.971425:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c5158a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x169:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967e2a expref: 211 pid: 29240 timeout: 1369 lvb_type: 0 00010000:00010000:3.0:1763333164.971437:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x169:0x0].0x0 (ffff92fe43ab5d00) 00010000:00010000:3.0:1763333164.971442:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5170b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x169:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 00010000:00010000:3.0:1763333164.971451:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5170b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x169:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT1 00010000:00010000:3.0:1763333164.971457:0:6504:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5170b lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x169:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT1 00010000:00010000:3.0:1763333164.971480:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333164.971516:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+210:2420:x1848987613363456:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 170us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333164.971528:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2753 00000100:00100000:3.0:1763333164.972737:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000001:00080000:3.0:1763333164.977776:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294971522 is committed 00000004:00080000:3.0:1763333164.977792:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 766 committed 00000004:00080000:3.0:1763333164.977807:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 769 committed 00000004:00080000:3.0:1763333164.977815:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 768 committed 00000004:00080000:3.0:1763333164.977819:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 765 committed 00000004:00080000:3.0:1763333164.977835:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 764 committed 00000004:00080000:3.0:1763333164.977841:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 767 committed 00000100:00100000:3.0:1763333164.977974:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44a61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627153024:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763333164.978054:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333164.978095:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763333164.978105:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44a61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627153152:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763333164.978129:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333164.978167:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff74034000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627153408:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333164.978190:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333164.978207:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763333164.978213:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44a62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627153280:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333164.978234:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333164.978262:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627153024 00000100:00100000:3.0:1763333164.978270:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627153024 00000100:00100000:3.0:1763333164.978311:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627153152 00000100:00100000:3.0:1763333164.978314:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627153152 00000100:00100000:3.0:1763333164.978325:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627153408 00000100:00100000:3.0:1763333164.978328:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627153408 00000100:00100000:3.0:1763333164.978340:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627153280 00000100:00100000:3.0:1763333164.978343:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627153280 00000100:00100000:3.0:1763333164.978386:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5785 00000100:00100000:3.0:1763333164.978395:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e05ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+24:3654:x1848987627153024:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763333164.978423:0:8407:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:475 count 1 00010000:00010000:3.0:1763333164.978445:0:8407:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe48190400/0xb32e3ef184c51719 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x1db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333164.978463:0:8407:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe48190200/0xb32e3ef184c51624 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967e70 expref: 21 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333164.978470:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333164.978472:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333164.978475:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe48190400/0xb32e3ef184c51719 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x1db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333164.978504:0:8407:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe48190200/0xb32e3ef184c51624 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967e70 expref: 21 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333164.978517:0:8407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe48190200/0xb32e3ef184c51624 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967e70 expref: 21 pid: 8611 timeout: 1369 lvb_type: 0 00000100:00100000:3.0:1763333164.978528:0:8407:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff74037b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8407:1848987627153536:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333164.978599:0:8407:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7ad02300 going to sleep for 11 seconds 00000100:00100000:3.0:1763333164.978621:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5786 00000100:00100000:3.0:1763333164.978629:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74034e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+24:3654:x1848987627153152:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763333164.978641:0:17605:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:476 count 1 00002000:00010000:3.0:1763333164.978670:0:17605:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x1dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333164.978676:0:17605:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c51720 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333164.978683:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333164.978684:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333164.978688:0:17605:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c51720 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333164.978698:0:17605:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c51720 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333164.978705:0:17605:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c51720 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333164.978711:0:17605:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c51720 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333164.978724:0:17605:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763333164.978923:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74034e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+25:3654:x1848987627153152:12345-0@lo:6:osp-syn-1-1.0 Request processed in 294us (792us total) trans 17179871254 rc 0/0 00000100:00100000:3.0:1763333164.978930:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5786 00000100:00100000:3.0:1763333164.978946:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5787 00000100:00100000:3.0:1763333164.978951:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74037100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+24:3653:x1848987627153408:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1763333164.979023:0:17605:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x1da:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333164.979026:0:17605:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x1da:0x0] updating lvb mtime from disk: 1763333165 -> 1763333165 00002000:00010000:3.0:1763333164.979029:0:17605:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x1da:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333164.979032:0:17605:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x1da:0x0] updating lvb ctime from disk: 1763333165 -> 1763333165 00002000:00010000:3.0:1763333164.979034:0:17605:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x1da:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333164.979061:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74037100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+25:3653:x1848987627153408:12345-0@lo:2:osp-syn-1-1.0 Request processed in 110us (870us total) trans 17179871255 rc 0/0 00000100:00100000:3.0:1763333164.979067:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5787 00000100:00100000:3.0:1763333164.979078:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5788 00000100:00100000:3.0:1763333164.979084:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74036680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+24:3653:x1848987627153280:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1763333164.979128:0:17605:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x1d9:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1763333164.979131:0:17605:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x1d9:0x0] updating lvb mtime from disk: 1763333164 -> 1763333164 00002000:00010000:3.0:1763333164.979133:0:17605:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x1d9:0x0] updating lvb atime from disk: 1763333164 -> 1763333164 00002000:00010000:3.0:1763333164.979135:0:17605:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x1d9:0x0] updating lvb ctime from disk: 1763333165 -> 1763333165 00002000:00010000:3.0:1763333164.979137:0:17605:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x1d9:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763333164.979160:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74036680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+25:3653:x1848987627153280:12345-0@lo:2:osp-syn-1-1.0 Request processed in 76us (924us total) trans 17179871256 rc 0/0 00000100:00100000:3.0:1763333164.979165:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5788 00000004:00080000:3.0:1763333164.979216:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44a62300/2, rc 0, transno 17179871256 00000100:00100000:3.0:1763333164.979222:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44a62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627153280:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763333164.979230:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff74034000/2, rc 0, transno 17179871255 00000100:00100000:3.0:1763333164.979232:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff74034000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627153408:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763333164.979247:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44a61c00/2, rc 0, transno 17179871254 00000100:00100000:3.0:1763333164.979250:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44a61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627153152:0@lo:6:osp-syn-1-1.0 00000004:00010000:3.0:1763333164.979282:0:6522:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000304efc2b reply state 000000001c0f8330 transno 4294971522 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5170b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x169:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 00010000:00010000:3.0:1763333164.979299:0:6522:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5170b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x169:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 00010000:00010000:3.0:1763333164.979306:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x169:0x0].0x0 (ffff92fe43ab5d00) 00010000:00010000:3.0:1763333164.979309:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1763333164.979312:0:6522:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763333164.979317:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x169:0x0].0x0 (ffff92fe43ab5d00) 00010000:00010000:3.0:1763333164.979319:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763333164.979324:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c514f7 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x169:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967df9 expref: 200 pid: 29240 timeout: 0 lvb_type: 0 00010000:00080000:3.0:1763333164.979417:0:6522:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1763333164.979431:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+200:56705:x1848987613363200:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 15992us (16403us total) trans 4294971522 rc 0/0 00000100:00100000:3.0:1763333164.979438:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2861 00010000:00010000:3.0:1763333164.979458:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5170b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x169:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 00010000:00010000:3.0:1763333164.979464:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5170b lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x169:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 00010000:00010000:3.0:1763333164.979470:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5170b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x169:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 00010000:00010000:3.0:1763333164.979475:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdee00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333164.979478:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5170b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x169:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 00010000:00010000:3.0:1763333164.979484:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5170b lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x169:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 00010000:00010000:3.0:1763333164.979497:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x169:0x0].0x0 (ffff92fe43ab5d00) 00010000:00010000:3.0:1763333164.979499:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763333164.979504:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5170b lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x169:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 00010000:00010000:3.0:1763333164.979509:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5170b lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x169:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 00000100:00100000:3.0:1763333164.979561:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333164.979581:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613363968 00000100:00100000:3.0:1763333164.979585:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613363968 00000100:00100000:3.0:1763333164.979609:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2863 00000100:00100000:3.0:1763333164.979615:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+200:56709:x1848987613363968:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333164.979730:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+201:56709:x1848987613363968:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 114us (168us total) trans 4294971524 rc 0/0 00000100:00100000:3.0:1763333164.979736:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2863 00010000:00010000:3.0:1763333164.985848:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333164.985859:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c51727 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333164.985873:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf600 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333164.985879:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c51727 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333164.985889:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c51727 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333164.985907:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c51727 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333164.985915:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c51727 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333164.985939:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333164.985941:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333164.985944:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763333164.986008:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333164.987249:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613364352 00000100:00100000:3.0:1763333164.987256:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613364352 00000100:00100000:3.0:1763333164.989230:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8417 00000100:00100000:3.0:1763333164.989246:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bdd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+201:55917:x1848987613364352:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333164.989268:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333164.989330:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c5173c lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36967ec4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333164.989486:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c51743 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333164.989499:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c51743 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333164.989510:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c51743 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333164.989523:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c5174a lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333164.989528:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c5174a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333164.989537:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c5174a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333164.989599:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43000/0xb32e3ef184c51751 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x16c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333164.989607:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43000/0xb32e3ef184c51751 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x16c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333164.989613:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43000/0xb32e3ef184c51751 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x16c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:3.0:1763333164.989623:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x16c:0x0]: returning size 0 00010000:00010000:3.0:1763333164.989711:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c51743 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333164.989718:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c51743 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333164.989724:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c51743 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333164.989730:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c51743 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333164.989735:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48191400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333164.989739:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c51743 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333164.989745:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c51743 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333164.989755:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff8016f700) 00010000:00010000:3.0:1763333164.989758:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333164.989763:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c51743 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333164.989769:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c51743 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333164.989781:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c5174a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333164.989786:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c5174a lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333164.989791:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c5174a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333164.989795:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46e43c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333164.989798:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c5174a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333164.989803:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c5174a lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333164.989809:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff8016fb00) 00010000:00010000:3.0:1763333164.989811:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333164.989814:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c5174a lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333164.989819:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c5174a lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333164.989862:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c5173c lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967ec4 expref: 204 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333164.989877:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43000/0xb32e3ef184c51751 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x16c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967ec4 expref: 203 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333164.989884:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x16c:0x0].0x0 (ffff92ff8016f200) 00010000:00010000:3.0:1763333164.989886:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333164.989889:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46e43000, rc 0) 00000100:00100000:3.0:1763333164.989955:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bdd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+203:55917:x1848987613364352:12345-192.168.204.28@tcp:101:bash.0 Request processed in 713us (2994us total) trans 4294971525 rc 0/0 00000100:00100000:3.0:1763333164.989964:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8417 00010000:00010000:3.0:1763333164.992419:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1763333164.992426:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c5172e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333164.992435:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdfe00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333164.992438:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c5172e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333164.992448:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c5172e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333164.992464:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c5172e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333164.992472:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c5172e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333164.992490:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333164.992492:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333164.992493:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763333164.998249:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613364992 00000100:00100000:3.0:1763333164.998261:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613364992 00000100:00100000:3.0:1763333164.998336:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8418 00000100:00100000:3.0:1763333164.998380:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+203:55917:x1848987613364992:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333164.998406:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333164.998431:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c5175f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x16c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36967ecb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333164.998472:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51766 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x16c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333164.998488:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51766 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x16c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333164.998502:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51766 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x16c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333164.998637:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c5175f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x16c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967ecb expref: 205 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333164.998655:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51766 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x16c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967ecb expref: 204 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333164.998696:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x16c:0x0].0x0 (ffff92ff8016f200) 00010000:00010000:3.0:1763333164.998699:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763333164.998703:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46e42c00, rc 0) 00000100:00100000:3.0:1763333164.998760:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+204:55917:x1848987613364992:12345-192.168.204.28@tcp:101:bash.0 Request processed in 415us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333164.998767:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8418 00000100:00100000:3.0:1763333165.002792:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333165.009501:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613365504 00000100:00100000:3.0:1763333165.009512:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613365504 00000100:00100000:3.0:1763333165.009570:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8420 00000100:00100000:3.0:1763333165.009581:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+207:56705:x1848987613365504:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333165.009605:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333165.009626:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c5177b lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36967ed2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.009712:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c51782 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333165.009726:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c51782 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333165.009737:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c51782 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333165.009748:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c51789 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333165.009755:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c51789 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333165.009762:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c51789 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333165.009865:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c51790 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x16c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333165.009873:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c51790 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x16c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333165.009879:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c51790 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x16c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:3.0:1763333165.009893:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x16c:0x0]: returning size 0 00000100:00100000:3.0:1763333165.017715:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613366016 00000100:00100000:3.0:1763333165.017723:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613366016 00000100:00100000:3.0:1763333165.017769:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613366144 00000100:00100000:3.0:1763333165.017774:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613366144 00000100:00100000:3.0:1763333165.024230:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613366272 00000100:00100000:3.0:1763333165.024239:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613366272 00010000:00010000:3.0:1763333165.024282:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c51790 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x16c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967ed2 expref: 211 pid: 6519 timeout: 1369 lvb_type: 0 00000100:00100000:3.0:1763333165.024336:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2756 00000100:00100000:3.0:1763333165.024366:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff800db450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+211:2420:x1848987613366272:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333165.024384:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333165.024391:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c51790 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x16c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967ed2 expref: 211 pid: 6519 timeout: 1369 lvb_type: 0 00010000:00010000:3.0:1763333165.024405:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c51790 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x16c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967ed2 expref: 211 pid: 6519 timeout: 1369 lvb_type: 0 00010000:00010000:3.0:1763333165.024426:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c51790 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x16c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967ed2 expref: 211 pid: 6519 timeout: 1369 lvb_type: 0 00010000:00010000:3.0:1763333165.024440:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x16c:0x0].0x0 (ffff92ff8016f200) 00010000:00010000:3.0:1763333165.024445:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c517b3 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x16c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.024455:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c517b3 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x16c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.024466:0:6506:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c517b3 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x16c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.024496:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333165.024559:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff800db450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+210:2420:x1848987613366272:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 213us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333165.024567:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2756 00000100:00100000:3.0:1763333165.033579:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5798 00000100:00100000:3.0:1763333165.033596:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+28:3654:x1848987627154944:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1763333165.033789:0:28600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x1de:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333165.033793:0:28600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x1de:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763333165.033795:0:28600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x1de:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333165.033797:0:28600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x1de:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763333165.033798:0:28600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x1de:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333165.035769:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+29:3654:x1848987627154944:12345-0@lo:2:osp-syn-1-1.0 Request processed in 2170us (4458us total) trans 17179871258 rc 0/0 00000100:00100000:3.0:1763333165.035782:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5798 00000100:00100000:3.0:1763333165.035818:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5800 00000100:00100000:3.0:1763333165.035825:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+12:3652:x1848987627155200:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333165.038561:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+14:3652:x1848987627155200:12345-0@lo:2:osp-syn-0-1.0 Request processed in 2736us (7155us total) trans 21474838563 rc 0/0 00000100:00100000:3.0:1763333165.038569:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5800 00000100:00100000:3.0:1763333165.038782:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333165.038802:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613366528 00000100:00100000:3.0:1763333165.038809:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613366528 00010000:00010000:3.0:1763333165.038845:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92ff4148f000/0xb32e3ef184c51472 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967dd6 expref: 13 pid: 8407 timeout: 1369 lvb_type: 0 00000100:00100000:3.0:1763333165.038873:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2757 00000100:00100000:3.0:1763333165.038881:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74037b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2420:x1848987613366528:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333165.038896:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333165.038901:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92ff4148f000/0xb32e3ef184c51472 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967dd6 expref: 13 pid: 8407 timeout: 1369 lvb_type: 0 00010000:00010000:3.0:1763333165.038911:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92ff4148f000/0xb32e3ef184c51472 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967dd6 expref: 13 pid: 8407 timeout: 1369 lvb_type: 0 00010000:00010000:3.0:1763333165.040550:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff4148f000/0xb32e3ef184c51472 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967dd6 expref: 13 pid: 8407 timeout: 1369 lvb_type: 0 00010000:00010000:3.0:1763333165.040565:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333165.040568:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333165.040572:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb200/0xb32e3ef184c517c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.040581:0:6506:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb200/0xb32e3ef184c517c8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.040617:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333165.040645:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74037b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:2420:x1848987613366528:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 1763us (1863us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333165.040655:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2757 00000100:00100000:3.0:1763333165.045024:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333165.048262:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613367040 00000100:00100000:3.0:1763333165.048269:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613367040 00010000:00010000:3.0:1763333165.048295:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c516d3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967ea1 expref: 23 pid: 8611 timeout: 1369 lvb_type: 0 00000100:00100000:3.0:1763333165.048320:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2759 00000100:00100000:3.0:1763333165.048329:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2421:x1848987613367040:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333165.048370:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333165.048378:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c516d3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967ea1 expref: 23 pid: 8611 timeout: 1369 lvb_type: 0 00010000:00010000:3.0:1763333165.048389:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c516d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967ea1 expref: 23 pid: 8611 timeout: 1369 lvb_type: 0 00010000:00010000:3.0:1763333165.048411:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c516d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x1d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967ea1 expref: 23 pid: 8611 timeout: 1369 lvb_type: 0 00010000:00010000:3.0:1763333165.048424:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333165.048427:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333165.048431:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c517d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.048439:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c517d6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.048459:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333165.048509:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2421:x1848987613367040:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 180us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333165.048516:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2759 00010000:00010000:3.0:1763333165.049022:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333165.049028:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c517d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.049036:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe44d75200 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333165.049040:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c517d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.049049:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c517d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.049061:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c517d6 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.049068:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c517d6 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.049086:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333165.049088:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333165.049090:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763333165.058515:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613367680 00000100:00100000:3.0:1763333165.058523:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613367680 00010000:00010000:3.0:1763333165.058554:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c517eb lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967efc expref: 23 pid: 8406 timeout: 1369 lvb_type: 1 00000100:00100000:3.0:1763333165.058586:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2761 00000100:00100000:3.0:1763333165.058593:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45180700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2421:x1848987613367680:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333165.058606:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333165.058612:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c517eb lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x1dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967efc expref: 23 pid: 8406 timeout: 1369 lvb_type: 1 00010000:00010000:3.0:1763333165.058625:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c517eb lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967efc expref: 23 pid: 8406 timeout: 1369 lvb_type: 1 00010000:00010000:3.0:1763333165.058654:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333165.058666:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333165.058675:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c517e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967f03 expref: 23 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.058686:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c517e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967f03 expref: 23 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.058723:0:6504:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c517e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967f03 expref: 23 pid: 29010 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333165.058736:0:6504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff74036d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6504:1848987627156224:192.168.204.28@tcp:105: 00000100:00100000:3.0:1763333165.058803:0:6504:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7ad02840 going to sleep for 11 seconds 00000100:00100000:3.0:1763333165.067005:0:6504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff74036d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6504:1848987627156224:192.168.204.28@tcp:105: 00010000:00010000:3.0:1763333165.067034:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333165.067114:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45180700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2421:x1848987613367680:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 8520us (9812us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333165.067126:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2761 00000100:00100000:3.0:1763333165.078162:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613368320 00000100:00100000:3.0:1763333165.078180:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613368320 00000100:00100000:3.0:1763333165.078254:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2867 00000100:00100000:3.0:1763333165.078265:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5922b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+205:56705:x1848987613368320:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333165.080963:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5922b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+206:56705:x1848987613368320:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 2687us (5996us total) trans 4294971533 rc 0/0 00000100:00100000:3.0:1763333165.080978:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2867 00000100:00100000:3.0:1763333165.101816:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613368960 00000100:00100000:3.0:1763333165.101830:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613368960 00000100:00100000:3.0:1763333165.101901:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8425 00000100:00100000:3.0:1763333165.101912:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+206:56710:x1848987613368960:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:3.0:1763333165.101975:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1763333165.102007:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c517b3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x16c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967ee0 expref: 206 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.102029:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c517c1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x16c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967ef5 expref: 205 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.102042:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c51807 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x16c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967f0a expref: 204 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.102055:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51766 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x16c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967ecb expref: 203 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.102066:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x16c:0x0].0x0 (ffff92ff8016f200) 00010000:00010000:3.0:1763333165.102075:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333165.102105:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43000/0xb32e3ef184c5181c lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333165.102118:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43000/0xb32e3ef184c5181c lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.102127:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43000/0xb32e3ef184c5181c lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.102139:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51823 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333165.102146:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51823 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.102152:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51823 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.102232:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c5182a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x16c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333165.102240:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c5182a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x16c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.102248:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c5182a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x16c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00080000:3.0:1763333165.102545:0:8606:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x16c:0x0] is inserted into orphan list, open count = 1 00010000:00010000:3.0:1763333165.102638:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c5182a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x16c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.102646:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c5182a lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x16c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.102651:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c5182a lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x16c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.102670:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46e42600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333165.102674:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c5182a lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x16c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.102682:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c5182a lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x16c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.102691:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x16c:0x0].0x0 (ffff92ff8016f700) 00010000:00010000:3.0:1763333165.102694:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1763333165.102698:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c5182a lrc: 2/0,0 mode: --/EX res: [0x240000404:0x16c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.102703:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c5182a lrc: 0/0,0 mode: --/EX res: [0x240000404:0x16c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.102720:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43000/0xb32e3ef184c5181c lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.102726:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43000/0xb32e3ef184c5181c lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.102731:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43000/0xb32e3ef184c5181c lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.102737:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43000/0xb32e3ef184c5181c lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.102742:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46e43000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333165.102744:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43000/0xb32e3ef184c5181c lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.102750:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43000/0xb32e3ef184c5181c lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.102757:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff8016fe00) 00010000:00010000:3.0:1763333165.102760:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333165.102762:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43000/0xb32e3ef184c5181c lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.102768:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43000/0xb32e3ef184c5181c lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000004:00010000:3.0:1763333165.102780:0:8606:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ec483ad3 reply state 000000008096892c transno 4294971534 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51823 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.102790:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51823 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.102797:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff8016f400) 00010000:00010000:3.0:1763333165.102800:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763333165.102802:0:8606:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763333165.102879:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+204:56710:x1848987613368960:12345-192.168.204.28@tcp:36:rm.0 Request processed in 967us (1168us total) trans 4294971534 rc 0/0 00000100:00100000:3.0:1763333165.102887:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8425 00000100:00100000:3.0:1763333165.121127:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333165.136784:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613369984 00000100:00100000:3.0:1763333165.136793:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613369984 00000100:00100000:3.0:1763333165.136847:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8430 00000100:00100000:3.0:1763333165.136857:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+207:56705:x1848987613369984:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333165.136879:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333165.136901:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43000/0xb32e3ef184c51885 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x16c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36967f34 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.136958:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43000/0xb32e3ef184c51885 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x16c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967f34 expref: 208 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.136973:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43000/0xb32e3ef184c51885 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x16c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967f34 expref: 208 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.136990:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x16c:0x0].0x0 (ffff92ff8016fe00) 00010000:00010000:3.0:1763333165.136993:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763333165.136997:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46e43000, rc 0) 00000100:00100000:3.0:1763333165.137054:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+208:56705:x1848987613369984:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 198us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333165.137060:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8430 00000100:00100000:3.0:1763333165.150929:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613370624 00000100:00100000:3.0:1763333165.150937:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613370624 00000100:00100000:3.0:1763333165.150991:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8432 00000100:00100000:3.0:1763333165.150999:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+209:56711:x1848987613370624:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333165.151015:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333165.151018:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763333165.151037:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c5187e lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967f2d expref: 209 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.151048:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab5e00) 00010000:00010000:3.0:1763333165.151056:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333165.151069:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c518a8 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36967f42 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.151158:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c518af lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333165.151168:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c518af lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.151176:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c518af lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.151185:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c518b6 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333165.151196:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c518b6 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.151202:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c518b6 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.151784:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c518bd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x16e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333165.151794:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c518bd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x16e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.151801:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c518bd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x16e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:3.0:1763333165.151812:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x16e:0x0]: returning size 0 00010000:00010000:3.0:1763333165.151837:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c518af lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.151843:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c518af lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.151848:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c518af lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.151854:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c518af lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.151860:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe44d75200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333165.151863:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c518af lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.151870:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c518af lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.151883:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff8016f700) 00010000:00010000:3.0:1763333165.151886:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333165.151889:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c518af lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.151896:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c518af lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000004:00010000:3.0:1763333165.151906:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003120b4b9 reply state 0000000021cbdf03 transno 4294971538 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c518b6 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.151915:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c518b6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.151920:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff8016f400) 00010000:00010000:3.0:1763333165.151922:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763333165.151924:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763333165.151948:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c518a8 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967f42 expref: 211 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.151964:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c518bd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x16e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967f42 expref: 210 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.151971:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x16e:0x0].0x0 (ffff92ff8016f200) 00010000:00010000:3.0:1763333165.151973:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333165.151976:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe467bf600, rc 0) 00000100:00100000:3.0:1763333165.152028:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+211:56711:x1848987613370624:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1030us (1171us total) trans 4294971538 rc 0/0 00000100:00100000:3.0:1763333165.152035:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8432 00000100:00100000:3.0:1763333165.154654:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613370880 00000100:00100000:3.0:1763333165.154673:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613370880 00000100:00100000:3.0:1763333165.167866:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613371008 00000100:00100000:3.0:1763333165.167919:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613371008 00010000:00010000:3.0:1763333165.167964:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c518bd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x16e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967f42 expref: 213 pid: 6521 timeout: 1369 lvb_type: 0 00000100:00100000:3.0:1763333165.168010:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2762 00000100:00100000:3.0:1763333165.168021:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+213:2420:x1848987613371008:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333165.168038:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333165.168045:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c518bd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x16e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967f42 expref: 213 pid: 6521 timeout: 1369 lvb_type: 0 00010000:00010000:3.0:1763333165.168059:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c518bd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x16e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967f42 expref: 213 pid: 6521 timeout: 1369 lvb_type: 0 00010000:00010000:3.0:1763333165.168082:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c518bd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x16e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967f42 expref: 213 pid: 6521 timeout: 1369 lvb_type: 0 00010000:00010000:3.0:1763333165.168100:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x16e:0x0].0x0 (ffff92ff8016f200) 00010000:00010000:3.0:1763333165.168105:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feae00/0xb32e3ef184c518d2 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x16e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.168116:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feae00/0xb32e3ef184c518d2 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x16e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.168122:0:6504:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feae00/0xb32e3ef184c518d2 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x16e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.168155:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333165.168218:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+212:2420:x1848987613371008:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 199us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333165.168230:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2762 00000100:00100000:3.0:1763333165.193406:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333165.193454:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333165.219472:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333165.220342:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613371904 00000100:00100000:3.0:1763333165.220374:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613371904 00000100:00100000:3.0:1763333165.220410:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 5806 00000100:00100000:3.0:1763333165.220421:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2420:x1848987613371904:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333165.220442:0:28650:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333165.220461:0:28650:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c51918 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36967f57 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333165.220488:0:28650:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x1e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333165.220504:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333165.220506:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333165.220515:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c51918 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967f57 expref: 23 pid: 28650 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333165.220536:0:28650:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c51918 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967f57 expref: 23 pid: 28650 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333165.220552:0:28650:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe467bf600, rc 0) 00000100:00100000:3.0:1763333165.220585:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2420:x1848987613371904:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 167us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333165.220597:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 5806 00000100:00100000:3.0:1763333165.259786:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613373568 00000100:00100000:3.0:1763333165.259803:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613373568 00000100:00100000:3.0:1763333165.259879:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2874 00000100:00100000:3.0:1763333165.259890:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:56712:x1848987613373568:12345-192.168.204.28@tcp:35:lfs.0 00010000:00010000:3.0:1763333165.264856:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51823 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.264870:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51823 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.264880:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51823 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.264887:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46e43c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333165.264892:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51823 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.264901:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51823 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.264921:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff8016f400) 00010000:00010000:3.0:1763333165.264925:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333165.264931:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51823 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.264937:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51823 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.264971:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c518b6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.264978:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c518b6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.264988:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c518b6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.264993:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe44d75a00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333165.264996:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c518b6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.265003:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c518b6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.265011:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff8016f400) 00010000:00010000:3.0:1763333165.265014:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333165.265017:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c518b6 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.265023:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c518b6 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.265042:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feae00/0xb32e3ef184c51957 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x16e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.265047:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feae00/0xb32e3ef184c51957 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x16e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.265052:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feae00/0xb32e3ef184c51957 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x16e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.265057:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feae00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333165.265060:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feae00/0xb32e3ef184c51957 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x16e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.265066:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feae00/0xb32e3ef184c51957 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x16e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.265074:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x16e:0x0].0x0 (ffff92fe44cd0300) 00010000:00010000:3.0:1763333165.265077:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333165.265080:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feae00/0xb32e3ef184c51957 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x16e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.265085:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feae00/0xb32e3ef184c51957 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x16e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000100:00100000:3.0:1763333165.267187:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613374080 00000100:00100000:3.0:1763333165.267198:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613374080 00000100:00100000:3.0:1763333165.267251:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8441 00000100:00100000:3.0:1763333165.267261:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56712:x1848987613374080:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333165.267291:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333165.267319:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c5197a lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36967f88 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.267424:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c51981 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333165.267441:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c51981 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.267453:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c51981 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.267466:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51988 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333165.267473:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51988 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.267479:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51988 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.267592:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c5198f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x16e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333165.267601:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c5198f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x16e:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.267607:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c5198f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x16e:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:3.0:1763333165.267617:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x16e:0x0]: returning size 2 00010000:00010000:3.0:1763333165.267702:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c5198f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x16e:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.267710:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c5198f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x16e:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.267717:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c5198f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x16e:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.267723:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46e42600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333165.267726:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c5198f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x16e:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.267733:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c5198f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x16e:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.267745:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x16e:0x0].0x0 (ffff92fe44cd0300) 00010000:00010000:3.0:1763333165.267748:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1763333165.267754:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c5198f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x16e:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.267759:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c5198f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x16e:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.267781:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c51981 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.267787:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c51981 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.267793:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c51981 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.267799:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c51981 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.267804:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe467bf200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333165.267807:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c51981 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.267813:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c51981 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.267820:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff8016ff00) 00010000:00010000:3.0:1763333165.267823:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333165.267826:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c51981 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.267832:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c51981 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.267842:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51988 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.267848:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51988 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.267854:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51988 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.267860:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46e42c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333165.267863:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51988 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.267868:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51988 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.267876:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff8016f000) 00010000:00010000:3.0:1763333165.267878:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333165.267881:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51988 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.267886:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51988 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.267927:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c5197a lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967f88 expref: 223 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.267937:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff8016ff00) 00010000:00010000:3.0:1763333165.267940:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763333165.267943:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c5197a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967f88 expref: 223 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.271319:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe467be000, rc 0) 00000100:00100000:3.0:1763333165.279100:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613374208 00000100:00100000:3.0:1763333165.279105:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613374208 00010000:00010000:3.0:1763333165.279134:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c517ba lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967eee expref: 24 pid: 29010 timeout: 1369 lvb_type: 1 00000100:00100000:3.0:1763333165.279161:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613374464 00000100:00100000:3.0:1763333165.279165:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613374464 00010000:00010000:3.0:1763333165.279179:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42febc00/0xb32e3ef184c517a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967ee7 expref: 14 pid: 8406 timeout: 1369 lvb_type: 1 00000100:00100000:3.0:1763333165.279201:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2763 00000100:00100000:3.0:1763333165.279211:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:2421:x1848987613374208:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333165.279228:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333165.279234:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c517ba lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967eee expref: 24 pid: 29010 timeout: 1369 lvb_type: 1 00010000:00010000:3.0:1763333165.279247:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c517ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967eee expref: 24 pid: 29010 timeout: 1369 lvb_type: 1 00010000:00010000:3.0:1763333165.279274:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c517ba lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x1de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967eee expref: 24 pid: 29010 timeout: 1369 lvb_type: 1 00010000:00010000:3.0:1763333165.279289:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333165.279291:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333165.279296:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5199d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.279305:0:6506:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5199d lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.279327:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333165.279405:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2421:x1848987613374208:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 194us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333165.279413:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2763 00000100:00100000:3.0:1763333165.279433:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2764 00000100:00100000:3.0:1763333165.279440:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2419:x1848987613374464:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333165.279449:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333165.279453:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe42febc00/0xb32e3ef184c517a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967ee7 expref: 14 pid: 8406 timeout: 1369 lvb_type: 1 00010000:00010000:3.0:1763333165.279464:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe42febc00/0xb32e3ef184c517a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967ee7 expref: 14 pid: 8406 timeout: 1369 lvb_type: 1 00010000:00010000:3.0:1763333165.279479:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe42febc00/0xb32e3ef184c517a5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967ee7 expref: 14 pid: 8406 timeout: 1369 lvb_type: 1 00010000:00010000:3.0:1763333165.279489:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333165.279491:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333165.279495:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb200/0xb32e3ef184c519ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.279503:0:6506:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb200/0xb32e3ef184c519ab lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.279520:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333165.279539:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2419:x1848987613374464:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 99us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333165.279546:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2764 00000100:00100000:3.0:1763333165.279607:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333165.279629:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613374592 00000100:00100000:3.0:1763333165.279633:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613374592 00010000:00010000:3.0:1763333165.279647:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c51815 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967f11 expref: 13 pid: 29010 timeout: 1369 lvb_type: 0 00000100:00100000:3.0:1763333165.279683:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2765 00000100:00100000:3.0:1763333165.279690:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2419:x1848987613374592:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333165.279699:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333165.279704:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c51815 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967f11 expref: 13 pid: 29010 timeout: 1369 lvb_type: 0 00010000:00010000:3.0:1763333165.279713:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c51815 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967f11 expref: 13 pid: 29010 timeout: 1369 lvb_type: 0 00010000:00010000:3.0:1763333165.279726:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333165.279728:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333165.279732:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe42feac00/0xb32e3ef184c519b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.279741:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42feac00/0xb32e3ef184c519b2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.279753:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333165.279772:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2419:x1848987613374592:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 83us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333165.279779:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2765 00000100:00100000:3.0:1763333165.279846:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333165.279910:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333165.288784:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613375232 00000100:00100000:3.0:1763333165.288796:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613375232 00000100:00100000:3.0:1763333165.288864:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2876 00000100:00100000:3.0:1763333165.288884:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc01850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+205:56712:x1848987613375232:12345-192.168.204.28@tcp:33:lfs.0 00000100:00100000:3.0:1763333165.291019:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc01850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+205:56712:x1848987613375232:12345-192.168.204.28@tcp:33:lfs.0 Request processed in 2134us (2271us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333165.291032:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2876 00000100:00100000:3.0:1763333165.302333:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613375488 00000100:00100000:3.0:1763333165.302376:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613375488 00002000:00010000:3.0:1763333165.302431:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/479 (0->18446744073709551615) 00002000:00100000:3.0:1763333165.302441:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff6bc10380 with x1848987613375488 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333165.302461:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff6bc10380. 00000100:00100000:3.0:1763333165.302504:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1468 00000100:00100000:3.0:1763333165.302515:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2421:x1848987613375488:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:3.0:1763333165.302734:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x1df:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333165.302738:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x1df:0x0] updating lvb mtime from disk: 0 -> 1763333165 00002000:00010000:3.0:1763333165.302741:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x1df:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333165.302743:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x1df:0x0] updating lvb ctime from disk: 0 -> 1763333165 00002000:00010000:3.0:1763333165.302746:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x1df:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333165.302831:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2421:x1848987613375488:12345-192.168.204.28@tcp:10:bash.0 Request processed in 316us (1894us total) trans 17179871267 rc 0/0 00000100:00100000:3.0:1763333165.302839:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1468 00002000:00010000:3.0:1763333165.302842:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/479 (0->18446744073709551615) 00002000:00100000:3.0:1763333165.302845:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff6bc10380 with x1848987613375488 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333165.302849:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff6bc10380. 00000100:00100000:3.0:1763333165.302867:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1469 00000100:00100000:3.0:1763333165.302875:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2420:x1848987613375360:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:3.0:1763333165.302966:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x1df:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333165.302970:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x1df:0x0] updating lvb mtime from disk: 0 -> 1763333165 00002000:00010000:3.0:1763333165.302972:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x1df:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333165.302974:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x1df:0x0] updating lvb ctime from disk: 0 -> 1763333165 00002000:00010000:3.0:1763333165.302976:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1df:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333165.302999:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2420:x1848987613375360:12345-192.168.204.28@tcp:10:bash.0 Request processed in 125us (2128us total) trans 21474838572 rc 0/0 00000100:00100000:3.0:1763333165.303006:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1469 00002000:00010000:3.0:1763333165.303009:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/479 (0->18446744073709551615) 00002000:00100000:3.0:1763333165.303013:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff6bc11880 with x1848987613375360 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333165.303017:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff6bc11880. 00000100:00100000:3.0:1763333165.313636:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613375744 00000100:00100000:3.0:1763333165.313651:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613375744 00000100:00100000:3.0:1763333165.313733:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2877 00000100:00100000:3.0:1763333165.313742:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+205:55917:x1848987613375744:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:3.0:1763333165.314073:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+206:55917:x1848987613375744:12345-192.168.204.28@tcp:35:bash.0 Request processed in 330us (2849us total) trans 4294971552 rc 0/0 00000100:00100000:3.0:1763333165.314081:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2877 00000100:00100000:3.0:1763333165.338282:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613376256 00000100:00100000:3.0:1763333165.338292:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613376256 00000100:00100000:3.0:1763333165.338383:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2878 00000100:00100000:3.0:1763333165.338398:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+208:56713:x1848987613376256:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333165.338750:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+209:56713:x1848987613376256:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 355us (633us total) trans 4294971554 rc 0/0 00000100:00100000:3.0:1763333165.338759:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2878 00010000:00010000:3.0:1763333165.340818:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333165.340828:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c519ff lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x16e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333165.340836:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdea00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333165.340840:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c519ff lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x16e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333165.340847:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c519ff lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x16e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333165.340857:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x16e:0x0].0x0 (ffff92fe44cd0800) 00010000:00010000:3.0:1763333165.340860:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763333165.340863:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c519ff lrc: 1/0,0 mode: --/PW res: [0x240000404:0x16e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333165.340869:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c519ff lrc: 0/0,0 mode: --/PW res: [0x240000404:0x16e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333165.340885:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333165.340887:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333165.340889:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763333165.386200:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333165.393482:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333165.393530:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333165.412449:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333165.432257:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613378176 00000100:00100000:3.0:1763333165.432268:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613378176 00000100:00100000:3.0:1763333165.432463:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8451 00000100:00100000:3.0:1763333165.432476:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+211:56717:x1848987613378176:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333165.432502:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333165.432529:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51aa0 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36967fd5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.432622:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51aa7 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333165.432637:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51aa7 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.432683:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51aa7 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.432696:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c51aae lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333165.432704:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c51aae lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.432711:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c51aae lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.432840:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c51ab5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x16f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333165.432848:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c51ab5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x16f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.432854:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c51ab5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x16f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.432952:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51aa7 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.432959:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51aa7 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.432965:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51aa7 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.432972:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51aa7 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.432978:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46e42c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333165.432982:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51aa7 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.432988:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51aa7 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.432999:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff8016ff00) 00010000:00010000:3.0:1763333165.433002:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333165.433007:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51aa7 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.433013:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51aa7 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.433026:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c51aae lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.433031:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c51aae lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.433036:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c51aae lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.433040:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46e42600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333165.433042:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c51aae lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.433047:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c51aae lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.433059:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe44cd0500) 00010000:00010000:3.0:1763333165.433061:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333165.433065:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c51aae lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.433071:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c51aae lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.433112:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51aa0 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967fd5 expref: 214 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.433129:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c51ab5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x16f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967fd5 expref: 213 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.433136:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x16f:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:3.0:1763333165.433139:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333165.433141:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe467be000, rc 0) 00000100:00100000:3.0:1763333165.433213:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+213:56717:x1848987613378176:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 740us (1047us total) trans 4294971558 rc 0/0 00000100:00100000:3.0:1763333165.433221:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8451 00000100:00100000:3.0:1763333165.441310:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613378816 00000100:00100000:3.0:1763333165.441316:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613378816 00000100:00100000:3.0:1763333165.446341:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613379072 00000100:00100000:3.0:1763333165.447073:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613379072 00000100:00100000:3.0:1763333165.447174:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2881 00000100:00100000:3.0:1763333165.447186:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+215:56717:x1848987613379072:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333165.447478:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+216:56717:x1848987613379072:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 293us (2188us total) trans 4294971561 rc 0/0 00000100:00100000:3.0:1763333165.447491:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2881 00000100:00100000:3.0:1763333165.459364:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613379328 00000100:00100000:3.0:1763333165.459375:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613379328 00000100:00100000:3.0:1763333165.459429:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613379584 00000100:00100000:3.0:1763333165.459432:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613379584 00000100:00100000:3.0:1763333165.459462:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8452 00000100:00100000:3.0:1763333165.459471:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+217:55917:x1848987613379328:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333165.459493:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333165.459497:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763333165.459524:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c51ab5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x16f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967fd5 expref: 217 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.459545:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x16f:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:3.0:1763333165.459558:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333165.459573:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c51aca lrc: 2/0,0 mode: --/CW res: [0x240000404:0x16f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36967fe3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.459706:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51ad1 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x16f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333165.459722:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51ad1 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x16f:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.459732:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51ad1 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x16f:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:3.0:1763333165.459745:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x16f:0x0]: returning size 0 00010000:00010000:3.0:1763333165.459864:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c51aca lrc: 0/0,0 mode: --/CW res: [0x240000404:0x16f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967fe3 expref: 219 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.459882:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51ad1 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x16f:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967fe3 expref: 218 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.459888:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x16f:0x0].0x0 (ffff92ff8016ff00) 00010000:00010000:3.0:1763333165.459891:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:3.0:1763333165.459894:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46e43c00, rc 0) 00000100:00100000:3.0:1763333165.459970:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+218:55917:x1848987613379328:12345-192.168.204.28@tcp:101:bash.0 Request processed in 499us (1090us total) trans 4294971562 rc 0/0 00000100:00100000:3.0:1763333165.459978:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8452 00000100:00100000:3.0:1763333165.460000:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8453 00000100:00100000:3.0:1763333165.460007:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+217:56717:x1848987613379584:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333165.460016:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333165.460026:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c51adf lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36967fea expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.460069:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51ae6 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333165.460077:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51ae6 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.460084:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51ae6 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.460095:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c51aed lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333165.460102:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c51aed lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.460108:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c51aed lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.460191:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c51af4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x16f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333165.460203:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c51af4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x16f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.460209:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c51af4 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x16f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.460216:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c51af4 lrc: 3/0,0 mode: --/PR res: [0x240000404:0x16f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.460222:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff4139a000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333165.460225:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c51af4 lrc: 3/0,0 mode: --/PR res: [0x240000404:0x16f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.460232:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c51af4 lrc: 4/0,0 mode: --/PR res: [0x240000404:0x16f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.460239:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x16f:0x0].0x0 (ffff92ff8016ff00) 00010000:00010000:3.0:1763333165.460244:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c51af4 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x16f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.460250:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c51af4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x16f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000004:00200000:3.0:1763333165.460261:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x16f:0x0]: returning size 0 00010000:00010000:3.0:1763333165.460300:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51ae6 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.460306:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51ae6 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.460312:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51ae6 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.460317:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51ae6 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.460322:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46e42c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333165.460325:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51ae6 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.460331:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51ae6 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.460338:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff8016f400) 00010000:00010000:3.0:1763333165.460381:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333165.460385:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51ae6 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.460391:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51ae6 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.460402:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c51aed lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.460408:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c51aed lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.460413:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c51aed lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.460418:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff4139a800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333165.460421:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c51aed lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.460432:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c51aed lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.460439:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe44cd0500) 00010000:00010000:3.0:1763333165.460443:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333165.460446:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c51aed lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.460451:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c51aed lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.460478:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c51adf lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967fea expref: 219 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.460487:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff8016f400) 00010000:00010000:3.0:1763333165.460490:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763333165.460494:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c51adf lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967fea expref: 219 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.460506:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46e42600, rc 0) 00000100:00100000:3.0:1763333165.460534:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+218:56717:x1848987613379584:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 528us (1587us total) trans 4294971563 rc 301/301 00000100:00100000:3.0:1763333165.460541:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8453 00000100:00100000:3.0:1763333165.467733:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8455 00000100:00100000:3.0:1763333165.467749:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:55917:x1848987613379840:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333165.467766:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333165.467781:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c51b09 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x16f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36967ff8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.467819:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c51b10 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x16f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333165.467840:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c51b10 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x16f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.467854:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c51b10 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x16f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.468173:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c51b09 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x16f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967ff8 expref: 222 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.468195:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c51b10 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x16f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967ff8 expref: 221 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.468206:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x16f:0x0].0x0 (ffff92ff8016ff00) 00010000:00010000:3.0:1763333165.468210:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763333165.468213:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe44d75a00, rc 0) 00000100:00100000:3.0:1763333165.468271:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:55917:x1848987613379840:12345-192.168.204.28@tcp:101:bash.0 Request processed in 527us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333165.468280:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8455 00000100:00100000:3.0:1763333165.470908:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613379968 00000100:00100000:3.0:1763333165.470919:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613379968 00010000:00010000:3.0:1763333165.471115:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51ad1 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x16f:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967fe3 expref: 221 pid: 6521 timeout: 1369 lvb_type: 0 00000100:00100000:3.0:1763333165.471151:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2768 00000100:00100000:3.0:1763333165.471160:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dffbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:2420:x1848987613379968:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333165.471176:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333165.471182:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51ad1 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x16f:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967fe3 expref: 221 pid: 6521 timeout: 1369 lvb_type: 0 00010000:00010000:3.0:1763333165.471193:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51ad1 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x16f:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967fe3 expref: 221 pid: 6521 timeout: 1369 lvb_type: 0 00010000:00010000:3.0:1763333165.471212:0:28428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x16f:0x0].0x0 (ffff92ff8016ff00) 00010000:00010000:3.0:1763333165.471217:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c51b17 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x16f:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333165.471226:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c51b17 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x16f:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333165.471232:0:28428:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c51b17 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x16f:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333165.471248:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333165.471288:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dffbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:2420:x1848987613379968:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 130us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333165.471295:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2768 00000100:00100000:3.0:1763333165.488167:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333165.498966:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333165.504737:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333165.541387:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2774 00000100:00100000:3.0:1763333165.541399:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:2421:x1848987613382272:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333165.541411:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333165.541416:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c51ac3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967fdc expref: 24 pid: 8407 timeout: 1369 lvb_type: 1 00010000:00010000:3.0:1763333165.541431:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c51ac3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967fdc expref: 24 pid: 8407 timeout: 1369 lvb_type: 1 00010000:00010000:3.0:1763333165.541446:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c51ac3 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x1e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36967fdc expref: 24 pid: 8407 timeout: 1369 lvb_type: 1 00010000:00010000:3.0:1763333165.541455:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333165.541457:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333165.541463:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c51b79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968014 expref: 23 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.541471:0:6506:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c51b79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968014 expref: 23 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.541503:0:6506:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c51b79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968014 expref: 23 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333165.541518:0:6506:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46269c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6506:1848987627160064:192.168.204.28@tcp:105: 00000100:00100000:3.0:1763333165.544462:0:6506:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7ad02300 going to sleep for 11 seconds 00000100:00100000:3.0:1763333165.550825:0:6506:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46269c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6506:1848987627160064:192.168.204.28@tcp:105: 00010000:00010000:3.0:1763333165.550859:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333165.550956:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2421:x1848987613382272:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 9559us (10354us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333165.550969:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2774 00000100:00100000:3.0:1763333165.552062:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613382528 00000100:00100000:3.0:1763333165.552073:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613382528 00000100:00100000:3.0:1763333165.552128:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 5828 00000100:00100000:3.0:1763333165.552138:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:55917:x1848987613382528:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333165.552161:0:8611:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333165.552189:0:8611:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe44d75400/0xb32e3ef184c51b80 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696801b expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333165.552221:0:8611:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333165.552243:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333165.552246:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333165.552258:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe44d75400/0xb32e3ef184c51b80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696801b expref: 13 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.552275:0:8611:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe44d75400/0xb32e3ef184c51b80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696801b expref: 13 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.552289:0:8611:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe44d75400, rc 0) 00000100:00100000:3.0:1763333165.552341:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:55917:x1848987613382528:12345-192.168.204.28@tcp:101:bash.0 Request processed in 205us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333165.552372:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 5828 00000100:00100000:3.0:1763333165.588345:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333165.596888:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333165.598180:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333165.629088:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333165.631924:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613384320 00000100:00100000:3.0:1763333165.631935:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613384320 00000100:00100000:3.0:1763333165.667230:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333165.671214:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333165.691533:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333165.691580:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333165.691608:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613386368 00000100:00100000:3.0:1763333165.691617:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613386368 00000100:00100000:3.0:1763333165.691676:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 5829 00000100:00100000:3.0:1763333165.691687:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2420:x1848987613386368:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333165.691710:0:8406:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333165.691739:0:8406:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c51cb4 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696806f expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333165.691764:0:8406:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x1e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333165.691789:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333165.691791:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333165.691802:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c51cb4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696806f expref: 24 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333165.691822:0:8406:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c51cb4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696806f expref: 24 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333165.691836:0:8406:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe44d75200, rc 0) 00000100:00100000:3.0:1763333165.691900:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:2420:x1848987613386368:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 215us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333165.691907:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 5829 00000100:00100000:3.0:1763333165.691958:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333165.691977:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613386496 00000100:00100000:3.0:1763333165.691980:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613386496 00000100:00100000:3.0:1763333165.692002:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 5830 00000100:00100000:3.0:1763333165.692008:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2420:x1848987613386496:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333165.692017:0:8611:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333165.692028:0:8611:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe44d75a00/0xb32e3ef184c51cbb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968076 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333165.692042:0:8611:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333165.692051:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333165.692053:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333165.692058:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe44d75a00/0xb32e3ef184c51cbb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968076 expref: 15 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333165.692069:0:8611:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe44d75a00/0xb32e3ef184c51cbb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968076 expref: 15 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333165.692077:0:8611:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe44d75a00, rc 0) 00000100:00100000:3.0:1763333165.692098:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2420:x1848987613386496:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 89us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333165.692104:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 5830 00000100:00100000:3.0:1763333165.697198:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333165.701943:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+214:56722:x1848987613386752:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333165.706746:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+216:56722:x1848987613386752:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 5083us (9542us total) trans 4294971580 rc 0/0 00000100:00100000:3.0:1763333165.706764:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2889 00000100:00100000:3.0:1763333165.710588:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333165.716947:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613387392 00000100:00100000:3.0:1763333165.716957:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613387392 00000100:00100000:3.0:1763333165.722976:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613387648 00000100:00100000:3.0:1763333165.722987:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613387648 00000100:00100000:3.0:1763333165.723042:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8475 00000100:00100000:3.0:1763333165.723052:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73164a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:56722:x1848987613387648:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333165.723076:0:29240:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333165.723100:0:29240:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c51cec lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696808b expref: -99 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.723173:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51cf3 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:3.0:1763333165.723186:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51cf3 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333165.723197:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51cf3 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333165.723207:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51cfa lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:3.0:1763333165.723214:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51cfa lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333165.723220:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51cfa lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333165.723322:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c51d01 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x170:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:3.0:1763333165.723331:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c51d01 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x170:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333165.723338:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c51d01 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x170:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00000004:00200000:3.0:1763333165.723369:0:29240:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x170:0x0]: returning size 0 00010000:00010000:3.0:1763333165.723442:0:29240:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51cf3 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333165.723450:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51cf3 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333165.723456:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51cf3 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333165.723462:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51cf3 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333165.723469:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46e43c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333165.723473:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51cf3 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333165.723480:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51cf3 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333165.723491:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff8016f200) 00010000:00010000:3.0:1763333165.723494:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333165.723499:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51cf3 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333165.723505:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51cf3 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333165.723518:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51cfa lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333165.723524:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51cfa lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333165.723535:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51cfa lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333165.723540:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46e42c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333165.723542:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51cfa lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333165.723548:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51cfa lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333165.723554:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe4345b300) 00010000:00010000:3.0:1763333165.723556:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333165.723559:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51cfa lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333165.723564:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51cfa lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333165.723595:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c51cec lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696808b expref: 222 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.723612:0:29240:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c51d01 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x170:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696808b expref: 221 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.723619:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x170:0x0].0x0 (ffff92ff618aae00) 00010000:00010000:3.0:1763333165.723621:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333165.723623:0:29240:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff4139a600, rc 0) 00000100:00100000:3.0:1763333165.726788:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73164a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56722:x1848987613387648:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 3720us (3886us total) trans 4294971583 rc 0/0 00000100:00100000:3.0:1763333165.726804:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8475 00000100:00100000:3.0:1763333165.727325:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613387776 00000100:00100000:3.0:1763333165.727334:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613387776 00000100:00100000:3.0:1763333165.727680:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8476 00000100:00100000:3.0:1763333165.727690:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73166d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:55917:x1848987613387776:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333165.727716:0:29240:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333165.727737:0:29240:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c51d0f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x170:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968092 expref: -99 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.727794:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c51d0f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x170:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968092 expref: 222 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.727809:0:29240:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c51d0f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x170:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968092 expref: 222 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.727828:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x170:0x0].0x0 (ffff92ff618aae00) 00010000:00010000:3.0:1763333165.727831:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763333165.727835:0:29240:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff4139a800, rc 0) 00000100:00100000:3.0:1763333165.727892:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73166d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:55917:x1848987613387776:12345-192.168.204.28@tcp:101:bash.0 Request processed in 204us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333165.727898:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8476 00000100:00100000:3.0:1763333165.734627:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613388032 00000100:00100000:3.0:1763333165.734640:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613388032 00000100:00100000:3.0:1763333165.734722:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2890 00000100:00100000:3.0:1763333165.734731:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73167480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:56722:x1848987613388032:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333165.734995:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73167480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56722:x1848987613388032:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 263us (440us total) trans 4294971584 rc 0/0 00000100:00100000:3.0:1763333165.735003:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2890 00000001:00080000:3.0:1763333165.742571:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294971585 is committed 00000004:00080000:3.0:1763333165.742580:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 777 committed 00000004:00080000:3.0:1763333165.742598:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 774 committed 00000004:00080000:3.0:1763333165.742605:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 773 committed 00000004:00080000:3.0:1763333165.742607:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 776 committed 00000100:00100000:3.0:1763333165.743541:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7dcfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627160448:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763333165.743654:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333165.743857:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff6bc11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627160960:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763333165.743879:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333165.754088:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613388800 00000100:00100000:3.0:1763333165.754102:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613388800 00000100:00100000:3.0:1763333165.754451:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2891 00000100:00100000:3.0:1763333165.754461:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+203:56722:x1848987613388800:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333165.755085:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+204:56722:x1848987613388800:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 622us (2821us total) trans 4294971587 rc 0/0 00000100:00100000:3.0:1763333165.755094:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2891 00010000:00010000:3.0:1763333165.756222:0:8611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe44d75400/0xb32e3ef184c51b80 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696801b expref: 14 pid: 8611 timeout: 1369 lvb_type: 0 00000100:00100000:3.0:1763333165.756235:0:8611:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff50049500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8611:1848987627161344:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333165.756257:0:8611:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c51d47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.756267:0:8611:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c51d47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.756275:0:8611:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c51d47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.756285:0:8611:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c51d47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.756294:0:8611:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c51d47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.756312:0:8611:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763333165.756560:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+25:3654:x1848987627160320:12345-0@lo:6:osp-syn-0-1.0 Request processed in 12449us (13090us total) trans 21474838581 rc 0/0 00000100:00100000:3.0:1763333165.756568:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5831 00010000:00010000:3.0:1763333165.756587:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333165.756594:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c51d47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.756601:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feba00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333165.756605:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c51d47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.756613:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c51d47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.756626:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c51d47 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.756633:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c51d47 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.756667:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333165.756669:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333165.756671:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763333165.756699:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7dcfca80/2, rc 0, transno 21474838581 00000100:00100000:3.0:1763333165.756706:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7dcfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627160320:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1763333165.759122:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333165.759138:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c51d5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.759152:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdee00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333165.759157:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c51d5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.759169:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c51d5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.759196:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c51d5c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.759204:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c51d5c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.759242:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333165.759244:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333165.759246:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763333165.759305:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff6bc11f80/2, rc 0, transno 17179871276 00000100:00100000:3.0:1763333165.759315:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff6bc11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627160832:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763333165.764599:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613389312 00000100:00100000:3.0:1763333165.764609:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613389312 00000100:00100000:3.0:1763333165.764672:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2892 00000100:00100000:3.0:1763333165.764683:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+204:56722:x1848987613389312:12345-192.168.204.28@tcp:33:lfs.0 00000100:00100000:3.0:1763333165.764846:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+204:56722:x1848987613389312:12345-192.168.204.28@tcp:33:lfs.0 Request processed in 165us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333165.764853:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2892 00000100:00100000:3.0:1763333165.770259:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613389440 00000100:00100000:3.0:1763333165.770270:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613389440 00000100:00100000:3.0:1763333165.770336:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 5840 00000100:00100000:3.0:1763333165.770367:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:55917:x1848987613389440:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333165.770387:0:8611:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333165.770409:0:8611:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c51d6a lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369680ae expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333165.770433:0:8611:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x1e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333165.770454:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333165.770457:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333165.770465:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c51d6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369680ae expref: 24 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.770480:0:8611:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c51d6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369680ae expref: 24 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.770492:0:8611:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff4139a000, rc 0) 00000100:00100000:3.0:1763333165.770555:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:55917:x1848987613389440:12345-192.168.204.28@tcp:101:bash.0 Request processed in 210us (1154us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333165.770563:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 5840 00000100:00100000:3.0:1763333165.779261:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613389568 00000100:00100000:3.0:1763333165.779273:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613389568 00002000:00010000:3.0:1763333165.779319:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/483 (0->18446744073709551615) 00002000:00100000:3.0:1763333165.779324:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe44e18e00 with x1848987613389568 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333165.779337:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe44e18e00. 00000100:00100000:3.0:1763333165.779403:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613389696 00000100:00100000:3.0:1763333165.779407:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613389696 00002000:00010000:3.0:1763333165.779421:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/483 (0->18446744073709551615) 00002000:00100000:3.0:1763333165.779424:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe472f5500 with x1848987613389696 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333165.779431:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe472f5500. 00000100:00100000:3.0:1763333165.779447:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1472 00000100:00100000:3.0:1763333165.779456:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2421:x1848987613389568:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:3.0:1763333165.779660:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x1e3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333165.779664:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x1e3:0x0] updating lvb mtime from disk: 0 -> 1763333166 00002000:00010000:3.0:1763333165.779667:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x1e3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333165.779669:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x1e3:0x0] updating lvb ctime from disk: 0 -> 1763333166 00002000:00010000:3.0:1763333165.779671:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1e3:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333165.779728:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2421:x1848987613389568:12345-192.168.204.28@tcp:10:bash.0 Request processed in 272us (622us total) trans 21474838582 rc 0/0 00000100:00100000:3.0:1763333165.779737:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1472 00002000:00010000:3.0:1763333165.779741:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/483 (0->18446744073709551615) 00002000:00100000:3.0:1763333165.779744:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe44e18e00 with x1848987613389568 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333165.779748:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe44e18e00. 00000100:00100000:3.0:1763333165.779766:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1473 00000100:00100000:3.0:1763333165.779775:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:2421:x1848987613389696:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:3.0:1763333165.779871:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x1e3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333165.779874:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x1e3:0x0] updating lvb mtime from disk: 0 -> 1763333166 00002000:00010000:3.0:1763333165.779877:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x1e3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333165.779879:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x1e3:0x0] updating lvb ctime from disk: 0 -> 1763333166 00002000:00010000:3.0:1763333165.779882:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x1e3:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333165.779905:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:2421:x1848987613389696:12345-192.168.204.28@tcp:10:bash.0 Request processed in 130us (733us total) trans 17179871277 rc 0/0 00000100:00100000:3.0:1763333165.779911:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1473 00002000:00010000:3.0:1763333165.779914:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/483 (0->18446744073709551615) 00002000:00100000:3.0:1763333165.779917:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe472f5500 with x1848987613389696 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333165.779921:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe472f5500. 00000100:00100000:3.0:1763333165.790240:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613390208 00000100:00100000:3.0:1763333165.790249:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613390208 00000100:00100000:3.0:1763333165.790301:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8479 00000100:00100000:3.0:1763333165.790310:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+206:56723:x1848987613390208:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333165.790328:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333165.790369:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c51d71 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369680b5 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.790441:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c51d78 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333165.790455:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c51d78 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.790466:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c51d78 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.790484:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c51d7f lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333165.790491:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c51d7f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.790497:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c51d7f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.790589:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c51d86 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x170:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333165.790598:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c51d86 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x170:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.790604:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c51d86 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x170:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:3.0:1763333165.790614:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x170:0x0]: returning size 5 00010000:00010000:3.0:1763333165.790689:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c51d78 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.790697:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c51d78 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.790704:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c51d78 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.790711:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c51d78 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.790717:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff4139a800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333165.790722:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c51d78 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.790734:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c51d78 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.790746:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6231e000) 00010000:00010000:3.0:1763333165.790749:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333165.790753:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c51d78 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.790760:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c51d78 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.790772:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c51d7f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.790778:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c51d7f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.790784:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c51d7f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.790789:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe44d75400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333165.790792:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c51d7f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.790797:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c51d7f lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.790803:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6231e600) 00010000:00010000:3.0:1763333165.790806:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333165.790808:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c51d7f lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.790813:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c51d7f lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.790862:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c51d71 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369680b5 expref: 209 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.790877:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c51d86 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x170:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369680b5 expref: 208 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.790884:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x170:0x0].0x0 (ffff92ff618aae00) 00010000:00010000:3.0:1763333165.790887:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333165.790889:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46e42600, rc 0) 00000100:00100000:3.0:1763333165.790946:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+208:56723:x1848987613390208:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 637us (878us total) trans 4294971589 rc 0/0 00000100:00100000:3.0:1763333165.790955:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8479 00000100:00100000:3.0:1763333165.798337:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333165.807482:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333165.813797:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333165.841501:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333165.843207:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8483 00000100:00100000:3.0:1763333165.843223:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74039c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+207:56725:x1848987613391104:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333165.843247:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333165.843273:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51dda lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369680ca expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.843388:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51de1 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333165.843404:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51de1 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.843419:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51de1 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.843431:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c51de8 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333165.843439:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c51de8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.843444:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c51de8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.843486:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51de1 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.843493:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51de1 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.843499:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51de1 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.843504:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51de1 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.843510:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46e43c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333165.843515:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51de1 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.843523:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51de1 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.843536:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6231e000) 00010000:00010000:3.0:1763333165.843539:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333165.843544:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51de1 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.843549:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51de1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.843563:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c51de8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.843569:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c51de8 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.843575:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c51de8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.843580:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46e42600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333165.843583:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c51de8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.843588:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c51de8 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.843595:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff618aa100) 00010000:00010000:3.0:1763333165.843597:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333165.843600:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c51de8 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.843606:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c51de8 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333165.843633:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51dda lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369680ca expref: 208 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.843653:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6231e000) 00010000:00010000:3.0:1763333165.843656:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333165.843660:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51dda lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369680ca expref: 208 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.843672:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46e42c00, rc 0) 00000100:00100000:3.0:1763333165.853144:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74039c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+207:56725:x1848987613391104:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 9912us (11642us total) trans 0 rc 301/301 00000100:00100000:3.0:1763333165.853159:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8483 00000100:00100000:3.0:1763333165.854247:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613391232 00000100:00100000:3.0:1763333165.854265:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613391232 00000100:00100000:3.0:1763333165.873869:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613391744 00000100:00100000:3.0:1763333165.873883:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613391744 00000100:00100000:3.0:1763333165.887848:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613392000 00000100:00100000:3.0:1763333165.887868:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613392000 00000100:00100000:3.0:1763333165.887965:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8488 00000100:00100000:3.0:1763333165.887977:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+208:56725:x1848987613392000:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333165.888004:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333165.888007:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763333165.888040:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c51e0b lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369680d1 expref: 208 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.888061:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff618aa200) 00010000:00010000:3.0:1763333165.888074:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333165.888093:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51e3c lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369680ed expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.888206:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c51e43 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333165.888221:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c51e43 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.888232:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c51e43 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.888244:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51e4a lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333165.888251:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51e4a lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.888258:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51e4a lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.888718:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c51e51 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x171:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333165.888727:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c51e51 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.888734:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c51e51 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:3.0:1763333165.888744:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x171:0x0]: returning size 0 00010000:00010000:3.0:1763333165.888769:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c51e43 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.888776:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c51e43 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.888782:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c51e43 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.888787:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c51e43 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.888793:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46e42600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333165.888797:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c51e43 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.888804:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c51e43 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.888813:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6231e000) 00010000:00010000:3.0:1763333165.888816:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333165.888820:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c51e43 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.888826:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c51e43 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000004:00010000:3.0:1763333165.888838:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003e669e75 reply state 000000009639c008 transno 4294971592 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51e4a lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.888848:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c51e4a lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.888854:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff618aa100) 00010000:00010000:3.0:1763333165.888857:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763333165.888859:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763333165.888885:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51e3c lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369680ed expref: 210 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.888901:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c51e51 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369680ed expref: 209 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.888908:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x171:0x0].0x0 (ffff92ff6231e600) 00010000:00010000:3.0:1763333165.888910:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333165.888913:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe44d75400, rc 0) 00000100:00100000:3.0:1763333165.888991:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+210:56725:x1848987613392000:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1016us (5671us total) trans 4294971592 rc 0/0 00000100:00100000:3.0:1763333165.889000:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8488 00000100:00100000:3.0:1763333165.919837:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333165.927148:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333165.945946:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333165.952505:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613394432 00000100:00100000:3.0:1763333165.952514:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613394432 00000100:00100000:3.0:1763333165.952567:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8494 00000100:00100000:3.0:1763333165.952577:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+218:55917:x1848987613394432:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333165.952600:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333165.952621:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c51ed6 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x171:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968125 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.952670:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51edd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x171:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333165.952685:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51edd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x171:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.952697:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51edd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x171:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.952825:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c51ed6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x171:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968125 expref: 220 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.952843:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c51edd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x171:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968125 expref: 219 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.952851:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x171:0x0].0x0 (ffff92ff618aae00) 00010000:00010000:3.0:1763333165.952854:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763333165.952858:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46e42c00, rc 0) 00000100:00100000:3.0:1763333165.952927:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:55917:x1848987613394432:12345-192.168.204.28@tcp:101:bash.0 Request processed in 352us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333165.952934:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8494 00000100:00100000:3.0:1763333165.965888:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333165.969672:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333165.971551:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613395712 00000100:00100000:3.0:1763333165.971558:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613395712 00000100:00100000:3.0:1763333165.971609:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8497 00000100:00100000:3.0:1763333165.971619:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:55917:x1848987613395712:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333165.971638:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333165.971652:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763333165.971678:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c51ecf lrc: 0/0,0 mode: --/CR res: [0x240000404:0x171:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696811e expref: 225 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.971697:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x171:0x0].0x0 (ffff92ff618aae00) 00010000:00010000:3.0:1763333165.971703:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333165.971716:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c51f0e lrc: 2/0,0 mode: --/EX res: [0x240000404:0x171:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968133 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.971765:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c51f15 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x171:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333165.971779:0:6521:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c51f00 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696812c expref: 225 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.971789:0:6521:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c51f15 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x171:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.971825:0:6521:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c51f00 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696812c expref: 225 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.971841:0:6521:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c51f00 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696812c expref: 225 pid: 8606 timeout: 1370 lvb_type: 0 00000100:00100000:3.0:1763333165.971856:0:6521:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff74039c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6521:1848987627161728:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333165.971934:0:6521:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7ad02300 going to sleep for 11 seconds 00000100:00100000:3.0:1763333165.974622:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613395840 00000100:00100000:3.0:1763333165.974632:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613395840 00000100:00100000:3.0:1763333165.974700:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2900 00000100:00100000:3.0:1763333165.974710:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc00c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56727:x1848987613395840:12345-192.168.204.28@tcp:33:lfs.0 00000100:00100000:3.0:1763333165.974868:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc00c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56727:x1848987613395840:12345-192.168.204.28@tcp:33:lfs.0 Request processed in 158us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333165.974876:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2900 00000100:00100000:3.0:1763333165.984966:0:6521:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff74039c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6521:1848987627161728:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333165.985003:0:6521:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c51f15 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x171:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.985609:0:6521:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c51f15 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x171:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333165.985617:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c51f15 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x171:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000040:00080000:3.0:1763333165.985886:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1188, 88 off101568 00000004:00080000:3.0:1763333165.985895:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1270065545164ns, next at 1269974897475ns, rc = 0 00000040:00080000:3.0:1763333165.985942:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1189, 88 off101568 00000004:00080000:3.0:1763333165.985947:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1270065598181ns, next at 1269974869034ns, rc = 0 00000040:00080000:3.0:1763333165.985965:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1190, 88 off101656 00000004:00080000:3.0:1763333165.985969:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1270065620124ns, next at 1269974869034ns, rc = 0 00000040:00080000:3.0:1763333165.985978:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1189, 88 off101656 00000004:00080000:3.0:1763333165.985981:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1270065632201ns, next at 1269974897475ns, rc = 0 00000001:00080000:3.0:1763333165.989801:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294971605 is committed 00000004:00080000:3.0:1763333165.989816:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 776 committed 00000004:00080000:3.0:1763333165.989830:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 779 committed 00000004:00080000:3.0:1763333165.992443:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 778 committed 00000004:00080000:3.0:1763333165.993832:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 775 committed 00010000:00010000:3.0:1763333165.993962:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c51f15 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x171:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968133 expref: 203 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.993976:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x171:0x0].0x0 (ffff92ff618aae00) 00010000:00010000:3.0:1763333165.993978:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763333165.993994:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c51f0e lrc: 0/0,0 mode: --/EX res: [0x240000404:0x171:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968133 expref: 203 pid: 6521 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1763333165.994010:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c51f15 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x171:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968133 expref: 202 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333165.994035:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x171:0x0].0x0 (ffff92ff618aae00) 00010000:00010000:3.0:1763333165.994037:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763333165.994040:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff4139a600, rc 0) 00000100:00100000:3.0:1763333165.994071:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+202:55917:x1848987613395712:12345-192.168.204.28@tcp:101:bash.0 Request processed in 22454us (22670us total) trans 4294971605 rc 0/0 00000100:00100000:3.0:1763333165.994078:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8497 00010000:00010000:3.0:1763333166.007185:0:8611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c51cb4 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696806f expref: 25 pid: 8406 timeout: 1370 lvb_type: 1 00000100:00100000:3.0:1763333166.007205:0:8611:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42ef9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8611:1848987627162496:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333166.007223:0:8611:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb800/0xb32e3ef184c51f23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.007231:0:8611:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb800/0xb32e3ef184c51f23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.007237:0:8611:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb800/0xb32e3ef184c51f23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.007246:0:8611:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb800/0xb32e3ef184c51f23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.007254:0:8611:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb800/0xb32e3ef184c51f23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.007278:0:8611:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763333166.007497:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dffbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+45:3654:x1848987627161984:12345-0@lo:6:osp-syn-1-1.0 Request processed in 16609us (16964us total) trans 17179871281 rc 0/0 00000100:00100000:3.0:1763333166.007507:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5844 00000100:00100000:3.0:1763333166.010598:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333166.010650:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333166.010679:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613396992 00000100:00100000:3.0:1763333166.010689:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613396992 00000100:00100000:3.0:1763333166.010737:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 5852 00000100:00100000:3.0:1763333166.010747:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74038700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:55917:x1848987613396992:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333166.010767:0:8611:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333166.010789:0:8611:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c51f3f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968148 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333166.010815:0:8611:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333166.010836:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333166.010838:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333166.010847:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c51f3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968148 expref: 16 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.010863:0:8611:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c51f3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968148 expref: 16 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.010876:0:8611:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff4139a800, rc 0) 00000100:00100000:3.0:1763333166.010926:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74038700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:55917:x1848987613396992:12345-192.168.204.28@tcp:101:bash.0 Request processed in 180us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333166.010933:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 5852 00000100:00100000:3.0:1763333166.041492:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333166.041563:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333166.052389:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333166.054842:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333166.058937:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333166.070704:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613399168 00000100:00100000:3.0:1763333166.070710:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613399168 00010000:00010000:3.0:1763333166.070732:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb800/0xb32e3ef184c51f8c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968156 expref: 209 pid: 29240 timeout: 1370 lvb_type: 0 00000100:00100000:3.0:1763333166.070765:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2786 00000100:00100000:3.0:1763333166.070774:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+209:2421:x1848987613399168:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333166.070784:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333166.070790:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb800/0xb32e3ef184c51f8c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968156 expref: 209 pid: 29240 timeout: 1370 lvb_type: 0 00010000:00010000:3.0:1763333166.070807:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb800/0xb32e3ef184c51f8c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968156 expref: 209 pid: 29240 timeout: 1370 lvb_type: 0 00010000:00010000:3.0:1763333166.070824:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb800/0xb32e3ef184c51f8c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968156 expref: 209 pid: 29240 timeout: 1370 lvb_type: 0 00010000:00010000:3.0:1763333166.070837:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x171:0x0].0x0 (ffff92ff618aae00) 00010000:00010000:3.0:1763333166.070841:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c51fb6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x171:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333166.070849:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c51fb6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x171:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333166.070855:0:6506:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c51fb6 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x171:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333166.070885:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333166.072651:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+210:2421:x1848987613399168:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 1863us (3260us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333166.072661:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2786 00000100:00100000:3.0:1763333166.090629:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613399680 00000100:00100000:3.0:1763333166.090636:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613399680 00000100:00100000:3.0:1763333166.101384:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613399808 00000100:00100000:3.0:1763333166.101396:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613399808 00000100:00100000:3.0:1763333166.101455:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333166.116734:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613400320 00000100:00100000:3.0:1763333166.116740:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613400320 00000100:00100000:3.0:1763333166.116773:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8508 00000100:00100000:3.0:1763333166.116780:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+211:56728:x1848987613400320:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:3.0:1763333166.116809:0:29240:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333166.116830:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c51fd2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x171:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696816b expref: 211 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.116847:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x171:0x0].0x0 (ffff92ff618aae00) 00010000:00010000:3.0:1763333166.116853:0:29240:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333166.116875:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c52018 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x171:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:3.0:1763333166.116884:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c52018 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x171:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333166.116899:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c52018 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x171:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333166.127598:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfc00/0xb32e3ef184c51faf lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333166.127613:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfc00/0xb32e3ef184c51faf lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333166.127620:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfc00/0xb32e3ef184c51faf lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333166.127626:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdfc00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333166.127630:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfc00/0xb32e3ef184c51faf lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333166.127656:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfc00/0xb32e3ef184c51faf lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333166.127671:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff618aaf00) 00010000:00010000:3.0:1763333166.127674:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333166.127678:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfc00/0xb32e3ef184c51faf lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333166.127686:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfc00/0xb32e3ef184c51faf lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000100:00100000:3.0:1763333166.128011:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff5004ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627163904:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333166.128067:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333166.128103:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763333166.128109:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff50048380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627163776:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333166.128133:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333166.128166:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627163904 00000100:00100000:3.0:1763333166.128172:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627163904 00000100:00100000:3.0:1763333166.128218:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627163776 00000100:00100000:3.0:1763333166.128221:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627163776 00000100:00100000:3.0:1763333166.128239:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5854 00000100:00100000:3.0:1763333166.128245:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50049500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+46:3655:x1848987627163904:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1763333166.128402:0:8611:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x1e6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333166.128406:0:8611:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x1e6:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763333166.128408:0:8611:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x1e6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333166.128411:0:8611:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x1e6:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763333166.128413:0:8611:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x1e6:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333166.128452:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50049500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+47:3655:x1848987627163904:12345-0@lo:2:osp-syn-1-1.0 Request processed in 205us (383us total) trans 17179871284 rc 0/0 00000100:00100000:3.0:1763333166.128459:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5854 00000100:00100000:3.0:1763333166.128475:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5855 00000100:00100000:3.0:1763333166.128481:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+46:3655:x1848987627163776:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333166.128547:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+47:3655:x1848987627163776:12345-0@lo:2:osp-syn-1-1.0 Request processed in 66us (413us total) trans 17179871285 rc 0/0 00000100:00100000:3.0:1763333166.128553:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5855 00000100:00080000:3.0:1763333166.128568:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1763333166.128599:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff50048380/2, rc 0, transno 17179871285 00000100:00100000:3.0:1763333166.128604:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff50048380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627163776:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763333166.128613:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff5004ad80/2, rc 0, transno 17179871284 00000100:00100000:3.0:1763333166.128616:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff5004ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627163904:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333166.143722:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333166.152465:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333166.161296:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44de0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1848987627164928:0@lo:400:kworker.0 00000100:00100000:3.0:1763333166.161335:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333166.161396:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44de1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1848987627165440:0@lo:400:kworker.0 00000100:00100000:3.0:1763333166.161427:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333166.161455:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1763333166.161462:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44de2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1848987627165056:0@lo:400:kworker.0 00000100:00100000:3.0:1763333166.161487:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333166.161508:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe49209c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1848987627165568:0@lo:400:kworker.0 00000100:00100000:3.0:1763333166.161532:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333166.161569:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627165568 00000100:00100000:3.0:1763333166.161574:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627165568 00000100:00100000:3.0:1763333166.161621:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 899 00000100:00100000:3.0:1763333166.161631:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1848987627165568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1763333166.161695:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1848987627165568:12345-0@lo:400:kworker.0 Request processed in 66us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333166.161704:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 899 00000100:00100000:3.0:1763333166.161725:0:32350:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627164800 00000100:00100000:3.0:1763333166.161730:0:32350:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627164800 00000100:00100000:3.0:1763333166.161764:0:32350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1763333166.161775:0:32350:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff756e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e37baad-59e1-47e8-a7d1-7559d772e0ab+23:3653:x1848987627164800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1763333166.161819:0:32350:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff756e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e37baad-59e1-47e8-a7d1-7559d772e0ab+23:3653:x1848987627164800:12345-0@lo:400:kworker.0 Request processed in 46us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333166.161827:0:32350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1763333166.161861:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627165696 00000100:00100000:3.0:1763333166.161867:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627165696 00000100:00100000:3.0:1763333166.161904:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 900 00000100:00100000:3.0:1763333166.161917:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3653:x1848987627165696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1763333166.161974:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3653:x1848987627165696:12345-0@lo:400:kworker.0 Request processed in 60us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333166.161985:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 900 00000100:00100000:3.0:1763333166.162016:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627165440 00000100:00100000:3.0:1763333166.162021:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627165440 00000100:00100000:3.0:1763333166.162050:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627165312 00000100:00100000:3.0:1763333166.162055:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627165312 00000100:00100000:3.0:1763333166.162084:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627165184 00000100:00100000:3.0:1763333166.162090:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627165184 00000100:00100000:3.0:1763333166.162118:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1478 00000100:00100000:3.0:1763333166.162128:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1848987627165440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1763333166.162173:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1848987627165440:12345-0@lo:400:kworker.0 Request processed in 44us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333166.162182:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1478 00000100:00100000:3.0:1763333166.162199:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1480 00000100:00100000:3.0:1763333166.162212:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1848987627165312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1763333166.162273:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1848987627165312:12345-0@lo:400:kworker.0 Request processed in 65us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333166.162284:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1480 00000100:00100000:3.0:1763333166.162304:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1482 00000100:00100000:3.0:1763333166.162314:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1848987627165184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1763333166.162384:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1848987627165184:12345-0@lo:400:kworker.0 Request processed in 71us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333166.162396:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1482 00000100:00100000:3.0:1763333166.162442:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44de2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1848987627165056:0@lo:400:kworker.0 00000100:00100000:3.0:1763333166.162458:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe49209c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1848987627165568:0@lo:400:kworker.0 00000100:00100000:3.0:1763333166.172779:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613401984 00000100:00100000:3.0:1763333166.172793:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613401984 00000100:00100000:3.0:1763333166.172860:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2904 00000100:00100000:3.0:1763333166.172869:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+207:56730:x1848987613401984:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333166.173099:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+208:56730:x1848987613401984:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 230us (435us total) trans 4294971616 rc 0/0 00000100:00100000:3.0:1763333166.173106:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2904 00000100:00100000:3.0:1763333166.231974:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333166.235775:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613403264 00000100:00100000:3.0:1763333166.235783:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613403264 00000100:00100000:3.0:1763333166.235830:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 5860 00000100:00100000:3.0:1763333166.235839:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+28:2418:x1848987613403264:12345-192.168.204.28@tcp:23:lfs.0 00000100:00100000:3.0:1763333166.235939:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+28:2418:x1848987613403264:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 100us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333166.235947:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 5860 00000100:00100000:3.0:1763333166.244295:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627165952 00000100:00100000:3.0:1763333166.244302:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627165952 00000100:00100000:3.0:1763333166.244341:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627166080 00000100:00100000:3.0:1763333166.244367:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627166080 00000100:00100000:3.0:1763333166.244400:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5861 00000100:00100000:3.0:1763333166.244411:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+31:3654:x1848987627165952:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333166.244559:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+33:3654:x1848987627165952:12345-0@lo:2:osp-syn-0-1.0 Request processed in 150us (672us total) trans 21474838590 rc 0/0 00000100:00100000:3.0:1763333166.244566:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5861 00000100:00100000:3.0:1763333166.244580:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5863 00000100:00100000:3.0:1763333166.244586:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50066300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+48:3652:x1848987627166208:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333166.244682:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50066300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+50:3652:x1848987627166208:12345-0@lo:2:osp-syn-1-1.0 Request processed in 94us (286us total) trans 17179871287 rc 0/0 00000100:00100000:3.0:1763333166.245453:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5863 00000100:00100000:3.0:1763333166.260204:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333166.265612:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333166.271859:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333166.321081:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333166.321508:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333166.330554:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333166.330598:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333166.340317:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613406080 00000100:00100000:3.0:1763333166.340322:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613406080 00000100:00100000:3.0:1763333166.340383:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8526 00000100:00100000:3.0:1763333166.340391:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+209:56732:x1848987613406080:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333166.340408:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333166.340426:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c52184 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696820c expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.340493:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c5218b lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333166.340506:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c5218b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.340516:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c5218b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.340527:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c52192 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333166.340533:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c52192 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.340539:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c52192 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.340587:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c5218b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.340594:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c5218b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.340599:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c5218b lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.340609:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c5218b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.340615:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46e43c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333166.340618:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c5218b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.340625:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c5218b lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.340666:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b90400) 00010000:00010000:3.0:1763333166.340669:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333166.340675:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c5218b lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.340681:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c5218b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.340692:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c52192 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.340697:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c52192 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.340702:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c52192 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.340707:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46e42c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333166.340709:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c52192 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.340715:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c52192 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.340726:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b90b00) 00010000:00010000:3.0:1763333166.340728:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333166.340731:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c52192 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.340736:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c52192 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.340759:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c52184 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696820c expref: 210 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.340766:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b90400) 00010000:00010000:3.0:1763333166.340768:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333166.340771:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c52184 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696820c expref: 210 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.340778:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46e42600, rc 0) 00000100:00100000:3.0:1763333166.340805:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+209:56732:x1848987613406080:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 416us (1834us total) trans 0 rc 301/301 00000100:00100000:3.0:1763333166.340811:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8526 00000100:00100000:3.0:1763333166.344919:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333166.344967:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333166.378712:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333166.385040:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:3.0:1763333166.387434:0:6523:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c521d1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x171:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT1 00010000:00010000:3.0:1763333166.387447:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c521d1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x171:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT1 00000040:00080000:3.0:1763333166.391587:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1196, 88 off102224 00000004:00080000:3.0:1763333166.391602:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1270471252568ns, next at 1271377657934ns, rc = 0 00000040:00080000:3.0:1763333166.391647:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1197, 88 off102224 00000004:00080000:3.0:1763333166.391651:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1270471302468ns, next at 1271377629108ns, rc = 0 00000040:00080000:3.0:1763333166.391668:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1198, 88 off102312 00000004:00080000:3.0:1763333166.391672:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1270471322840ns, next at 1271377629108ns, rc = 0 00000040:00080000:3.0:1763333166.391680:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1197, 88 off102312 00000004:00080000:3.0:1763333166.391683:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1270471334165ns, next at 1271377657934ns, rc = 0 00010000:00010000:3.0:1763333166.395034:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c52122 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.395047:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c52122 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.395054:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c52122 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.395059:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333166.395063:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c52122 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.395070:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c52122 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.395085:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b90b00) 00010000:00010000:3.0:1763333166.395087:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333166.395091:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c52122 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.395097:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c52122 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.395115:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5214c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x171:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.395121:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5214c lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x171:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.395125:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5214c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x171:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.395129:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333166.395131:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5214c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x171:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.395136:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5214c lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x171:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.395141:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x171:0x0].0x0 (ffff92ff618aae00) 00010000:00010000:3.0:1763333166.395143:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333166.395146:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5214c lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x171:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.395150:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5214c lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x171:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.395157:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c521a7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333166.395161:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c521a7 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333166.395166:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c521a7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333166.395173:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4874b000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333166.395176:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c521a7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333166.395181:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c521a7 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333166.395186:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b90b00) 00010000:00010000:3.0:1763333166.395188:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333166.395190:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c521a7 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333166.395194:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c521a7 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333166.395207:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c521bc lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x171:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333166.395211:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c521bc lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x171:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333166.395215:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c521bc lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x171:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333166.395219:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333166.395221:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c521bc lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x171:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333166.395226:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c521bc lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x171:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333166.395232:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x171:0x0].0x0 (ffff92ff618aae00) 00010000:00010000:3.0:1763333166.395234:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333166.395236:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c521bc lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x171:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333166.395241:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c521bc lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x171:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000100:00100000:3.0:1763333166.398295:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4920e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627168000:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333166.398689:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333166.398709:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763333166.398713:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4920fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627168128:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333166.398730:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333166.398748:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627168000 00000100:00100000:3.0:1763333166.398751:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627168000 00000100:00100000:3.0:1763333166.398769:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627168128 00000100:00100000:3.0:1763333166.398771:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627168128 00000100:00100000:3.0:1763333166.398785:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5875 00000100:00100000:3.0:1763333166.398789:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+8:3654:x1848987627167872:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763333166.398799:0:8406:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:488 count 1 00002000:00010000:3.0:1763333166.399921:0:8406:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333166.399928:0:8406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46e42600/0xb32e3ef184c521f4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.399936:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333166.399938:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333166.399942:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46e42600/0xb32e3ef184c521f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.399954:0:8406:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46e42600/0xb32e3ef184c521f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.399968:0:8406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46e42600/0xb32e3ef184c521f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.399976:0:8406:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46e42600/0xb32e3ef184c521f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.399998:0:8406:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763333166.402608:0:3652:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474838591 gen 2 00000004:00080000:3.0:1763333166.402614:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff6bdd8000, transno 21474838559 00000004:00080000:3.0:1763333166.402639:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7dffaa00, transno 21474838560 00000004:00080000:3.0:1763333166.402642:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7dff9500, transno 21474838561 00000004:00080000:3.0:1763333166.402644:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7dffa300, transno 21474838562 00000004:00080000:3.0:1763333166.402646:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff6bddb100, transno 21474838563 00000004:00080000:3.0:1763333166.402649:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff77c6dc00, transno 21474838564 00000004:00080000:3.0:1763333166.402651:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff6bddb480, transno 21474838565 00000004:00080000:3.0:1763333166.402711:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff6bdd9500, transno 21474838566 00000004:00080000:3.0:1763333166.402714:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7e120e00, transno 21474838568 00000004:00080000:3.0:1763333166.402717:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7e121c00, transno 21474838569 00000004:00080000:3.0:1763333166.402719:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7e123800, transno 21474838570 00000004:00080000:3.0:1763333166.402721:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7e120000, transno 21474838571 00000004:00080000:3.0:1763333166.402724:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44a60380, transno 21474838573 00000004:00080000:3.0:1763333166.402727:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7dffad80, transno 21474838574 00000004:00080000:3.0:1763333166.402730:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7dff8e00, transno 21474838575 00000004:00080000:3.0:1763333166.402732:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7dffa680, transno 21474838576 00000004:00080000:3.0:1763333166.402735:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7dcfce00, transno 21474838578 00000004:00080000:3.0:1763333166.402737:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7dcfe300, transno 21474838579 00000004:00080000:3.0:1763333166.402739:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44e04000, transno 21474838580 00000004:00080000:3.0:1763333166.402742:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7dcfca80, transno 21474838581 00000004:00080000:3.0:1763333166.402745:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4684d180, transno 21474838583 00000004:00080000:3.0:1763333166.402748:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4684fb80, transno 21474838584 00000004:00080000:3.0:1763333166.402750:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4684c000, transno 21474838585 00000004:00080000:3.0:1763333166.402752:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4684e300, transno 21474838586 00000004:00080000:3.0:1763333166.402754:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4399ad80, transno 21474838588 00000004:00080000:3.0:1763333166.402757:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4399a680, transno 21474838589 00000004:00080000:3.0:1763333166.402759:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe469a0700, transno 21474838590 00000004:00080000:3.0:1763333166.402761:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe469a2300, transno 21474838591 00000100:00100000:3.0:1763333166.402769:0:3652:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff92fe4920e300 x1848987627168000/t21474838595(21474838595) o2->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763333182 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1763333166.402780:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4920e300/2, rc 0, transno 21474838595 00000100:00100000:3.0:1763333166.402784:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4920e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627168000:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1763333166.404433:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4920ce00/2, rc 0, transno 21474838596 00000100:00100000:3.0:1763333166.404438:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4920ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627167872:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1763333166.407955:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4920f800/2, rc 0, transno 21474838598 00000100:00100000:3.0:1763333166.407963:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4920f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627167744:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763333166.408171:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333166.408194:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613408512 00000100:00100000:3.0:1763333166.408199:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613408512 00010000:00010000:3.0:1763333166.408227:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4e00/0xb32e3ef184c520f1 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369681db expref: 32 pid: 17605 timeout: 1370 lvb_type: 0 00000100:00100000:3.0:1763333166.408255:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2794 00000100:00100000:3.0:1763333166.408262:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+32:2419:x1848987613408512:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333166.408275:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333166.408279:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4e00/0xb32e3ef184c520f1 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x1e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369681db expref: 32 pid: 17605 timeout: 1370 lvb_type: 0 00010000:00010000:3.0:1763333166.408289:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4e00/0xb32e3ef184c520f1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369681db expref: 32 pid: 17605 timeout: 1370 lvb_type: 0 00010000:00010000:3.0:1763333166.408308:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333166.408310:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333166.408314:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c521e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.408323:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c521e6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x1e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.408337:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333166.408390:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+32:2419:x1848987613408512:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 129us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333166.408397:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2794 00000004:00080000:3.0:1763333166.410117:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4684d880/2, rc 0, transno 17179871294 00000100:00100000:3.0:1763333166.410125:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4684d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627167104:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763333166.422575:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613409280 00000100:00100000:3.0:1763333166.422586:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613409280 00000100:00100000:3.0:1763333166.422652:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8532 00000100:00100000:3.0:1763333166.422661:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+206:55917:x1848987613409280:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333166.422683:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333166.422703:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c52225 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x174:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696822f expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.422738:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c5222c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x174:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333166.422753:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c5222c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x174:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.422763:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c5222c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x174:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.422877:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c52225 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x174:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696822f expref: 208 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.422892:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c5222c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x174:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696822f expref: 207 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.422901:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x174:0x0].0x0 (ffff92fe43b90700) 00010000:00010000:3.0:1763333166.422903:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763333166.422906:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46e42c00, rc 0) 00000100:00100000:3.0:1763333166.422971:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+207:55917:x1848987613409280:12345-192.168.204.28@tcp:101:bash.0 Request processed in 311us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333166.422977:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8532 00010000:00010000:3.0:1763333166.426471:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333166.426480:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c52233 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x171:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT1 00010000:00010000:3.0:1763333166.426488:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333166.426492:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c52233 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x171:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT1 00010000:00010000:3.0:1763333166.426501:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c52233 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x171:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT1 00010000:00010000:3.0:1763333166.426516:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x171:0x0].0x0 (ffff92ff618aae00) 00010000:00010000:3.0:1763333166.426519:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763333166.426524:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c52233 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x171:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT1 00010000:00010000:3.0:1763333166.426530:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c52233 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x171:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT1 00010000:00010000:3.0:1763333166.426542:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333166.426543:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333166.426545:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763333166.430168:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613409792 00000100:00100000:3.0:1763333166.430172:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613409792 00000100:00100000:3.0:1763333166.430774:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8533 00000100:00100000:3.0:1763333166.430785:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+209:55917:x1848987613409536:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:3.0:1763333166.430840:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333166.430866:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c52217 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x174:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968228 expref: 209 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.430885:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x174:0x0].0x0 (ffff92fe43b90700) 00010000:00010000:3.0:1763333166.430890:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333166.431074:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c5223a lrc: 3/0,1 mode: --/PW res: [0x240000404:0x174:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333166.431087:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c5223a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x174:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.431096:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c5223a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x174:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000001:00080000:3.0:1763333166.431142:0:12741:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294971632 00000004:00010000:3.0:1763333166.431166:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002eb77673 reply state 00000000e99355fc transno 4294971633 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c5223a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x174:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.431178:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c5223a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x174:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.431184:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x174:0x0].0x0 (ffff92fe43b90700) 00010000:00010000:3.0:1763333166.431186:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763333166.431189:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763333166.431288:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+211:55917:x1848987613409536:12345-192.168.204.28@tcp:36:bash.0 Request processed in 504us (1626us total) trans 4294971633 rc 0/0 00000100:00100000:3.0:1763333166.431295:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8533 00000020:00080000:3.0:1763333166.431301:0:12741:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763333166.431318:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8534 00000100:00100000:3.0:1763333166.431326:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+210:56728:x1848987613409792:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333166.431337:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333166.431367:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c52241 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968236 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.431415:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b200/0xb32e3ef184c52248 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333166.431424:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b200/0xb32e3ef184c52248 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.431431:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b200/0xb32e3ef184c52248 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.431442:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c5224f lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333166.431449:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c5224f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.431456:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c5224f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.431543:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c52256 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x174:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333166.431552:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c52256 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x174:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.431559:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c52256 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x174:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:3.0:1763333166.431568:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x174:0x0]: returning size 0 00010000:00010000:3.0:1763333166.431615:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b200/0xb32e3ef184c52248 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.431623:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b200/0xb32e3ef184c52248 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.431629:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b200/0xb32e3ef184c52248 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.431648:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b200/0xb32e3ef184c52248 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.431653:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4874b200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333166.431657:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b200/0xb32e3ef184c52248 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.431664:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b200/0xb32e3ef184c52248 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.431673:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6231ed00) 00010000:00010000:3.0:1763333166.431676:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333166.431681:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b200/0xb32e3ef184c52248 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.431688:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b200/0xb32e3ef184c52248 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.431697:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c5224f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.431702:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c5224f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.431718:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c5224f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.431722:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4874ae00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333166.431725:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c5224f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.431731:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c5224f lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.431738:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6231ee00) 00010000:00010000:3.0:1763333166.431740:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333166.431743:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c5224f lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.431748:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c5224f lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.431782:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c52241 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968236 expref: 213 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.431796:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c52256 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x174:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968236 expref: 212 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.431802:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x174:0x0].0x0 (ffff92fe43b90700) 00010000:00010000:3.0:1763333166.431805:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333166.431807:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4874ba00, rc 0) 00000100:00100000:3.0:1763333166.431843:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+212:56728:x1848987613409792:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 518us (1860us total) trans 4294971634 rc 0/0 00000100:00100000:3.0:1763333166.431850:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8534 00000100:00100000:3.0:1763333166.443278:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613410304 00000100:00100000:3.0:1763333166.443290:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613410304 00000100:00100000:3.0:1763333166.443393:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8536 00000100:00100000:3.0:1763333166.443403:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+213:55917:x1848987613410304:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333166.443432:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333166.443435:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:3.0:1763333166.443466:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c52264 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x174:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696823d expref: 213 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.443486:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c52256 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x174:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968236 expref: 212 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.443497:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x174:0x0].0x0 (ffff92fe43b90700) 00010000:00010000:3.0:1763333166.443503:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333166.443516:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c52272 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x174:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696824b expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.443567:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c52279 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x174:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333166.443581:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c52279 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x174:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.443592:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c52279 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x174:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000040:00080000:3.0:1763333166.443855:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1200, 88 off102528 00000004:00080000:3.0:1763333166.443864:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1270523514185ns, next at 1271377657934ns, rc = 0 00000040:00080000:3.0:1763333166.443889:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1201, 88 off102528 00000004:00080000:3.0:1763333166.443893:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1270523544166ns, next at 1271377629108ns, rc = 0 00000040:00080000:3.0:1763333166.443926:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1202, 88 off102616 00000004:00080000:3.0:1763333166.443931:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1270523581746ns, next at 1271377629108ns, rc = 0 00000040:00080000:3.0:1763333166.443940:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1201, 88 off102616 00000004:00080000:3.0:1763333166.443943:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1270523594034ns, next at 1271377657934ns, rc = 0 00000100:00100000:3.0:1763333166.450071:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff74039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627168384:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763333166.450101:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333166.450134:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763333166.450140:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7403b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627168512:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763333166.450159:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333166.450188:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627168384 00000100:00100000:3.0:1763333166.450192:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627168384 00000100:00100000:3.0:1763333166.450215:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627168512 00000100:00100000:3.0:1763333166.450218:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627168512 00000100:00100000:3.0:1763333166.450233:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5881 00000100:00100000:3.0:1763333166.450239:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+56:3654:x1848987627168384:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763333166.450252:0:17605:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:485 count 1 00010000:00010000:3.0:1763333166.450270:0:17605:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4874b200/0xb32e3ef184c52287 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.450288:0:17605:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfc00/0xb32e3ef184c52081 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369681aa expref: 31 pid: 29013 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333166.450296:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333166.450299:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333166.450302:0:17605:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4874b200/0xb32e3ef184c52287 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.450327:0:17605:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfc00/0xb32e3ef184c52081 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369681aa expref: 31 pid: 29013 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333166.450340:0:17605:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfc00/0xb32e3ef184c52081 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369681aa expref: 31 pid: 29013 timeout: 1370 lvb_type: 1 00000100:00100000:3.0:1763333166.450367:0:17605:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42f0d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17605:1848987627169280:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333166.450422:0:17605:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4869dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1763333166.450435:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627169152 00000100:00100000:3.0:1763333166.450439:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627169152 00000100:00100000:3.0:1763333166.450464:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5882 00000100:00100000:3.0:1763333166.450470:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+56:3654:x1848987627168512:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763333166.450481:0:8406:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:486 count 1 00010000:00010000:3.0:1763333166.450493:0:8406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c5228e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.450504:0:8406:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb000/0xb32e3ef184c5217d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369681fe expref: 31 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.450511:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333166.450512:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333166.450515:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c5228e lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.450534:0:8406:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb000/0xb32e3ef184c5217d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369681fe expref: 31 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.450543:0:8406:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb000/0xb32e3ef184c5217d lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369681fe expref: 31 pid: 8404 timeout: 1370 lvb_type: 0 00000100:00100000:3.0:1763333166.450553:0:8406:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42f0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8406:1848987627169536:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333166.450574:0:8406:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4869d480 going to sleep for 11 seconds 00000100:00100000:3.0:1763333166.450598:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff6bddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627168896:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763333166.450621:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333166.450649:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763333166.450654:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff6bddb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627169024:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763333166.450674:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763333166.460138:0:17605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfc00/0xb32e3ef184c52081 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369681aa expref: 31 pid: 29013 timeout: 1370 lvb_type: 1 00000100:00100000:3.0:1763333166.460150:0:17605:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42f0d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17605:1848987627169280:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333166.460164:0:17605:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe4874b200/0xb32e3ef184c52287 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.460173:0:17605:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe4874b200/0xb32e3ef184c52287 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.460181:0:17605:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4874b200/0xb32e3ef184c52287 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.460191:0:17605:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4874b200/0xb32e3ef184c52287 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.460199:0:17605:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4874b200/0xb32e3ef184c52287 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.460217:0:17605:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763333166.460552:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+57:3654:x1848987627168384:12345-0@lo:6:osp-syn-1-1.0 Request processed in 10312us (10449us total) trans 17179871297 rc 0/0 00000100:00100000:3.0:1763333166.460560:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5881 00010000:00010000:3.0:1763333166.460580:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333166.460586:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe4874b200/0xb32e3ef184c52287 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.460592:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4874b200 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333166.460596:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4874b200/0xb32e3ef184c52287 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.460605:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4874b200/0xb32e3ef184c52287 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.460618:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe4874b200/0xb32e3ef184c52287 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.460624:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4874b200/0xb32e3ef184c52287 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.460655:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333166.460657:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333166.460658:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763333166.460688:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff74039500/2, rc 0, transno 17179871297 00000100:00100000:3.0:1763333166.460694:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff74039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627168384:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763333166.460733:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333166.460751:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613410944 00000100:00100000:3.0:1763333166.460755:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613410944 00010000:00010000:3.0:1763333166.460771:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4874a600/0xb32e3ef184c52168 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369681f7 expref: 13 pid: 8404 timeout: 1370 lvb_type: 0 00000100:00100000:3.0:1763333166.460789:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2798 00000100:00100000:3.0:1763333166.460795:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff800dac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2421:x1848987613410944:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333166.460802:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333166.460806:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe4874a600/0xb32e3ef184c52168 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369681f7 expref: 13 pid: 8404 timeout: 1370 lvb_type: 0 00010000:00010000:3.0:1763333166.460816:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe4874a600/0xb32e3ef184c52168 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369681f7 expref: 13 pid: 8404 timeout: 1370 lvb_type: 0 00010000:00010000:3.0:1763333166.460828:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333166.460830:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333166.460833:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5229c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.460842:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5229c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.460855:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333166.460872:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff800dac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2421:x1848987613410944:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 77us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333166.460878:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2798 00000100:00100000:3.0:1763333166.460934:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:3.0:1763333166.465143:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763333166.466860:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff6bddb480/2, rc 0, transno 21474838601 00000100:00100000:3.0:1763333166.466872:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff6bddb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627169024:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1763333166.466883:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff6bddb100/2, rc 0, transno 21474838602 00000100:00100000:3.0:1763333166.466887:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff6bddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627168896:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1763333166.466899:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7403b800/2, rc 0, transno 17179871298 00000100:00100000:3.0:1763333166.466903:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7403b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627168512:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763333166.466989:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333166.472697:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333166.472735:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333166.480698:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613411968 00000100:00100000:3.0:1763333166.480711:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613411968 00000100:00100000:3.0:1763333166.490220:0:28428:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4684e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:28428:1848987627170176:192.168.204.28@tcp:105: 00010000:00010000:3.0:1763333166.490248:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333166.490319:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:2421:x1848987613411968:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 8053us (12712us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333166.490332:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2799 00000100:00100000:3.0:1763333166.504845:0:28430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1483 00000100:00100000:3.0:1763333166.504854:0:28430:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+11:2419:x1848987613412736:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:3.0:1763333166.505086:0:28430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x1e9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333166.505088:0:28430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x1e9:0x0] updating lvb mtime from disk: 0 -> 1763333166 00002000:00010000:3.0:1763333166.505091:0:28430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x1e9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333166.505093:0:28430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x1e9:0x0] updating lvb ctime from disk: 0 -> 1763333166 00002000:00010000:3.0:1763333166.505095:0:28430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1e9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333166.505116:0:28430:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:2419:x1848987613412736:12345-192.168.204.28@tcp:10:bash.0 Request processed in 263us (505us total) trans 21474838603 rc 0/0 00000100:00100000:3.0:1763333166.505122:0:28430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1483 00002000:00010000:3.0:1763333166.505125:0:28430:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/489 (0->18446744073709551615) 00002000:00100000:3.0:1763333166.505128:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe44de1180 with x1848987613412736 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333166.505132:0:28430:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe44de1180. 00000100:00100000:3.0:1763333166.508995:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613412992 00000100:00100000:3.0:1763333166.509007:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613412992 00000100:00100000:3.0:1763333166.509073:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2915 00000100:00100000:3.0:1763333166.509084:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+209:55917:x1848987613412992:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:3.0:1763333166.509408:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+210:55917:x1848987613412992:12345-192.168.204.28@tcp:35:bash.0 Request processed in 324us (1309us total) trans 4294971639 rc 0/0 00000100:00100000:3.0:1763333166.509416:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2915 00000100:00100000:3.0:1763333166.522191:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613413760 00000100:00100000:3.0:1763333166.522204:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613413760 00000100:00100000:3.0:1763333166.522828:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2916 00000100:00100000:3.0:1763333166.522839:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5004b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+214:56734:x1848987613413760:12345-192.168.204.28@tcp:35:rm.0 00000100:00100000:3.0:1763333166.523117:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5004b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+215:56734:x1848987613413760:12345-192.168.204.28@tcp:35:rm.0 Request processed in 279us (1194us total) trans 4294971641 rc 0/0 00000100:00100000:3.0:1763333166.523124:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2916 00000100:00100000:3.0:1763333166.528389:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613413888 00000100:00100000:3.0:1763333166.528400:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613413888 00010000:00010000:3.0:1763333166.528446:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c522bf lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x174:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968260 expref: 215 pid: 12741 timeout: 1370 lvb_type: 0 00000100:00100000:3.0:1763333166.528487:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2800 00000100:00100000:3.0:1763333166.528498:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50048000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+215:2421:x1848987613413888:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333166.528516:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333166.528523:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c522bf lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x174:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968260 expref: 215 pid: 12741 timeout: 1370 lvb_type: 0 00010000:00010000:3.0:1763333166.528536:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c522bf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x174:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968260 expref: 215 pid: 12741 timeout: 1370 lvb_type: 0 00010000:00010000:3.0:1763333166.528560:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c522bf lrc: 0/0,0 mode: --/PR res: [0x240000404:0x174:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968260 expref: 215 pid: 12741 timeout: 1370 lvb_type: 0 00010000:00010000:3.0:1763333166.528576:0:28428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x174:0x0].0x0 (ffff92fe43b90700) 00010000:00010000:3.0:1763333166.528582:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb000/0xb32e3ef184c522f0 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x174:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.528594:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb000/0xb32e3ef184c522f0 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x174:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.528601:0:28428:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb000/0xb32e3ef184c522f0 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x174:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.528646:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333166.528698:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50048000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+214:2421:x1848987613413888:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 200us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333166.528710:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2800 00000100:00100000:3.0:1763333166.533413:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613414400 00000100:00100000:3.0:1763333166.533427:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613414400 00000100:00100000:3.0:1763333166.533498:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8542 00000100:00100000:3.0:1763333166.533511:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+211:56733:x1848987613414400:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333166.533548:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333166.533575:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c52313 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x174:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696827c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333166.566739:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333166.575932:0:8406:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4399a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8406:1848987627170432:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333166.575966:0:8406:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c52336 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333166.576288:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613415168 00000100:00100000:3.0:1763333166.576296:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613415168 00002000:00100000:3.0:1763333166.576339:0:28427:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x2c0000400:0x1e9:0x0] (0->4) req@ffff92fe4399a680 x1848987613415168/t0(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:477/0 lens 496/0 e 0 to 0 dl 1763333177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763333166.576377:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4399a680 with x1848987613415168 ext(0->4) 00010000:00010000:3.0:1763333166.576385:0:28427:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c522a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968259 expref: 32 pid: 8407 timeout: 1370 lvb_type: 0 00010000:00010000:3.0:1763333166.576399:0:28427:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c522a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968259 expref: 32 pid: 8407 timeout: 1370 lvb_type: 0 00002000:00010000:3.0:1763333166.576407:0:28427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92fe4399a680 00000100:00100000:3.0:1763333166.576435:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 93 00000100:00100000:3.0:1763333166.576444:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4399a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+32:2419:x1848987613415168:12345-192.168.204.28@tcp:4:bash.0 00000100:00100000:3.0:1763333166.577423:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4399a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+34:2419:x1848987613415168:12345-192.168.204.28@tcp:4:bash.0 Request processed in 974us (1314us total) trans 17179871300 rc 0/0 00000100:00100000:3.0:1763333166.577433:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 93 00002000:00100000:3.0:1763333166.577443:0:28427:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x2c0000400:0x1e9:0x0] (0->4) req@ffff92fe4399a680 x1848987613415168/t17179871300(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:477/0 lens 496/448 e 0 to 0 dl 1763333177 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763333166.577452:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4399a680 with x1848987613415168 ext(0->4) 00010000:00010000:3.0:1763333166.577459:0:28427:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c522a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968259 expref: 34 pid: 8407 timeout: 1370 lvb_type: 0 00010000:00010000:3.0:1763333166.577472:0:28427:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c522a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968259 expref: 34 pid: 8407 timeout: 1370 lvb_type: 0 00002000:00010000:3.0:1763333166.577480:0:28427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92fe4399a680 00010000:00010000:3.0:1763333166.601295:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c522fe lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.601307:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c522fe lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.601314:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c522fe lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.601320:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333166.601325:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c522fe lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.601332:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c522fe lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.601366:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b90500) 00010000:00010000:3.0:1763333166.601370:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333166.601375:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c522fe lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333166.601382:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c522fe lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000100:00100000:3.0:1763333166.609220:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333166.617233:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613416576 00000100:00100000:3.0:1763333166.617239:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613416576 00000100:00100000:3.0:1763333166.617275:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8551 00000100:00100000:3.0:1763333166.617282:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+208:56733:x1848987613416576:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333166.617295:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333166.617306:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b200/0xb32e3ef184c523c2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x174:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369682b4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.617339:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b200/0xb32e3ef184c523c2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x174:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369682b4 expref: 209 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.617370:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b200/0xb32e3ef184c523c2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x174:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369682b4 expref: 209 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.617388:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x174:0x0].0x0 (ffff92fe43b90700) 00010000:00010000:3.0:1763333166.617391:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763333166.617395:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4874b200, rc 0) 00000100:00100000:3.0:1763333166.619454:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+209:56733:x1848987613416576:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 2160us (2994us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333166.619469:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8551 00000100:00100000:3.0:1763333166.625772:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613416704 00000100:00100000:3.0:1763333166.625778:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613416704 00010000:00010000:3.0:1763333166.625805:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c523a6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x176:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369682a6 expref: 210 pid: 6519 timeout: 1370 lvb_type: 0 00000100:00100000:3.0:1763333166.625846:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2803 00000100:00100000:3.0:1763333166.625856:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43998e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+210:2421:x1848987613416704:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333166.625872:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333166.625878:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c523a6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x176:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369682a6 expref: 210 pid: 6519 timeout: 1370 lvb_type: 0 00010000:00010000:3.0:1763333166.625890:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c523a6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x176:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369682a6 expref: 210 pid: 6519 timeout: 1370 lvb_type: 0 00010000:00010000:3.0:1763333166.625911:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c523a6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x176:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369682a6 expref: 210 pid: 6519 timeout: 1370 lvb_type: 0 00010000:00010000:3.0:1763333166.625928:0:28428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x176:0x0].0x0 (ffff92ff606cdc00) 00010000:00010000:3.0:1763333166.625933:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c523bb lrc: 3/0,1 mode: --/EX res: [0x240000404:0x176:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.625941:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c523bb lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x176:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.625949:0:28428:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c523bb lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x176:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.625975:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333166.626034:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43998e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+209:2421:x1848987613416704:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 178us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333166.626041:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2803 00010000:00010000:3.0:1763333166.626068:0:6521:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c523bb lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x176:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.626076:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c523bb lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x176:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:3.0:1763333166.626100:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x176:0x0]: returning size 0 00000004:00080000:3.0:1763333166.626296:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x1eb:0x0], index 0: 0 00000004:00080000:3.0:1763333166.626303:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x1eb:0x0], index 1: 0 00000004:00080000:3.0:1763333166.626307:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x1ec:0x0], index 1: 0 00000004:00080000:3.0:1763333166.626310:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x1ec:0x0], index 0: 0 00010000:00010000:3.0:1763333166.626465:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c523bb lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x176:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.626473:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c523bb lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x176:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.626478:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c523bb lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x176:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.626484:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333166.626488:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c523bb lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x176:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.626495:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c523bb lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x176:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.626504:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x176:0x0].0x0 (ffff92ff606cdc00) 00010000:00010000:3.0:1763333166.626507:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763333166.626512:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c523bb lrc: 2/0,0 mode: --/EX res: [0x240000404:0x176:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.626518:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c523bb lrc: 0/0,0 mode: --/EX res: [0x240000404:0x176:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.626565:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c523b4 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x176:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369682ad expref: 209 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.626574:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x176:0x0].0x0 (ffff92ff606cdc00) 00010000:00010000:3.0:1763333166.626576:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763333166.626580:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c523b4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x176:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369682ad expref: 209 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.626595:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7ec00, rc 0) 00000100:00100000:3.0:1763333166.626642:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+208:56735:x1848987613416448:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 10062us (11703us total) trans 4294971647 rc 301/301 00000100:00100000:3.0:1763333166.626649:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8550 00000100:00100000:3.0:1763333166.626669:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8552 00000100:00100000:3.0:1763333166.626677:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+207:56733:x1848987613416832:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333166.626693:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333166.626708:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c523d0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x174:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369682bb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.626762:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c523d7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x174:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333166.626774:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c523d7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x174:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.626781:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c523d7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x174:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:3.0:1763333166.626806:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x174:0x0]: returning size 5 00000004:00200000:3.0:1763333166.626810:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763333166.626821:0:6521:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c523d7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x174:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.626839:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c523d0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x174:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369682bb expref: 209 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.626850:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c523d7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x174:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369682bb expref: 208 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.626857:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x174:0x0].0x0 (ffff92fe43b90700) 00010000:00010000:3.0:1763333166.626859:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1763333166.626862:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4874ae00, rc 0) 00000100:00100000:3.0:1763333166.626882:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+208:56733:x1848987613416832:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 206us (1803us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333166.626888:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8552 00000100:00100000:3.0:1763333166.641833:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613417472 00000100:00100000:3.0:1763333166.641844:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613417472 00000100:00100000:3.0:1763333166.641917:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2918 00000100:00100000:3.0:1763333166.641928:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+209:56735:x1848987613417472:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333166.642162:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+210:56735:x1848987613417472:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 236us (429us total) trans 4294971649 rc 0/0 00000100:00100000:3.0:1763333166.642170:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2918 00000100:00100000:3.0:1763333166.660813:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333166.673768:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e00ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627171584:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333166.673811:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333166.673841:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763333166.673846:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e00d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627171456:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333166.673865:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333166.673894:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627171584 00000100:00100000:3.0:1763333166.673899:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627171584 00000100:00100000:3.0:1763333166.673932:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627171456 00000100:00100000:3.0:1763333166.673936:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627171456 00000100:00100000:3.0:1763333166.673970:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5895 00000100:00100000:3.0:1763333166.673978:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+16:3653:x1848987627171584:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333166.674186:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+17:3653:x1848987627171584:12345-0@lo:2:osp-syn-0-1.0 Request processed in 208us (374us total) trans 21474838606 rc 0/0 00000100:00100000:3.0:1763333166.674195:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5895 00000100:00100000:3.0:1763333166.674211:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5896 00000100:00100000:3.0:1763333166.674217:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+16:3653:x1848987627171456:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333166.674282:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+17:3653:x1848987627171456:12345-0@lo:2:osp-syn-0-1.0 Request processed in 66us (416us total) trans 21474838607 rc 0/0 00000100:00100000:3.0:1763333166.674289:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5896 00000004:00080000:3.0:1763333166.674342:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7e00d880/2, rc 0, transno 21474838607 00000100:00100000:3.0:1763333166.674373:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e00d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627171456:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1763333166.674385:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7e00ca80/2, rc 0, transno 21474838606 00000100:00100000:3.0:1763333166.674388:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e00ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627171584:0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1763333166.674460:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763333166.674469:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e00dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627171712:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1763333166.674496:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333166.674515:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763333166.674522:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7dcff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1848987627171328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1763333166.674541:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333166.682381:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333166.686594:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333166.689739:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333166.689792:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333166.694768:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333166.702785:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333166.712058:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000001:00080000:3.0:1763333166.753836:0:24714:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838609 is committed 00000001:00080000:3.0:1763333166.753861:0:24714:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838607 is committed 00000100:00100000:3.0:1763333166.786664:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613421056 00000100:00100000:3.0:1763333166.786678:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613421056 00000100:00100000:3.0:1763333166.786748:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 5903 00000100:00100000:3.0:1763333166.786762:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+11:56733:x1848987613421056:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333166.786783:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333166.786812:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4874aa00/0xb32e3ef184c524d3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968316 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333166.786845:0:8404:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1ea:0x0] initial LVB size: 4096, mtime: 0x691a542f, atime: 0x0, ctime: 0x691a542f, blocks: 0x8 00010000:00010000:3.0:1763333166.786873:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333166.786876:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333166.786885:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4874aa00/0xb32e3ef184c524d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968316 expref: 12 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.786903:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe4874aa00/0xb32e3ef184c524d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968316 expref: 12 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.786922:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4874aa00, rc 0) 00000100:00100000:3.0:1763333166.787005:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:56733:x1848987613421056:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 246us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333166.787012:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 5903 00000100:00100000:3.0:1763333166.791339:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613421184 00000100:00100000:3.0:1763333166.791464:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613421184 00000100:00100000:3.0:1763333166.823498:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613422464 00000100:00100000:3.0:1763333166.823508:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613422464 00010000:00010000:3.0:1763333166.823554:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c5250b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x178:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696832b expref: 218 pid: 12741 timeout: 1370 lvb_type: 0 00000100:00100000:3.0:1763333166.823600:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2804 00000100:00100000:3.0:1763333166.823610:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bdd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+218:2421:x1848987613422464:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333166.823637:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333166.823644:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c5250b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x178:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696832b expref: 218 pid: 12741 timeout: 1370 lvb_type: 0 00010000:00010000:3.0:1763333166.823657:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c5250b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x178:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696832b expref: 218 pid: 12741 timeout: 1370 lvb_type: 0 00010000:00010000:3.0:1763333166.823683:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c5250b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x178:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696832b expref: 218 pid: 12741 timeout: 1370 lvb_type: 0 00010000:00010000:3.0:1763333166.823700:0:8423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x178:0x0].0x0 (ffff92ff62250f00) 00010000:00010000:3.0:1763333166.823706:0:8423:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c52520 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x178:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333166.823721:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c52520 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x178:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333166.823729:0:8423:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c52520 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x178:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333166.823763:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333166.823818:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bdd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+217:2421:x1848987613422464:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 208us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333166.823825:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2804 00000100:00100000:3.0:1763333166.825200:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613422592 00000100:00100000:3.0:1763333166.825206:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613422592 00000100:00100000:3.0:1763333166.825246:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 5905 00000100:00100000:3.0:1763333166.825253:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+37:56733:x1848987613422592:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333166.825267:0:28600:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333166.825283:0:28600:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c52535 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968339 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.825306:0:28600:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c523de lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369682c2 expref: 38 pid: 28600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333166.825313:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333166.825315:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333166.825319:0:28600:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c52535 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968339 expref: 38 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.825365:0:28600:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c523de lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369682c2 expref: 38 pid: 28600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333166.825384:0:28600:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c523de lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369682c2 expref: 38 pid: 28600 timeout: 1370 lvb_type: 1 00000100:00100000:3.0:1763333166.825397:0:28600:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42f0e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28600:1848987627172224:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333166.827252:0:28600:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4869d240 going to sleep for 11 seconds 00000100:00100000:3.0:1763333166.832233:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613422848 00000100:00100000:3.0:1763333166.832246:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613422848 00000100:00100000:3.0:1763333166.832317:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2920 00000100:00100000:3.0:1763333166.832329:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bdd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+216:56737:x1848987613422848:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333166.832712:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bdd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+217:56737:x1848987613422848:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 384us (1526us total) trans 4294971661 rc 0/0 00000100:00100000:3.0:1763333166.832720:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2920 00000100:00100000:3.0:1763333166.835890:0:28600:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42f0e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28600:1848987627172224:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333166.835930:0:28600:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c52535 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968339 expref: 38 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.835953:0:28600:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4874ba00, rc 0) 00000100:00100000:3.0:1763333166.836031:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+38:56733:x1848987613422592:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 10775us (11936us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333166.836042:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 5905 00000100:00100000:3.0:1763333166.845533:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333166.851400:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613423872 00000100:00100000:3.0:1763333166.851412:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613423872 00000100:00100000:3.0:1763333166.851475:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2922 00000100:00100000:3.0:1763333166.851485:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6b3ec450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+220:56733:x1848987613423872:12345-192.168.204.28@tcp:35:lfs.0 00000004:00010000:3.0:1763333166.851549:0:35317:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x240000404:0x174:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ee00/0xb32e3ef184c52328 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x174:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968283 expref: 220 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.851602:0:35317:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c5255f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x174:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 35317 initiator: MDT0 00010000:00010000:3.0:1763333166.851614:0:35317:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b200/0xb32e3ef184c523c2 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x174:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369682b4 expref: 220 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.851635:0:35317:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c5255f lrc: 4/0,1 mode: --/EX res: [0x240000404:0x174:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 35317 initiator: MDT1 00010000:00010000:3.0:1763333166.851673:0:35317:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b200/0xb32e3ef184c523c2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x174:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369682b4 expref: 220 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.851686:0:35317:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b200/0xb32e3ef184c523c2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x174:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369682b4 expref: 220 pid: 6519 timeout: 1370 lvb_type: 0 00000100:00100000:3.0:1763333166.851700:0:35317:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42f0d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:35317:1848987627172480:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333166.851778:0:35317:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4869d240 going to sleep for 11 seconds 00000100:00100000:3.0:1763333166.856122:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613424000 00000100:00100000:3.0:1763333166.856136:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613424000 00000100:00100000:3.0:1763333166.856211:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8570 00000100:00100000:3.0:1763333166.856221:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74036300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:55917:x1848987613424000:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333166.856249:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333166.856273:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c52566 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x178:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968347 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.856325:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c5256d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x178:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333166.856341:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c5256d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x178:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.856371:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c5256d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x178:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.856505:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c52566 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x178:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968347 expref: 223 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.856526:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c5256d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x178:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968347 expref: 222 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.856535:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x178:0x0].0x0 (ffff92fe43b90500) 00010000:00010000:3.0:1763333166.856538:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763333166.856543:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4874ae00, rc 0) 00000100:00100000:3.0:1763333166.856618:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74036300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:55917:x1848987613424000:12345-192.168.204.28@tcp:101:bash.0 Request processed in 397us (1501us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333166.856633:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8570 00010000:00010000:3.0:1763333166.864141:0:35317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b200/0xb32e3ef184c523c2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x174:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369682b4 expref: 223 pid: 6519 timeout: 1370 lvb_type: 0 00000100:00100000:3.0:1763333166.864157:0:35317:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42f0d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:35317:1848987627172480:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333166.864177:0:35317:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c5255f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x174:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 35317 initiator: MDT1 00010000:00010000:3.0:1763333166.864186:0:35317:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c5255f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x174:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 35317 initiator: MDT1 00010000:00010000:3.0:1763333166.864192:0:35317:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c5255f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x174:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 35317 initiator: MDT1 00000040:00080000:3.0:1763333166.864397:0:35317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1208, 88 off103184 00000004:00080000:3.0:1763333166.864405:0:35317:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1270944055829ns, next at 1271377657934ns, rc = 0 00000040:00080000:3.0:1763333166.864440:0:35317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1209, 88 off103184 00000004:00080000:3.0:1763333166.864445:0:35317:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1270944096012ns, next at 1271377629108ns, rc = 0 00000040:00080000:3.0:1763333166.864461:0:35317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1210, 88 off103272 00000004:00080000:3.0:1763333166.864465:0:35317:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1270944116265ns, next at 1271377629108ns, rc = 0 00000040:00080000:3.0:1763333166.864475:0:35317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1209, 88 off103272 00000004:00080000:3.0:1763333166.864478:0:35317:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1270944129377ns, next at 1271377657934ns, rc = 0 00000100:00100000:3.0:1763333166.873781:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7400c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627173504:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333166.873812:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333166.873834:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763333166.873840:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7400d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627173376:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763333166.873859:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333166.873880:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627173504 00000100:00100000:3.0:1763333166.873885:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627173504 00000100:00100000:3.0:1763333166.873912:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627173376 00000100:00100000:3.0:1763333166.873915:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627173376 00000100:00100000:3.0:1763333166.873930:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5911 00000100:00100000:3.0:1763333166.873936:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3655:x1848987627173504:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1763333166.874018:0:17605:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x1e9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333166.874022:0:17605:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x1e9:0x0] updating lvb mtime from disk: 1763333166 -> 1763333166 00002000:00010000:3.0:1763333166.874024:0:17605:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x1e9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333166.874026:0:17605:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x1e9:0x0] updating lvb ctime from disk: 1763333166 -> 1763333166 00002000:00010000:3.0:1763333166.874028:0:17605:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1e9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333166.874058:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+7:3655:x1848987627173504:12345-0@lo:2:osp-syn-0-1.0 Request processed in 121us (244us total) trans 21474838611 rc 0/0 00000100:00100000:3.0:1763333166.874064:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5911 00000100:00100000:3.0:1763333166.874082:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5912 00000100:00100000:3.0:1763333166.874088:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3655:x1848987627173376:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763333166.874098:0:17605:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:492 count 1 00002000:00010000:3.0:1763333166.874115:0:17605:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333166.874120:0:17605:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe4874b000/0xb32e3ef184c52590 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.874130:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333166.874131:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333166.874135:0:17605:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4874b000/0xb32e3ef184c52590 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.874144:0:17605:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4874b000/0xb32e3ef184c52590 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.874150:0:17605:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe4874b000/0xb32e3ef184c52590 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.874157:0:17605:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4874b000/0xb32e3ef184c52590 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.874171:0:17605:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763333166.874290:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+7:3655:x1848987627173376:12345-0@lo:6:osp-syn-0-1.0 Request processed in 202us (429us total) trans 21474838612 rc 0/0 00000100:00100000:3.0:1763333166.874297:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5912 00010000:00010000:3.0:1763333166.874313:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333166.874318:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe4874b000/0xb32e3ef184c52590 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.874326:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4874b000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333166.874329:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4874b000/0xb32e3ef184c52590 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.874336:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4874b000/0xb32e3ef184c52590 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.874377:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe4874b000/0xb32e3ef184c52590 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.874385:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4874b000/0xb32e3ef184c52590 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.874398:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333166.874400:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333166.874402:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763333166.874429:0:3655:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474838607 gen 2 00000004:00080000:3.0:1763333166.874435:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4920e300, transno 21474838595 00000004:00080000:3.0:1763333166.874443:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4920ce00, transno 21474838596 00000004:00080000:3.0:1763333166.874446:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4920fb80, transno 21474838597 00000004:00080000:3.0:1763333166.874448:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4920f800, transno 21474838598 00000004:00080000:3.0:1763333166.874451:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff6bdd9500, transno 21474838599 00000004:00080000:3.0:1763333166.874453:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff6bdda680, transno 21474838600 00000004:00080000:3.0:1763333166.874455:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff6bddb480, transno 21474838601 00000004:00080000:3.0:1763333166.874458:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff6bddb100, transno 21474838602 00000004:00080000:3.0:1763333166.874461:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff73164000, transno 21474838604 00000004:00080000:3.0:1763333166.874464:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff73164700, transno 21474838605 00000004:00080000:3.0:1763333166.874467:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7e00ca80, transno 21474838606 00000004:00080000:3.0:1763333166.874469:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7e00d880, transno 21474838607 00000100:00100000:3.0:1763333166.874475:0:3655:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff92ff7400d500 x1848987627173376/t21474838612(21474838612) o6->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1763333182 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1763333166.874484:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7400d500/2, rc 0, transno 21474838612 00000100:00100000:3.0:1763333166.874488:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7400d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627173376:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1763333166.874499:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7400c380/2, rc 0, transno 21474838611 00000100:00100000:3.0:1763333166.874502:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7400c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627173504:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1763333166.874636:0:8604:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 4 in progress, 2 in flight, 12 done 00000004:00010000:3.0:1763333166.874677:0:35317:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ae81a268 reply state 000000002e6b1fde transno 4294971666 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c5255f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x174:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 35317 initiator: MDT1 00010000:00010000:3.0:1763333166.874693:0:35317:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c5255f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x174:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35317 initiator: MDT1 00010000:00010000:3.0:1763333166.874701:0:35317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x174:0x0].0x0 (ffff92fe43b90700) 00010000:00010000:3.0:1763333166.874704:0:35317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1763333166.874708:0:35317:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763333166.874712:0:35317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x174:0x0].0x0 (ffff92fe43b90700) 00010000:00010000:3.0:1763333166.874715:0:35317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763333166.874720:0:35317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ee00/0xb32e3ef184c52328 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x174:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968283 expref: 211 pid: 6519 timeout: 0 lvb_type: 0 00010000:00080000:3.0:1763333166.874799:0:35317:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1763333166.874820:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6b3ec450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+211:56733:x1848987613423872:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 23336us (23878us total) trans 4294971666 rc 0/0 00000100:00100000:3.0:1763333166.874829:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2922 00000100:00100000:3.0:1763333166.889983:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763333166.889991:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff6bdd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627174144:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333166.890014:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1763333166.890406:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff6bdd8700/2, rc 0, transno 21474838615 00000100:00100000:3.0:1763333166.890410:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff6bdd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627174144:0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1763333166.897538:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333166.897547:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c52582 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.897556:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feb200 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333166.897561:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c52582 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.897570:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c52582 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.897594:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c52582 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.897600:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c52582 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.897620:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333166.897631:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333166.897632:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763333166.898551:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe42f0d180/2, rc 0, transno 21474838616 00000100:00100000:3.0:1763333166.898558:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42f0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627173248:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763333166.908885:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613425536 00000100:00100000:3.0:1763333166.908897:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613425536 00000100:00100000:3.0:1763333166.911039:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613425664 00000100:00100000:3.0:1763333166.911048:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613425664 00000100:00100000:3.0:1763333166.911101:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 5920 00000100:00100000:3.0:1763333166.911111:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4b885c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:55917:x1848987613425664:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333166.911126:0:8406:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333166.911148:0:8406:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4874b000/0xb32e3ef184c525ba lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696836a expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333166.911170:0:8406:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333166.911193:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333166.911195:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333166.911204:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4874b000/0xb32e3ef184c525ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696836a expref: 13 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.911220:0:8406:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe4874b000/0xb32e3ef184c525ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696836a expref: 13 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.911232:0:8406:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4874b000, rc 0) 00000100:00100000:3.0:1763333166.912082:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4b885c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:55917:x1848987613425664:12345-192.168.204.28@tcp:101:bash.0 Request processed in 971us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333166.912091:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 5920 00000100:00100000:3.0:1763333166.919125:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613426176 00000100:00100000:3.0:1763333166.919130:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613426176 00000100:00100000:3.0:1763333166.919158:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8575 00000100:00100000:3.0:1763333166.919164:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+207:56733:x1848987613426176:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333166.919180:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333166.919200:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b200/0xb32e3ef184c525c8 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968371 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333166.919273:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c525cf lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333166.919288:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c525cf lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.919299:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c525cf lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.919312:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c525d6 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333166.919319:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c525d6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.919325:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c525d6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.919463:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c525dd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x178:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333166.919472:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c525dd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x178:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.919480:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c525dd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x178:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:3.0:1763333166.919491:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x178:0x0]: returning size 2 00010000:00010000:3.0:1763333166.919554:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c525cf lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.919562:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c525cf lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.919571:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c525cf lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.919578:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c525cf lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.919584:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4874a600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333166.919589:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c525cf lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.919596:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c525cf lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.919609:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6231e400) 00010000:00010000:3.0:1763333166.919612:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333166.919617:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c525cf lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.919631:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c525cf lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.919643:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c525d6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.919651:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c525d6 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.919657:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c525d6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.919662:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46e42c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333166.919665:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c525d6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.919674:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c525d6 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.919681:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6231ec00) 00010000:00010000:3.0:1763333166.919684:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333166.919687:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c525d6 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.919692:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c525d6 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333166.938379:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333166.938386:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c52600 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x178:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333166.938393:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333166.938396:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c52600 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x178:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333166.938403:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c52600 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x178:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333166.938413:0:8422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x178:0x0].0x0 (ffff92fe43a31a00) 00010000:00010000:3.0:1763333166.938415:0:8422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763333166.938419:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c52600 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x178:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333166.938425:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c52600 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x178:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333166.938439:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333166.938441:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333166.938443:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763333167.027382:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613429760 00000100:00100000:3.0:1763333167.027391:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613429760 00000100:00100000:3.0:1763333167.027440:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2927 00000100:00100000:3.0:1763333167.027449:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+217:56739:x1848987613429760:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333167.028549:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+218:56739:x1848987613429760:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 1097us (1281us total) trans 4294971678 rc 0/0 00000100:00100000:3.0:1763333167.028558:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2927 00000100:00100000:3.0:1763333167.030619:0:32351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613429888 00000100:00100000:3.0:1763333167.030637:0:32351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613429888 00000100:00100000:3.0:1763333167.031180:0:32351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 151 00000100:00100000:3.0:1763333167.031186:0:32351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff756e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae3ba77-d588-4a44-b5f9-fbec4e33064f+9:2421:x1848987613429888:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1763333167.031212:0:32351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff756e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae3ba77-d588-4a44-b5f9-fbec4e33064f+9:2421:x1848987613429888:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 27us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333167.031218:0:32351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 151 00000100:00100000:3.0:1763333167.031788:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613430400 00000100:00100000:3.0:1763333167.031793:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613430400 00000100:00100000:3.0:1763333167.031893:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 5921 00000100:00100000:3.0:1763333167.031901:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+39:2420:x1848987613430400:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333167.031913:0:8406:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333167.031934:0:8406:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c526ee lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369683be expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333167.032058:0:8406:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x1f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333167.032077:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.032079:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.032090:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c526ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369683be expref: 40 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333167.032112:0:8406:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c526ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369683be expref: 40 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333167.032127:0:8406:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46e42c00, rc 0) 00000100:00100000:3.0:1763333167.032192:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+40:2420:x1848987613430400:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 291us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333167.032199:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 5921 00000100:00100000:3.0:1763333167.035825:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613431040 00000100:00100000:3.0:1763333167.035829:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613431040 00000100:00100000:3.0:1763333167.035939:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8587 00000100:00100000:3.0:1763333167.035956:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+220:55917:x1848987613431040:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333167.035968:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333167.035971:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763333167.035994:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c526e0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x17a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369683b7 expref: 220 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.036012:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x17a:0x0].0x0 (ffff92fe43ab5900) 00010000:00010000:3.0:1763333167.036026:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333167.036042:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c526fc lrc: 2/0,0 mode: --/CW res: [0x240000404:0x17a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369683cc expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.036115:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c52703 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x17a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333167.036132:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c52703 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x17a:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333167.036146:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c52703 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x17a:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:3.0:1763333167.036159:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x17a:0x0]: returning size 0 00010000:00010000:3.0:1763333167.036225:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c526fc lrc: 0/0,0 mode: --/CW res: [0x240000404:0x17a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369683cc expref: 222 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.036240:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c52703 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x17a:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369683cc expref: 221 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.036247:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x17a:0x0].0x0 (ffff92ff6231e600) 00010000:00010000:3.0:1763333167.036250:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:3.0:1763333167.036252:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46e42600, rc 0) 00000100:00100000:3.0:1763333167.036295:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:55917:x1848987613431040:12345-192.168.204.28@tcp:101:bash.0 Request processed in 349us (676us total) trans 4294971681 rc 0/0 00000100:00100000:3.0:1763333167.036302:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8587 00000100:00100000:3.0:1763333167.037895:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.037980:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.052322:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613432192 00000100:00100000:3.0:1763333167.052326:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613432192 00000100:00100000:3.0:1763333167.052500:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8591 00000100:00100000:3.0:1763333167.052512:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:55917:x1848987613432192:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333167.052539:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333167.052563:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c52749 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x17a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369683e1 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.052827:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c52749 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x17a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369683e1 expref: 227 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.052846:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c52749 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x17a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369683e1 expref: 227 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.052863:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x17a:0x0].0x0 (ffff92ff6231e600) 00010000:00010000:3.0:1763333167.052867:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763333167.052870:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46e43c00, rc 0) 00000100:00100000:3.0:1763333167.052892:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:55917:x1848987613432192:12345-192.168.204.28@tcp:101:bash.0 Request processed in 384us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333167.052898:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8591 00000100:00100000:3.0:1763333167.057255:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613432448 00000100:00100000:3.0:1763333167.057265:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613432448 00000100:00100000:3.0:1763333167.057329:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8592 00000100:00100000:3.0:1763333167.057340:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:55917:x1848987613432448:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333167.057432:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333167.057436:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763333167.057464:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c52749 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x17a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369683e1 expref: 227 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.057482:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x17a:0x0].0x0 (ffff92ff6231e600) 00010000:00010000:3.0:1763333167.057488:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333167.057503:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c52750 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x17a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369683e8 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.057549:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c52757 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x17a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333167.057564:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c52757 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x17a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333167.057574:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c52757 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x17a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000040:00080000:3.0:1763333167.057834:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1217, 88 off103792 00000004:00080000:3.0:1763333167.057843:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1271137493700ns, next at 1271377629108ns, rc = 0 00000040:00080000:3.0:1763333167.057867:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1216, 88 off103792 00000004:00080000:3.0:1763333167.057872:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1271137523308ns, next at 1271377657934ns, rc = 0 00000040:00080000:3.0:1763333167.057904:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1217, 88 off103880 00000004:00080000:3.0:1763333167.057909:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1271137560082ns, next at 1271377657934ns, rc = 0 00000040:00080000:3.0:1763333167.057919:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1218, 88 off103880 00000004:00080000:3.0:1763333167.057922:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1271137573450ns, next at 1271377629108ns, rc = 0 00000100:00100000:3.0:1763333167.068691:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7400ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627176192:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763333167.068719:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333167.068742:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1763333167.068748:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7400ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627176064:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763333167.068768:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333167.068783:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff74035500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627176576:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333167.068799:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333167.068824:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627176192 00000100:00100000:3.0:1763333167.068827:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627176192 00000100:00100000:3.0:1763333167.068852:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627176064 00000100:00100000:3.0:1763333167.068855:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627176064 00000100:00100000:3.0:1763333167.068870:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627176576 00000100:00100000:3.0:1763333167.068873:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627176576 00000100:00100000:3.0:1763333167.068885:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5930 00000100:00100000:3.0:1763333167.068891:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+70:3653:x1848987627176192:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763333167.068905:0:8407:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:493 count 1 00010000:00010000:3.0:1763333167.068917:0:8407:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c52781 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.068929:0:8407:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c525b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968363 expref: 39 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.068936:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333167.068937:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333167.068940:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c52781 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.073575:0:8407:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c525b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968363 expref: 39 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.073744:0:8407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c525b3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968363 expref: 39 pid: 8404 timeout: 1371 lvb_type: 0 00000100:00100000:3.0:1763333167.073755:0:8407:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4920f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8407:1848987627176832:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333167.073797:0:8407:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4869d000 going to sleep for 11 seconds 00000100:00100000:3.0:1763333167.073812:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613432576 00000100:00100000:3.0:1763333167.073816:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613432576 00010000:00010000:3.0:1763333167.073836:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c522cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968267 expref: 15 pid: 8407 timeout: 1371 lvb_type: 0 00000100:00100000:3.0:1763333167.073865:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613432832 00000100:00100000:3.0:1763333167.073869:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613432832 00010000:00010000:3.0:1763333167.073880:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4874b000/0xb32e3ef184c525ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696836a expref: 16 pid: 8406 timeout: 1371 lvb_type: 0 00000100:00100000:3.0:1763333167.073900:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613432704 00000100:00100000:3.0:1763333167.073902:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613432704 00010000:00010000:3.0:1763333167.073913:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4874aa00/0xb32e3ef184c524d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968316 expref: 17 pid: 8404 timeout: 1371 lvb_type: 0 00000100:00100000:3.0:1763333167.073923:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2811 00000100:00100000:3.0:1763333167.073928:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44a61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2418:x1848987613432576:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333167.073938:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333167.073942:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c522cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968267 expref: 17 pid: 8407 timeout: 1371 lvb_type: 0 00010000:00010000:3.0:1763333167.074269:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c522cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968267 expref: 17 pid: 8407 timeout: 1371 lvb_type: 0 00010000:00010000:3.0:1763333167.074290:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c522cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968267 expref: 17 pid: 8407 timeout: 1371 lvb_type: 0 00010000:00010000:3.0:1763333167.074303:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.074305:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.074309:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c52765 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.074318:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c52765 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.074343:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333167.074417:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44a61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2418:x1848987613432576:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 487us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333167.074426:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2811 00000100:00100000:3.0:1763333167.074446:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2812 00000100:00100000:3.0:1763333167.074455:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff800d8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2418:x1848987613432832:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333167.074466:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333167.074471:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe4874b000/0xb32e3ef184c525ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696836a expref: 15 pid: 8406 timeout: 1371 lvb_type: 0 00010000:00010000:3.0:1763333167.074478:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe4874b000/0xb32e3ef184c525ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696836a expref: 15 pid: 8406 timeout: 1371 lvb_type: 0 00010000:00010000:3.0:1763333167.074492:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4874b000/0xb32e3ef184c525ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696836a expref: 15 pid: 8406 timeout: 1371 lvb_type: 0 00010000:00010000:3.0:1763333167.074502:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.074503:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.074507:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c52773 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.074513:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c52773 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.074534:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333167.074551:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff800d8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2418:x1848987613432832:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 99us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333167.074558:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2812 00000100:00100000:3.0:1763333167.074602:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2813 00000100:00100000:3.0:1763333167.074609:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44a60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2418:x1848987613432704:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333167.074616:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333167.074631:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe4874aa00/0xb32e3ef184c524d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968316 expref: 13 pid: 8404 timeout: 1371 lvb_type: 0 00010000:00010000:3.0:1763333167.074640:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe4874aa00/0xb32e3ef184c524d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968316 expref: 13 pid: 8404 timeout: 1371 lvb_type: 0 00010000:00010000:3.0:1763333167.074653:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4874aa00/0xb32e3ef184c524d3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968316 expref: 13 pid: 8404 timeout: 1371 lvb_type: 0 00010000:00010000:3.0:1763333167.079785:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.079790:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.079799:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5000/0xb32e3ef184c5276c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.079810:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5000/0xb32e3ef184c5276c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.079855:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333167.079913:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44a60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:2418:x1848987613432704:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 5304us (6465us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333167.079920:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2813 00000100:00100000:3.0:1763333167.081186:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613433216 00000100:00100000:3.0:1763333167.081198:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613433216 00010000:00010000:3.0:1763333167.081240:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c52535 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968339 expref: 40 pid: 28600 timeout: 1371 lvb_type: 0 00000100:00100000:3.0:1763333167.081278:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613433344 00000100:00100000:3.0:1763333167.081282:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613433344 00010000:00010000:3.0:1763333167.081293:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42febe00/0xb32e3ef184c524ef lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968324 expref: 41 pid: 28600 timeout: 1371 lvb_type: 0 00000100:00100000:3.0:1763333167.081304:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613433600 00000100:00100000:3.0:1763333167.081307:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613433600 00010000:00010000:3.0:1763333167.081317:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c525b3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968363 expref: 42 pid: 8404 timeout: 1371 lvb_type: 0 00000100:00100000:3.0:1763333167.081331:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2814 00000100:00100000:3.0:1763333167.081339:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+42:2421:x1848987613433216:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333167.081383:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333167.081389:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c52535 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x1e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968339 expref: 42 pid: 28600 timeout: 1371 lvb_type: 0 00010000:00010000:3.0:1763333167.081401:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c52535 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968339 expref: 42 pid: 28600 timeout: 1371 lvb_type: 0 00010000:00010000:3.0:1763333167.081423:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.081425:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.081429:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb000/0xb32e3ef184c5277a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.081438:0:28428:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb000/0xb32e3ef184c5277a lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x1e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.081459:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333167.081503:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+42:2421:x1848987613433216:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 163us (1258us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333167.081511:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2814 00000100:00100000:3.0:1763333167.081526:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2815 00000100:00100000:3.0:1763333167.081532:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+41:2421:x1848987613433344:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333167.081540:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333167.081545:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe42febe00/0xb32e3ef184c524ef lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968324 expref: 41 pid: 28600 timeout: 1371 lvb_type: 0 00010000:00010000:3.0:1763333167.081553:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe42febe00/0xb32e3ef184c524ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968324 expref: 41 pid: 28600 timeout: 1371 lvb_type: 0 00010000:00010000:3.0:1763333167.081565:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe42febe00/0xb32e3ef184c524ef lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x1ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968324 expref: 41 pid: 28600 timeout: 1371 lvb_type: 0 00010000:00010000:3.0:1763333167.081575:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.081577:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.081580:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe42febc00/0xb32e3ef184c52788 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.081587:0:28428:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42febc00/0xb32e3ef184c52788 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.081602:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333167.081631:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+40:2421:x1848987613433344:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 88us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333167.081637:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2815 00000100:00100000:3.0:1763333167.081649:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2816 00000100:00100000:3.0:1763333167.081654:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+39:2420:x1848987613433600:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333167.081662:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333167.081666:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c525b3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968363 expref: 39 pid: 8404 timeout: 1371 lvb_type: 0 00010000:00010000:3.0:1763333167.081675:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c525b3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968363 expref: 39 pid: 8404 timeout: 1371 lvb_type: 0 00010000:00010000:3.0:1763333167.081685:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.081686:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.081689:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c52781 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.081696:0:28428:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c52781 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.081706:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333167.081723:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+39:2420:x1848987613433600:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 69us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333167.081728:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2816 00000100:00100000:3.0:1763333167.081756:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613433472 00000100:00100000:3.0:1763333167.081759:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613433472 00000100:00100000:3.0:1763333167.081776:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 5935 00000100:00100000:3.0:1763333167.081781:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:55917:x1848987613433472:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333167.081795:0:28600:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333167.081811:0:28600:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff4139a000/0xb32e3ef184c527b9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369683f6 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333167.081830:0:28600:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333167.081844:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.081846:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.081853:0:28600:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff4139a000/0xb32e3ef184c527b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369683f6 expref: 13 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.081864:0:28600:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92ff4139a000/0xb32e3ef184c527b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369683f6 expref: 13 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.081875:0:28600:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff4139a000, rc 0) 00000100:00100000:3.0:1763333167.081892:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:55917:x1848987613433472:12345-192.168.204.28@tcp:101:bash.0 Request processed in 111us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333167.081898:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 5935 00010000:00010000:3.0:1763333167.081922:0:8611:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c52773 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.081929:0:8611:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c52773 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.081938:0:8611:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c52773 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.081946:0:8611:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c52773 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.081961:0:8611:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763333167.082091:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5922b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+17:3654:x1848987627174912:12345-0@lo:6:osp-syn-0-1.0 Request processed in 19541us (20641us total) trans 21474838622 rc 0/0 00000100:00100000:3.0:1763333167.082098:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5928 00010000:00010000:3.0:1763333167.082115:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333167.082119:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c52773 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.082126:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5c00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333167.082129:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c52773 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.082136:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c52773 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.082146:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c52773 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.082153:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c52773 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.082164:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333167.082166:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333167.082167:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333167.082176:0:28650:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe42febc00/0xb32e3ef184c52788 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.082188:0:28650:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe42febc00/0xb32e3ef184c52788 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.082195:0:28650:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe42febc00/0xb32e3ef184c52788 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.082201:0:28650:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42febc00/0xb32e3ef184c52788 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.082215:0:28650:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763333167.082389:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+73:3653:x1848987627176064:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9952us (13619us total) trans 17179871318 rc 0/0 00000100:00100000:3.0:1763333167.082397:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5931 00010000:00010000:3.0:1763333167.082414:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333167.082419:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe42febc00/0xb32e3ef184c52788 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.082427:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42febc00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333167.082431:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe42febc00/0xb32e3ef184c52788 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.082437:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe42febc00/0xb32e3ef184c52788 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.082448:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe42febc00/0xb32e3ef184c52788 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.082459:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe42febc00/0xb32e3ef184c52788 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.082472:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333167.082474:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333167.082476:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333167.082486:0:8404:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c52765 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.082494:0:8404:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c52765 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.082502:0:8404:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c52765 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.082510:0:8404:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c52765 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.082534:0:8404:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763333167.082654:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+17:3652:x1848987627174656:12345-0@lo:6:osp-syn-0-1.0 Request processed in 20651us (21359us total) trans 21474838623 rc 0/0 00000100:00100000:3.0:1763333167.082661:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5924 00010000:00010000:3.0:1763333167.082821:0:8407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c525b3 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968363 expref: 38 pid: 8404 timeout: 1371 lvb_type: 0 00000100:00100000:3.0:1763333167.082832:0:8407:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4920f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8407:1848987627176832:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333167.082849:0:8407:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c52781 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.082858:0:8407:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c52781 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.082864:0:8407:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c52781 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.082872:0:8407:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c52781 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.082879:0:8407:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c52781 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.082892:0:8407:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763333167.082988:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+73:3653:x1848987627176192:12345-0@lo:6:osp-syn-1-1.0 Request processed in 14096us (14268us total) trans 17179871319 rc 0/0 00000100:00100000:3.0:1763333167.082995:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5930 00010000:00010000:3.0:1763333167.083010:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333167.087244:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333167.087255:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb000/0xb32e3ef184c5277a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.087266:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feb000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333167.087271:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb000/0xb32e3ef184c5277a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.087287:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb000/0xb32e3ef184c5277a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.087309:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb000/0xb32e3ef184c5277a lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.087315:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb000/0xb32e3ef184c5277a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.087335:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333167.087337:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333167.087339:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763333167.094858:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613434112 00000100:00100000:3.0:1763333167.094875:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613434112 00002000:00010000:3.0:1763333167.094926:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/495 (0->18446744073709551615) 00002000:00100000:3.0:1763333167.094932:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe44e1aa00 with x1848987613434112 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333167.094946:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe44e1aa00. 00000100:00100000:3.0:1763333167.095437:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613434240 00000100:00100000:3.0:1763333167.095440:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613434240 00002000:00010000:3.0:1763333167.095455:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/495 (0->18446744073709551615) 00002000:00100000:3.0:1763333167.095458:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe44e1b800 with x1848987613434240 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333167.095466:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe44e1b800. 00000100:00100000:3.0:1763333167.095480:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1492 00000100:00100000:3.0:1763333167.095486:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2420:x1848987613434112:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:3.0:1763333167.095788:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x1ef:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333167.095791:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x1ef:0x0] updating lvb mtime from disk: 0 -> 1763333167 00002000:00010000:3.0:1763333167.095794:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x1ef:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333167.095796:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x1ef:0x0] updating lvb ctime from disk: 0 -> 1763333167 00002000:00010000:3.0:1763333167.095799:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1ef:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333167.096017:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2420:x1848987613434112:12345-192.168.204.28@tcp:10:bash.0 Request processed in 529us (1222us total) trans 21474838624 rc 0/0 00000100:00100000:3.0:1763333167.096024:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1492 00002000:00010000:3.0:1763333167.096027:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/495 (0->18446744073709551615) 00002000:00100000:3.0:1763333167.096029:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe44e1aa00 with x1848987613434112 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333167.096034:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe44e1aa00. 00000100:00100000:3.0:1763333167.115431:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.121098:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.128672:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613435136 00000100:00100000:3.0:1763333167.128683:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613435136 00002000:00100000:3.0:1763333167.128741:0:28426:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1ef:0x0] (0->4) req@ffff92fe44e19880 x1848987613435136/t0(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:478/0 lens 496/0 e 0 to 0 dl 1763333178 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763333167.128753:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe44e19880 with x1848987613435136 ext(0->4) 00010000:00010000:3.0:1763333167.128762:0:28426:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff92ff4139a000/0xb32e3ef184c527b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369683f6 expref: 15 pid: 28600 timeout: 1371 lvb_type: 0 00010000:00010000:3.0:1763333167.128780:0:28426:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff92ff4139a000/0xb32e3ef184c527b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369683f6 expref: 15 pid: 28600 timeout: 1371 lvb_type: 0 00002000:00010000:3.0:1763333167.128789:0:28426:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff92fe44e19880 00000100:00100000:3.0:1763333167.129441:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 94 00000100:00100000:3.0:1763333167.129456:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2420:x1848987613435136:12345-192.168.204.28@tcp:4:bash.0 00000100:00100000:3.0:1763333167.130380:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2420:x1848987613435136:12345-192.168.204.28@tcp:4:bash.0 Request processed in 924us (1824us total) trans 21474838625 rc 0/0 00000100:00100000:3.0:1763333167.130391:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 94 00002000:00100000:3.0:1763333167.130402:0:28426:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1ef:0x0] (0->4) req@ffff92fe44e19880 x1848987613435136/t21474838625(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:478/0 lens 496/448 e 0 to 0 dl 1763333178 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763333167.130411:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe44e19880 with x1848987613435136 ext(0->4) 00010000:00010000:3.0:1763333167.130420:0:28426:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff92ff4139a000/0xb32e3ef184c527b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369683f6 expref: 17 pid: 28600 timeout: 1371 lvb_type: 0 00010000:00010000:3.0:1763333167.130434:0:28426:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff92ff4139a000/0xb32e3ef184c527b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369683f6 expref: 17 pid: 28600 timeout: 1371 lvb_type: 0 00002000:00010000:3.0:1763333167.130442:0:28426:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff92fe44e19880 00000100:00100000:3.0:1763333167.130998:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:3.0:1763333167.146140:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c52830 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x17a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333167.146149:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c52830 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x17a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333167.146156:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c52830 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x17a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333167.146161:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333167.146166:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c52830 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x17a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333167.146173:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c52830 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x17a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333167.146184:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x17a:0x0].0x0 (ffff92ff6231e600) 00010000:00010000:3.0:1763333167.146187:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763333167.146190:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c52830 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x17a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333167.146196:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c52830 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x17a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000100:00100000:3.0:1763333167.154084:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.154143:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.159179:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.159228:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.166069:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613437056 00000100:00100000:3.0:1763333167.166078:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613437056 00010000:00010000:3.0:1763333167.166123:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5800/0xb32e3ef184c5287d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x17b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968435 expref: 212 pid: 6519 timeout: 1371 lvb_type: 0 00000100:00100000:3.0:1763333167.166486:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2818 00000100:00100000:3.0:1763333167.166501:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e120e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+212:2420:x1848987613437056:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333167.166521:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333167.166531:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5800/0xb32e3ef184c5287d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x17b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968435 expref: 212 pid: 6519 timeout: 1371 lvb_type: 0 00010000:00010000:3.0:1763333167.166546:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5800/0xb32e3ef184c5287d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x17b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968435 expref: 212 pid: 6519 timeout: 1371 lvb_type: 0 00010000:00010000:3.0:1763333167.166576:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5800/0xb32e3ef184c5287d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x17b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968435 expref: 212 pid: 6519 timeout: 1371 lvb_type: 0 00010000:00010000:3.0:1763333167.166600:0:8423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x17b:0x0].0x0 (ffff92ff61a46a00) 00010000:00010000:3.0:1763333167.166606:0:8423:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c52892 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x17b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.166628:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c52892 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x17b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.166638:0:8423:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c52892 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x17b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.166667:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333167.166739:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e120e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+211:2420:x1848987613437056:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 241us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333167.166748:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2818 00000100:00100000:3.0:1763333167.178151:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000001:00080000:3.0:1763333167.224245:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294971699 is committed 00000004:00080000:3.0:1763333167.224260:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 799 committed 00000004:00080000:3.0:1763333167.224279:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 802 committed 00000004:00080000:3.0:1763333167.224293:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 801 committed 00000004:00080000:3.0:1763333167.224295:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 798 committed 00000100:00100000:3.0:1763333167.224805:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe438aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627178112:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333167.224833:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333167.225134:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627178240 00000100:00100000:3.0:1763333167.225138:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627178240 00000100:00100000:3.0:1763333167.225706:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5946 00000100:00100000:3.0:1763333167.225719:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+21:3654:x1848987627178112:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333167.225887:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+22:3654:x1848987627178112:12345-0@lo:2:osp-syn-0-1.0 Request processed in 173us (1052us total) trans 21474838629 rc 0/0 00000100:00100000:3.0:1763333167.225895:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5946 00000100:00100000:3.0:1763333167.225912:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5947 00000100:00100000:3.0:1763333167.225923:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+77:3653:x1848987627178368:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333167.226040:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+78:3653:x1848987627178368:12345-0@lo:2:osp-syn-1-1.0 Request processed in 121us (1076us total) trans 17179871325 rc 0/0 00000100:00100000:3.0:1763333167.226046:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5947 00000100:00100000:3.0:1763333167.226059:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5948 00000100:00100000:3.0:1763333167.226065:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+77:3654:x1848987627178240:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333167.226125:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+78:3654:x1848987627178240:12345-0@lo:2:osp-syn-1-1.0 Request processed in 60us (1109us total) trans 17179871326 rc 0/0 00000100:00100000:3.0:1763333167.226131:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5948 00000004:00080000:3.0:1763333167.226179:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44a61f80/2, rc 0, transno 17179871325 00000100:00100000:3.0:1763333167.226185:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44a61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627178368:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333167.239741:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.239776:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.239801:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613439232 00000100:00100000:3.0:1763333167.239809:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613439232 00000100:00100000:3.0:1763333167.239851:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 5952 00000100:00100000:3.0:1763333167.239859:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:55917:x1848987613439232:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333167.239878:0:29013:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333167.239898:0:29013:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46e42600/0xb32e3ef184c528fb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968474 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333167.239921:0:29013:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333167.239945:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.239947:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.239956:0:29013:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46e42600/0xb32e3ef184c528fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968474 expref: 17 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.239976:0:29013:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe46e42600/0xb32e3ef184c528fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968474 expref: 17 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.239989:0:29013:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46e42600, rc 0) 00000100:00100000:3.0:1763333167.240050:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:55917:x1848987613439232:12345-192.168.204.28@tcp:101:bash.0 Request processed in 190us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333167.240057:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 5952 00000100:00100000:3.0:1763333167.245501:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613439360 00000100:00100000:3.0:1763333167.245513:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613439360 00002000:00010000:3.0:1763333167.245813:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/497 (0->18446744073709551615) 00002000:00100000:3.0:1763333167.245819:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe44e05500 with x1848987613439360 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333167.245832:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe44e05500. 00000100:00100000:3.0:1763333167.245863:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1495 00000100:00100000:3.0:1763333167.245872:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+40:2420:x1848987613439360:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:3.0:1763333167.246022:0:28427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x1f1:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333167.246026:0:28427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x1f1:0x0] updating lvb mtime from disk: 0 -> 1763333167 00002000:00010000:3.0:1763333167.246029:0:28427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x1f1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333167.246031:0:28427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x1f1:0x0] updating lvb ctime from disk: 0 -> 1763333167 00002000:00010000:3.0:1763333167.246034:0:28427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x1f1:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333167.246512:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+41:2420:x1848987613439360:12345-192.168.204.28@tcp:10:bash.0 Request processed in 639us (1318us total) trans 17179871327 rc 0/0 00000100:00100000:3.0:1763333167.246520:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1495 00002000:00010000:3.0:1763333167.246525:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/497 (0->18446744073709551615) 00002000:00100000:3.0:1763333167.246527:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe44e05500 with x1848987613439360 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333167.246533:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe44e05500. 00000100:00100000:3.0:1763333167.266243:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613440128 00000100:00100000:3.0:1763333167.266252:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613440128 00010000:00010000:3.0:1763333167.266286:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c526ee lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369683be expref: 42 pid: 8406 timeout: 1371 lvb_type: 1 00000100:00100000:3.0:1763333167.266325:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2819 00000100:00100000:3.0:1763333167.266334:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff800d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+42:2421:x1848987613440128:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333167.266368:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333167.266389:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c526ee lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369683be expref: 42 pid: 8406 timeout: 1371 lvb_type: 1 00010000:00010000:3.0:1763333167.266402:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c526ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369683be expref: 42 pid: 8406 timeout: 1371 lvb_type: 1 00010000:00010000:3.0:1763333167.266425:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c526ee lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x1f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369683be expref: 42 pid: 8406 timeout: 1371 lvb_type: 1 00010000:00010000:3.0:1763333167.266444:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.266446:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.266451:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c52917 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.266460:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c52917 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.266491:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333167.266548:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff800d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+41:2421:x1848987613440128:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 215us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333167.266557:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2819 00010000:00010000:3.0:1763333167.286738:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333167.286745:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5294f lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x17b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333167.286820:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f200 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333167.286825:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5294f lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x17b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333167.286837:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5294f lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x17b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333167.286847:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x17b:0x0].0x0 (ffff92fe438a1500) 00010000:00010000:3.0:1763333167.286850:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763333167.286853:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5294f lrc: 1/0,0 mode: --/PW res: [0x240000404:0x17b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333167.286859:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5294f lrc: 0/0,0 mode: --/PW res: [0x240000404:0x17b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT1 00000100:00100000:3.0:1763333167.299443:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.302217:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613441152 00000100:00100000:3.0:1763333167.302226:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613441152 00000100:00100000:3.0:1763333167.302284:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 5954 00000100:00100000:3.0:1763333167.302292:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49608e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:56742:x1848987613441152:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333167.302307:0:29013:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333167.302323:0:29013:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46e42c00/0xb32e3ef184c52979 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968497 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.302388:0:29013:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c526f5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369683c5 expref: 19 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333167.302397:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.302399:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.302404:0:29013:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46e42c00/0xb32e3ef184c52979 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968497 expref: 19 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.302435:0:29013:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c526f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369683c5 expref: 19 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333167.302448:0:29013:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c526f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369683c5 expref: 19 pid: 8404 timeout: 1371 lvb_type: 1 00000100:00100000:3.0:1763333167.302460:0:29013:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46e2f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29013:1848987627178624:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333167.302651:0:29013:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4869d000 going to sleep for 11 seconds 00000100:00100000:3.0:1763333167.305970:0:29013:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46e2f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29013:1848987627178624:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333167.306004:0:29013:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe46e42c00/0xb32e3ef184c52979 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968497 expref: 20 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.306027:0:29013:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46e42c00, rc 0) 00000100:00100000:3.0:1763333167.306087:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49608e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:56742:x1848987613441152:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 3795us (3989us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333167.306095:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 5954 00000100:00100000:3.0:1763333167.307205:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.309757:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.309837:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.311425:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.314191:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.317016:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.318774:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.321267:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.321705:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.326898:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5962 00000100:00100000:3.0:1763333167.326907:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e059450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+25:3654:x1848987627179392:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1763333167.327041:0:8404:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x1ef:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1763333167.327044:0:8404:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x1ef:0x0] updating lvb mtime from disk: 1763333167 -> 1763333167 00002000:00010000:3.0:1763333167.327047:0:8404:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x1ef:0x0] updating lvb atime from disk: 1763333167 -> 1763333167 00002000:00010000:3.0:1763333167.327049:0:8404:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x1ef:0x0] updating lvb ctime from disk: 1763333167 -> 1763333167 00002000:00010000:3.0:1763333167.327052:0:8404:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1ef:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763333167.327077:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e059450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+26:3654:x1848987627179392:12345-0@lo:2:osp-syn-0-1.0 Request processed in 173us (1795us total) trans 21474838636 rc 0/0 00000100:00100000:3.0:1763333167.327084:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5962 00000004:00080000:3.0:1763333167.328030:0:9836:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 4 in progress, 1 in flight, 72 done 00000100:00100000:3.0:1763333167.330155:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613443584 00000100:00100000:3.0:1763333167.330160:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613443584 00000100:00100000:3.0:1763333167.330189:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2937 00000100:00100000:3.0:1763333167.330195:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+206:56746:x1848987613443584:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333167.330492:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+207:56746:x1848987613443584:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 296us (482us total) trans 4294971707 rc 0/0 00000100:00100000:3.0:1763333167.330498:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2937 00000100:00100000:3.0:1763333167.331994:0:28651:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46268000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28651:1848987627180160:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333167.332010:0:28651:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c529fe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333167.334071:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613443968 00000100:00100000:3.0:1763333167.334081:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613443968 00010000:00010000:3.0:1763333167.334120:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c528f4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696846d expref: 15 pid: 8407 timeout: 1371 lvb_type: 0 00000100:00100000:3.0:1763333167.334164:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2823 00000100:00100000:3.0:1763333167.334175:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44a61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2419:x1848987613443968:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333167.334192:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333167.334198:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c528f4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696846d expref: 15 pid: 8407 timeout: 1371 lvb_type: 0 00010000:00010000:3.0:1763333167.334212:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c528f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696846d expref: 15 pid: 8407 timeout: 1371 lvb_type: 0 00010000:00010000:3.0:1763333167.334237:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c528f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x1f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696846d expref: 15 pid: 8407 timeout: 1371 lvb_type: 0 00010000:00010000:3.0:1763333167.334254:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.334256:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.334261:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c52a05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.334271:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c52a05 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.334314:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333167.334398:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44a61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2419:x1848987613443968:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 224us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333167.334405:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2823 00010000:00010000:3.0:1763333167.337165:0:28651:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c529fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.337178:0:28651:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c529fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.337190:0:28651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c529fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.337198:0:28651:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c529fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.337451:0:28651:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763333167.338283:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46268700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+26:3653:x1848987627179136:12345-0@lo:6:osp-syn-0-1.0 Request processed in 12827us (13497us total) trans 21474838637 rc 0/0 00000100:00100000:3.0:1763333167.338293:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5956 00000100:00100000:3.0:1763333167.357601:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.366292:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613445376 00000100:00100000:3.0:1763333167.366297:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613445376 00010000:00010000:3.0:1763333167.366320:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c52a52 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x17d:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369684cf expref: 215 pid: 6519 timeout: 1371 lvb_type: 0 00000100:00100000:3.0:1763333167.366376:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2825 00000100:00100000:3.0:1763333167.366384:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45181c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+215:2421:x1848987613445376:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333167.366394:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333167.366400:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c52a52 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x17d:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369684cf expref: 215 pid: 6519 timeout: 1371 lvb_type: 0 00010000:00010000:3.0:1763333167.366412:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c52a52 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x17d:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369684cf expref: 215 pid: 6519 timeout: 1371 lvb_type: 0 00010000:00010000:3.0:1763333167.366428:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c52a52 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x17d:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369684cf expref: 215 pid: 6519 timeout: 1371 lvb_type: 0 00010000:00010000:3.0:1763333167.366440:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x17d:0x0].0x0 (ffff92fe438a1c00) 00010000:00010000:3.0:1763333167.366445:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c52a67 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x17d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.366454:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c52a67 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x17d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.366461:0:6505:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c52a67 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x17d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.366481:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333167.366507:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45181c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+214:2421:x1848987613445376:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 125us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333167.366515:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2825 00000100:00100000:3.0:1763333167.371906:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613445760 00000100:00100000:3.0:1763333167.371914:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613445760 00000100:00100000:3.0:1763333167.371961:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8628 00000100:00100000:3.0:1763333167.371969:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4b887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+215:56742:x1848987613445760:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333167.371983:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333167.371999:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c52a83 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x17d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369684e4 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.372047:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c52a83 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x17d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369684e4 expref: 216 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.372061:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c52a83 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x17d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369684e4 expref: 216 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.372078:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x17d:0x0].0x0 (ffff92fe438a1c00) 00010000:00010000:3.0:1763333167.372081:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763333167.372084:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe44d75200, rc 0) 00000100:00100000:3.0:1763333167.372134:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4b887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+216:56742:x1848987613445760:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 165us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333167.372142:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8628 00000100:00100000:3.0:1763333167.376969:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613445888 00000100:00100000:3.0:1763333167.376978:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613445888 00000100:00100000:3.0:1763333167.377048:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 5964 00000100:00100000:3.0:1763333167.377057:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2420:x1848987613445888:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333167.377075:0:28651:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333167.377094:0:28651:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe44d75400/0xb32e3ef184c52a8a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369684eb expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333167.377118:0:28651:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333167.377136:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.377138:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.377149:0:28651:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe44d75400/0xb32e3ef184c52a8a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369684eb expref: 20 pid: 28651 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333167.377164:0:28651:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe44d75400/0xb32e3ef184c52a8a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369684eb expref: 20 pid: 28651 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333167.377176:0:28651:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe44d75400, rc 0) 00000100:00100000:3.0:1763333167.377223:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2420:x1848987613445888:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 167us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333167.377229:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 5964 00000100:00100000:3.0:1763333167.391532:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5968 00000100:00100000:3.0:1763333167.391541:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4626a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+12:3654:x1848987627180928:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333167.391655:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4626a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+13:3654:x1848987627180928:12345-0@lo:2:osp-syn-1-1.0 Request processed in 115us (1451us total) trans 17179871335 rc 0/0 00000100:00100000:3.0:1763333167.391661:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5968 00000100:00100000:3.0:1763333167.400138:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.400189:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.403888:0:28600:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff6bdda680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28600:1848987627181312:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333167.403924:0:28600:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c52aa6 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.409856:0:29013:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c52aad lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.409880:0:29013:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c52aad lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.409894:0:29013:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c52aad lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.409908:0:29013:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c52aad lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.409951:0:29013:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763333167.412026:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.412064:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.412091:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.412112:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.412134:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.412165:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613446912 00000100:00100000:3.0:1763333167.412174:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613446912 00010000:00010000:3.0:1763333167.412218:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c527c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369683fd expref: 13 pid: 29010 timeout: 1371 lvb_type: 0 00000100:00100000:3.0:1763333167.412258:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613447168 00000100:00100000:3.0:1763333167.412261:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613447168 00010000:00010000:3.0:1763333167.412276:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42febe00/0xb32e3ef184c52899 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968443 expref: 20 pid: 29010 timeout: 1371 lvb_type: 1 00000100:00100000:3.0:1763333167.412293:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613447040 00000100:00100000:3.0:1763333167.412295:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613447040 00010000:00010000:3.0:1763333167.412306:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46e42c00/0xb32e3ef184c52979 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968497 expref: 21 pid: 29013 timeout: 1371 lvb_type: 0 00000100:00100000:3.0:1763333167.412320:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2828 00000100:00100000:3.0:1763333167.412330:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e122680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2421:x1848987613446912:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333167.412379:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333167.412385:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c527c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369683fd expref: 13 pid: 29010 timeout: 1371 lvb_type: 0 00010000:00010000:3.0:1763333167.412398:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c527c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369683fd expref: 13 pid: 29010 timeout: 1371 lvb_type: 0 00010000:00010000:3.0:1763333167.412423:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c527c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369683fd expref: 13 pid: 29010 timeout: 1371 lvb_type: 0 00010000:00010000:3.0:1763333167.412439:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.412441:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.412447:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c52aa6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.412457:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c52aa6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.412483:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333167.412533:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e122680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:2421:x1848987613446912:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 204us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333167.412541:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2828 00000100:00100000:3.0:1763333167.412559:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2829 00000100:00100000:3.0:1763333167.412565:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e121500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2421:x1848987613447168:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333167.412573:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333167.412578:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe42febe00/0xb32e3ef184c52899 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968443 expref: 21 pid: 29010 timeout: 1371 lvb_type: 1 00010000:00010000:3.0:1763333167.412593:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe42febe00/0xb32e3ef184c52899 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968443 expref: 21 pid: 29010 timeout: 1371 lvb_type: 1 00010000:00010000:3.0:1763333167.412608:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.412609:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.412612:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5400/0xb32e3ef184c52abb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.412632:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5400/0xb32e3ef184c52abb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.412644:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333167.412662:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e121500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2421:x1848987613447168:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 97us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333167.412668:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2829 00000100:00100000:3.0:1763333167.412680:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2830 00000100:00100000:3.0:1763333167.412686:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e123800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2421:x1848987613447040:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333167.412695:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333167.412700:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe46e42c00/0xb32e3ef184c52979 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968497 expref: 20 pid: 29013 timeout: 1371 lvb_type: 0 00010000:00010000:3.0:1763333167.412709:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe46e42c00/0xb32e3ef184c52979 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968497 expref: 20 pid: 29013 timeout: 1371 lvb_type: 0 00010000:00010000:3.0:1763333167.412721:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.412722:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.412726:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5600/0xb32e3ef184c52ab4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.412733:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5600/0xb32e3ef184c52ab4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.412744:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333167.412763:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e123800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2421:x1848987613447040:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 77us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333167.412769:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2830 00010000:00010000:3.0:1763333167.412799:0:28600:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c52aa6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.412808:0:28600:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c52aa6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.412819:0:28600:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c52aa6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.412826:0:28600:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c52aa6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.412844:0:28600:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763333167.413057:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4626b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+13:3652:x1848987627180672:12345-0@lo:6:osp-syn-1-1.0 Request processed in 22054us (22935us total) trans 17179871337 rc 0/0 00000100:00100000:3.0:1763333167.413065:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5966 00010000:00010000:3.0:1763333167.413087:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333167.413094:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c52aa6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.413102:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feb200 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333167.413106:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c52aa6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.413115:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c52aa6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.413127:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c52aa6 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.413134:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c52aa6 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.413150:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333167.413152:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333167.413154:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763333167.413187:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff77c6ca80/2, rc 0, transno 17179871337 00000100:00100000:3.0:1763333167.413194:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77c6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627180672:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1763333167.414459:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1763333167.414466:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5600/0xb32e3ef184c52ab4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.414474:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5600 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333167.414477:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5600/0xb32e3ef184c52ab4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.414489:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5600/0xb32e3ef184c52ab4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.414504:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5600/0xb32e3ef184c52ab4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.414511:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5600/0xb32e3ef184c52ab4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.414531:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333167.414534:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5400/0xb32e3ef184c52abb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.414540:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333167.414543:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5400/0xb32e3ef184c52abb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.414550:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5400/0xb32e3ef184c52abb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.414558:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5400/0xb32e3ef184c52abb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.414565:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5400/0xb32e3ef184c52abb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.414585:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333167.414588:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333167.414590:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763333167.440800:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.451217:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613448576 00000100:00100000:3.0:1763333167.451237:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613448576 00000100:00100000:3.0:1763333167.464325:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.480144:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.483865:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613449984 00000100:00100000:3.0:1763333167.483873:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613449984 00000100:00100000:3.0:1763333167.483926:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8634 00000100:00100000:3.0:1763333167.483940:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:56748:x1848987613449984:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:3.0:1763333167.484105:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:3.0:1763333167.484123:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c52afa lrc: 0/0,0 mode: --/CR res: [0x240000404:0x17d:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968515 expref: 218 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.484139:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c52a98 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x17d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369684f2 expref: 217 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.484151:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4e00/0xb32e3ef184c52a9f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x17d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369684f9 expref: 216 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.484159:0:6521:0:(ldlm_lockd.c:1753:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie b32e3ef184c52ade) 00010000:00010000:3.0:1763333167.484254:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c52a75 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x17d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369684dd expref: 215 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.484265:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x17d:0x0].0x0 (ffff92fe438a1c00) 00010000:00010000:3.0:1763333167.484269:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333167.484294:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c52b1d lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333167.484302:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c52b1d lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.484309:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c52b1d lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.484322:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c52b24 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333167.484328:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c52b24 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.484334:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c52b24 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.484591:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c52b2b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x17d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333167.484602:0:6521:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e200/0xb32e3ef184c52b0f lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x17d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696851c expref: 214 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.484610:0:6521:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c52b2b lrc: 4/0,1 mode: --/EX res: [0x240000404:0x17d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.484652:0:6521:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e200/0xb32e3ef184c52b0f lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x17d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696851c expref: 214 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.484666:0:6521:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e200/0xb32e3ef184c52b0f lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x17d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696851c expref: 214 pid: 6519 timeout: 1371 lvb_type: 0 00000100:00100000:3.0:1763333167.484686:0:6521:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4960b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6521:1848987627182720:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333167.484834:0:6521:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4869d480 going to sleep for 11 seconds 00000100:00100000:3.0:1763333167.488333:0:6521:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4960b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6521:1848987627182720:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333167.488377:0:6521:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c52b2b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x17d:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.489420:0:6521:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c52b2b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x17d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.489428:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c52b2b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x17d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT1 00000004:00080000:3.0:1763333167.489705:0:6521:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x17d:0x0] is inserted into orphan list, open count = 1 00010000:00010000:3.0:1763333167.489802:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c52b2b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x17d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.489811:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c52b2b lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x17d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.489818:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c52b2b lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x17d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.489823:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46e43c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333167.489827:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c52b2b lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x17d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.489833:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c52b2b lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x17d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.489843:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x17d:0x0].0x0 (ffff92fe438a1c00) 00010000:00010000:3.0:1763333167.489848:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1763333167.489851:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c52b39 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x17d:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333167.489857:0:6521:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c52b39 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333167.489862:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c52b39 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333167.491651:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c52b2b lrc: 2/0,0 mode: --/EX res: [0x240000404:0x17d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.491664:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c52b2b lrc: 0/0,0 mode: --/EX res: [0x240000404:0x17d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.491686:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c52b1d lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.491692:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c52b1d lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.491698:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c52b1d lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.491704:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c52b1d lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.491709:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46e42600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333167.491712:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c52b1d lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.491718:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c52b1d lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.491731:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff8016f700) 00010000:00010000:3.0:1763333167.491735:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333167.491738:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c52b1d lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.491743:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c52b1d lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000004:00010000:3.0:1763333167.491759:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009979bf06 reply state 000000002f81a073 transno 4294971722 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c52b24 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.491769:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c52b24 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.491775:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff8016fb00) 00010000:00010000:3.0:1763333167.491778:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763333167.491780:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763333167.501664:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613450624 00000100:00100000:3.0:1763333167.501678:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613450624 00000100:00100000:3.0:1763333167.501743:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 5975 00000100:00100000:3.0:1763333167.501755:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46268380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2420:x1848987613450624:12345-192.168.204.28@tcp:1:lfs.0 00010000:00010000:3.0:1763333167.501822:0:8611:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe44d75a00/0xb32e3ef184c52b55 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.501848:0:8611:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c52ac2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968500 expref: 19 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.501859:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333167.501863:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333167.501866:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe44d75a00/0xb32e3ef184c52b55 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.501909:0:8611:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c52ac2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968500 expref: 19 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.501926:0:8611:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c52ac2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968500 expref: 19 pid: 17605 timeout: 1371 lvb_type: 0 00000100:00100000:3.0:1763333167.501943:0:8611:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4960b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8611:1848987627182848:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333167.502187:0:8611:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4869d000 going to sleep for 11 seconds 00000100:00100000:3.0:1763333167.508894:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.526170:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613451136 00000100:00100000:3.0:1763333167.526183:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613451136 00000100:00100000:3.0:1763333167.526250:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8638 00000100:00100000:3.0:1763333167.526260:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46268000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+218:56749:x1848987613451136:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333167.526287:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333167.526314:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c52b71 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968538 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.526412:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c52b78 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333167.526425:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c52b78 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.526436:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c52b78 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.526449:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c52b7f lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333167.526456:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c52b7f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.526467:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c52b7f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.526521:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c52b78 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.526528:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c52b78 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.526534:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c52b78 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.526541:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c52b78 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.526546:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46e43c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333167.526550:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c52b78 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.526557:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c52b78 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.526570:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff8016f700) 00010000:00010000:3.0:1763333167.526574:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333167.526578:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c52b78 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.526585:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c52b78 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.526598:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c52b7f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.526603:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c52b7f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.526609:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c52b7f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.526625:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe44d75200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333167.526628:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c52b7f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.526633:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c52b7f lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.526640:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff8016fb00) 00010000:00010000:3.0:1763333167.526642:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333167.526645:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c52b7f lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.526651:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c52b7f lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.526689:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c52b71 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968538 expref: 219 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.526700:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff8016f700) 00010000:00010000:3.0:1763333167.526703:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333167.526706:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c52b71 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968538 expref: 219 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.526723:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46e42600, rc 0) 00000100:00100000:3.0:1763333167.526794:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46268000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+218:56749:x1848987613451136:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 536us (725us total) trans 0 rc 301/301 00000100:00100000:3.0:1763333167.526803:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8638 00000100:00100000:3.0:1763333167.536268:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613451520 00000100:00100000:3.0:1763333167.536283:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613451520 00000100:00100000:3.0:1763333167.536582:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8640 00000100:00100000:3.0:1763333167.536595:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46269c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:56749:x1848987613451520:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333167.536630:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333167.536663:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c52b8d lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696853f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.536745:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c52b94 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333167.536761:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c52b94 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.536772:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c52b94 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:3.0:1763333167.536819:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1763333167.536824:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1763333167.536861:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c52b8d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696853f expref: 221 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.536881:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c52b94 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696853f expref: 220 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.536890:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff8016ff00) 00010000:00010000:3.0:1763333167.536893:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1763333167.536897:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe467bf200, rc 0) 00000100:00100000:3.0:1763333167.538554:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46269c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+209:56749:x1848987613451520:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1959us (4533us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333167.538563:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8640 00000100:00100000:3.0:1763333167.539152:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627183360 00000100:00100000:3.0:1763333167.539155:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627183360 00000100:00100000:3.0:1763333167.539180:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5976 00000100:00100000:3.0:1763333167.539187:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+31:3653:x1848987627182976:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333167.540720:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+32:3653:x1848987627182976:12345-0@lo:2:osp-syn-0-1.0 Request processed in 1531us (2548us total) trans 21474838644 rc 0/0 00000100:00100000:3.0:1763333167.540727:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5976 00000100:00100000:3.0:1763333167.552881:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.566620:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613452288 00000100:00100000:3.0:1763333167.566625:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613452288 00000100:00100000:3.0:1763333167.566670:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 5980 00000100:00100000:3.0:1763333167.566679:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2419:x1848987613452288:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333167.566691:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333167.566709:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c52bf6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968562 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333167.566731:0:8404:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1f3:0x0] initial LVB size: 5, mtime: 0x691a542f, atime: 0x0, ctime: 0x691a542f, blocks: 0x8 00010000:00010000:3.0:1763333167.566751:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.566754:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.566764:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c52bf6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968562 expref: 21 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333167.566780:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c52bf6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968562 expref: 21 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333167.566794:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe467bf600, rc 0) 00000100:00100000:3.0:1763333167.566846:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2419:x1848987613452288:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 169us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333167.566857:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 5980 00000100:00100000:3.0:1763333167.574069:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613452672 00000100:00100000:3.0:1763333167.574083:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613452672 00000100:00100000:3.0:1763333167.615899:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613453824 00000100:00100000:3.0:1763333167.615914:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613453824 00000100:00100000:3.0:1763333167.616176:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8648 00000100:00100000:3.0:1763333167.616188:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+217:55917:x1848987613453824:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:3.0:1763333167.616257:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333167.616286:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c52c19 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968570 expref: 217 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.616307:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x17e:0x0].0x0 (ffff92ff618aa300) 00010000:00010000:3.0:1763333167.616312:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333167.616568:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c52c35 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x17e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333167.616582:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c52c35 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.616593:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c52c35 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000001:00080000:3.0:1763333167.616652:0:6521:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294971730 00000004:00010000:3.0:1763333167.616676:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c533b5d0 reply state 00000000466bec0c transno 4294971731 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c52c35 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.616688:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c52c35 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.616694:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x17e:0x0].0x0 (ffff92ff618aa300) 00010000:00010000:3.0:1763333167.616698:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763333167.616700:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763333167.616826:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:55917:x1848987613453824:12345-192.168.204.28@tcp:36:bash.0 Request processed in 639us (2309us total) trans 4294971731 rc 0/0 00000100:00100000:3.0:1763333167.616834:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8648 00000020:00080000:3.0:1763333167.616840:0:6521:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763333167.643691:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.643717:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.643734:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613454976 00000100:00100000:3.0:1763333167.643739:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613454976 00000100:00100000:3.0:1763333167.643771:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 5987 00000100:00100000:3.0:1763333167.643779:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:55917:x1848987613454976:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333167.643793:0:29013:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333167.643816:0:29013:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c52c66 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968593 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333167.643838:0:29013:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x1f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333167.643857:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.643859:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.643867:0:29013:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c52c66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968593 expref: 15 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.643883:0:29013:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c52c66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968593 expref: 15 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.643895:0:29013:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe467bf200, rc 0) 00000100:00100000:3.0:1763333167.643934:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:55917:x1848987613454976:12345-192.168.204.28@tcp:101:bash.0 Request processed in 156us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333167.643944:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 5987 00000100:00100000:3.0:1763333167.664105:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.683142:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613456000 00000100:00100000:3.0:1763333167.683150:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613456000 00000100:00100000:3.0:1763333167.683195:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 5989 00000100:00100000:3.0:1763333167.683203:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:56747:x1848987613456000:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333167.683214:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333167.683233:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c52c9e lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369685a1 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333167.683255:0:8404:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x1f4:0x0] initial LVB size: 4096, mtime: 0x691a542f, atime: 0x0, ctime: 0x691a542f, blocks: 0x8 00010000:00010000:3.0:1763333167.683271:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.683274:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.683282:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c52c9e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369685a1 expref: 15 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.683296:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c52c9e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369685a1 expref: 15 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.683309:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46e42c00, rc 0) 00000100:00100000:3.0:1763333167.683345:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:56747:x1848987613456000:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 143us (1602us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333167.683380:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 5989 00000100:00100000:3.0:1763333167.689606:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.689662:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.689698:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:3.0:1763333167.700572:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763333167.716957:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.721850:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.733514:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.742752:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.745755:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.746720:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.751226:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:3.0:1763333167.761815:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c52c7b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x17d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.761840:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c52c7b lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x17d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.761860:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c52c7b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x17d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.761875:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7ec00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333167.761881:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c52c7b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x17d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.761890:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c52c7b lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x17d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.761912:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x17d:0x0].0x0 (ffff92fe438a1c00) 00010000:00010000:3.0:1763333167.761916:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333167.761922:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c52c7b lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x17d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.761929:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c52c7b lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x17d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.761953:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e200/0xb32e3ef184c52cb3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.761962:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e200/0xb32e3ef184c52cb3 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.761970:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e200/0xb32e3ef184c52cb3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.761977:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333167.761982:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e200/0xb32e3ef184c52cb3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.761993:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e200/0xb32e3ef184c52cb3 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.762019:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff618aa100) 00010000:00010000:3.0:1763333167.762031:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333167.762036:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e200/0xb32e3ef184c52cb3 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.762045:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e200/0xb32e3ef184c52cb3 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.762125:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42febe00/0xb32e3ef184c52cc8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x17d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333167.762136:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42febe00/0xb32e3ef184c52cc8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x17d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333167.762143:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42febe00/0xb32e3ef184c52cc8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x17d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333167.762148:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42febe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333167.762153:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42febe00/0xb32e3ef184c52cc8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x17d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333167.762161:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42febe00/0xb32e3ef184c52cc8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x17d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333167.762173:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x17d:0x0].0x0 (ffff92fe438a1c00) 00010000:00010000:3.0:1763333167.762176:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333167.762180:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42febe00/0xb32e3ef184c52cc8 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x17d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333167.762186:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42febe00/0xb32e3ef184c52cc8 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x17d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333167.762204:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c52d38 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333167.762223:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c52d38 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333167.762232:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c52d38 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333167.762239:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333167.762243:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c52d38 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333167.762260:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c52d38 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333167.762285:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff618aa100) 00010000:00010000:3.0:1763333167.762290:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333167.762294:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c52d38 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333167.762313:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c52d38 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000100:00100000:3.0:1763333167.762462:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6000 00000100:00100000:3.0:1763333167.762485:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+37:3654:x1848987627185280:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1763333167.762665:0:29013:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x1f3:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1763333167.762670:0:29013:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x1f3:0x0] updating lvb mtime from disk: 1763333167 -> 1763333167 00002000:00010000:3.0:1763333167.762673:0:29013:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x1f3:0x0] updating lvb atime from disk: 1763333167 -> 1763333167 00002000:00010000:3.0:1763333167.762676:0:29013:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x1f3:0x0] updating lvb ctime from disk: 1763333168 -> 1763333168 00002000:00010000:3.0:1763333167.762679:0:29013:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1f3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763333167.763397:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+39:3654:x1848987627185280:12345-0@lo:2:osp-syn-0-1.0 Request processed in 920us (2078us total) trans 21474838653 rc 0/0 00000100:00100000:3.0:1763333167.763409:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6000 00000100:00100000:3.0:1763333167.771155:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4684c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627185792:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333167.771187:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c52d70 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x180:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000100:00100000:3.0:1763333167.772330:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613459328 00000100:00100000:3.0:1763333167.772335:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613459328 00010000:00010000:3.0:1763333167.772369:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c52d3f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x180:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369685d9 expref: 211 pid: 6519 timeout: 1371 lvb_type: 0 00000100:00100000:3.0:1763333167.772390:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2839 00000100:00100000:3.0:1763333167.772397:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+211:2421:x1848987613459328:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333167.772406:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333167.772412:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c52d3f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x180:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369685d9 expref: 211 pid: 6519 timeout: 1371 lvb_type: 0 00010000:00010000:3.0:1763333167.772421:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c52d3f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x180:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369685d9 expref: 211 pid: 6519 timeout: 1371 lvb_type: 0 00010000:00010000:3.0:1763333167.772440:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c52d3f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x180:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369685d9 expref: 211 pid: 6519 timeout: 1371 lvb_type: 0 00010000:00010000:3.0:1763333167.772453:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x180:0x0].0x0 (ffff92ff618aa300) 00010000:00010000:3.0:1763333167.772458:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c52d70 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x180:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333167.772466:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c52d70 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x180:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333167.772472:0:6504:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c52d70 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x180:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333167.772489:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333167.773098:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+210:2421:x1848987613459328:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 701us (2011us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333167.773105:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2839 00010000:00010000:3.0:1763333167.773127:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c52d70 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x180:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333167.773133:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c52d70 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x180:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:3.0:1763333167.773163:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x180:0x0]: returning size 0 00000004:00080000:3.0:1763333167.774100:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x1f7:0x0], index 0: 0 00000004:00080000:3.0:1763333167.774107:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x1f7:0x0], index 1: 0 00000004:00080000:3.0:1763333167.774112:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x1f8:0x0], index 1: 0 00000004:00080000:3.0:1763333167.774116:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x1f8:0x0], index 0: 0 00010000:00010000:3.0:1763333167.774318:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c52d70 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x180:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333167.774326:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c52d70 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x180:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333167.774332:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c52d70 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x180:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333167.774338:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333167.774342:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c52d70 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x180:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333167.774369:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c52d70 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x180:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333167.774379:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x180:0x0].0x0 (ffff92ff618aa300) 00010000:00010000:3.0:1763333167.774382:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763333167.774386:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c52d70 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x180:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333167.774392:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c52d70 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x180:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333167.774434:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c52d69 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x180:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369685e0 expref: 212 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.774445:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x180:0x0].0x0 (ffff92ff618aa300) 00010000:00010000:3.0:1763333167.774447:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763333167.774451:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c52d69 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x180:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369685e0 expref: 212 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.774463:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5e00, rc 0) 00000100:00100000:3.0:1763333167.774498:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+210:56751:x1848987613458816:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 11028us (16323us total) trans 4294971740 rc 301/301 00000100:00100000:3.0:1763333167.774505:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8661 00000100:00100000:3.0:1763333167.782995:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.783105:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.790148:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613460224 00000100:00100000:3.0:1763333167.790164:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613460224 00000100:00100000:3.0:1763333167.790572:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613460352 00000100:00100000:3.0:1763333167.790580:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613460352 00000100:00100000:3.0:1763333167.803192:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.803242:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.807408:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.810864:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613461376 00000100:00100000:3.0:1763333167.810877:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613461376 00000100:00100000:3.0:1763333167.810944:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8666 00000100:00100000:3.0:1763333167.810968:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+216:55917:x1848987613461376:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333167.810993:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333167.811017:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c52dd9 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x180:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968611 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.811053:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c52de0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x180:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333167.811069:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c52de0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x180:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333167.811081:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c52de0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x180:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333167.811221:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c52dd9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x180:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968611 expref: 218 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.811248:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c52de0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x180:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968611 expref: 217 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.811257:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x180:0x0].0x0 (ffff92fe4345b000) 00010000:00010000:3.0:1763333167.811261:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763333167.811265:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46e42600, rc 0) 00000100:00100000:3.0:1763333167.811333:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+217:55917:x1848987613461376:12345-192.168.204.28@tcp:101:bash.0 Request processed in 368us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333167.811340:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8666 00000100:00100000:3.0:1763333167.825070:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613461888 00000100:00100000:3.0:1763333167.825081:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613461888 00000100:00100000:3.0:1763333167.825135:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613462144 00000100:00100000:3.0:1763333167.825138:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613462144 00000100:00100000:3.0:1763333167.825169:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8668 00000100:00100000:3.0:1763333167.825179:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:55917:x1848987613461888:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333167.825201:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333167.825205:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763333167.825235:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c52dbd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x180:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696860a expref: 221 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.825256:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x180:0x0].0x0 (ffff92fe4345b000) 00010000:00010000:3.0:1763333167.825261:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333167.825276:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c52dee lrc: 2/0,0 mode: --/EX res: [0x240000404:0x180:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968618 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.825332:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe465eec00/0xb32e3ef184c52df5 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x180:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333167.825365:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe465eec00/0xb32e3ef184c52df5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x180:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333167.825376:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe465eec00/0xb32e3ef184c52df5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x180:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000040:00080000:3.0:1763333167.825622:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1241, 88 off105712 00000004:00080000:3.0:1763333167.825631:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1271905281277ns, next at 1272422704053ns, rc = 0 00000040:00080000:3.0:1763333167.825669:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1240, 88 off105712 00000004:00080000:3.0:1763333167.825675:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1271905325807ns, next at 1272422731578ns, rc = 0 00000040:00080000:3.0:1763333167.825691:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1241, 88 off105800 00000004:00080000:3.0:1763333167.825695:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1271905345778ns, next at 1272422731578ns, rc = 0 00000040:00080000:3.0:1763333167.825704:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1242, 88 off105800 00000004:00080000:3.0:1763333167.825707:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1271905358027ns, next at 1272422704053ns, rc = 0 00000100:00100000:3.0:1763333167.826031:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8669 00000100:00100000:3.0:1763333167.826040:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74035500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:56747:x1848987613462144:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333167.826051:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333167.826065:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe465ef600/0xb32e3ef184c52dfc lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696861f expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.826126:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe465efc00/0xb32e3ef184c52e03 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333167.826135:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe465efc00/0xb32e3ef184c52e03 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333167.826142:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe465efc00/0xb32e3ef184c52e03 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333167.826157:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe465ee200/0xb32e3ef184c52e0a lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333167.826163:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe465ee200/0xb32e3ef184c52e0a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333167.826169:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe465ee200/0xb32e3ef184c52e0a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333167.826253:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c52e11 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x180:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333167.826262:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c52e11 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x180:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333167.826269:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c52e11 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x180:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:3.0:1763333167.826279:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x180:0x0]: returning size 2 00010000:00010000:3.0:1763333167.827736:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c52e11 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x180:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333167.827749:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c52e11 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x180:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333167.827757:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c52e11 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x180:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333167.827764:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333167.827769:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c52e11 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x180:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333167.827775:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c52e11 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x180:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333167.827791:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x180:0x0].0x0 (ffff92fe4345b000) 00010000:00010000:3.0:1763333167.827794:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1763333167.827799:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c52e11 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x180:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333167.827805:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c52e11 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x180:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333167.827822:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe465efc00/0xb32e3ef184c52e03 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333167.827828:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe465efc00/0xb32e3ef184c52e03 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333167.827833:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe465efc00/0xb32e3ef184c52e03 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333167.827838:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe465efc00/0xb32e3ef184c52e03 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333167.827842:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe465efc00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333167.827845:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe465efc00/0xb32e3ef184c52e03 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333167.827849:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe465efc00/0xb32e3ef184c52e03 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333167.827856:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6231ec00) 00010000:00010000:3.0:1763333167.827858:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333167.827861:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe465efc00/0xb32e3ef184c52e03 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333167.827866:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe465efc00/0xb32e3ef184c52e03 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333167.827875:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe465ee200/0xb32e3ef184c52e0a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333167.827880:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe465ee200/0xb32e3ef184c52e0a lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333167.827885:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe465ee200/0xb32e3ef184c52e0a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333167.827890:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe465ee200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333167.827892:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe465ee200/0xb32e3ef184c52e0a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333167.827897:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe465ee200/0xb32e3ef184c52e0a lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333167.827903:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43978800) 00010000:00010000:3.0:1763333167.827905:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333167.827907:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe465ee200/0xb32e3ef184c52e0a lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333167.827912:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe465ee200/0xb32e3ef184c52e0a lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333167.827972:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe465ef600/0xb32e3ef184c52dfc lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696861f expref: 224 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.827981:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6231ec00) 00010000:00010000:3.0:1763333167.827983:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763333167.827987:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe465ef600/0xb32e3ef184c52dfc lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696861f expref: 224 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.828003:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe465ef600, rc 0) 00000100:00100000:3.0:1763333167.828084:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74035500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56747:x1848987613462144:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 2044us (3424us total) trans 4294971749 rc 301/301 00000100:00100000:3.0:1763333167.828093:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8669 00000001:00080000:3.0:1763333167.830927:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294971748 is committed 00000004:00080000:3.0:1763333167.830941:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 815 committed 00000004:00080000:3.0:1763333167.832974:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 812 committed 00000004:00080000:3.0:1763333167.832984:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 811 committed 00000004:00080000:3.0:1763333167.832987:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 814 committed 00010000:00010000:3.0:1763333167.833116:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe465eec00/0xb32e3ef184c52df5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x180:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968618 expref: 212 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.833127:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x180:0x0].0x0 (ffff92fe4345b000) 00010000:00010000:3.0:1763333167.833131:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763333167.833145:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c52dee lrc: 0/0,0 mode: --/EX res: [0x240000404:0x180:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968618 expref: 212 pid: 12741 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1763333167.833162:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe465eec00/0xb32e3ef184c52df5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x180:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968618 expref: 211 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.833190:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x180:0x0].0x0 (ffff92fe4345b000) 00010000:00010000:3.0:1763333167.833192:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763333167.833195:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe465eec00, rc 0) 00000100:00100000:3.0:1763333167.833224:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+211:55917:x1848987613461888:12345-192.168.204.28@tcp:101:bash.0 Request processed in 8047us (9543us total) trans 4294971748 rc 0/0 00000100:00100000:3.0:1763333167.833231:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8668 00000100:00100000:3.0:1763333167.834899:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627186688 00000100:00100000:3.0:1763333167.834910:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627186688 00000100:00100000:3.0:1763333167.834955:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6007 00000100:00100000:3.0:1763333167.834968:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+9:3653:x1848987627186688:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763333167.835002:0:8404:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:499 count 1 00010000:00010000:3.0:1763333167.835028:0:8404:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c52e2d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.835053:0:8404:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c52aec lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696850e expref: 15 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.835062:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333167.835064:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333167.835067:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c52e2d lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.835098:0:8404:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c52aec lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696850e expref: 15 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.835124:0:8404:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c52aec lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696850e expref: 15 pid: 17605 timeout: 1371 lvb_type: 0 00000100:00100000:3.0:1763333167.835164:0:8404:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4684d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8404:1848987627187200:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333167.835246:0:8404:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff6be07540 going to sleep for 11 seconds 00000004:00080000:3.0:1763333167.839991:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4684f480/2, rc 0, transno 17179871350 00000100:00100000:3.0:1763333167.840002:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4684f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627187072:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333167.841517:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613462656 00000100:00100000:3.0:1763333167.841525:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613462656 00010000:00010000:3.0:1763333167.841571:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb200/0xb32e3ef184c52ca5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369685af expref: 26 pid: 28600 timeout: 1371 lvb_type: 0 00000100:00100000:3.0:1763333167.841618:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613462528 00000100:00100000:3.0:1763333167.841623:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613462528 00010000:00010000:3.0:1763333167.841646:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c52ce4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369685bd expref: 27 pid: 8404 timeout: 1371 lvb_type: 0 00000100:00100000:3.0:1763333167.841681:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2840 00000100:00100000:3.0:1763333167.841689:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff4627dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+27:2421:x1848987613462656:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333167.841703:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333167.841710:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb200/0xb32e3ef184c52ca5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369685af expref: 27 pid: 28600 timeout: 1371 lvb_type: 0 00010000:00010000:3.0:1763333167.841720:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb200/0xb32e3ef184c52ca5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369685af expref: 27 pid: 28600 timeout: 1371 lvb_type: 0 00010000:00010000:3.0:1763333167.842564:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb200/0xb32e3ef184c52ca5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369685af expref: 26 pid: 28600 timeout: 1371 lvb_type: 0 00010000:00010000:3.0:1763333167.842733:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.842736:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.842740:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c52e26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.842750:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c52e26 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.842768:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333167.842794:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff4627dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:2421:x1848987613462656:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 1105us (1362us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333167.842802:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2840 00000004:00080000:3.0:1763333167.844237:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff50065500/2, rc 0, transno 21474838657 00000100:00100000:3.0:1763333167.844250:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff50065500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627186048:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1763333167.851849:0:8404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c52aec lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696850e expref: 14 pid: 17605 timeout: 1371 lvb_type: 0 00000100:00100000:3.0:1763333167.851873:0:8404:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4684d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8404:1848987627187200:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333167.851894:0:8404:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c52e2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.851904:0:8404:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c52e2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.851913:0:8404:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c52e2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.851926:0:8404:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c52e2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.851934:0:8404:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c52e2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.851964:0:8404:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763333167.852308:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+13:3653:x1848987627186688:12345-0@lo:6:osp-syn-1-1.0 Request processed in 17341us (17457us total) trans 17179871352 rc 0/0 00000100:00100000:3.0:1763333167.852320:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6007 00000004:00080000:3.0:1763333167.852411:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff6bc10e00/2, rc 0, transno 17179871352 00000100:00100000:3.0:1763333167.852418:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff6bc10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627186688:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763333167.856739:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613463168 00000100:00100000:3.0:1763333167.856750:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613463168 00000100:00100000:3.0:1763333167.856915:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2956 00000100:00100000:3.0:1763333167.856926:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6b3ef850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+212:56747:x1848987613463168:12345-192.168.204.28@tcp:33:lfs.0 00000100:00100000:3.0:1763333167.857327:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6b3ef850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+212:56747:x1848987613463168:12345-192.168.204.28@tcp:33:lfs.0 Request processed in 402us (1079us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333167.857335:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2956 00000100:00100000:3.0:1763333167.858116:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613463296 00000100:00100000:3.0:1763333167.858122:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613463296 00000100:00100000:3.0:1763333167.858156:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6012 00000100:00100000:3.0:1763333167.858164:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:55917:x1848987613463296:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333167.858177:0:28650:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333167.858199:0:28650:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c52e42 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696862d expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333167.858219:0:28650:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x1f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333167.858238:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.858240:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.858248:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c52e42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696862d expref: 15 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.858262:0:28650:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c52e42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696862d expref: 15 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.858279:0:28650:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96000, rc 0) 00000100:00100000:3.0:1763333167.858301:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:55917:x1848987613463296:12345-192.168.204.28@tcp:101:bash.0 Request processed in 138us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333167.858308:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6012 00000100:00100000:3.0:1763333167.878106:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613463808 00000100:00100000:3.0:1763333167.878116:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613463808 00000100:00100000:3.0:1763333167.878183:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8670 00000100:00100000:3.0:1763333167.878193:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+212:56752:x1848987613463808:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333167.878220:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1763333167.879729:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613464064 00000100:00100000:3.0:1763333167.879736:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613464064 00000100:00100000:3.0:1763333167.879774:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2957 00000100:00100000:3.0:1763333167.879781:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+214:55917:x1848987613464064:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:3.0:1763333167.880007:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+215:55917:x1848987613464064:12345-192.168.204.28@tcp:35:bash.0 Request processed in 227us (402us total) trans 4294971752 rc 0/0 00000100:00100000:3.0:1763333167.880014:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2957 00000100:00100000:3.0:1763333167.891807:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613464320 00000100:00100000:3.0:1763333167.891814:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613464320 00000100:00100000:3.0:1763333167.899323:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613464704 00000100:00100000:3.0:1763333167.899337:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613464704 00000100:00100000:3.0:1763333167.899439:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8672 00000100:00100000:3.0:1763333167.899450:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5922b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+215:56752:x1848987613464704:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333167.899483:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333167.899521:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c52e88 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696863b expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.899653:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c52e8f lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333167.899668:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c52e8f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333167.899680:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c52e8f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333167.899690:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c52e96 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333167.899697:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c52e96 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333167.899703:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c52e96 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333167.899752:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c52e8f lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333167.899759:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c52e8f lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333167.899765:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c52e8f lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333167.899770:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c52e8f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333167.899775:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333167.899779:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c52e8f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333167.899789:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c52e8f lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333167.899800:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43978400) 00010000:00010000:3.0:1763333167.899803:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333167.899807:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c52e8f lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333167.899813:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c52e8f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333167.899827:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c52e96 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333167.899833:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c52e96 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333167.899839:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c52e96 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333167.899843:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333167.899846:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c52e96 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333167.899852:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c52e96 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333167.899858:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe4345b900) 00010000:00010000:3.0:1763333167.899861:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333167.899864:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c52e96 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333167.899869:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c52e96 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333167.899900:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c52e88 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696863b expref: 216 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.899911:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43978400) 00010000:00010000:3.0:1763333167.899914:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333167.899918:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c52e88 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696863b expref: 216 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.899931:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a97000, rc 0) 00000100:00100000:3.0:1763333167.900005:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5922b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+215:56752:x1848987613464704:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 556us (785us total) trans 0 rc 301/301 00000100:00100000:3.0:1763333167.900013:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8672 00000100:00100000:3.0:1763333167.929278:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.949279:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613466240 00000100:00100000:3.0:1763333167.949292:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613466240 00000100:00100000:3.0:1763333167.949399:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2959 00000100:00100000:3.0:1763333167.949411:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+218:56754:x1848987613466240:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333167.949818:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:56754:x1848987613466240:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 408us (820us total) trans 4294971757 rc 0/0 00000100:00100000:3.0:1763333167.949827:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2959 00000100:00100000:3.0:1763333167.963493:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.963539:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.968811:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.968858:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.973597:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.977069:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333167.977108:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:3.0:1763333167.980976:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42febe00/0xb32e3ef184c52e73 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333167.980984:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42febe00/0xb32e3ef184c52e73 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333167.980991:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42febe00/0xb32e3ef184c52e73 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333167.980998:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42febe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333167.981002:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42febe00/0xb32e3ef184c52e73 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333167.981010:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42febe00/0xb32e3ef184c52e73 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333167.981021:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe4345b900) 00010000:00010000:3.0:1763333167.981023:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333167.981027:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42febe00/0xb32e3ef184c52e73 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333167.981033:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42febe00/0xb32e3ef184c52e73 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333167.981045:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c52ef8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.981051:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c52ef8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.981057:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c52ef8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.981062:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333167.981065:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c52ef8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.981071:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c52ef8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.981078:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe4345b900) 00010000:00010000:3.0:1763333167.981080:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333167.981083:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c52ef8 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.981088:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c52ef8 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333167.981096:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c52f5a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x181:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333167.981102:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c52f5a lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x181:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333167.981108:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c52f5a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x181:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333167.981112:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333167.981115:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c52f5a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x181:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333167.981120:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c52f5a lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x181:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333167.981128:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x181:0x0].0x0 (ffff92ff618aa900) 00010000:00010000:3.0:1763333167.981130:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333167.981132:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c52f5a lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x181:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333167.981142:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c52f5a lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x181:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000100:00100000:3.0:1763333167.981158:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e120a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627187584:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763333167.982918:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333167.983876:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe438a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627188224:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763333167.983901:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333167.983924:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763333167.983929:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe438a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627188608:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333167.983978:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333167.989420:0:8407:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e00fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8407:1848987627188992:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333167.989433:0:8407:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c52fae lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x1f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333167.993122:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613468416 00000100:00100000:3.0:1763333167.993130:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613468416 00010000:00010000:3.0:1763333167.993163:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c52e42 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696862d expref: 16 pid: 28650 timeout: 1372 lvb_type: 0 00000100:00100000:3.0:1763333167.993200:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2848 00000100:00100000:3.0:1763333167.993209:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43999c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2419:x1848987613468416:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333167.993224:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333167.993229:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c52e42 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696862d expref: 16 pid: 28650 timeout: 1372 lvb_type: 0 00010000:00010000:3.0:1763333167.993246:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c52e42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696862d expref: 16 pid: 28650 timeout: 1372 lvb_type: 0 00010000:00010000:3.0:1763333167.993266:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c52e42 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x1f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696862d expref: 16 pid: 28650 timeout: 1372 lvb_type: 0 00010000:00010000:3.0:1763333167.993279:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.993281:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.993286:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c52fae lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.993294:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c52fae lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x1f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.993331:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333167.993404:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43999c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2419:x1848987613468416:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 195us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333167.993412:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2848 00010000:00010000:3.0:1763333167.994047:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333167.994053:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c52fae lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.994061:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f200 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333167.994065:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c52fae lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.994074:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c52fae lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.994145:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c52fae lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.994153:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c52fae lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.994168:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333167.994170:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333167.994172:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763333167.996648:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613468544 00000100:00100000:3.0:1763333167.996655:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613468544 00000100:00100000:3.0:1763333167.996700:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6022 00000100:00100000:3.0:1763333167.996709:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:55917:x1848987613468544:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333167.996721:0:8407:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333167.996736:0:8407:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c52fca lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x1f9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696869d expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.996761:0:8407:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c52f53 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x1f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968673 expref: 16 pid: 28651 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333167.996769:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.996771:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333167.996776:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c52fca lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x1f9:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696869d expref: 16 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.996810:0:8407:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c52f53 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968673 expref: 16 pid: 28651 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333167.996828:0:8407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c52f53 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968673 expref: 16 pid: 28651 timeout: 1372 lvb_type: 1 00000100:00100000:3.0:1763333167.996903:0:8407:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff73167100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8407:1848987627189120:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333167.996976:0:8407:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff742b9600 going to sleep for 11 seconds 00000100:00100000:3.0:1763333167.998930:0:8407:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff73167100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8407:1848987627189120:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333167.998974:0:8407:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c52fca lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x1f9:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696869d expref: 16 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333167.998996:0:8407:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a97800, rc 0) 00000100:00100000:3.0:1763333167.999258:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:55917:x1848987613468544:12345-192.168.204.28@tcp:101:bash.0 Request processed in 2548us (3240us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333167.999267:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6022 00000100:00100000:3.0:1763333168.002154:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613469056 00000100:00100000:3.0:1763333168.002159:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613469056 00000100:00100000:3.0:1763333168.002194:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6023 00000100:00100000:3.0:1763333168.002201:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2419:x1848987613469056:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333168.002214:0:8407:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333168.002228:0:8407:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c52fd1 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x1f9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369686ab expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333168.002272:0:8407:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff73167100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8407:1848987627189376:192.168.204.28@tcp:106: 00000100:00100000:3.0:1763333168.017004:0:28430:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613469312 00000100:00100000:3.0:1763333168.017015:0:28430:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613469312 00002000:00010000:3.0:1763333168.017058:0:28430:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/505 (0->18446744073709551615) 00002000:00100000:3.0:1763333168.017064:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4920ce00 with x1848987613469312 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333168.017077:0:28430:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe4920ce00. 00000100:00100000:3.0:1763333168.036963:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333168.046064:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2851 00000100:00100000:3.0:1763333168.046074:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e123800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+217:2419:x1848987613470720:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333168.046089:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333168.046098:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c52f84 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x181:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968696 expref: 217 pid: 12741 timeout: 1372 lvb_type: 0 00010000:00010000:3.0:1763333168.046111:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c52f84 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x181:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968696 expref: 217 pid: 12741 timeout: 1372 lvb_type: 0 00010000:00010000:3.0:1763333168.047175:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c52f84 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x181:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968696 expref: 217 pid: 12741 timeout: 1372 lvb_type: 0 00010000:00010000:3.0:1763333168.047193:0:8423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x181:0x0].0x0 (ffff92ff618aa900) 00010000:00010000:3.0:1763333168.047200:0:8423:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c52ff4 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x181:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT1 00010000:00010000:3.0:1763333168.047213:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c52ff4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x181:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT1 00010000:00010000:3.0:1763333168.047219:0:8423:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c52ff4 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x181:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT1 00010000:00010000:3.0:1763333168.047245:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333168.047787:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e123800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+215:2419:x1848987613470720:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 1714us (1951us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333168.047795:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2851 00000100:00100000:3.0:1763333168.099890:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333168.125945:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613472512 00000100:00100000:3.0:1763333168.126160:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613472512 00010000:00010000:3.0:1763333168.126210:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c53080 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x182:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369686e3 expref: 221 pid: 12741 timeout: 1372 lvb_type: 0 00000100:00100000:3.0:1763333168.126253:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2852 00000100:00100000:3.0:1763333168.126264:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:2421:x1848987613472512:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333168.126281:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333168.126288:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c53080 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x182:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369686e3 expref: 221 pid: 12741 timeout: 1372 lvb_type: 0 00010000:00010000:3.0:1763333168.126300:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c53080 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x182:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369686e3 expref: 221 pid: 12741 timeout: 1372 lvb_type: 0 00010000:00010000:3.0:1763333168.126326:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c53080 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x182:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369686e3 expref: 221 pid: 12741 timeout: 1372 lvb_type: 0 00010000:00010000:3.0:1763333168.126344:0:8423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x182:0x0].0x0 (ffff92fe43a0be00) 00010000:00010000:3.0:1763333168.126406:0:8423:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53095 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x182:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.126417:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53095 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x182:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.126424:0:8423:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53095 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x182:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.126458:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333168.126512:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+220:2421:x1848987613472512:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 249us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333168.126521:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2852 00000100:00100000:3.0:1763333168.134988:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333168.135032:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333168.160187:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613474176 00000100:00100000:3.0:1763333168.160197:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613474176 00000100:00100000:3.0:1763333168.160250:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613474304 00000100:00100000:3.0:1763333168.160253:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613474304 00000100:00100000:3.0:1763333168.160282:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8700 00000100:00100000:3.0:1763333168.160290:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:55917:x1848987613474176:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333168.160312:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333168.160332:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c530f0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x182:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968714 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.160413:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c530f0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x182:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968714 expref: 229 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.160428:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c530f0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x182:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968714 expref: 229 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.160447:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x182:0x0].0x0 (ffff92fe43a0b500) 00010000:00010000:3.0:1763333168.160450:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763333168.160455:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a97000, rc 0) 00000100:00100000:3.0:1763333168.160508:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:55917:x1848987613474176:12345-192.168.204.28@tcp:101:bash.0 Request processed in 218us (1571us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333168.160514:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8700 00000100:00100000:3.0:1763333168.160534:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8701 00000100:00100000:3.0:1763333168.160539:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56758:x1848987613474304:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333168.160546:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333168.160558:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c530f7 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696871b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.160618:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c530fe lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333168.160635:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c530fe lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.160644:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c530fe lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.160654:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c53105 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333168.160661:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c53105 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.160667:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c53105 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.160743:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c5310c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x182:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333168.160750:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c5310c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x182:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.160756:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c5310c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x182:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:3.0:1763333168.160788:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x182:0x0]: returning size 0 00000004:00200000:3.0:1763333168.160793:0:6519:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763333168.160809:0:6519:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c5310c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x182:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.160819:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c5310c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x182:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.160827:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c530fe lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.160832:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c530fe lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.160838:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c530fe lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.160845:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c530fe lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.160850:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333168.160855:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c530fe lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.160861:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c530fe lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.160870:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff80045200) 00010000:00010000:3.0:1763333168.160873:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333168.160876:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c530fe lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.160882:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c530fe lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.160894:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c53105 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.160899:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c53105 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.160904:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c53105 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.160909:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333168.160912:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c53105 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.160917:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c53105 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.160923:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff618aa000) 00010000:00010000:3.0:1763333168.160926:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333168.160928:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c53105 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.160934:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c53105 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.160956:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c530f7 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696871b expref: 230 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.160970:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c5310c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x182:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696871b expref: 229 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.160977:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x182:0x0].0x0 (ffff92fe43a0b500) 00010000:00010000:3.0:1763333168.160979:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333168.160981:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96000, rc 0) 00000100:00100000:3.0:1763333168.161012:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56758:x1848987613474304:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 472us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333168.161019:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8701 00000001:00080000:3.0:1763333168.187707:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294971777 is committed 00000004:00080000:3.0:1763333168.187721:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 819 committed 00000004:00080000:3.0:1763333168.198564:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 816 committed 00000004:00080000:3.0:1763333168.198598:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 815 committed 00000004:00080000:3.0:1763333168.198609:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 818 committed 00000100:00100000:3.0:1763333168.199140:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7400d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627190656:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763333168.199171:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763333168.206400:0:28651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c52fd8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369686b2 expref: 26 pid: 8407 timeout: 1372 lvb_type: 0 00000100:00100000:3.0:1763333168.206415:0:28651:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77c6d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28651:1848987627190528:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333168.206436:0:28651:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5313d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.206447:0:28651:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5313d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.206455:0:28651:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5313d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.206464:0:28651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5313d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.206471:0:28651:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5313d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.206494:0:28651:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763333168.206711:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+50:3653:x1848987627190016:12345-0@lo:6:osp-syn-0-1.0 Request processed in 12726us (16641us total) trans 21474838668 rc 0/0 00000100:00100000:3.0:1763333168.206720:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6029 00000100:00100000:3.0:1763333168.206734:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613475840 00000100:00100000:3.0:1763333168.206737:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613475840 00000100:00100000:3.0:1763333168.206760:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6035 00000100:00100000:3.0:1763333168.206766:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+26:55917:x1848987613475840:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333168.206775:0:28651:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333168.206788:0:28651:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c53159 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968737 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333168.206808:0:28651:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333168.206820:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333168.206822:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333168.206829:0:28651:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c53159 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968737 expref: 27 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.206843:0:28651:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c53159 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968737 expref: 27 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.206853:0:28651:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96400, rc 0) 00000100:00100000:3.0:1763333168.206877:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+27:55917:x1848987613475840:12345-192.168.204.28@tcp:101:bash.0 Request processed in 111us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333168.206882:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6035 00000004:00080000:3.0:1763333168.206914:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7e00fb80/2, rc 0, transno 21474838668 00000100:00100000:3.0:1763333168.206920:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e00fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627190016:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1763333168.208139:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763333168.225499:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333168.235637:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:3.0:1763333168.260699:0:8606:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5319f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x182:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333168.260705:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5319f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x182:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:3.0:1763333168.260746:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x182:0x0]: returning size 5 00000004:00200000:3.0:1763333168.260751:0:8606:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763333168.260769:0:8606:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5319f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x182:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333168.260797:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c53198 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x182:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696874c expref: 220 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.260811:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5319f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x182:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696874c expref: 219 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.260818:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x182:0x0].0x0 (ffff92fe43a0b500) 00010000:00010000:3.0:1763333168.260821:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333168.260823:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4400, rc 0) 00000100:00100000:3.0:1763333168.260863:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:56760:x1848987613477248:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 3198us (5127us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333168.260870:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8706 00000100:00100000:3.0:1763333168.264722:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613478016 00000100:00100000:3.0:1763333168.264727:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613478016 00000100:00100000:3.0:1763333168.264757:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8708 00000100:00100000:3.0:1763333168.264763:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+220:56761:x1848987613478016:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:3.0:1763333168.264794:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1763333168.264820:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c5311a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x182:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968722 expref: 219 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.264839:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c531bb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x182:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968753 expref: 218 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.264852:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5319f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x182:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696874c expref: 217 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.264865:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c530cd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x182:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369686f8 expref: 216 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.264875:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x182:0x0].0x0 (ffff92fe43a0b500) 00010000:00010000:3.0:1763333168.264880:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333168.264911:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c531c2 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333168.264923:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c531c2 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.264931:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c531c2 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.264941:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c531c9 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333168.264946:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c531c9 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.264961:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c531c9 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.265025:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c531d0 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x182:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333168.265039:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c53128 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x182:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968729 expref: 215 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.265047:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c531d0 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x182:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.265080:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c53128 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x182:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968729 expref: 215 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.265092:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c53128 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x182:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968729 expref: 215 pid: 6521 timeout: 1372 lvb_type: 0 00000100:00100000:3.0:1763333168.265104:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff73165880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627191552:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333168.265154:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff742b9600 going to sleep for 11 seconds 00010000:00010000:3.0:1763333168.267661:0:6519:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.204.28@tcp) returned -22 from blocking AST (req@00000000ba4c2a35 x1848987627191552) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c53128 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x182:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968729 expref: 216 pid: 6521 timeout: 1372 lvb_type: 0 00010000:00010000:3.0:1763333168.267679:0:6519:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c53128 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x182:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968729 expref: 216 pid: 6521 timeout: 1372 lvb_type: 0 00000100:00100000:3.0:1763333168.267700:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff73165880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627191552:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333168.267842:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x182:0x0].0x0 (ffff92fe43a0b500) 00010000:00010000:3.0:1763333168.267847:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c531d0 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x182:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.267855:0:6519:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c531d0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x182:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.267866:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c531d0 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x182:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.267884:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c531d0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x182:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.267891:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c531d0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x182:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.267895:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c531d0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x182:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00080000:3.0:1763333168.268517:0:6519:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x182:0x0] is inserted into orphan list, open count = 1 00010000:00010000:3.0:1763333168.268907:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c531d0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x182:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.268916:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c531d0 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x182:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.268922:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c531d0 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x182:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.268933:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333168.268937:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c531d0 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x182:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.268944:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c531d0 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x182:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.269029:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x182:0x0].0x0 (ffff92fe43a0b500) 00010000:00010000:3.0:1763333168.269032:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1763333168.269037:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c531d0 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x182:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.269046:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c531d0 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x182:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.269061:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c531c2 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.269067:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c531c2 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.269073:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c531c2 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.269079:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c531c2 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.269083:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333168.269086:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c531c2 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.269091:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c531c2 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.269098:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43978a00) 00010000:00010000:3.0:1763333168.269100:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333168.269102:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c531c2 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.269107:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c531c2 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:3.0:1763333168.269119:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000064fc8d78 reply state 00000000a5d2cfd7 transno 4294971783 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c531c9 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.269127:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c531c9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.269134:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43978000) 00010000:00010000:3.0:1763333168.269136:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763333168.269139:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763333168.269626:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+218:56761:x1848987613478016:12345-192.168.204.28@tcp:36:rm.0 Request processed in 4862us (5189us total) trans 4294971783 rc 0/0 00000100:00100000:3.0:1763333168.269632:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8708 00000100:00100000:3.0:1763333168.287195:0:28430:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613478912 00000100:00100000:3.0:1763333168.287200:0:28430:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613478912 00002000:00100000:3.0:1763333168.287232:0:28430:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x280000400:0x1fb:0x0] (0->4) req@ffff92fe46a6fb80 x1848987613478912/t0(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:479/0 lens 496/0 e 0 to 0 dl 1763333179 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763333168.287241:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe46a6fb80 with x1848987613478912 ext(0->4) 00010000:00010000:3.0:1763333168.287249:0:28430:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c53159 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968737 expref: 29 pid: 28651 timeout: 1372 lvb_type: 0 00010000:00010000:3.0:1763333168.287261:0:28430:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c53159 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968737 expref: 29 pid: 28651 timeout: 1372 lvb_type: 0 00002000:00010000:3.0:1763333168.287268:0:28430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff92fe46a6fb80 00000100:00100000:3.0:1763333168.287293:0:28430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 96 00000100:00100000:3.0:1763333168.287299:0:28430:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:2420:x1848987613478912:12345-192.168.204.28@tcp:4:bash.0 00000100:00100000:3.0:1763333168.289131:0:28430:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+31:2420:x1848987613478912:12345-192.168.204.28@tcp:4:bash.0 Request processed in 1823us (2635us total) trans 21474838670 rc 0/0 00000100:00100000:3.0:1763333168.289144:0:28430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 96 00002000:00100000:3.0:1763333168.289155:0:28430:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x280000400:0x1fb:0x0] (0->4) req@ffff92fe46a6fb80 x1848987613478912/t21474838670(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:479/0 lens 496/448 e 0 to 0 dl 1763333179 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763333168.289172:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe46a6fb80 with x1848987613478912 ext(0->4) 00010000:00010000:3.0:1763333168.289180:0:28430:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c53159 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968737 expref: 31 pid: 28651 timeout: 1372 lvb_type: 0 00010000:00010000:3.0:1763333168.289194:0:28430:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c53159 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968737 expref: 31 pid: 28651 timeout: 1372 lvb_type: 0 00002000:00010000:3.0:1763333168.289202:0:28430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff92fe46a6fb80 00000100:00100000:3.0:1763333168.297162:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8715 00000100:00100000:3.0:1763333168.297170:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56760:x1848987613479552:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:3.0:1763333168.297207:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333168.297229:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c531ec lrc: 0/0,0 mode: --/CR res: [0x240000404:0x182:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968761 expref: 222 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.297246:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x182:0x0].0x0 (ffff92fe43a0b500) 00010000:00010000:3.0:1763333168.297250:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333168.297268:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c53240 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x182:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333168.297276:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c53240 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x182:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.297283:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c53240 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x182:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000040:00080000:3.0:1763333168.297535:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1251, 88 off106496 00000004:00080000:3.0:1763333168.297543:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1272377193314ns, next at 1272422704053ns, rc = 0 00000040:00080000:3.0:1763333168.297585:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1250, 88 off106496 00000004:00080000:3.0:1763333168.297589:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1272377240482ns, next at 1272422731578ns, rc = 0 00000040:00080000:3.0:1763333168.297617:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1251, 88 off106584 00000004:00080000:3.0:1763333168.297622:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1272377272721ns, next at 1272422731578ns, rc = 0 00000040:00080000:3.0:1763333168.297643:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1252, 88 off106584 00000004:00080000:3.0:1763333168.297648:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1272377298824ns, next at 1272422704053ns, rc = 0 00000004:00010000:3.0:1763333168.302151:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b682f823 reply state 0000000075f69a9d transno 4294971785 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c53240 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x182:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.302173:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c53240 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x182:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.302182:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x182:0x0].0x0 (ffff92fe43a0b500) 00010000:00010000:3.0:1763333168.302184:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1763333168.302189:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1763333168.302380:0:12741:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1763333168.302397:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+212:56760:x1848987613479552:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 5225us (5449us total) trans 4294971785 rc 0/0 00000100:00100000:3.0:1763333168.302406:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8715 00000100:00100000:3.0:1763333168.305903:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613479808 00000100:00100000:3.0:1763333168.305916:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613479808 00000100:00100000:3.0:1763333168.305987:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613479936 00000100:00100000:3.0:1763333168.305990:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613479936 00000100:00100000:3.0:1763333168.306021:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8716 00000100:00100000:3.0:1763333168.306031:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+212:56762:x1848987613479808:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333168.306054:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333168.306058:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763333168.306085:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c5322b lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968776 expref: 212 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.306102:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff62250f00) 00010000:00010000:3.0:1763333168.306112:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333168.306121:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c53255 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968784 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.306217:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c5325c lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333168.306226:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c5325c lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.306234:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c5325c lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.306246:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c53263 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333168.306252:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c53263 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.306257:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c53263 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.306657:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c5326a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x183:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333168.306667:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c5326a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.306674:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c5326a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:3.0:1763333168.306684:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x183:0x0]: returning size 0 00010000:00010000:3.0:1763333168.306710:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c5325c lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.306719:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c5325c lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.306725:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c5325c lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.306730:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c5325c lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.306737:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333168.306741:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c5325c lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.306748:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c5325c lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.306755:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43978a00) 00010000:00010000:3.0:1763333168.306758:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333168.306761:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c5325c lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.306766:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c5325c lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000004:00010000:3.0:1763333168.306777:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003e669e75 reply state 0000000012aba3e3 transno 4294971786 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c53263 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.306788:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c53263 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.306794:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43978700) 00010000:00010000:3.0:1763333168.306796:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763333168.306799:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763333168.306824:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c53255 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968784 expref: 214 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.306837:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c5326a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968784 expref: 213 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.306843:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x183:0x0].0x0 (ffff92fe43978f00) 00010000:00010000:3.0:1763333168.306846:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333168.306848:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96000, rc 0) 00000100:00100000:3.0:1763333168.306874:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+214:56762:x1848987613479808:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 845us (2379us total) trans 4294971786 rc 0/0 00000100:00100000:3.0:1763333168.306880:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8716 00000100:00100000:3.0:1763333168.312342:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333168.320036:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333168.336673:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333168.342185:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333168.350882:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333168.362604:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333168.371333:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333168.379450:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe434c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627192576:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333168.379514:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333168.379572:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627192576 00000100:00100000:3.0:1763333168.379579:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627192576 00000100:00100000:3.0:1763333168.379637:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6043 00000100:00100000:3.0:1763333168.379647:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+23:3654:x1848987627192576:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333168.379820:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+24:3654:x1848987627192576:12345-0@lo:2:osp-syn-1-1.0 Request processed in 173us (304us total) trans 17179871367 rc 0/0 00000100:00100000:3.0:1763333168.379831:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6043 00000004:00080000:3.0:1763333168.379872:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe434c7100/2, rc 0, transno 17179871367 00000100:00100000:3.0:1763333168.379879:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe434c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627192576:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333168.392316:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613482240 00000100:00100000:3.0:1763333168.392331:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613482240 00000100:00100000:3.0:1763333168.392432:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6046 00000100:00100000:3.0:1763333168.392444:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:55917:x1848987613482240:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333168.392464:0:8406:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333168.392490:0:8406:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c532ef lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369687c3 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333168.392520:0:8406:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x1fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333168.392546:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333168.392548:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333168.392557:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c532ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369687c3 expref: 19 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.392574:0:8406:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c532ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369687c3 expref: 19 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.392588:0:8406:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96400, rc 0) 00000100:00100000:3.0:1763333168.392670:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:55917:x1848987613482240:12345-192.168.204.28@tcp:101:bash.0 Request processed in 228us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333168.392678:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6046 00000100:00100000:3.0:1763333168.393165:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627192704 00000100:00100000:3.0:1763333168.393171:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627192704 00000100:00100000:3.0:1763333168.393208:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6047 00000100:00100000:3.0:1763333168.393215:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+53:3654:x1848987627192704:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333168.393415:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+54:3654:x1848987627192704:12345-0@lo:2:osp-syn-0-1.0 Request processed in 200us (333us total) trans 21474838674 rc 0/0 00000100:00100000:3.0:1763333168.393421:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6047 00000100:00100000:3.0:1763333168.398580:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333168.398632:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333168.401763:0:28430:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613482624 00000100:00100000:3.0:1763333168.401774:0:28430:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613482624 00002000:00010000:3.0:1763333168.401825:0:28430:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/509 (0->18446744073709551615) 00002000:00100000:3.0:1763333168.401830:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4684dc00 with x1848987613482624 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333168.401848:0:28430:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe4684dc00. 00000100:00100000:3.0:1763333168.401879:0:28430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1514 00000100:00100000:3.0:1763333168.401889:0:28430:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2419:x1848987613482624:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:3.0:1763333168.402097:0:28430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x1fd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333168.402100:0:28430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x1fd:0x0] updating lvb mtime from disk: 0 -> 1763333168 00002000:00010000:3.0:1763333168.402103:0:28430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x1fd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333168.402105:0:28430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x1fd:0x0] updating lvb ctime from disk: 0 -> 1763333168 00002000:00010000:3.0:1763333168.402107:0:28430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x1fd:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333168.402166:0:28430:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2419:x1848987613482624:12345-192.168.204.28@tcp:10:bash.0 Request processed in 278us (471us total) trans 17179871369 rc 0/0 00000100:00100000:3.0:1763333168.402173:0:28430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1514 00002000:00010000:3.0:1763333168.402178:0:28430:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/509 (0->18446744073709551615) 00002000:00100000:3.0:1763333168.402180:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4684dc00 with x1848987613482624 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333168.402184:0:28430:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe4684dc00. 00000100:00100000:3.0:1763333168.406492:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613482752 00000100:00100000:3.0:1763333168.406507:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613482752 00000100:00100000:3.0:1763333168.407789:0:28430:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613482880 00000100:00100000:3.0:1763333168.407797:0:28430:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613482880 00002000:00010000:3.0:1763333168.407821:0:28430:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/509 (0->18446744073709551615) 00002000:00100000:3.0:1763333168.407826:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4684c000 with x1848987613482880 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333168.407838:0:28430:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe4684c000. 00000100:00100000:3.0:1763333168.407861:0:28430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1515 00000100:00100000:3.0:1763333168.407868:0:28430:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+32:2419:x1848987613482880:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:3.0:1763333168.408029:0:28430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x1fd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333168.408033:0:28430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x1fd:0x0] updating lvb mtime from disk: 0 -> 1763333168 00002000:00010000:3.0:1763333168.408035:0:28430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x1fd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333168.408037:0:28430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x1fd:0x0] updating lvb ctime from disk: 0 -> 1763333168 00002000:00010000:3.0:1763333168.408040:0:28430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1fd:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333168.410173:0:28430:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+32:2419:x1848987613482880:12345-192.168.204.28@tcp:10:bash.0 Request processed in 2297us (3446us total) trans 21474838675 rc 0/0 00000100:00100000:3.0:1763333168.410184:0:28430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1515 00002000:00010000:3.0:1763333168.410191:0:28430:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/509 (0->18446744073709551615) 00002000:00100000:3.0:1763333168.410195:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4684c000 with x1848987613482880 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333168.410204:0:28430:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe4684c000. 00000100:00100000:3.0:1763333168.429430:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333168.448467:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613484032 00000100:00100000:3.0:1763333168.448475:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613484032 00010000:00010000:3.0:1763333168.448519:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c530d4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369686ff expref: 21 pid: 28600 timeout: 1372 lvb_type: 1 00000100:00100000:3.0:1763333168.448557:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2860 00000100:00100000:3.0:1763333168.448566:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff4627c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2419:x1848987613484032:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333168.448584:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333168.448617:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c530d4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x1fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369686ff expref: 21 pid: 28600 timeout: 1372 lvb_type: 1 00010000:00010000:3.0:1763333168.448630:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c530d4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x1fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369686ff expref: 21 pid: 28600 timeout: 1372 lvb_type: 1 00010000:00010000:3.0:1763333168.448655:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c530d4 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x1fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369686ff expref: 21 pid: 28600 timeout: 1372 lvb_type: 1 00010000:00010000:3.0:1763333168.448672:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333168.448674:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333168.448679:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5332e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.448690:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5332e lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.448725:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333168.448796:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff4627c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2419:x1848987613484032:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 230us (2228us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333168.448804:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2860 00000001:00080000:3.0:1763333168.455608:0:26035:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871370 is committed 00000001:00080000:3.0:1763333168.455630:0:26035:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871368 is committed 00010000:00010000:0.0:1763333168.464986:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c53358 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333168.464994:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c53358 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333168.465000:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c53358 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333168.465006:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c53358 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333168.465012:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333168.465017:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c53358 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333168.465024:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c53358 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333168.465036:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab5a00) 00010000:00010000:0.0:1763333168.465039:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333168.465043:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c53358 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333168.465049:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c53358 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333168.465064:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c5335f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333168.465070:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c5335f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333168.465076:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c5335f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333168.465080:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333168.465084:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c5335f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333168.465089:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c5335f lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333168.465095:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43ab5f00) 00010000:00010000:0.0:1763333168.465098:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333168.465101:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c5335f lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333168.465107:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c5335f lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333168.465136:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c53351 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369687df expref: 217 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.465147:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab5a00) 00010000:00010000:0.0:1763333168.465149:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333168.465153:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c53351 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369687df expref: 217 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.465451:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feba00, rc 0) 00000100:00100000:0.0:1763333168.465524:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+216:56764:x1848987613484160:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 777us (1789us total) trans 0 rc 301/301 00000100:00100000:0.0:1763333168.465532:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8728 00000100:00100000:0.0:1763333168.469704:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333168.470523:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333168.477792:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333168.478069:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613484800 00000100:00100000:0.0:1763333168.478080:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613484800 00000100:00100000:0.0:1763333168.478131:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8731 00000100:00100000:0.0:1763333168.478141:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+217:56764:x1848987613484800:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333168.478168:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333168.478195:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c53382 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369687f4 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.478270:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c53390 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333168.478286:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c53390 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333168.478301:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c53390 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:0.0:1763333168.478384:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1763333168.478390:0:12741:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763333168.478424:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c53382 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369687f4 expref: 219 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.478449:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c53390 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369687f4 expref: 218 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.478460:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab5a00) 00010000:00010000:0.0:1763333168.478463:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1763333168.478466:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea800, rc 0) 00000100:00100000:0.0:1763333168.478490:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+218:56764:x1848987613484800:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 351us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333168.478497:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8731 00000100:00100000:3.0:1763333168.486163:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613485056 00000100:00100000:3.0:1763333168.486179:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613485056 00000100:00100000:3.0:1763333168.486251:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8732 00000100:00100000:3.0:1763333168.486263:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+218:56764:x1848987613485056:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333168.486285:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333168.486309:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c5339e lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968802 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.486446:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c533a5 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333168.486462:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c533a5 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333168.486475:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c533a5 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333168.486486:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c533ac lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333168.486492:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c533ac lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333168.486498:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c533ac lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333168.486543:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c533a5 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333168.486549:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c533a5 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333168.486555:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c533a5 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333168.486562:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c533a5 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333168.486568:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333168.486572:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c533a5 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333168.486578:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c533a5 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333168.486590:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab5a00) 00010000:00010000:3.0:1763333168.486593:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333168.486608:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c533a5 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333168.486616:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c533a5 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333168.486631:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c533ac lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333168.486636:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c533ac lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333168.486641:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c533ac lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333168.486647:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333168.486649:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c533ac lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333168.486656:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c533ac lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333168.486663:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43ab5f00) 00010000:00010000:3.0:1763333168.486667:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333168.486674:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c533ac lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333168.486686:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c533ac lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333168.486726:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c5339e lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968802 expref: 219 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.486738:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab5a00) 00010000:00010000:3.0:1763333168.486741:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333168.486745:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c5339e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968802 expref: 219 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.487703:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a97200, rc 0) 00000100:00100000:3.0:1763333168.487741:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+218:56764:x1848987613485056:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1480us (4591us total) trans 0 rc 301/301 00000100:00100000:3.0:1763333168.487749:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8732 00000100:00100000:0.0:1763333168.490470:0:8423:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46a6d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8423:1848987627193216:192.168.204.28@tcp:105: 00010000:00010000:0.0:1763333168.490504:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333168.490578:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+32:2420:x1848987613485184:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 3518us (4189us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333168.490590:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2861 00000100:00100000:3.0:1763333168.492453:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613485440 00000100:00100000:3.0:1763333168.492464:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613485440 00000100:00100000:3.0:1763333168.492519:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8733 00000100:00100000:3.0:1763333168.492530:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+218:56764:x1848987613485440:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333168.492554:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333168.492558:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763333168.492584:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c53390 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369687f4 expref: 218 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.492616:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab5a00) 00010000:00010000:3.0:1763333168.492626:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333168.492643:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c533b3 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968809 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.492766:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c533ba lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333168.492779:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c533ba lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333168.492787:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c533ba lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333168.492797:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c533c1 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333168.492804:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c533c1 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333168.492810:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c533c1 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000100:00100000:0.0:1763333168.505186:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613486208 00000100:00100000:0.0:1763333168.505196:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613486208 00000100:00100000:0.0:1763333168.505249:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613485952 00000100:00100000:0.0:1763333168.505252:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613485952 00000100:00100000:0.0:1763333168.505282:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8734 00000100:00100000:0.0:1763333168.505291:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56760:x1848987613486208:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:0.0:1763333168.505407:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c533d6 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x182:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333168.505424:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c533d6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x182:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333168.505435:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c533d6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x182:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00010000:0.0:1763333168.505546:0:8606:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000050d325b9 reply state 0000000067113ea1 transno 4294971798 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c533d6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x182:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333168.505558:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c533d6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x182:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333168.505566:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x182:0x0].0x0 (ffff92fe43a0b500) 00010000:00010000:0.0:1763333168.505569:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333168.505573:0:8606:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763333168.505679:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56760:x1848987613486208:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 387us (1938us total) trans 4294971798 rc 0/0 00000100:00100000:0.0:1763333168.506019:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8734 00000100:00100000:0.0:1763333168.510102:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613486336 00000100:00100000:0.0:1763333168.510111:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613486336 00000100:00100000:0.0:1763333168.510171:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6053 00000100:00100000:0.0:1763333168.510183:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4399ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+33:2421:x1848987613486336:12345-192.168.204.28@tcp:2:lfs.0 00002000:00010000:0.0:1763333168.510341:0:28651:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x1fb:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1763333168.510344:0:28651:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x1fb:0x0] updating lvb mtime from disk: 1763333168 -> 1763333168 00002000:00010000:0.0:1763333168.510392:0:28651:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x1fb:0x0] updating lvb atime from disk: 0 -> 1763333168 00002000:00010000:0.0:1763333168.510396:0:28651:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x1fb:0x0] updating lvb ctime from disk: 1763333168 -> 1763333168 00002000:00010000:0.0:1763333168.510398:0:28651:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1fb:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1763333168.510458:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4399ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+34:2421:x1848987613486336:12345-192.168.204.28@tcp:2:lfs.0 Request processed in 277us (592us total) trans 21474838677 rc 0/0 00000100:00100000:0.0:1763333168.510466:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6053 00000100:00100000:3.0:1763333168.510545:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613486464 00000100:00100000:3.0:1763333168.510550:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613486464 00010000:00010000:3.0:1763333168.510578:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c533c8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x185:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968809 expref: 224 pid: 6521 timeout: 1372 lvb_type: 0 00000100:00100000:3.0:1763333168.510620:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2862 00000100:00100000:3.0:1763333168.510628:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43999500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:2421:x1848987613486464:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333168.510640:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333168.510646:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c533c8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x185:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968809 expref: 224 pid: 6521 timeout: 1372 lvb_type: 0 00010000:00010000:3.0:1763333168.510658:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c533c8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x185:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968809 expref: 224 pid: 6521 timeout: 1372 lvb_type: 0 00010000:00010000:3.0:1763333168.510680:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c533c8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x185:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968809 expref: 224 pid: 6521 timeout: 1372 lvb_type: 0 00010000:00010000:3.0:1763333168.510696:0:8423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x185:0x0].0x0 (ffff92fe43a0bc00) 00010000:00010000:3.0:1763333168.510700:0:8423:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c533e4 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x185:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333168.510711:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c533e4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x185:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333168.510718:0:8423:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c533e4 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x185:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333168.510738:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333168.510775:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43999500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:2421:x1848987613486464:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 147us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333168.510783:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2862 00000100:00100000:3.0:1763333168.520067:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613486976 00000100:00100000:3.0:1763333168.520076:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613486976 00000100:00100000:3.0:1763333168.520176:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2975 00000100:00100000:3.0:1763333168.520185:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5004a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56764:x1848987613486976:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333168.520479:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5004a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56764:x1848987613486976:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 294us (685us total) trans 4294971800 rc 0/0 00000100:00100000:3.0:1763333168.520486:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2975 00000100:00100000:0.0:1763333168.522316:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333168.522497:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613487104 00000100:00100000:3.0:1763333168.522505:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613487104 00010000:00010000:3.0:1763333168.522542:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5324e lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x182:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696878b expref: 224 pid: 8606 timeout: 1372 lvb_type: 0 00000100:00100000:3.0:1763333168.522603:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2863 00000100:00100000:3.0:1763333168.522613:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:2421:x1848987613487104:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333168.522628:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333168.522636:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5324e lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x182:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696878b expref: 224 pid: 8606 timeout: 1372 lvb_type: 0 00010000:00010000:3.0:1763333168.522650:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5324e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x182:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696878b expref: 224 pid: 8606 timeout: 1372 lvb_type: 0 00010000:00010000:3.0:1763333168.522674:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x182:0x0].0x0 (ffff92fe43a0b500) 00010000:00010000:3.0:1763333168.522679:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c533f2 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x182:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 19668 initiator: MDT1 00010000:00010000:3.0:1763333168.522690:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c533f2 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x182:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 19668 initiator: MDT1 00010000:00010000:3.0:1763333168.522698:0:6505:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c533f2 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x182:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 19668 initiator: MDT1 00010000:00010000:3.0:1763333168.522719:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333168.522775:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:2421:x1848987613487104:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 162us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333168.522783:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2863 00000100:00100000:0.0:1763333168.524325:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613487360 00000100:00100000:0.0:1763333168.524334:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613487360 00000100:00100000:0.0:1763333168.524394:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2976 00000100:00100000:0.0:1763333168.524405:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56764:x1848987613487360:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333168.526614:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56764:x1848987613487360:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 2186us (2446us total) trans 4294971802 rc 0/0 00000100:00100000:0.0:1763333168.526632:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2976 00000100:00100000:3.0:1763333168.532022:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff6bc13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627193600:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763333168.532089:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333168.532133:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763333168.532138:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff6bc11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627193984:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333168.532164:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333168.532195:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff6bc13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627193728:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763333168.532222:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333168.532261:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763333168.532266:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff6bc12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627193856:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333168.532285:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333168.532313:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627193600 00000100:00100000:3.0:1763333168.532322:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627193600 00000100:00100000:3.0:1763333168.532389:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627193984 00000100:00100000:3.0:1763333168.532392:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627193984 00000100:00100000:3.0:1763333168.532409:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627193728 00000100:00100000:3.0:1763333168.532412:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627193728 00000100:00100000:3.0:1763333168.532424:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627193856 00000100:00100000:3.0:1763333168.532426:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627193856 00000100:00100000:3.0:1763333168.532442:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6054 00000100:00100000:3.0:1763333168.532448:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+8:3653:x1848987627193600:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763333168.532473:0:8404:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:509 count 1 00010000:00010000:3.0:1763333168.532500:0:8404:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c533f9 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x1fd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.532518:0:8404:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c532ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369687c3 expref: 14 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.532527:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333168.532529:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333168.532532:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c533f9 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x1fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.532556:0:8404:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c532ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369687c3 expref: 14 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.532569:0:8404:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c532ef lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369687c3 expref: 14 pid: 8406 timeout: 1372 lvb_type: 0 00000100:00100000:3.0:1763333168.532580:0:8404:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff6bc11180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8404:1848987627194112:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333168.532631:0:8404:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff742b9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1763333168.532765:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6055 00000100:00100000:3.0:1763333168.532772:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+8:3653:x1848987627193984:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1763333168.532927:0:8611:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x1fc:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1763333168.532931:0:8611:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x1fc:0x0] updating lvb mtime from disk: 1763333168 -> 1763333168 00002000:00010000:3.0:1763333168.532934:0:8611:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x1fc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333168.532936:0:8611:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x1fc:0x0] updating lvb ctime from disk: 1763333168 -> 1763333168 00002000:00010000:3.0:1763333168.532939:0:8611:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x1fc:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763333168.532979:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+9:3653:x1848987627193984:12345-0@lo:2:osp-syn-1-1.0 Request processed in 206us (815us total) trans 17179871372 rc 0/0 00000100:00100000:3.0:1763333168.532989:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6055 00000100:00100000:3.0:1763333168.533010:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6056 00000100:00100000:3.0:1763333168.533018:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+8:3654:x1848987627193728:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763333168.533031:0:8611:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:510 count 1 00002000:00010000:3.0:1763333168.533053:0:8611:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x1fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333168.533061:0:8611:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c53400 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.533081:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333168.533085:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333168.533092:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c53400 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.533111:0:8611:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c53400 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.533123:0:8611:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c53400 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.533135:0:8611:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c53400 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.533162:0:8611:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763333168.533393:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+9:3654:x1848987627193728:12345-0@lo:6:osp-syn-1-1.0 Request processed in 373us (1168us total) trans 17179871373 rc 0/0 00000100:00100000:3.0:1763333168.533404:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6056 00000100:00100000:3.0:1763333168.533420:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6057 00000100:00100000:3.0:1763333168.533427:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+8:3654:x1848987627193856:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1763333168.533485:0:8611:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x1fb:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333168.533488:0:8611:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x1fb:0x0] updating lvb mtime from disk: 1763333168 -> 1763333168 00002000:00010000:3.0:1763333168.533490:0:8611:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x1fb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333168.533492:0:8611:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x1fb:0x0] updating lvb ctime from disk: 1763333168 -> 1763333168 00002000:00010000:3.0:1763333168.533494:0:8611:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x1fb:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333168.533521:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+9:3654:x1848987627193856:12345-0@lo:2:osp-syn-1-1.0 Request processed in 96us (1235us total) trans 17179871374 rc 0/0 00000100:00100000:3.0:1763333168.533528:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6057 00010000:00010000:3.0:1763333168.533556:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333168.533563:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c53400 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.533570:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97800 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333168.533574:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c53400 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.533581:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c53400 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.533607:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c53400 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.533616:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c53400 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.533630:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333168.533632:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333168.533634:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763333168.533666:0:3654:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179871368 gen 2 00000004:00080000:3.0:1763333168.533673:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff74034e00, transno 17179871346 00000004:00080000:3.0:1763333168.533684:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff74036680, transno 17179871347 00000004:00080000:3.0:1763333168.533687:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff74037100, transno 17179871348 00000004:00080000:3.0:1763333168.533690:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff74034000, transno 17179871349 00000004:00080000:3.0:1763333168.533693:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4684f480, transno 17179871350 00000004:00080000:3.0:1763333168.533696:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff6bc11f80, transno 17179871351 00000004:00080000:3.0:1763333168.533699:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff6bc10e00, transno 17179871352 00000004:00080000:3.0:1763333168.533702:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff6bc12680, transno 17179871353 00000004:00080000:3.0:1763333168.533705:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe438a8700, transno 17179871355 00000004:00080000:3.0:1763333168.533709:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe438a8a80, transno 17179871356 00000004:00080000:3.0:1763333168.533711:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe438a9500, transno 17179871357 00000004:00080000:3.0:1763333168.533714:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe438a8e00, transno 17179871358 00000004:00080000:3.0:1763333168.533716:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46a6df80, transno 17179871360 00000004:00080000:3.0:1763333168.533719:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46a6d880, transno 17179871361 00000004:00080000:3.0:1763333168.533722:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46a6c000, transno 17179871362 00000004:00080000:3.0:1763333168.533725:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7400d880, transno 17179871363 00000004:00080000:3.0:1763333168.533728:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe438a9c00, transno 17179871365 00000004:00080000:3.0:1763333168.533731:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe438aaa00, transno 17179871366 00000004:00080000:3.0:1763333168.533734:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe434c7100, transno 17179871367 00000004:00080000:3.0:1763333168.533736:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe434c4e00, transno 17179871368 00000100:00100000:0.0:1763333168.533948:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4684d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627194624:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333168.533987:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333168.534020:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1763333168.534025:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4684ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627194240:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763333168.534045:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333168.534072:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627194624 00000100:00100000:0.0:1763333168.534079:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627194624 00000100:00100000:0.0:1763333168.534113:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627194240 00000100:00100000:0.0:1763333168.534117:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627194240 00000100:00100000:0.0:1763333168.534137:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6058 00000100:00100000:0.0:1763333168.534144:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+55:3652:x1848987627194624:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1763333168.534232:0:8406:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x1fc:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333168.534236:0:8406:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x1fc:0x0] updating lvb mtime from disk: 1763333168 -> 1763333168 00002000:00010000:0.0:1763333168.534239:0:8406:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x1fc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333168.534241:0:8406:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x1fc:0x0] updating lvb ctime from disk: 1763333168 -> 1763333168 00002000:00010000:0.0:1763333168.534243:0:8406:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1fc:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333168.534282:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+56:3652:x1848987627194624:12345-0@lo:2:osp-syn-0-1.0 Request processed in 138us (295us total) trans 21474838678 rc 0/0 00000100:00100000:0.0:1763333168.534291:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6058 00000100:00100000:0.0:1763333168.534309:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6059 00000100:00100000:0.0:1763333168.534316:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+55:3652:x1848987627194240:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1763333168.534331:0:8406:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:509 count 1 00010000:00010000:0.0:1763333168.534376:0:8406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb200/0xb32e3ef184c53407 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1fd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.534392:0:8406:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c532f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369687ca expref: 33 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.534402:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333168.534407:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333168.534411:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb200/0xb32e3ef184c53407 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.534450:0:8406:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c532f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369687ca expref: 33 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.534469:0:8406:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c532f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369687ca expref: 33 pid: 8406 timeout: 1372 lvb_type: 0 00000100:00100000:0.0:1763333168.534485:0:8406:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4684df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8406:1848987627194752:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333168.534541:0:8406:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff801ac180 going to sleep for 11 seconds 00000100:00100000:0.0:1763333168.534571:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4684d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627194496:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333168.534617:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333168.534638:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1763333168.534647:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4684ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627194368:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763333168.534679:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333168.534707:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627194496 00000100:00100000:0.0:1763333168.534712:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627194496 00000100:00100000:0.0:1763333168.534734:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627194368 00000100:00100000:0.0:1763333168.534737:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627194368 00000100:00100000:0.0:1763333168.534762:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6060 00000100:00100000:0.0:1763333168.534788:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff59229c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+57:3655:x1848987627194496:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1763333168.534863:0:8407:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x1fb:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1763333168.534866:0:8407:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x1fb:0x0] updating lvb mtime from disk: 1763333168 -> 1763333168 00002000:00010000:0.0:1763333168.534869:0:8407:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x1fb:0x0] updating lvb atime from disk: 1763333168 -> 1763333168 00002000:00010000:0.0:1763333168.534872:0:8407:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x1fb:0x0] updating lvb ctime from disk: 1763333168 -> 1763333168 00002000:00010000:0.0:1763333168.534874:0:8407:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1fb:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1763333168.534909:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff59229c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+58:3655:x1848987627194496:12345-0@lo:2:osp-syn-0-1.0 Request processed in 121us (288us total) trans 21474838679 rc 0/0 00000100:00100000:0.0:1763333168.534921:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6060 00000100:00100000:0.0:1763333168.534942:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6061 00000100:00100000:0.0:1763333168.534951:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff59229880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+57:3655:x1848987627194368:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1763333168.534965:0:8407:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:510 count 1 00002000:00010000:0.0:1763333168.534983:0:8407:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333168.534988:0:8407:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c53431 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.534996:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333168.534997:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333168.535001:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c53431 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.535010:0:8407:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c53431 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.535017:0:8407:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c53431 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.535023:0:8407:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c53431 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.535041:0:8407:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763333168.539731:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff59229880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+58:3655:x1848987627194368:12345-0@lo:6:osp-syn-0-1.0 Request processed in 4771us (5044us total) trans 21474838680 rc 0/0 00000100:00100000:0.0:1763333168.539746:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6061 00000004:00080000:0.0:1763333168.539807:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4684ea00/2, rc 0, transno 21474838680 00000100:00100000:0.0:1763333168.539813:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4684ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627194368:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763333168.540686:0:3654:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff92ff6bc12300 x1848987627193856/t17179871374(17179871374) o2->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763333184 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1763333168.540763:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff6bc12300/2, rc 0, transno 17179871374 00000100:00100000:3.0:1763333168.540768:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff6bc12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627193856:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763333168.540790:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff6bc13800/2, rc 0, transno 17179871373 00000100:00100000:3.0:1763333168.540794:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff6bc13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627193728:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1763333168.541170:0:9836:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 4 in progress, 1 in flight, 20 done 00000100:00100000:0.0:1763333168.547651:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333168.547704:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333168.547735:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613488000 00000100:00100000:0.0:1763333168.547741:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613488000 00000100:00100000:0.0:1763333168.547783:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8737 00000100:00100000:0.0:1763333168.547793:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5922a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+214:56760:x1848987613488000:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333168.547819:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333168.547842:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb800/0xb32e3ef184c53438 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x182:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696881e expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.547901:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb800/0xb32e3ef184c53438 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x182:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696881e expref: 216 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.547918:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb800/0xb32e3ef184c53438 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x182:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696881e expref: 216 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.547940:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x182:0x0].0x0 (ffff92fe43a0b500) 00010000:00010000:0.0:1763333168.547945:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333168.547949:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feb800, rc 0) 00000100:00100000:0.0:1763333168.547973:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5922a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+216:56760:x1848987613488000:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 183us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333168.547980:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8737 00010000:00010000:3.0:1763333168.548334:0:8404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c532ef lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x1fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369687c3 expref: 14 pid: 8406 timeout: 1372 lvb_type: 0 00000100:00100000:3.0:1763333168.548346:0:8404:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff6bc11180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8404:1848987627194112:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333168.548385:0:8404:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c533f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.548396:0:8404:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c533f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.548407:0:8404:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c533f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.548416:0:8404:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c533f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.548423:0:8404:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c533f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.548441:0:8404:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763333168.548679:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+9:3653:x1848987627193600:12345-0@lo:6:osp-syn-1-1.0 Request processed in 16229us (16589us total) trans 17179871375 rc 0/0 00000100:00100000:3.0:1763333168.548686:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6054 00010000:00010000:3.0:1763333168.548705:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333168.548711:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c533f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.548718:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97200 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333168.548722:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c533f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.548730:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c533f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.548742:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c533f9 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.548753:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c533f9 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.548769:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333168.548770:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333168.548771:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763333168.548796:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff6bc13100/2, rc 0, transno 17179871375 00000100:00100000:3.0:1763333168.548801:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff6bc13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627193600:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1763333168.551318:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333168.551329:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb200/0xb32e3ef184c53407 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.551339:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feb200 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333168.551344:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb200/0xb32e3ef184c53407 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.551379:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb200/0xb32e3ef184c53407 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.551400:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb200/0xb32e3ef184c53407 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.551407:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb200/0xb32e3ef184c53407 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.551427:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333168.551429:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333168.551431:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763333168.555080:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4684ed80/2, rc 0, transno 21474838681 00000100:00100000:0.0:1763333168.555088:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4684ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627194240:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763333168.555761:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333168.555801:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333168.555935:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613488384 00000100:00100000:3.0:1763333168.555940:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613488384 00000100:00100000:3.0:1763333168.555972:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8739 00000100:00100000:3.0:1763333168.555979:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5922b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+216:55917:x1848987613488384:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:3.0:1763333168.556005:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333168.556028:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c53423 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x185:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968817 expref: 216 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.556043:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x185:0x0].0x0 (ffff92ff618aa100) 00010000:00010000:3.0:1763333168.556047:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333168.556178:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c5344d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x185:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333168.556192:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c5344d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x185:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333168.556202:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c5344d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x185:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000001:00080000:3.0:1763333168.556239:0:6521:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294971804 00000004:00010000:3.0:1763333168.556258:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f4f90145 reply state 00000000c51ef43a transno 4294971806 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c5344d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x185:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333168.556270:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c5344d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x185:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333168.556277:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x185:0x0].0x0 (ffff92ff618aa100) 00010000:00010000:3.0:1763333168.556279:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763333168.556282:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763333168.556338:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333168.556344:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c53454 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x182:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333168.556379:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e800 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333168.556383:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c53454 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x182:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333168.556391:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c53454 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x182:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333168.556401:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x182:0x0].0x0 (ffff92fe43a0b500) 00010000:00010000:0.0:1763333168.556404:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763333168.556408:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c53454 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x182:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333168.556413:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c53454 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x182:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333168.556421:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333168.556423:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333168.556425:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763333168.560466:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333168.570454:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333168.574704:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613489024 00000100:00100000:3.0:1763333168.574721:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613489024 00000100:00100000:3.0:1763333168.574810:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8741 00000100:00100000:3.0:1763333168.574822:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5922bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+220:55917:x1848987613489024:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333168.574850:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333168.574875:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c5347e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x185:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968833 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.574941:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c5347e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x185:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968833 expref: 221 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.574955:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c5347e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x185:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968833 expref: 221 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.574974:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x185:0x0].0x0 (ffff92ff618aa100) 00010000:00010000:3.0:1763333168.574978:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763333168.574981:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a97200, rc 0) 00000100:00100000:3.0:1763333168.575065:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5922bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:55917:x1848987613489024:12345-192.168.204.28@tcp:101:bash.0 Request processed in 246us (4621us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333168.575072:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8741 00000100:00100000:0.0:1763333168.579234:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333168.579290:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333168.579691:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613489664 00000100:00100000:3.0:1763333168.579706:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613489664 00000100:00100000:3.0:1763333168.579773:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8742 00000100:00100000:3.0:1763333168.579783:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff59229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:55917:x1848987613489664:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333168.579811:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333168.579814:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:3.0:1763333168.579847:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c5347e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x185:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968833 expref: 221 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.579872:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c53470 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x185:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696882c expref: 220 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.579884:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x185:0x0].0x0 (ffff92ff618aa100) 00010000:00010000:3.0:1763333168.579890:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333168.579902:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c5348c lrc: 2/0,0 mode: --/EX res: [0x240000404:0x185:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968841 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.579962:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c53493 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x185:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333168.579975:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c53493 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x185:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333168.579984:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c53493 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x185:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000040:00080000:3.0:1763333168.580211:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1261, 88 off107280 00000004:00080000:3.0:1763333168.580219:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1272659869362ns, next at 1273519604631ns, rc = 0 00000040:00080000:3.0:1763333168.580257:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1260, 88 off107280 00000004:00080000:3.0:1763333168.580262:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1272659912632ns, next at 1273519575533ns, rc = 0 00000040:00080000:3.0:1763333168.580312:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1261, 88 off107368 00000004:00080000:3.0:1763333168.580318:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1272659968829ns, next at 1273519575533ns, rc = 0 00000040:00080000:3.0:1763333168.580338:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1262, 88 off107368 00000004:00080000:3.0:1763333168.580342:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1272659992964ns, next at 1273519604631ns, rc = 0 00000100:00100000:0.0:1763333168.586486:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:3.0:1763333168.588104:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c5344d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x185:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333168.588112:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c5344d lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x185:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333168.588118:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c5344d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x185:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333168.588123:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333168.588127:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c5344d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x185:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333168.588133:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c5344d lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x185:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333168.588143:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x185:0x0].0x0 (ffff92ff618aa100) 00010000:00010000:3.0:1763333168.588146:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333168.588149:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c5344d lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x185:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333168.588155:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c5344d lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x185:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000100:00100000:3.0:1763333168.588202:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6065 00000100:00100000:3.0:1763333168.588211:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75667800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+13:3655:x1848987627195136:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333168.588552:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4920df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627195904:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333168.591174:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75667800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+13:3655:x1848987627195136:12345-0@lo:2:osp-syn-1-1.0 Request processed in 2962us (3940us total) trans 17179871377 rc 0/0 00000100:00100000:3.0:1763333168.591182:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6065 00010000:00010000:3.0:1763333168.591249:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c53493 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x185:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968841 expref: 216 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.591261:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x185:0x0].0x0 (ffff92ff618aa100) 00010000:00010000:3.0:1763333168.591266:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763333168.591281:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c5348c lrc: 0/0,0 mode: --/EX res: [0x240000404:0x185:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968841 expref: 216 pid: 6521 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1763333168.591300:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c53493 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x185:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968841 expref: 215 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.591328:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x185:0x0].0x0 (ffff92ff618aa100) 00000100:00100000:0.0:1763333168.591333:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763333168.591334:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763333168.591338:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a97000, rc 0) 00000100:00100000:3.0:1763333168.591387:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff59229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+215:55917:x1848987613489664:12345-192.168.204.28@tcp:101:bash.0 Request processed in 11605us (12096us total) trans 4294971808 rc 0/0 00000100:00100000:3.0:1763333168.591395:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8742 00000100:00100000:0.0:1763333168.591429:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4920c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627195776:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333168.591457:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1763333168.591486:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff50049180/2, rc 0, transno 17179871377 00000100:00100000:0.0:1763333168.591492:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff50049180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627195136:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333168.591501:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1763333168.591508:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4920ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627195648:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763333168.591532:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333168.591562:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627195904 00000100:00100000:0.0:1763333168.591566:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627195904 00000100:00100000:0.0:1763333168.591587:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627195776 00000100:00100000:0.0:1763333168.591590:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627195776 00000100:00100000:0.0:1763333168.591616:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627195648 00000100:00100000:0.0:1763333168.591619:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627195648 00000100:00100000:0.0:1763333168.591634:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6068 00000100:00100000:0.0:1763333168.591640:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+61:3652:x1848987627195904:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333168.591781:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+62:3652:x1848987627195904:12345-0@lo:2:osp-syn-0-1.0 Request processed in 141us (451us total) trans 21474838682 rc 0/0 00000100:00100000:0.0:1763333168.591788:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6068 00000100:00100000:0.0:1763333168.591801:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6069 00000100:00100000:0.0:1763333168.591807:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e05b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+61:3655:x1848987627195776:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1763333168.591861:0:8406:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x1ff:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333168.591865:0:8406:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x1ff:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763333168.591867:0:8406:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x1ff:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333168.591869:0:8406:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x1ff:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763333168.591871:0:8406:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1ff:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333168.591899:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e05b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+62:3655:x1848987627195776:12345-0@lo:2:osp-syn-0-1.0 Request processed in 92us (440us total) trans 21474838683 rc 0/0 00000100:00100000:0.0:1763333168.591905:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6069 00000100:00100000:0.0:1763333168.591917:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6070 00000100:00100000:0.0:1763333168.591924:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+61:3655:x1848987627195648:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1763333168.591935:0:8406:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:508 count 1 00010000:00010000:0.0:1763333168.591948:0:8406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c534d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.591962:0:8406:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c53397 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369687fb expref: 33 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.591969:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333168.591971:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333168.591975:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c534d2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.591996:0:8406:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c53397 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369687fb expref: 33 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.592006:0:8406:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c53397 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369687fb expref: 33 pid: 28651 timeout: 1372 lvb_type: 0 00000100:00100000:0.0:1763333168.592016:0:8406:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4920f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8406:1848987627196288:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333168.592042:0:8406:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff801ac180 going to sleep for 11 seconds 00000004:00080000:0.0:1763333168.592066:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4920c700/2, rc 0, transno 21474838683 00000100:00100000:0.0:1763333168.592071:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4920c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627195776:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1763333168.592087:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4920df80/2, rc 0, transno 21474838682 00000100:00100000:0.0:1763333168.592092:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4920df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627195904:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333168.599159:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333168.599200:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333168.599227:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613490048 00000100:00100000:0.0:1763333168.599237:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613490048 00010000:00010000:0.0:1763333168.599284:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c5317c lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x1fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696873e expref: 14 pid: 17605 timeout: 1372 lvb_type: 0 00000100:00100000:0.0:1763333168.599317:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613490176 00000100:00100000:0.0:1763333168.599320:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613490176 00010000:00010000:0.0:1763333168.599336:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5329b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369687a0 expref: 34 pid: 8404 timeout: 1372 lvb_type: 1 00000100:00100000:0.0:1763333168.599399:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2866 00000100:00100000:0.0:1763333168.599410:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2418:x1848987613490048:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333168.599428:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333168.599434:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c5317c lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x1fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696873e expref: 14 pid: 17605 timeout: 1372 lvb_type: 0 00010000:00010000:0.0:1763333168.599449:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c5317c lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696873e expref: 14 pid: 17605 timeout: 1372 lvb_type: 0 00010000:00010000:0.0:1763333168.599477:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333168.599479:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333168.599485:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c534bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.599496:0:28428:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c534bd lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x1fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.599520:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333168.599580:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2418:x1848987613490048:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 171us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333168.599589:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2866 00000100:00100000:0.0:1763333168.599626:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2867 00000100:00100000:0.0:1763333168.599633:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff4627f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+34:2418:x1848987613490176:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333168.599643:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333168.599648:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5329b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369687a0 expref: 34 pid: 8404 timeout: 1372 lvb_type: 1 00010000:00010000:0.0:1763333168.599658:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5329b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369687a0 expref: 34 pid: 8404 timeout: 1372 lvb_type: 1 00010000:00010000:0.0:1763333168.599674:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333168.599677:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333168.599681:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5600/0xb32e3ef184c534cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.599688:0:28428:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5600/0xb32e3ef184c534cb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.599702:0:8404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5329b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369687a0 expref: 34 pid: 8404 timeout: 1372 lvb_type: 1 00010000:00010000:0.0:1763333168.599702:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333168.599720:0:8404:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e123100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8404:1848987627196160:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333168.599727:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff4627f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+33:2418:x1848987613490176:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 93us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333168.599734:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2867 00000100:00100000:0.0:1763333168.599865:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333168.599882:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613490304 00000100:00100000:0.0:1763333168.599886:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613490304 00010000:00010000:0.0:1763333168.599901:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53389 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369687ed expref: 14 pid: 8404 timeout: 1372 lvb_type: 0 00000100:00100000:0.0:1763333168.599920:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2868 00000100:00100000:0.0:1763333168.599926:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2418:x1848987613490304:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333168.599934:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333168.599939:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53389 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x1fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369687ed expref: 14 pid: 8404 timeout: 1372 lvb_type: 0 00010000:00010000:0.0:1763333168.599948:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53389 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369687ed expref: 14 pid: 8404 timeout: 1372 lvb_type: 0 00010000:00010000:0.0:1763333168.599966:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333168.599968:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333168.599971:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c534c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.599979:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c534c4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x1fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.599990:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333168.600007:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2418:x1848987613490304:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 81us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333168.600013:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2868 00000100:00100000:0.0:1763333168.600075:0:8406:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4920f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8406:1848987627196288:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333168.600090:0:8406:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c534d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333168.600123:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333168.600139:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613490432 00000100:00100000:0.0:1763333168.600143:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613490432 00010000:00010000:0.0:1763333168.600157:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c53397 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369687fb expref: 33 pid: 28651 timeout: 1372 lvb_type: 0 00000100:00100000:0.0:1763333168.600175:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2869 00000100:00100000:0.0:1763333168.600181:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+33:2419:x1848987613490432:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333168.600188:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333168.600193:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c53397 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369687fb expref: 33 pid: 28651 timeout: 1372 lvb_type: 0 00010000:00010000:0.0:1763333168.600203:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c53397 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369687fb expref: 33 pid: 28651 timeout: 1372 lvb_type: 0 00010000:00010000:0.0:1763333168.600216:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c53397 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369687fb expref: 33 pid: 28651 timeout: 1372 lvb_type: 0 00010000:00010000:0.0:1763333168.600225:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333168.600227:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333168.600230:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c534d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.600237:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c534d2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.600252:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333168.600270:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+32:2419:x1848987613490432:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 89us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333168.600277:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2869 00010000:00010000:3.0:1763333168.600290:0:8404:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5600/0xb32e3ef184c534cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.600298:0:8406:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c534d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.600302:0:8404:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5600/0xb32e3ef184c534cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.600313:0:8406:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c534d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.600316:0:8404:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5600/0xb32e3ef184c534cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.600332:0:8406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c534d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.600335:0:8404:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5600/0xb32e3ef184c534cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.600385:0:8404:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5600/0xb32e3ef184c534cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.600387:0:8406:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c534d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.600415:0:8404:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1763333168.600770:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+62:3653:x1848987627195520:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9950us (10080us total) trans 21474838684 rc 0/0 00000100:00100000:3.0:1763333168.600779:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6067 00010000:00010000:0.0:1763333168.602002:0:8406:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:0.0:1763333168.602226:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+62:3655:x1848987627195648:12345-0@lo:6:osp-syn-0-1.0 Request processed in 10301us (10690us total) trans 21474838685 rc 0/0 00000100:00100000:0.0:1763333168.602236:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6070 00010000:00010000:0.0:1763333168.602266:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1763333168.602274:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5600/0xb32e3ef184c534cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.602282:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5600 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333168.602286:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5600/0xb32e3ef184c534cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.602294:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5600/0xb32e3ef184c534cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.602310:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5600/0xb32e3ef184c534cb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.602316:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5600/0xb32e3ef184c534cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.602334:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1763333168.602337:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c534d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.602343:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea800 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333168.604607:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c534d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.604630:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c534d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.604648:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333168.604654:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c534d2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.604662:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c534d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.604692:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333168.604694:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333168.604698:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763333168.604847:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613490816 00000100:00100000:0.0:1763333168.604855:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613490816 00000100:00100000:0.0:1763333168.604903:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6071 00000100:00100000:0.0:1763333168.604910:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+32:55917:x1848987613490816:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333168.604927:0:28600:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333168.604945:0:28600:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c534d9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696884f expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.604972:0:28600:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53485 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696883a expref: 33 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333168.604984:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333168.604987:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333168.604991:0:28600:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c534d9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696884f expref: 33 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.605027:0:28600:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53485 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696883a expref: 33 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333168.605040:0:28600:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53485 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696883a expref: 33 pid: 8406 timeout: 1372 lvb_type: 1 00000100:00100000:0.0:1763333168.605053:0:28600:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4920e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28600:1848987627196416:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333168.605142:0:28600:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff471d7a80 going to sleep for 11 seconds 00000004:00080000:3.0:1763333168.605994:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff5004b480/2, rc 0, transno 17179871379 00000100:00100000:3.0:1763333168.606002:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff5004b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627194880:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1763333168.606824:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763333168.609764:0:28600:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4920e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28600:1848987627196416:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333168.609773:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613491072 00000100:00100000:3.0:1763333168.609784:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613491072 00010000:00010000:0.0:1763333168.609805:0:28600:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c534d9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696884f expref: 34 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.609832:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53485 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696883a expref: 34 pid: 8406 timeout: 1372 lvb_type: 1 00010000:00010000:0.0:1763333168.609832:0:28600:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea000, rc 0) 00000100:00100000:3.0:1763333168.609874:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2870 00000100:00100000:3.0:1763333168.609885:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+34:2421:x1848987613491072:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333168.609902:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333168.609908:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53485 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696883a expref: 34 pid: 8406 timeout: 1372 lvb_type: 1 00010000:00010000:3.0:1763333168.609922:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53485 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696883a expref: 34 pid: 8406 timeout: 1372 lvb_type: 1 00010000:00010000:3.0:1763333168.609962:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53485 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696883a expref: 34 pid: 8406 timeout: 1372 lvb_type: 1 00010000:00010000:3.0:1763333168.609982:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333168.609985:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333168.609996:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c534d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696884f expref: 33 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.610009:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c534d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696884f expref: 33 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.610057:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c534d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696884f expref: 33 pid: 28600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333168.610075:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff6bc11180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6505:1848987627196544:192.168.204.28@tcp:105: 00000100:00100000:0.0:1763333168.610791:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+33:55917:x1848987613490816:12345-192.168.204.28@tcp:101:bash.0 Request processed in 5877us (6000us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333168.610800:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff742b9600 going to sleep for 11 seconds 00000100:00100000:0.0:1763333168.610800:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6071 00000100:00100000:0.0:1763333168.622222:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613491200 00000100:00100000:0.0:1763333168.622234:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613491200 00000100:00100000:0.0:1763333168.622299:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6072 00000100:00100000:0.0:1763333168.622310:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:55917:x1848987613491200:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333168.622331:0:28600:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333168.622382:0:28600:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c534e0 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968856 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763333168.622410:0:28600:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x1ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333168.622436:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333168.622438:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333168.622451:0:28600:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c534e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968856 expref: 13 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.622470:0:28600:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c534e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968856 expref: 13 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.622484:0:28600:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea800, rc 0) 00000100:00100000:0.0:1763333168.622511:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:55917:x1848987613491200:12345-192.168.204.28@tcp:101:bash.0 Request processed in 204us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333168.622518:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6072 00000100:00100000:3.0:1763333168.641283:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333168.641331:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333168.641568:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1521 00000100:00100000:3.0:1763333168.641580:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2421:x1848987613491456:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:3.0:1763333168.641789:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x1ff:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333168.641797:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x1ff:0x0] updating lvb mtime from disk: 0 -> 1763333168 00002000:00010000:3.0:1763333168.641803:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x1ff:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333168.641808:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x1ff:0x0] updating lvb ctime from disk: 0 -> 1763333168 00002000:00010000:3.0:1763333168.641812:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x1ff:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333168.641889:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2421:x1848987613491456:12345-192.168.204.28@tcp:10:bash.0 Request processed in 312us (556us total) trans 17179871380 rc 0/0 00000100:00100000:3.0:1763333168.641897:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1521 00002000:00010000:3.0:1763333168.641902:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/511 (0->18446744073709551615) 00002000:00100000:3.0:1763333168.641905:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff6bc10e00 with x1848987613491456 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333168.641910:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff6bc10e00. 00000100:00100000:3.0:1763333168.649404:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613491712 00000100:00100000:3.0:1763333168.649417:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613491712 00000100:00100000:3.0:1763333168.649476:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8744 00000100:00100000:3.0:1763333168.649487:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+216:56765:x1848987613491712:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333168.649513:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333168.649544:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c534e7 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696885d expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.649656:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c534ee lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333168.649674:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c534ee lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.649688:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c534ee lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.649703:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c534f5 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333168.649709:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c534f5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.649715:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c534f5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.649864:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c534fc lrc: 3/1,0 mode: --/PR res: [0x240000404:0x185:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333168.649874:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c534fc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x185:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.649880:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c534fc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x185:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:3.0:1763333168.649891:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x185:0x0]: returning size 2 00010000:00010000:3.0:1763333168.649990:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c534ee lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.649998:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c534ee lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.650005:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c534ee lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.650011:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c534ee lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.650017:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333168.650021:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c534ee lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.650027:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c534ee lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.650041:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff80045000) 00010000:00010000:3.0:1763333168.650044:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333168.650049:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c534ee lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.650057:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c534ee lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.650073:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c534f5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.650078:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c534f5 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.650083:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c534f5 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.650089:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333168.650091:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c534f5 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.650097:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c534f5 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.650103:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045c00) 00010000:00010000:3.0:1763333168.650106:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333168.650108:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c534f5 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.650114:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c534f5 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.650162:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c534e7 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696885d expref: 219 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.650179:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c534fc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x185:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696885d expref: 218 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.650191:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x185:0x0].0x0 (ffff92ff618aa100) 00010000:00010000:3.0:1763333168.650194:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333168.650197:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96000, rc 0) 00000100:00100000:3.0:1763333168.650281:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+218:56765:x1848987613491712:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 796us (1056us total) trans 4294971812 rc 0/0 00000100:00100000:3.0:1763333168.650290:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8744 00000100:00100000:0.0:1763333168.651069:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333168.656107:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613492224 00000100:00100000:3.0:1763333168.656119:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613492224 00000100:00100000:3.0:1763333168.656186:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2982 00000100:00100000:3.0:1763333168.656196:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:56765:x1848987613492224:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333168.656514:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+220:56765:x1848987613492224:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 319us (484us total) trans 4294971814 rc 0/0 00000100:00100000:3.0:1763333168.656524:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2982 00000100:00100000:0.0:1763333168.669039:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613492480 00000100:00100000:0.0:1763333168.669052:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613492480 00000100:00100000:0.0:1763333168.669128:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8745 00000100:00100000:0.0:1763333168.669138:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+220:56766:x1848987613492480:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:0.0:1763333168.669199:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1763333168.669227:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c53493 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x185:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968841 expref: 220 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.669249:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c534fc lrc: 0/0,0 mode: --/PR res: [0x240000404:0x185:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696885d expref: 219 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.669263:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c53446 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x185:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968825 expref: 218 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.669274:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x185:0x0].0x0 (ffff92ff618aa100) 00010000:00010000:0.0:1763333168.669286:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333168.669313:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5350a lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333168.669325:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5350a lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.669417:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5350a lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.669455:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42febe00/0xb32e3ef184c53511 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333168.669463:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42febe00/0xb32e3ef184c53511 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.669470:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42febe00/0xb32e3ef184c53511 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.669558:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c53518 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x185:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333168.669566:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c53518 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x185:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.669572:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c53518 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x185:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000040:00080000:0.0:1763333168.669837:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1263, 64 off107432 00000040:00080000:0.0:1763333168.669866:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1262, 64 off107432 00000040:00080000:0.0:1763333168.669879:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1263, 64 off107496 00000040:00080000:0.0:1763333168.669890:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1264, 64 off107496 00010000:00010000:0.0:1763333168.669950:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c5351f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x185:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333168.669959:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c5351f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x185:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.669966:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c5351f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x185:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.669973:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c5351f lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x185:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.669980:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c5351f lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x185:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.669985:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c5351f lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x185:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.670015:0:6521:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763333168.670033:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c53518 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x185:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.670041:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c53518 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x185:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.670052:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c53518 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x185:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.670071:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333168.670079:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c53518 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x185:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.670099:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c53518 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x185:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.670120:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x185:0x0].0x0 (ffff92fe43ab5f00) 00010000:00010000:0.0:1763333168.670124:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1763333168.670293:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c53518 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x185:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.670302:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c53518 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x185:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.670454:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5350a lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.670460:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5350a lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.670465:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5350a lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.670471:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5350a lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.670475:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feba00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333168.670478:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5350a lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.670484:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5350a lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.670492:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab5800) 00010000:00010000:0.0:1763333168.670495:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333168.670499:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5350a lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.670504:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5350a lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000004:00010000:0.0:1763333168.670517:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000cc3d2524 reply state 000000001f5cfe31 transno 4294971815 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42febe00/0xb32e3ef184c53511 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.670527:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42febe00/0xb32e3ef184c53511 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.670533:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43ab5200) 00010000:00010000:0.0:1763333168.670535:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333168.670537:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763333168.670626:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:56766:x1848987613492480:12345-192.168.204.28@tcp:36:rm.0 Request processed in 1487us (1683us total) trans 4294971815 rc 0/0 00000100:00100000:0.0:1763333168.670634:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8745 00000100:00100000:0.0:1763333168.677917:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333168.679755:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613492608 00000100:00100000:3.0:1763333168.679774:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613492608 00000100:00100000:3.0:1763333168.711139:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613492864 00000100:00100000:3.0:1763333168.711155:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613492864 00000100:00100000:3.0:1763333168.711237:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8748 00000100:00100000:3.0:1763333168.711247:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:56767:x1848987613492864:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333168.711269:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333168.711296:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c53550 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968872 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.711412:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c53557 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333168.711430:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c53557 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.711441:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c53557 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.711452:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c5355e lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333168.711459:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c5355e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.711464:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c5355e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.711504:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c53557 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.711511:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c53557 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.711517:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c53557 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.711523:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c53557 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.711530:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333168.711534:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c53557 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.711542:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c53557 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.711557:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff80045000) 00010000:00010000:3.0:1763333168.711561:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333168.711566:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c53557 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.711572:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c53557 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.711586:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c5355e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.711604:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c5355e lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.711610:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c5355e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.711616:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333168.711619:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c5355e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.711626:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c5355e lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.711634:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43ab5200) 00010000:00010000:3.0:1763333168.711637:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333168.711640:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c5355e lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.711646:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c5355e lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.711673:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c53550 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968872 expref: 220 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.711685:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff80045000) 00010000:00010000:3.0:1763333168.711688:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333168.711691:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c53550 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968872 expref: 220 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.711705:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96e00, rc 0) 00000100:00100000:3.0:1763333168.712037:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:56767:x1848987613492864:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 791us (2580us total) trans 0 rc 301/301 00000100:00100000:3.0:1763333168.712049:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8748 00000100:00100000:0.0:1763333168.714097:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333168.733608:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333168.733945:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613493632 00000100:00100000:3.0:1763333168.734048:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613493632 00000100:00100000:3.0:1763333168.740276:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613493760 00000100:00100000:3.0:1763333168.740286:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613493760 00010000:00010000:3.0:1763333168.740327:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5359d lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x187:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968887 expref: 224 pid: 6521 timeout: 1372 lvb_type: 0 00000100:00100000:3.0:1763333168.740410:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2871 00000100:00100000:3.0:1763333168.740421:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43999500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:2420:x1848987613493760:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333168.740437:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333168.740444:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5359d lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x187:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968887 expref: 224 pid: 6521 timeout: 1372 lvb_type: 0 00010000:00010000:3.0:1763333168.740458:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5359d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x187:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968887 expref: 224 pid: 6521 timeout: 1372 lvb_type: 0 00010000:00010000:3.0:1763333168.740481:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x187:0x0].0x0 (ffff92ff618aa000) 00010000:00010000:3.0:1763333168.740486:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c535b2 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x187:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333168.740496:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c535b2 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x187:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333168.740504:0:6505:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c535b2 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x187:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333168.740525:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333168.740576:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43999500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:2420:x1848987613493760:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 156us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333168.740583:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2871 00010000:00010000:0.0:1763333168.740702:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5359d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x187:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968887 expref: 223 pid: 6521 timeout: 1372 lvb_type: 0 00000100:00100000:0.0:1763333168.740718:0:6521:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e123b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6521:1848987627196672:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333168.740740:0:6521:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c535b2 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x187:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.740748:0:6521:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c535b2 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x187:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.740753:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c535b2 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x187:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:0.0:1763333168.740777:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x187:0x0]: returning size 0 00000004:00080000:0.0:1763333168.740954:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x201:0x0], index 1: 0 00000004:00080000:0.0:1763333168.740962:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x201:0x0], index 0: 0 00000004:00080000:0.0:1763333168.740967:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x202:0x0], index 0: 0 00000004:00080000:0.0:1763333168.740971:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x202:0x0], index 1: 0 00010000:00010000:0.0:1763333168.741084:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c535b2 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x187:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.741092:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c535b2 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x187:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.741099:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c535b2 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x187:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.741105:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333168.741109:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c535b2 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x187:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.741116:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c535b2 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x187:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.741126:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x187:0x0].0x0 (ffff92ff618aa000) 00010000:00010000:0.0:1763333168.741129:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333168.741133:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c535b2 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x187:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.741139:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c535b2 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x187:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.741185:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c535ab lrc: 1/0,0 mode: --/CR res: [0x240000404:0x187:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696888e expref: 223 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.741193:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x187:0x0].0x0 (ffff92ff618aa000) 00010000:00010000:0.0:1763333168.741195:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763333168.741199:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c535ab lrc: 0/0,0 mode: --/CR res: [0x240000404:0x187:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696888e expref: 223 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.741213:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5e00, rc 0) 00000100:00100000:0.0:1763333168.741264:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:56767:x1848987613493632:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 6348us (7681us total) trans 4294971817 rc 301/301 00000100:00100000:0.0:1763333168.741271:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8752 00000100:00100000:3.0:1763333168.750038:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333168.750120:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613494272 00000100:00100000:0.0:1763333168.750130:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613494272 00000100:00100000:0.0:1763333168.750187:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8753 00000100:00100000:0.0:1763333168.750196:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56768:x1848987613494272:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333168.750219:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333168.750241:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c535c0 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968895 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.750308:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c535c7 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333168.750322:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c535c7 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.750333:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c535c7 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.750341:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c535ce lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333168.750368:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c535ce lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.750374:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c535ce lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.750498:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c535d5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x187:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333168.750506:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c535d5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x187:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.750511:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c535d5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x187:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:0.0:1763333168.750521:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x187:0x0]: returning size 0 00010000:00010000:0.0:1763333168.750620:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c535c7 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.750627:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c535c7 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.750633:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c535c7 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.750639:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c535c7 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.750645:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feba00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333168.750649:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c535c7 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.750656:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c535c7 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.750667:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab5800) 00010000:00010000:0.0:1763333168.750670:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333168.750675:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c535c7 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.750685:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c535c7 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.750698:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c535ce lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.750703:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c535ce lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.750708:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c535ce lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.750712:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feb200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333168.750715:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c535ce lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.750720:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c535ce lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.750727:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43ab5200) 00010000:00010000:0.0:1763333168.750729:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333168.750732:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c535ce lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.750737:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c535ce lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.750772:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c535c0 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968895 expref: 226 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.750789:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c535d5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x187:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968895 expref: 225 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.750800:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x187:0x0].0x0 (ffff92fe43ab5c00) 00010000:00010000:0.0:1763333168.750803:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333168.750805:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe467bf200, rc 0) 00000100:00100000:0.0:1763333168.750870:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56768:x1848987613494272:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 674us (842us total) trans 4294971819 rc 0/0 00000100:00100000:0.0:1763333168.750877:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8753 00000100:00100000:0.0:1763333168.755319:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333168.765190:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613494912 00000100:00100000:3.0:1763333168.765201:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613494912 00000100:00100000:3.0:1763333168.765262:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2985 00000100:00100000:3.0:1763333168.765272:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73165180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56768:x1848987613494912:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333168.765304:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613495168 00000100:00100000:0.0:1763333168.765308:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613495168 00000100:00100000:0.0:1763333168.765363:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8754 00000100:00100000:0.0:1763333168.765371:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:55917:x1848987613495168:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333168.765381:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333168.765383:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763333168.765408:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c535d5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x187:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968895 expref: 227 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.765424:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x187:0x0].0x0 (ffff92fe43ab5c00) 00010000:00010000:0.0:1763333168.765433:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333168.765446:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c535ea lrc: 2/0,0 mode: --/CW res: [0x240000404:0x187:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369688a3 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333168.765514:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73165180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56768:x1848987613494912:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 243us (546us total) trans 4294971821 rc 0/0 00010000:00010000:0.0:1763333168.765517:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c535f1 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x187:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00000100:00100000:3.0:1763333168.765522:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2985 00010000:00010000:0.0:1763333168.765530:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c535f1 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x187:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333168.765540:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c535f1 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x187:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:0.0:1763333168.765554:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x187:0x0]: returning size 0 00010000:00010000:0.0:1763333168.765630:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c535ea lrc: 0/0,0 mode: --/CW res: [0x240000404:0x187:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369688a3 expref: 229 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.765644:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c535f1 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x187:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369688a3 expref: 228 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.765652:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x187:0x0].0x0 (ffff92fe43ab5800) 00010000:00010000:0.0:1763333168.765654:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:0.0:1763333168.765657:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe467be000, rc 0) 00000100:00100000:0.0:1763333168.765688:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:55917:x1848987613495168:12345-192.168.204.28@tcp:101:bash.0 Request processed in 317us (454us total) trans 4294971822 rc 0/0 00000100:00100000:0.0:1763333168.765695:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8754 00000100:00100000:0.0:1763333168.769536:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613495424 00000100:00100000:0.0:1763333168.769547:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613495424 00000100:00100000:0.0:1763333168.769615:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8755 00000100:00100000:0.0:1763333168.769625:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56768:x1848987613495424:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333168.769652:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333168.769681:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c535ff lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369688aa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.771342:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c53614 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333168.771369:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c53614 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.771378:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c53614 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.771391:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfc00/0xb32e3ef184c5361b lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333168.771399:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfc00/0xb32e3ef184c5361b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.771405:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfc00/0xb32e3ef184c5361b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.771503:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c53622 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x187:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333168.771514:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c53622 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x187:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.771521:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c53622 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x187:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.771527:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c53622 lrc: 3/0,0 mode: --/PR res: [0x240000404:0x187:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.771533:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abde200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333168.771538:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c53622 lrc: 3/0,0 mode: --/PR res: [0x240000404:0x187:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.771545:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c53622 lrc: 4/0,0 mode: --/PR res: [0x240000404:0x187:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.771554:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x187:0x0].0x0 (ffff92fe43ab5800) 00010000:00010000:0.0:1763333168.771559:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c53622 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x187:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.771565:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c53622 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x187:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000004:00200000:0.0:1763333168.771582:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x187:0x0]: returning size 0 00010000:00010000:0.0:1763333168.771668:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c53614 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.771675:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c53614 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.771681:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c53614 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.771686:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c53614 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.771691:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe44c39000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333168.771694:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c53614 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.771700:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c53614 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.771709:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab5b00) 00010000:00010000:0.0:1763333168.771711:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333168.771715:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c53614 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.774584:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c53614 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.774616:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfc00/0xb32e3ef184c5361b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.774622:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfc00/0xb32e3ef184c5361b lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.774633:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfc00/0xb32e3ef184c5361b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.774638:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdfc00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333168.774642:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfc00/0xb32e3ef184c5361b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.774649:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfc00/0xb32e3ef184c5361b lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.774662:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43ab5200) 00010000:00010000:0.0:1763333168.774666:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333168.774669:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfc00/0xb32e3ef184c5361b lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.774676:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfc00/0xb32e3ef184c5361b lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.775038:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c535ff lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369688aa expref: 231 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.775051:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab5b00) 00010000:00010000:0.0:1763333168.775054:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763333168.775058:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c535ff lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369688aa expref: 231 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.775074:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe44c38800, rc 0) 00000100:00100000:0.0:1763333168.775895:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56768:x1848987613495424:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 6266us (6566us total) trans 4294971823 rc 301/301 00000100:00100000:0.0:1763333168.775905:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8755 00000100:00100000:0.0:1763333168.776238:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613495808 00000100:00100000:0.0:1763333168.776248:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613495808 00000100:00100000:0.0:1763333168.776305:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8757 00000100:00100000:0.0:1763333168.776314:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:55917:x1848987613495808:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:0.0:1763333168.776386:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333168.776407:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c535f1 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x187:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369688a3 expref: 230 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.776422:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x187:0x0].0x0 (ffff92fe43ab5800) 00010000:00010000:0.0:1763333168.776426:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333168.776638:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c53630 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x187:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333168.776655:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c53630 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x187:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.776665:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c53630 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x187:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000001:00080000:0.0:1763333168.776713:0:6521:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294971824 00000004:00010000:0.0:1763333168.777623:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007513eb1a reply state 0000000010b6c90c transno 4294971825 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c53630 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x187:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.777641:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c53630 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x187:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.777647:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x187:0x0].0x0 (ffff92fe43ab5800) 00010000:00010000:0.0:1763333168.777650:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333168.777653:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763333168.778467:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:55917:x1848987613495808:12345-192.168.204.28@tcp:36:bash.0 Request processed in 2147us (2428us total) trans 4294971825 rc 0/0 00000100:00100000:0.0:1763333168.778477:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8757 00000020:00080000:0.0:1763333168.778485:0:6521:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763333168.783804:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613495936 00000100:00100000:0.0:1763333168.783818:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613495936 00000100:00100000:0.0:1763333168.783891:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613496064 00000100:00100000:0.0:1763333168.783895:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613496064 00000100:00100000:0.0:1763333168.783924:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8758 00000100:00100000:0.0:1763333168.783934:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56768:x1848987613495936:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333168.783972:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333168.783997:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c53637 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x187:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369688b8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.784110:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c5363e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x187:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333168.784123:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c5363e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x187:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.784134:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c5363e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x187:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:0.0:1763333168.784163:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x187:0x0]: returning size 0 00000004:00200000:0.0:1763333168.784168:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763333168.784188:0:6521:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c5363e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x187:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333168.784219:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c53637 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x187:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369688b8 expref: 235 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.784238:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c5363e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x187:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369688b8 expref: 234 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.784247:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x187:0x0].0x0 (ffff92fe43ab5800) 00010000:00010000:0.0:1763333168.784251:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333168.784255:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdf400, rc 0) 00000100:00100000:0.0:1763333168.784313:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:56768:x1848987613495936:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 381us (2403us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333168.784319:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8758 00000100:00100000:0.0:1763333168.784336:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8759 00000100:00100000:0.0:1763333168.784342:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:55917:x1848987613496064:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333168.784375:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333168.784383:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c53645 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x187:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369688bf expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.784409:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c53645 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x187:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369688bf expref: 234 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.784418:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c53645 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x187:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369688bf expref: 234 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.784431:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x187:0x0].0x0 (ffff92fe43ab5800) 00010000:00010000:0.0:1763333168.784433:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333168.784436:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdee00, rc 0) 00000100:00100000:0.0:1763333168.784458:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:55917:x1848987613496064:12345-192.168.204.28@tcp:101:bash.0 Request processed in 117us (1636us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333168.784464:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8759 00000100:00100000:3.0:1763333168.793875:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613496448 00000100:00100000:3.0:1763333168.793885:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613496448 00000100:00100000:3.0:1763333168.793939:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2987 00000100:00100000:3.0:1763333168.793949:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:56768:x1848987613496448:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333168.795966:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:56768:x1848987613496448:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 2009us (2296us total) trans 4294971826 rc 0/0 00000100:00100000:3.0:1763333168.795980:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2987 00000100:00100000:3.0:1763333168.798117:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613496704 00000100:00100000:3.0:1763333168.798139:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613496704 00000100:00100000:0.0:1763333168.802628:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613496960 00000100:00100000:0.0:1763333168.802640:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613496960 00000100:00100000:0.0:1763333168.802702:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8761 00000100:00100000:0.0:1763333168.802711:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56768:x1848987613496960:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333168.802753:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333168.802778:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c5365a lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369688cd expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.802863:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfc00/0xb32e3ef184c53661 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333168.802877:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfc00/0xb32e3ef184c53661 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333168.802887:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfc00/0xb32e3ef184c53661 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333168.802897:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c53668 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333168.802905:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c53668 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333168.802911:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c53668 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333168.803032:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5366f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x187:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333168.803042:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5366f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x187:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333168.803048:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5366f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x187:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:0.0:1763333168.803060:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x187:0x0]: returning size 2 00010000:00010000:0.0:1763333168.804394:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5366f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x187:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333168.804414:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5366f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x187:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333168.804421:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5366f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x187:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333168.804427:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333168.804432:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5366f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x187:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333168.804439:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5366f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x187:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333168.804454:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x187:0x0].0x0 (ffff92fe43ab5800) 00010000:00010000:0.0:1763333168.804456:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1763333168.804462:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5366f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x187:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333168.804468:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5366f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x187:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333168.804489:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfc00/0xb32e3ef184c53661 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333168.804494:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfc00/0xb32e3ef184c53661 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333168.804498:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfc00/0xb32e3ef184c53661 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333168.804502:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfc00/0xb32e3ef184c53661 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333168.804507:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdfc00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333168.804510:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfc00/0xb32e3ef184c53661 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333168.804514:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfc00/0xb32e3ef184c53661 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333168.804522:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab5b00) 00010000:00010000:0.0:1763333168.804524:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333168.804527:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfc00/0xb32e3ef184c53661 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333168.804532:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfc00/0xb32e3ef184c53661 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333168.804539:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c53668 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333168.804543:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c53668 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333168.804548:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c53668 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333168.804552:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abde200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333168.804555:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c53668 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333168.804560:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c53668 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333168.804566:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43ab5200) 00010000:00010000:0.0:1763333168.804569:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333168.804571:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c53668 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333168.804580:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c53668 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333168.804639:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c5365a lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369688cd expref: 238 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.804649:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab5b00) 00010000:00010000:0.0:1763333168.804652:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763333168.804655:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c5365a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369688cd expref: 238 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.804670:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdea00, rc 0) 00000100:00100000:0.0:1763333168.804743:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56768:x1848987613496960:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 2033us (3009us total) trans 4294971828 rc 301/301 00000100:00100000:0.0:1763333168.804753:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8761 00000100:00100000:3.0:1763333168.809073:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613497216 00000100:00100000:3.0:1763333168.809085:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613497216 00000100:00100000:3.0:1763333168.809148:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2988 00000100:00100000:3.0:1763333168.809158:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73164000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56768:x1848987613497216:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333168.810626:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73164000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:56768:x1848987613497216:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 1465us (1664us total) trans 4294971829 rc 0/0 00000100:00100000:3.0:1763333168.810636:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2988 00000100:00100000:3.0:1763333168.810672:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46e2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627196800:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763333168.810724:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333168.810758:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763333168.810764:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627197184:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333168.810782:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333168.810807:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627196800 00000100:00100000:3.0:1763333168.810811:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627196800 00000100:00100000:3.0:1763333168.810838:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627197184 00000100:00100000:3.0:1763333168.810840:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627197184 00000100:00100000:3.0:1763333168.810856:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6074 00000100:00100000:3.0:1763333168.810864:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+14:3653:x1848987627196800:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763333168.810887:0:28600:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:511 count 1 00010000:00010000:3.0:1763333168.810911:0:28600:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c5367d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.810928:0:28600:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c534e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968856 expref: 14 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.810936:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333168.810938:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333168.810942:0:28600:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c5367d lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.810982:0:28600:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c534e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968856 expref: 14 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.810996:0:28600:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c534e0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968856 expref: 14 pid: 28600 timeout: 1372 lvb_type: 0 00000100:00100000:3.0:1763333168.811008:0:28600:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff6bc10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28600:1848987627197312:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333168.811050:0:28600:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff742b9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1763333168.811068:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6076 00000100:00100000:3.0:1763333168.811074:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50066d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+16:3655:x1848987627197056:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1763333168.811130:0:29010:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x201:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333168.811133:0:29010:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x201:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763333168.811135:0:29010:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x201:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333168.811138:0:29010:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x201:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763333168.811140:0:29010:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x201:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333168.811165:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50066d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+17:3655:x1848987627197056:12345-0@lo:2:osp-syn-1-1.0 Request processed in 91us (273us total) trans 17179871382 rc 0/0 00000100:00100000:3.0:1763333168.811171:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6076 00000004:00080000:3.0:1763333168.811229:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe472f2300/2, rc 0, transno 17179871381 00000100:00100000:3.0:1763333168.811235:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627197184:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1763333168.811289:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c53653 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x187:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369688c6 expref: 216 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.811297:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x187:0x0].0x0 (ffff92fe43ab5800) 00010000:00010000:3.0:1763333168.811300:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763333168.811312:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c5364c lrc: 0/0,0 mode: --/EX res: [0x240000404:0x187:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369688c6 expref: 216 pid: 6519 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1763333168.811326:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c53653 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x187:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369688c6 expref: 215 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.811371:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x187:0x0].0x0 (ffff92fe43ab5800) 00010000:00010000:3.0:1763333168.811375:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763333168.811377:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7ec00, rc 0) 00000100:00100000:3.0:1763333168.811400:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+215:55917:x1848987613496704:12345-192.168.204.28@tcp:101:bash.0 Request processed in 12785us (15247us total) trans 4294971827 rc 0/0 00000100:00100000:3.0:1763333168.811407:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8760 00000100:00100000:3.0:1763333168.811491:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4684c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627197824:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333168.811517:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333168.811543:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763333168.811548:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff6bc11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627197440:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763333168.811568:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333168.811599:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627197824 00000100:00100000:3.0:1763333168.811603:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627197824 00000100:00100000:3.0:1763333168.811623:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627197696 00000100:00100000:3.0:1763333168.811625:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627197696 00000100:00100000:3.0:1763333168.811639:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627197440 00000100:00100000:3.0:1763333168.811641:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627197440 00000100:00100000:3.0:1763333168.811657:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6078 00000100:00100000:3.0:1763333168.811663:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+65:3652:x1848987627197824:12345-0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1763333168.813910:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4684f800/2, rc 0, transno 21474838688 00000100:00100000:0.0:1763333168.813916:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4684f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627197696:0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1763333168.814061:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333168.814067:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53692 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.814075:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e600 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333168.814079:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53692 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.814086:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53692 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.814104:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53692 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.814111:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53692 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.814129:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333168.814131:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333168.814132:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763333168.814259:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff6bc12d80/2, rc 0, transno 21474838689 00000100:00100000:0.0:1763333168.814263:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff6bc12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627197568:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763333168.815170:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+66:3652:x1848987627197824:12345-0@lo:2:osp-syn-0-1.0 Request processed in 3503us (3647us total) trans 21474838687 rc 0/0 00000100:00100000:3.0:1763333168.815184:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6078 00000100:00100000:3.0:1763333168.816810:0:28600:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff6bc10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28600:1848987627197312:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333168.816841:0:28600:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c5367d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1763333168.817415:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4684c700/2, rc 0, transno 21474838687 00000100:00100000:0.0:1763333168.817421:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4684c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627197824:0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1763333168.818263:0:28600:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c5367d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.818271:0:28600:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c5367d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.818281:0:28600:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c5367d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.818289:0:28600:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c5367d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.818315:0:28600:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763333168.818561:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+17:3653:x1848987627196800:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7697us (7835us total) trans 17179871384 rc 0/0 00000100:00100000:0.0:1763333168.818569:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6074 00000004:00080000:0.0:1763333168.818617:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe46e2dc00/2, rc 0, transno 17179871384 00000100:00100000:0.0:1763333168.818623:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46e2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627196800:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763333168.822939:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333168.822975:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000004:00080000:0.0:1763333168.823894:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff6bc11c00/2, rc 0, transno 21474838690 00000100:00100000:0.0:1763333168.823901:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff6bc11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627197440:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763333168.829110:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333168.836523:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333168.836572:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00002000:00010000:0.0:1763333168.838656:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/513 (0->18446744073709551615) 00002000:00100000:0.0:1763333168.838662:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4684df80 with x1848987613498112 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333168.838680:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe4684df80. 00000100:00100000:0.0:1763333168.838732:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1522 00000100:00100000:0.0:1763333168.838820:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2420:x1848987613498112:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:0.0:1763333168.839004:0:28427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x201:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333168.839008:0:28427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x201:0x0] updating lvb mtime from disk: 0 -> 1763333169 00002000:00010000:0.0:1763333168.839011:0:28427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x201:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333168.839013:0:28427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x201:0x0] updating lvb ctime from disk: 0 -> 1763333169 00002000:00010000:0.0:1763333168.839015:0:28427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x201:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333168.839094:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2420:x1848987613498112:12345-192.168.204.28@tcp:10:bash.0 Request processed in 352us (2579us total) trans 17179871385 rc 0/0 00000100:00100000:0.0:1763333168.839103:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1522 00002000:00010000:0.0:1763333168.839107:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/513 (0->18446744073709551615) 00002000:00100000:0.0:1763333168.839109:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4684df80 with x1848987613498112 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333168.839114:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe4684df80. 00002000:00010000:0.0:1763333168.839144:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/513 (0->18446744073709551615) 00002000:00100000:0.0:1763333168.839147:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7e492050 with x1848987613498240 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333168.839152:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7e492050. 00000100:00100000:0.0:1763333168.839178:0:28429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1523 00000100:00100000:0.0:1763333168.839184:0:28429:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e492050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+33:2421:x1848987613498240:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:0.0:1763333168.839278:0:28429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x201:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333168.839281:0:28429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x201:0x0] updating lvb mtime from disk: 0 -> 1763333169 00002000:00010000:0.0:1763333168.839283:0:28429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x201:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333168.839285:0:28429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x201:0x0] updating lvb ctime from disk: 0 -> 1763333169 00002000:00010000:0.0:1763333168.839287:0:28429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x201:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333168.839309:0:28429:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e492050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+34:2421:x1848987613498240:12345-192.168.204.28@tcp:10:bash.0 Request processed in 125us (2737us total) trans 21474838691 rc 0/0 00000100:00100000:0.0:1763333168.839486:0:28429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1523 00002000:00010000:0.0:1763333168.839490:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/513 (0->18446744073709551615) 00002000:00100000:0.0:1763333168.839492:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7e492050 with x1848987613498240 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333168.839497:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7e492050. 00000100:00100000:0.0:1763333168.843341:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333168.843604:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613498496 00000100:00100000:3.0:1763333168.843616:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613498496 00000100:00100000:3.0:1763333168.843682:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8762 00000100:00100000:3.0:1763333168.843691:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+215:56769:x1848987613498496:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333168.843729:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333168.843763:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c536a7 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369688e2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.843867:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c536ae lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333168.843884:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c536ae lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.843898:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c536ae lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.843911:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c536b5 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333168.843916:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c536b5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.843926:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c536b5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.844053:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c536bc lrc: 3/1,0 mode: --/PR res: [0x240000404:0x187:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333168.844061:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c536bc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x187:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.844067:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c536bc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x187:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:3.0:1763333168.844078:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x187:0x0]: returning size 2 00010000:00010000:3.0:1763333168.844157:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c536ae lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.844164:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c536ae lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.844169:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c536ae lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.844175:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c536ae lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.844181:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333168.844185:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c536ae lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.844191:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c536ae lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.844205:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6231ec00) 00010000:00010000:3.0:1763333168.844208:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333168.844213:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c536ae lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.844219:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c536ae lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.844231:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c536b5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.844236:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c536b5 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.844241:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c536b5 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.844245:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333168.844247:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c536b5 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.844252:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c536b5 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.844257:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6231eb00) 00010000:00010000:3.0:1763333168.844259:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333168.844261:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c536b5 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.844265:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c536b5 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.844299:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c536a7 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369688e2 expref: 218 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.844310:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c536bc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x187:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369688e2 expref: 217 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.844317:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x187:0x0].0x0 (ffff92fe43ab5800) 00010000:00010000:3.0:1763333168.844319:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333168.844321:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96e00, rc 0) 00000100:00100000:3.0:1763333168.844442:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+217:56769:x1848987613498496:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 750us (1112us total) trans 4294971830 rc 0/0 00000100:00100000:3.0:1763333168.844449:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8762 00000100:00100000:0.0:1763333168.855630:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333168.862889:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333168.863405:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613499392 00000100:00100000:3.0:1763333168.863422:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613499392 00010000:00010000:3.0:1763333168.863470:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c536bc lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x187:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369688e2 expref: 221 pid: 6519 timeout: 1372 lvb_type: 0 00000100:00100000:3.0:1763333168.863521:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2875 00000100:00100000:3.0:1763333168.863534:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:2421:x1848987613499392:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333168.863553:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333168.863561:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c536bc lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x187:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369688e2 expref: 221 pid: 6519 timeout: 1372 lvb_type: 0 00010000:00010000:3.0:1763333168.863576:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c536bc lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x187:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369688e2 expref: 221 pid: 6519 timeout: 1372 lvb_type: 0 00010000:00010000:3.0:1763333168.863613:0:8423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x187:0x0].0x0 (ffff92fe43ab5800) 00010000:00010000:3.0:1763333168.863618:0:8423:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c536d1 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x187:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333168.863628:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c536d1 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x187:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333168.863640:0:8423:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c536d1 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x187:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333168.863662:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333168.863712:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:2421:x1848987613499392:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 182us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333168.863720:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2875 00000100:00100000:0.0:1763333168.870565:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333168.872056:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333168.872311:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613499648 00000100:00100000:3.0:1763333168.872316:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613499648 00000100:00100000:3.0:1763333168.872377:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8765 00000100:00100000:3.0:1763333168.872386:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:56769:x1848987613499648:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333168.872398:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333168.872408:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c536fb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x187:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369688f7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.872469:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c53702 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x187:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333168.872479:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c53702 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x187:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.872485:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c53702 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x187:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000100:00100000:0.0:1763333168.875608:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333168.876339:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613499776 00000100:00100000:3.0:1763333168.876374:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613499776 00010000:00010000:3.0:1763333168.876415:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c536d1 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x187:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369688e9 expref: 224 pid: 8606 timeout: 1372 lvb_type: 0 00000100:00100000:3.0:1763333168.877051:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2876 00000100:00100000:3.0:1763333168.877064:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:2421:x1848987613499776:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333168.877082:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333168.877091:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c536d1 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x187:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369688e9 expref: 224 pid: 8606 timeout: 1372 lvb_type: 0 00010000:00010000:3.0:1763333168.877106:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c536d1 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x187:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369688e9 expref: 224 pid: 8606 timeout: 1372 lvb_type: 0 00010000:00010000:3.0:1763333168.877129:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c536d1 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x187:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369688e9 expref: 224 pid: 8606 timeout: 1372 lvb_type: 0 00010000:00010000:3.0:1763333168.877145:0:8423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x187:0x0].0x0 (ffff92fe43ab5800) 00010000:00010000:3.0:1763333168.877150:0:8423:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c536f4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x187:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333168.877161:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c536f4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x187:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333168.877168:0:8423:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c536f4 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x187:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333168.877176:0:8423:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c53702 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x187:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.877183:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c53702 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x187:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.877188:0:8423:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c53702 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x187:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333168.877227:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333168.877288:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:2421:x1848987613499776:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 226us (1698us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333168.877295:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2876 00000100:00100000:3.0:1763333168.882262:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333168.887305:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333168.892824:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333168.900441:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333168.905816:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333168.908433:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333168.909644:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333168.912163:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333168.912206:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333168.913141:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8771 00000100:00100000:0.0:1763333168.913151:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56769:x1848987613501312:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:0.0:1763333168.913190:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333168.913215:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c53733 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x187:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968905 expref: 223 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.913233:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x187:0x0].0x0 (ffff92fe43ab5800) 00010000:00010000:0.0:1763333168.913238:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333168.913259:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c5375d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x187:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333168.913271:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c5375d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x187:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333168.913280:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c5375d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x187:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000040:00080000:0.0:1763333168.913500:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1266, 88 off107760 00000004:00080000:0.0:1763333168.913507:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1272993157658ns, next at 1273519575533ns, rc = 0 00000040:00080000:0.0:1763333168.913553:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1267, 88 off107760 00000004:00080000:0.0:1763333168.913557:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1272993208247ns, next at 1273519604631ns, rc = 0 00000040:00080000:0.0:1763333168.913571:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1268, 88 off107848 00000004:00080000:0.0:1763333168.913575:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1272993225693ns, next at 1273519604631ns, rc = 0 00000040:00080000:0.0:1763333168.913583:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1267, 88 off107848 00000004:00080000:0.0:1763333168.913601:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1272993252411ns, next at 1273519575533ns, rc = 0 00000100:00100000:0.0:1763333168.915977:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:0.0:1763333168.916085:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53725 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333168.916097:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53725 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333168.916105:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53725 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333168.916111:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333168.916114:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53725 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333168.916122:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53725 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333168.916136:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff618aa300) 00010000:00010000:0.0:1763333168.916139:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333168.916144:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53725 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333168.916154:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53725 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000100:00100000:3.0:1763333168.916217:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613501440 00000100:00100000:3.0:1763333168.916228:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613501440 00000100:00100000:0.0:1763333168.916289:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4684dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627198848:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333168.916334:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8772 00000100:00100000:0.0:1763333168.916340:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333168.916344:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+213:56771:x1848987613501440:12345-192.168.204.28@tcp:101:lfs.0 00000100:00100000:0.0:1763333168.916388:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42ef8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627198720:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1763333168.916389:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1763333168.916408:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763333168.916411:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c53772 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696891a expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333168.916443:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763333168.916449:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627198848 00000100:00100000:0.0:1763333168.916450:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4684c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627198976:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333168.916452:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627198848 00000100:00100000:0.0:1763333168.916472:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333168.916478:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627198720 00000100:00100000:3.0:1763333168.916481:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627198720 00000100:00100000:3.0:1763333168.916500:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627198976 00000100:00100000:3.0:1763333168.916504:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627198976 00000100:00100000:0.0:1763333168.916510:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6085 00000100:00100000:0.0:1763333168.916517:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7403ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+67:3653:x1848987627198848:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333168.916522:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6086 00000100:00100000:3.0:1763333168.916527:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74039f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+17:3653:x1848987627198720:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1763333168.916653:0:8404:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x201:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333168.916657:0:8404:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x201:0x0] updating lvb mtime from disk: 1763333169 -> 1763333169 00002000:00010000:0.0:1763333168.916660:0:8404:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x201:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333168.916661:0:8404:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x201:0x0] updating lvb ctime from disk: 1763333169 -> 1763333169 00002000:00010000:0.0:1763333168.916663:0:8404:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x201:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333168.916692:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74039f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+18:3653:x1848987627198720:12345-0@lo:2:osp-syn-1-1.0 Request processed in 165us (282us total) trans 17179871387 rc 0/0 00000100:00100000:3.0:1763333168.916699:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6086 00000100:00100000:3.0:1763333168.916716:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6087 00000100:00100000:3.0:1763333168.916723:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7403a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+68:3655:x1848987627198976:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333168.916911:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7403a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+69:3655:x1848987627198976:12345-0@lo:2:osp-syn-0-1.0 Request processed in 188us (438us total) trans 21474838693 rc 0/0 00000100:00100000:3.0:1763333168.916918:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6087 00000100:00100000:3.0:1763333168.916929:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6088 00000100:00100000:3.0:1763333168.916934:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+18:3655:x1848987627199104:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333168.917091:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+19:3655:x1848987627199104:12345-0@lo:2:osp-syn-1-1.0 Request processed in 156us (322us total) trans 17179871388 rc 0/0 00000100:00100000:3.0:1763333168.917097:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6088 00000100:00100000:0.0:1763333168.917135:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7403ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+68:3653:x1848987627198848:12345-0@lo:2:osp-syn-0-1.0 Request processed in 618us (792us total) trans 21474838692 rc 0/0 00000100:00100000:0.0:1763333168.917144:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6085 00000004:00080000:3.0:1763333168.917404:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4684dc00/2, rc 0, transno 21474838692 00000100:00100000:3.0:1763333168.917408:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4684dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627198848:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1763333168.917418:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe42ef8e00/2, rc 0, transno 17179871387 00000100:00100000:3.0:1763333168.917422:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42ef8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627198720:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1763333168.917489:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c53779 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333168.917503:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c53779 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333168.917514:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c53779 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:3.0:1763333168.917556:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1763333168.917560:0:8606:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1763333168.917611:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c53772 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696891a expref: 216 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.917627:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c53779 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696891a expref: 215 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.917634:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6231ec00) 00010000:00010000:3.0:1763333168.917637:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1763333168.917640:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96000, rc 0) 00000100:00100000:3.0:1763333168.917721:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+214:56771:x1848987613501440:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1378us (1757us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333168.917727:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8772 00000100:00100000:3.0:1763333168.919495:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333168.922164:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333168.923002:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333168.925900:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333168.930190:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333168.936249:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:3.0:1763333168.951606:0:12741:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c537db lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x188:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.951620:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c537db lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x188:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:3.0:1763333168.951656:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x188:0x0]: returning size 0 00000004:00080000:3.0:1763333168.951861:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x203:0x0], index 0: 0 00000004:00080000:3.0:1763333168.951870:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x203:0x0], index 1: 0 00000004:00080000:3.0:1763333168.951877:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x204:0x0], index 1: 0 00000004:00080000:3.0:1763333168.951882:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x204:0x0], index 0: 0 00010000:00010000:3.0:1763333168.952048:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c537db lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x188:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.952057:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c537db lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x188:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.952064:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c537db lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x188:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.952070:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333168.952075:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c537db lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x188:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.952084:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c537db lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x188:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.952098:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x188:0x0].0x0 (ffff92ff618aa100) 00010000:00010000:3.0:1763333168.952101:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763333168.952105:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c537db lrc: 2/0,0 mode: --/EX res: [0x240000404:0x188:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.952111:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c537db lrc: 0/0,0 mode: --/EX res: [0x240000404:0x188:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333168.952170:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c537d4 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x188:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968944 expref: 218 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.952180:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x188:0x0].0x0 (ffff92ff618aa100) 00010000:00010000:3.0:1763333168.952183:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763333168.952187:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c537d4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x188:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968944 expref: 218 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333168.952205:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7fa00, rc 0) 00000100:00100000:3.0:1763333168.952284:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+217:56771:x1848987613502464:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 21997us (22092us total) trans 4294971838 rc 301/301 00000100:00100000:3.0:1763333168.952294:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8777 00000100:00100000:3.0:1763333168.965073:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333168.971490:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613502976 00000100:00100000:3.0:1763333168.971504:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613502976 00000100:00100000:3.0:1763333168.971570:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2992 00000100:00100000:3.0:1763333168.971579:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+217:56771:x1848987613502976:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333168.972109:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333168.973308:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+218:56771:x1848987613502976:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 1724us (3318us total) trans 4294971839 rc 0/0 00000100:00100000:3.0:1763333168.973318:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2992 00000100:00100000:0.0:1763333168.976582:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333168.976774:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613503360 00000100:00100000:3.0:1763333168.976786:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613503360 00000100:00100000:0.0:1763333168.976871:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:1.0:1763333168.977407:0:28429:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c537e9 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x201:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333168.977420:0:28429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c537e9 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x201:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333168.977480:0:28429:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74039880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2420:x1848987613503488:12345-192.168.204.28@tcp:3:lfs.0 Request processed in 331us (609us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1763333168.977488:0:28429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1524 00000100:00100000:3.0:1763333168.977741:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2993 00000100:00100000:3.0:1763333168.977751:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74038380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+218:56771:x1848987613503360:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333168.977929:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74038380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:56771:x1848987613503360:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 180us (1356us total) trans 4294971840 rc 0/0 00000100:00100000:3.0:1763333168.977935:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2993 00000100:00100000:0.0:1763333168.983216:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333168.983311:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613503616 00000100:00100000:3.0:1763333168.983325:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613503616 00000100:00100000:0.0:1763333168.984313:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8778 00000100:00100000:0.0:1763333168.984330:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7403b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:56769:x1848987613503616:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333168.984486:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333168.984510:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c537f0 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x187:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696894b expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.984545:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfc00/0xb32e3ef184c537f7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x187:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333168.984559:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfc00/0xb32e3ef184c537f7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x187:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333168.984571:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfc00/0xb32e3ef184c537f7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x187:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333168.984698:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c537f0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x187:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696894b expref: 221 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.984716:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfc00/0xb32e3ef184c537f7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x187:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696894b expref: 220 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.984782:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x187:0x0].0x0 (ffff92fe43ab5800) 00010000:00010000:0.0:1763333168.984786:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763333168.984790:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdfc00, rc 0) 00000100:00100000:0.0:1763333168.984861:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7403b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+220:56769:x1848987613503616:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 537us (1657us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333168.984868:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8778 00000100:00100000:1.0:1763333168.988534:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333168.988626:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613503872 00000100:00100000:0.0:1763333168.988639:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613503872 00000100:00100000:3.0:1763333168.989375:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333168.989636:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8779 00000100:00100000:0.0:1763333168.989651:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+220:55917:x1848987613503872:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333168.989675:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333168.989701:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c537fe lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968952 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.989876:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c53805 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333168.989891:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c53805 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333168.989902:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c53805 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333168.989918:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c5380c lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333168.989925:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c5380c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333168.989931:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c5380c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333168.990003:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c53813 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x188:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333168.990011:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c53813 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333168.990017:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c53813 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:0.0:1763333168.990029:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x188:0x0]: returning size 0 00010000:00010000:0.0:1763333168.990115:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c53805 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333168.990122:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c53805 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333168.990128:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c53805 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333168.990135:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c53805 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333168.990140:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdea00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333168.990144:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c53805 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333168.990152:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c53805 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333168.990164:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe4345b100) 00010000:00010000:0.0:1763333168.990167:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333168.990172:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c53805 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333168.990178:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c53805 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333168.990193:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c5380c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333168.990198:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c5380c lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333168.990204:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c5380c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333168.990209:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abde400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333168.990212:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c5380c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333168.990217:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c5380c lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333168.990224:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff618aa000) 00010000:00010000:0.0:1763333168.990226:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333168.990228:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c5380c lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333168.990233:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c5380c lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333168.990269:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c537fe lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968952 expref: 223 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.990285:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c53813 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968952 expref: 222 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.990292:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x188:0x0].0x0 (ffff92fe4345ba00) 00010000:00010000:0.0:1763333168.990294:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333168.990297:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdf600, rc 0) 00000100:00100000:0.0:1763333168.990388:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:55917:x1848987613503872:12345-192.168.204.28@tcp:101:bash.0 Request processed in 740us (1865us total) trans 4294971841 rc 0/0 00000100:00100000:0.0:1763333168.990395:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8779 00000100:00100000:1.0:1763333168.990557:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613504000 00000100:00100000:1.0:1763333168.990564:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613504000 00000100:00100000:1.0:1763333168.990625:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1525 00000100:00100000:1.0:1763333168.990634:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+34:2420:x1848987613504000:12345-192.168.204.28@tcp:4:lfs.0 00002000:00010000:1.0:1763333168.990671:0:28426:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x202:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333168.990678:0:28426:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53821 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333168.990689:0:28426:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333168.990691:0:28426:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333168.990696:0:28426:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53821 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333168.990709:0:28426:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53821 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333168.996271:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333168.996390:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613504128 00000100:00100000:0.0:1763333168.996400:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613504128 00000100:00100000:0.0:1763333168.996465:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8780 00000100:00100000:0.0:1763333168.996477:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:55917:x1848987613504128:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333168.996501:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333168.996522:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c53828 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x188:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968959 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.996556:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c5382f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x188:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333168.996570:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c5382f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x188:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333168.996582:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c5382f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x188:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333168.996708:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c53828 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x188:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968959 expref: 224 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.996728:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c5382f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x188:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968959 expref: 223 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333168.996736:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x188:0x0].0x0 (ffff92fe4345ba00) 00010000:00010000:0.0:1763333168.996740:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763333168.996744:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdf400, rc 0) 00000100:00100000:0.0:1763333168.996819:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:55917:x1848987613504128:12345-192.168.204.28@tcp:101:bash.0 Request processed in 344us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333168.996827:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8780 00000001:00080000:1.0:1763333168.999730:0:24714:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838694 is committed 00000001:00080000:1.0:1763333168.999754:0:24714:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838693 is committed 00002000:00010000:0.0:1763333169.000036:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x202:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:0.0:1763333169.000041:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x202:0x0] updating lvb mtime from disk: 0 -> 1763333169 00002000:00010000:0.0:1763333169.000044:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x202:0x0] updating lvb ctime from disk: 0 -> 1763333169 00002000:00010000:0.0:1763333169.000046:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x202:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1763333169.000059:0:28426:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53821 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.000071:0:28426:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53821 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.000079:0:28426:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53821 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.000086:0:28426:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fe00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333169.000090:0:28426:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53821 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.000099:0:28426:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53821 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.000118:0:28426:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53821 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.000126:0:28426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53821 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333169.000222:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+10:2420:x1848987613504000:12345-192.168.204.28@tcp:4:lfs.0 Request processed in 9583us (10873us total) trans 21474838694 rc 0/0 00000100:00100000:0.0:1763333169.000233:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1525 00000100:00100000:3.0:1763333169.002884:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333169.002950:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613504384 00000100:00100000:0.0:1763333169.002961:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613504384 00000100:00100000:0.0:1763333169.003022:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8781 00000100:00100000:0.0:1763333169.003031:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:55917:x1848987613504384:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:0.0:1763333169.003083:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333169.003109:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c53813 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968952 expref: 223 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.003127:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x188:0x0].0x0 (ffff92fe4345ba00) 00010000:00010000:0.0:1763333169.003132:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333169.003295:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c53836 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x188:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333169.003309:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c53836 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x188:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333169.003322:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c53836 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x188:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000001:00080000:0.0:1763333169.003402:0:12741:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294971842 00000004:00010000:0.0:1763333169.003422:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000063d2815f reply state 00000000da878de8 transno 4294971843 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c53836 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x188:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333169.003433:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c53836 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x188:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333169.003439:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x188:0x0].0x0 (ffff92fe4345ba00) 00010000:00010000:0.0:1763333169.003442:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333169.003444:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763333169.003515:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:55917:x1848987613504384:12345-192.168.204.28@tcp:36:bash.0 Request processed in 486us (640us total) trans 4294971843 rc 0/0 00000100:00100000:0.0:1763333169.003522:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8781 00000020:00080000:0.0:1763333169.003527:0:12741:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763333169.010485:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613504512 00000100:00100000:3.0:1763333169.010497:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613504512 00000100:00100000:3.0:1763333169.010557:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8782 00000100:00100000:3.0:1763333169.010567:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:55917:x1848987613504512:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333169.010596:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333169.010615:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5383d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x188:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968960 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.010664:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5383d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x188:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968960 expref: 226 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.010678:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5383d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x188:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968960 expref: 226 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.010698:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x188:0x0].0x0 (ffff92fe4345ba00) 00010000:00010000:3.0:1763333169.010701:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763333169.010705:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a97000, rc 0) 00000100:00100000:3.0:1763333169.010762:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:55917:x1848987613504512:12345-192.168.204.28@tcp:101:bash.0 Request processed in 197us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333169.010769:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8782 00000100:00100000:1.0:1763333169.012743:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333169.013456:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613504768 00000100:00100000:3.0:1763333169.013469:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613504768 00000100:00100000:3.0:1763333169.013536:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8783 00000100:00100000:3.0:1763333169.013547:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:55917:x1848987613504768:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333169.013569:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333169.013572:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763333169.013607:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5383d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x188:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968960 expref: 226 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.013625:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x188:0x0].0x0 (ffff92fe4345ba00) 00010000:00010000:3.0:1763333169.013631:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333169.013645:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c53844 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x188:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968967 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.013692:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c5384b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x188:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333169.013704:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c5384b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x188:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333169.013713:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c5384b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x188:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000040:00080000:3.0:1763333169.014057:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1269, 88 off107936 00000004:00080000:3.0:1763333169.014067:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1273093717442ns, next at 1273519604631ns, rc = 0 00000100:00100000:0.0:1763333169.024467:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613505024 00000100:00100000:0.0:1763333169.024479:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613505024 00000100:00100000:3.0:1763333169.024543:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8784 00000100:00100000:3.0:1763333169.024561:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56769:x1848987613505024:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:0.0:1763333169.026064:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c537b8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333169.026074:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c537b8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333169.026081:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c537b8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333169.026086:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333169.026091:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c537b8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333169.026101:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c537b8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333169.026114:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff618aa000) 00010000:00010000:0.0:1763333169.026116:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333169.026120:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c537b8 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333169.026125:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c537b8 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333169.026146:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c53836 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x188:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333169.026151:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c53836 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x188:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333169.026156:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c53836 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x188:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333169.026160:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333169.026163:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c53836 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x188:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333169.026168:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c53836 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x188:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333169.026175:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x188:0x0].0x0 (ffff92fe4345ba00) 00010000:00010000:0.0:1763333169.026178:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333169.026181:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c53836 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x188:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333169.026186:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c53836 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x188:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000100:00100000:1.0:1763333169.026379:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe438aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627199616:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333169.026430:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333169.026474:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1763333169.026480:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42ef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627199360:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333169.026499:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333169.026514:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe438ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627199488:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333169.026528:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333169.026546:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1763333169.026551:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42efb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627199744:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333169.026569:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333169.026602:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627199616 00000100:00100000:1.0:1763333169.026608:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627199616 00000100:00100000:3.0:1763333169.026639:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627199360 00000100:00100000:3.0:1763333169.026646:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627199360 00000100:00100000:1.0:1763333169.026648:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627199488 00000100:00100000:1.0:1763333169.026653:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627199488 00000100:00100000:3.0:1763333169.026678:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627199744 00000100:00100000:3.0:1763333169.026687:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627199744 00000100:00100000:1.0:1763333169.026762:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6092 00000100:00100000:1.0:1763333169.026773:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+6:3653:x1848987627199616:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333169.027173:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+7:3653:x1848987627199616:12345-0@lo:2:osp-syn-0-1.0 Request processed in 401us (740us total) trans 21474838696 rc 0/0 00000100:00100000:1.0:1763333169.027181:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6092 00000100:00100000:1.0:1763333169.028404:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333169.028501:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613505152 00000100:00100000:3.0:1763333169.028506:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613505152 00000100:00100000:3.0:1763333169.028548:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6096 00000100:00100000:3.0:1763333169.028557:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+10:56769:x1848987613505152:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333169.028570:0:29013:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333169.028597:0:29013:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97000/0xb32e3ef184c53859 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696896e expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333169.028615:0:29013:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x202:0x0] initial LVB size: 4096, mtime: 0x691a5431, atime: 0x0, ctime: 0x691a5431, blocks: 0x8 00010000:00010000:3.0:1763333169.028631:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333169.028635:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333169.028642:0:29013:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97000/0xb32e3ef184c53859 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696896e expref: 11 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.028656:0:29013:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97000/0xb32e3ef184c53859 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696896e expref: 11 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.028666:0:29013:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a97000, rc 0) 00000100:00100000:3.0:1763333169.028703:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+11:56769:x1848987613505152:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 136us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333169.028710:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6096 00000004:00080000:0.0:1763333169.028876:0:8604:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 2 in progress, 0 in flight, 62 done 00000100:00100000:1.0:1763333169.032982:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333169.033098:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613505280 00000100:00100000:3.0:1763333169.033110:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613505280 00000100:00100000:3.0:1763333169.033178:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6097 00000100:00100000:3.0:1763333169.033189:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+11:55917:x1848987613505280:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333169.033206:0:28651:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333169.033230:0:28651:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c53860 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968975 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333169.033254:0:28651:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x203:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333169.033292:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333169.033294:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333169.033304:0:28651:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c53860 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968975 expref: 12 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.033319:0:28651:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c53860 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968975 expref: 12 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.033330:0:28651:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96000, rc 0) 00000100:00100000:3.0:1763333169.033435:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:55917:x1848987613505280:12345-192.168.204.28@tcp:101:bash.0 Request processed in 246us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333169.033443:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6097 00000100:00100000:0.0:1763333169.035615:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333169.035729:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613505408 00000100:00100000:3.0:1763333169.035738:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613505408 00000100:00100000:3.0:1763333169.036390:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6098 00000100:00100000:3.0:1763333169.036402:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74039500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:56769:x1848987613505408:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333169.036422:0:28651:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333169.036442:0:28651:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c53867 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696897c expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333169.036461:0:28651:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x202:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333169.036483:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333169.036485:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333169.036492:0:28651:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c53867 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696897c expref: 18 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.036507:0:28651:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c53867 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696897c expref: 18 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.036518:0:28651:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96c00, rc 0) 00000100:00100000:3.0:1763333169.036576:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74039500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:56769:x1848987613505408:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 177us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333169.036593:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6098 00000100:00100000:1.0:1763333169.038615:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613505536 00000100:00100000:1.0:1763333169.038624:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613505536 00000100:00100000:1.0:1763333169.038681:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6099 00000100:00100000:1.0:1763333169.038690:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:55917:x1848987613505536:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333169.038707:0:29013:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333169.038728:0:29013:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c5386e lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968983 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333169.039047:0:29013:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x203:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333169.039072:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333169.039074:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333169.039084:0:29013:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c5386e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968983 expref: 19 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.039099:0:29013:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c5386e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968983 expref: 19 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.039111:0:29013:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e600, rc 0) 00000100:00100000:1.0:1763333169.039168:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:55917:x1848987613505536:12345-192.168.204.28@tcp:101:bash.0 Request processed in 478us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333169.039175:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6099 00000100:00100000:0.0:1763333169.040393:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613505792 00000100:00100000:0.0:1763333169.040401:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613505792 00002000:00010000:0.0:1763333169.040434:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/514 (0->18446744073709551615) 00002000:00100000:0.0:1763333169.040439:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe472f1880 with x1848987613505792 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333169.040449:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe472f1880. 00000100:00100000:0.0:1763333169.040469:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613505664 00000100:00100000:0.0:1763333169.040473:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613505664 00002000:00010000:0.0:1763333169.040487:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/514 (5->18446744073709551615) 00002000:00100000:0.0:1763333169.040490:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe472f3800 with x1848987613505664 ext(5->18446744073709551615) 00002000:00010000:0.0:1763333169.040495:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe472f3800. 00000100:00100000:0.0:1763333169.040519:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1526 00000100:00100000:0.0:1763333169.040528:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2420:x1848987613505792:12345-192.168.204.28@tcp:10:lfs.0 00002000:00010000:0.0:1763333169.040712:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x202:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333169.040716:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x202:0x0] updating lvb mtime from disk: 0 -> 1763333169 00002000:00010000:0.0:1763333169.040719:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x202:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333169.040721:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x202:0x0] updating lvb ctime from disk: 0 -> 1763333169 00002000:00010000:0.0:1763333169.040723:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x202:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333169.040767:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2420:x1848987613505792:12345-192.168.204.28@tcp:10:lfs.0 Request processed in 239us (579us total) trans 17179871391 rc 0/0 00000100:00100000:0.0:1763333169.040775:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1526 00002000:00010000:0.0:1763333169.040778:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/514 (0->18446744073709551615) 00002000:00100000:0.0:1763333169.040780:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe472f1880 with x1848987613505792 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333169.040785:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe472f1880. 00000100:00100000:0.0:1763333169.040804:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1527 00000100:00100000:0.0:1763333169.040810:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:2420:x1848987613505664:12345-192.168.204.28@tcp:10:lfs.0 00002000:00010000:0.0:1763333169.041046:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x202:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:0.0:1763333169.041050:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x202:0x0] updating lvb mtime from disk: 1763333169 -> 1763333169 00002000:00010000:0.0:1763333169.041052:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x202:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333169.041054:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x202:0x0] updating lvb ctime from disk: 1763333169 -> 1763333169 00002000:00010000:0.0:1763333169.041056:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x202:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1763333169.041079:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2420:x1848987613505664:12345-192.168.204.28@tcp:10:lfs.0 Request processed in 268us (846us total) trans 21474838697 rc 0/0 00000100:00100000:0.0:1763333169.041085:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1527 00002000:00010000:0.0:1763333169.041087:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/514 (5->18446744073709551615) 00002000:00100000:0.0:1763333169.041090:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe472f3800 with x1848987613505664 ext(5->18446744073709551615) 00002000:00010000:0.0:1763333169.041094:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe472f3800. 00000100:00100000:0.0:1763333169.045178:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.046083:0:28429:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613506048 00000100:00100000:1.0:1763333169.046095:0:28429:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613506048 00002000:00010000:1.0:1763333169.046140:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/515 (0->18446744073709551615) 00002000:00100000:1.0:1763333169.046145:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7403b800 with x1848987613506048 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333169.046158:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff7403b800. 00000100:00100000:1.0:1763333169.046200:0:28429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1528 00000100:00100000:1.0:1763333169.046210:0:28429:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7403b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2420:x1848987613506048:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:1.0:1763333169.046428:0:28429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x203:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333169.046431:0:28429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x203:0x0] updating lvb mtime from disk: 0 -> 1763333169 00002000:00010000:1.0:1763333169.046433:0:28429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x203:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333169.046436:0:28429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x203:0x0] updating lvb ctime from disk: 0 -> 1763333169 00002000:00010000:1.0:1763333169.046438:0:28429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x203:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333169.046496:0:28429:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7403b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2420:x1848987613506048:12345-192.168.204.28@tcp:10:bash.0 Request processed in 286us (1329us total) trans 17179871392 rc 0/0 00000100:00100000:1.0:1763333169.046504:0:28429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1528 00002000:00010000:1.0:1763333169.046508:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/515 (0->18446744073709551615) 00002000:00100000:1.0:1763333169.046510:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7403b800 with x1848987613506048 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333169.046514:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff7403b800. 00000100:00100000:0.0:1763333169.046941:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613505920 00000100:00100000:0.0:1763333169.046947:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613505920 00002000:00010000:0.0:1763333169.046983:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/515 (0->18446744073709551615) 00002000:00100000:0.0:1763333169.046987:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe472f3480 with x1848987613505920 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333169.046995:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe472f3480. 00000100:00100000:0.0:1763333169.047021:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1529 00000100:00100000:0.0:1763333169.047028:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2420:x1848987613505920:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:0.0:1763333169.047131:0:28427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x203:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333169.047134:0:28427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x203:0x0] updating lvb mtime from disk: 0 -> 1763333169 00002000:00010000:0.0:1763333169.047137:0:28427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x203:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333169.047138:0:28427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x203:0x0] updating lvb ctime from disk: 0 -> 1763333169 00002000:00010000:0.0:1763333169.047140:0:28427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x203:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333169.047177:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2420:x1848987613505920:12345-192.168.204.28@tcp:10:bash.0 Request processed in 149us (525us total) trans 21474838698 rc 0/0 00000100:00100000:0.0:1763333169.047184:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1529 00002000:00010000:0.0:1763333169.047186:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/515 (0->18446744073709551615) 00002000:00100000:0.0:1763333169.047189:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe472f3480 with x1848987613505920 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333169.047193:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe472f3480. 00000100:00100000:0.0:1763333169.050443:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613506304 00000100:00100000:0.0:1763333169.050453:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613506304 00000100:00100000:0.0:1763333169.050514:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8785 00000100:00100000:0.0:1763333169.050525:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+218:56769:x1848987613506304:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:0.0:1763333169.050634:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c53875 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x187:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333169.050653:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c53875 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x187:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333169.050666:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c53875 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x187:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00010000:0.0:1763333169.050779:0:8606:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000fdc78cfc reply state 00000000d370a0d8 transno 4294971846 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c53875 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x187:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333169.050791:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c53875 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x187:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333169.050798:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x187:0x0].0x0 (ffff92fe43ab5800) 00010000:00010000:0.0:1763333169.050801:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333169.050806:0:8606:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763333169.053180:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+220:56769:x1848987613506304:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 2644us (2852us total) trans 4294971846 rc 0/0 00000100:00100000:0.0:1763333169.053194:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8785 00000100:00100000:3.0:1763333169.053786:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.060227:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333169.068394:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613506688 00000100:00100000:3.0:1763333169.068412:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613506688 00000100:00100000:0.0:1763333169.068709:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.068789:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613506816 00000100:00100000:1.0:1763333169.068794:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613506816 00000100:00100000:1.0:1763333169.068853:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8786 00000100:00100000:1.0:1763333169.068864:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74038700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56772:x1848987613506816:12345-192.168.204.28@tcp:101:rm.0 00010000:00010000:1.0:1763333169.068888:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333169.068913:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5387c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696898a expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.068982:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53883 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333169.068994:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53883 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333169.069005:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53883 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333169.069017:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c5388a lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333169.069023:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c5388a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333169.069028:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c5388a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333169.069109:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53891 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x188:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333169.069118:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53891 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x188:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333169.069125:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53891 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x188:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:1.0:1763333169.069169:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x188:0x0]: returning size 5 00000004:00200000:1.0:1763333169.069174:0:8606:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763333169.069195:0:8606:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53891 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x188:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333169.069209:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53891 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333169.069219:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53883 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333169.069225:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53883 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333169.069231:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53883 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333169.069238:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53883 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333169.069244:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333169.069248:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53883 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333169.069256:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53883 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333169.069268:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff4ad5e800) 00010000:00010000:1.0:1763333169.069272:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333169.069277:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53883 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333169.069283:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53883 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333169.069297:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c5388a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333169.069303:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c5388a lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333169.069309:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c5388a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333169.069314:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333169.069316:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c5388a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333169.069322:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c5388a lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333169.069329:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff4ad5eb00) 00010000:00010000:1.0:1763333169.069331:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333169.069334:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c5388a lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333169.069339:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c5388a lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333169.069419:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5387c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696898a expref: 223 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.069436:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53891 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696898a expref: 222 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.069444:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x188:0x0].0x0 (ffff92fe4345ba00) 00010000:00010000:1.0:1763333169.069447:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333169.069450:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7ea00, rc 0) 00000100:00100000:1.0:1763333169.069512:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74038700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:56772:x1848987613506816:12345-192.168.204.28@tcp:101:rm.0 Request processed in 649us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333169.069520:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8786 00000100:00100000:0.0:1763333169.077237:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333169.078048:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333169.078156:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613507072 00000100:00100000:3.0:1763333169.078167:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613507072 00000100:00100000:3.0:1763333169.078237:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8787 00000100:00100000:3.0:1763333169.078247:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:56772:x1848987613507072:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:3.0:1763333169.078303:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1763333169.078334:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c5384b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x188:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968967 expref: 222 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.078379:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53891 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696898a expref: 221 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.078391:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c5382f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x188:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968959 expref: 220 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.078403:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x188:0x0].0x0 (ffff92fe4345ba00) 00010000:00010000:3.0:1763333169.078412:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333169.078437:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c53898 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333169.078449:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c53898 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.078457:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c53898 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.078467:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c5389f lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333169.078473:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c5389f lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.078478:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c5389f lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.078559:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c538a6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x188:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333169.078566:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c538a6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x188:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.078575:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c538a6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x188:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000100:00100000:1.0:1763333169.079089:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613507328 00000100:00100000:1.0:1763333169.079094:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613507328 00000100:00100000:1.0:1763333169.079129:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2995 00000100:00100000:1.0:1763333169.079136:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6b3ea850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+220:56769:x1848987613507328:12345-192.168.204.28@tcp:35:lfs.0 00000004:00010000:1.0:1763333169.079168:0:19668:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x240000404:0x187:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c53710 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x187:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369688fe expref: 220 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.079192:0:19668:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c538ad lrc: 3/0,1 mode: --/EX res: [0x240000404:0x187:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19668 initiator: MDT0 00010000:00010000:1.0:1763333169.079201:0:19668:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c53780 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x187:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968921 expref: 220 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.079209:0:19668:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c538ad lrc: 4/0,1 mode: --/EX res: [0x240000404:0x187:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19668 initiator: MDT1 00010000:00010000:1.0:1763333169.079241:0:19668:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c53780 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x187:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968921 expref: 220 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.079258:0:19668:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c53780 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x187:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968921 expref: 220 pid: 8606 timeout: 1373 lvb_type: 0 00000100:00100000:1.0:1763333169.079271:0:19668:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe469a3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:19668:1848987627199872:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333169.079343:0:19668:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7df5dcc0 going to sleep for 11 seconds 00000040:00080000:3.0:1763333169.080025:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1271, 64 off108088 00000040:00080000:3.0:1763333169.080054:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1270, 64 off108088 00000040:00080000:3.0:1763333169.080065:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1271, 64 off108152 00000040:00080000:3.0:1763333169.080074:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1272, 64 off108152 00010000:00010000:3.0:1763333169.080128:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c538b4 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x188:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333169.080139:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c538b4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x188:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.080147:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c538b4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x188:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.080154:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c538b4 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x188:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.080159:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c538b4 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x188:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.080165:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c538b4 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x188:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.080185:0:6521:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763333169.080202:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c538a6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x188:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.080208:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c538a6 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x188:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.080213:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c538a6 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x188:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.080223:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333169.080226:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c538a6 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x188:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.080232:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c538a6 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x188:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.080240:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x188:0x0].0x0 (ffff92ff80045300) 00010000:00010000:3.0:1763333169.080242:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1763333169.080246:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c538a6 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x188:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.080250:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c538a6 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x188:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.080390:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c53898 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.080396:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c53898 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.080401:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c53898 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.080406:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c53898 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.080410:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333169.080413:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c53898 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.080418:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c53898 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.080429:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff80045d00) 00010000:00010000:3.0:1763333169.080431:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333169.080434:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c53898 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.080439:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c53898 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000004:00010000:3.0:1763333169.080449:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000aabec5e3 reply state 00000000ad0b383d transno 4294971848 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c5389f lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.080458:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c5389f lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.080463:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045200) 00010000:00010000:3.0:1763333169.080465:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763333169.080468:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763333169.080538:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:56772:x1848987613507072:12345-192.168.204.28@tcp:36:rm.0 Request processed in 2290us (3310us total) trans 4294971848 rc 0/0 00000100:00100000:3.0:1763333169.080547:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8787 00010000:00010000:1.0:1763333169.081238:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333169.081245:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c538b4 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x188:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.081252:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333169.081255:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c538b4 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x188:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.081262:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c538b4 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x188:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.081274:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x188:0x0].0x0 (ffff92ff80045300) 00010000:00010000:1.0:1763333169.081277:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1763333169.081281:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c538b4 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x188:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.081285:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c538b4 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x188:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.081301:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333169.081304:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333169.081305:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763333169.094090:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.094220:0:19668:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe469a3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:19668:1848987627199872:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333169.094250:0:19668:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c538ad lrc: 3/0,1 mode: --/EX res: [0x240000404:0x187:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19668 initiator: MDT1 00000100:00100000:3.0:1763333169.094313:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613507456 00000100:00100000:3.0:1763333169.094320:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613507456 00010000:00010000:3.0:1763333169.094382:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c53780 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x187:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968921 expref: 222 pid: 8606 timeout: 1373 lvb_type: 0 00000100:00100000:3.0:1763333169.094427:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2879 00000100:00100000:3.0:1763333169.094437:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:2420:x1848987613507456:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333169.094453:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333169.094460:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c53780 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x187:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968921 expref: 222 pid: 8606 timeout: 1373 lvb_type: 0 00010000:00010000:3.0:1763333169.094474:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c53780 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x187:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968921 expref: 222 pid: 8606 timeout: 1373 lvb_type: 0 00010000:00010000:3.0:1763333169.094498:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c53780 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x187:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968921 expref: 222 pid: 8606 timeout: 1373 lvb_type: 0 00010000:00010000:3.0:1763333169.094513:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x187:0x0].0x0 (ffff92fe43ab5800) 00010000:00010000:3.0:1763333169.094518:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c538ad lrc: 3/0,1 mode: --/EX res: [0x240000404:0x187:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19668 initiator: MDT1 00010000:00010000:3.0:1763333169.094528:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c538ad lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x187:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 19668 initiator: MDT1 00010000:00010000:3.0:1763333169.094536:0:6505:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c538ad lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x187:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 19668 initiator: MDT1 00010000:00010000:3.0:1763333169.094561:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333169.094616:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:2420:x1848987613507456:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 180us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333169.094622:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2879 00010000:00010000:1.0:1763333169.094688:0:19668:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c538ad lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x187:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19668 initiator: MDT1 00010000:00010000:1.0:1763333169.094696:0:19668:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c538ad lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x187:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19668 initiator: MDT1 00000040:00080000:1.0:1763333169.094948:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1272, 88 off108240 00000004:00080000:1.0:1763333169.094956:0:19668:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1273174606504ns, next at 1273519575533ns, rc = 0 00000040:00080000:1.0:1763333169.094997:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1273, 88 off108240 00000004:00080000:1.0:1763333169.095002:0:19668:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1273174653138ns, next at 1273519604631ns, rc = 0 00000040:00080000:1.0:1763333169.095017:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1274, 88 off108328 00000004:00080000:1.0:1763333169.095021:0:19668:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1273174672308ns, next at 1273519604631ns, rc = 0 00000040:00080000:1.0:1763333169.095031:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1273, 88 off108328 00000004:00080000:1.0:1763333169.095034:0:19668:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1273174685423ns, next at 1273519575533ns, rc = 0 00000001:00080000:1.0:1763333169.097899:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294971849 is committed 00000004:00080000:1.0:1763333169.097912:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 833 committed 00000004:00080000:1.0:1763333169.098631:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 836 committed 00000004:00080000:1.0:1763333169.098641:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 835 committed 00000004:00080000:1.0:1763333169.098643:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 832 committed 00000100:00100000:0.0:1763333169.098840:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff6bc12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627200384:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333169.098921:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333169.098971:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763333169.098978:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42ef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627200000:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763333169.099001:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333169.099027:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42efad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627200128:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763333169.099049:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333169.099067:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1763333169.099073:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42ef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627200256:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333169.099094:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333169.099124:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627200384 00000100:00100000:0.0:1763333169.099131:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627200384 00000100:00100000:0.0:1763333169.099170:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627200000 00000100:00100000:0.0:1763333169.099173:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627200000 00000100:00100000:0.0:1763333169.099189:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627200128 00000100:00100000:0.0:1763333169.099192:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627200128 00000100:00100000:0.0:1763333169.099204:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627200256 00000100:00100000:0.0:1763333169.099206:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627200256 00000100:00100000:0.0:1763333169.099226:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6101 00000100:00100000:0.0:1763333169.099234:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+10:3654:x1848987627200384:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1763333169.099413:0:8404:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x202:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1763333169.099418:0:8404:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x202:0x0] updating lvb mtime from disk: 1763333169 -> 1763333169 00002000:00010000:0.0:1763333169.099421:0:8404:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x202:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333169.099423:0:8404:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x202:0x0] updating lvb ctime from disk: 1763333169 -> 1763333169 00002000:00010000:0.0:1763333169.099426:0:8404:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x202:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1763333169.099463:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+11:3654:x1848987627200384:12345-0@lo:2:osp-syn-0-1.0 Request processed in 230us (542us total) trans 21474838699 rc 0/0 00000100:00100000:0.0:1763333169.099469:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6101 00000100:00100000:0.0:1763333169.099488:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6102 00000100:00100000:0.0:1763333169.099494:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+10:3654:x1848987627200000:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1763333169.099507:0:8404:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:515 count 1 00010000:00010000:0.0:1763333169.099525:0:8404:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c538bb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x203:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.099546:0:8404:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c53860 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968975 expref: 13 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.099554:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333169.099557:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333169.099560:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c538bb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.099600:0:8404:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c53860 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968975 expref: 13 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.099613:0:8404:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c53860 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968975 expref: 13 pid: 28651 timeout: 1373 lvb_type: 0 00000100:00100000:0.0:1763333169.099625:0:8404:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4684ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8404:1848987627200512:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333169.099685:0:8404:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4ce84840 going to sleep for 11 seconds 00000100:00100000:0.0:1763333169.099707:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6103 00000100:00100000:0.0:1763333169.099713:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+10:3652:x1848987627200128:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1763333169.099726:0:8407:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:516 count 1 00002000:00010000:0.0:1763333169.099746:0:8407:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x204:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333169.099751:0:8407:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abde400/0xb32e3ef184c538c2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.099760:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333169.099762:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333169.099766:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abde400/0xb32e3ef184c538c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.099777:0:8407:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4abde400/0xb32e3ef184c538c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.099786:0:8407:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abde400/0xb32e3ef184c538c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.099793:0:8407:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abde400/0xb32e3ef184c538c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.099809:0:8407:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763333169.099989:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+11:3652:x1848987627200128:12345-0@lo:6:osp-syn-0-1.0 Request processed in 275us (938us total) trans 21474838700 rc 0/0 00000100:00100000:0.0:1763333169.099995:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6103 00000100:00100000:0.0:1763333169.100010:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6104 00000100:00100000:0.0:1763333169.100016:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+10:3652:x1848987627200256:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1763333169.100075:0:8407:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x201:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333169.100078:0:8407:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x201:0x0] updating lvb mtime from disk: 1763333169 -> 1763333169 00002000:00010000:0.0:1763333169.100080:0:8407:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x201:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333169.100083:0:8407:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x201:0x0] updating lvb ctime from disk: 1763333169 -> 1763333169 00002000:00010000:0.0:1763333169.100085:0:8407:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x201:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333169.100107:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+11:3652:x1848987627200256:12345-0@lo:2:osp-syn-0-1.0 Request processed in 91us (1012us total) trans 21474838701 rc 0/0 00000100:00100000:0.0:1763333169.100112:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6104 00010000:00010000:0.0:1763333169.100141:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333169.100147:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe4abde400/0xb32e3ef184c538c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.100154:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abde400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333169.100158:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4abde400/0xb32e3ef184c538c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.100166:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4abde400/0xb32e3ef184c538c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.100180:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe4abde400/0xb32e3ef184c538c2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.100187:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abde400/0xb32e3ef184c538c2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.100202:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333169.100204:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333169.100206:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763333169.100238:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe42ef8380/2, rc 0, transno 21474838701 00000100:00100000:0.0:1763333169.100245:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42ef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627200256:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1763333169.100256:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe42efad80/2, rc 0, transno 21474838700 00000100:00100000:0.0:1763333169.100259:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42efad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627200128:0@lo:6:osp-syn-0-1.0 00000004:00080000:0.0:1763333169.100288:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff6bc12d80/2, rc 0, transno 21474838699 00000100:00100000:0.0:1763333169.100292:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff6bc12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627200384:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333169.102847:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e120e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627200640:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763333169.102882:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333169.102913:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763333169.102919:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e122680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627201024:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333169.102939:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333169.102962:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627200640 00000100:00100000:3.0:1763333169.102966:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627200640 00000100:00100000:3.0:1763333169.102988:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627201024 00000100:00100000:3.0:1763333169.102992:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627201024 00000100:00100000:3.0:1763333169.103006:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6107 00000100:00100000:3.0:1763333169.103012:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+24:3655:x1848987627200640:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763333169.103025:0:8611:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:515 count 1 00010000:00010000:3.0:1763333169.103039:0:8611:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c538d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x203:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.103055:0:8611:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c5386e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968983 expref: 21 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.103062:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333169.103064:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333169.103067:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c538d0 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.103094:0:8611:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c5386e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968983 expref: 21 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.103106:0:8611:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c5386e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968983 expref: 21 pid: 29013 timeout: 1373 lvb_type: 0 00000100:00100000:3.0:1763333169.103118:0:8611:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe438aad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8611:1848987627201152:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333169.103164:0:8611:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff742b9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1763333169.103179:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6108 00000100:00100000:3.0:1763333169.103186:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+24:3655:x1848987627201024:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1763333169.103253:0:8406:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x202:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333169.103256:0:8406:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x202:0x0] updating lvb mtime from disk: 1763333169 -> 1763333169 00002000:00010000:3.0:1763333169.103259:0:8406:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x202:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333169.103262:0:8406:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x202:0x0] updating lvb ctime from disk: 1763333169 -> 1763333169 00002000:00010000:3.0:1763333169.103264:0:8406:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x202:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333169.103292:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+25:3655:x1848987627201024:12345-0@lo:2:osp-syn-1-1.0 Request processed in 107us (352us total) trans 17179871396 rc 0/0 00000100:00100000:3.0:1763333169.103299:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6108 00000004:00080000:3.0:1763333169.103324:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7e122680/2, rc 0, transno 17179871396 00000100:00100000:3.0:1763333169.103328:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e122680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627201024:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333169.105514:0:8404:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4684ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8404:1848987627200512:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333169.105545:0:8404:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c538bb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333169.105680:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:3.0:1763333169.110665:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c538ad lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x187:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19668 initiator: MDT1 00010000:00010000:3.0:1763333169.110677:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c538ad lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x187:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19668 initiator: MDT1 00010000:00010000:3.0:1763333169.110685:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c538ad lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x187:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19668 initiator: MDT1 00010000:00010000:3.0:1763333169.110691:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333169.110695:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c538ad lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x187:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19668 initiator: MDT1 00010000:00010000:3.0:1763333169.110703:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c538ad lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x187:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19668 initiator: MDT1 00010000:00010000:3.0:1763333169.110717:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x187:0x0].0x0 (ffff92fe43ab5800) 00010000:00010000:3.0:1763333169.110720:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763333169.110725:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c538ad lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x187:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19668 initiator: MDT1 00010000:00010000:3.0:1763333169.110731:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c538ad lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x187:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19668 initiator: MDT1 00000100:00100000:1.0:1763333169.111240:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.111266:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613507584 00000100:00100000:1.0:1763333169.111274:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613507584 00010000:00010000:1.0:1763333169.111304:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c53860 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968975 expref: 14 pid: 28651 timeout: 1373 lvb_type: 0 00000100:00100000:1.0:1763333169.111328:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613507712 00000100:00100000:1.0:1763333169.111331:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613507712 00010000:00010000:1.0:1763333169.111345:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c5386e lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968983 expref: 22 pid: 29013 timeout: 1373 lvb_type: 0 00000100:00100000:1.0:1763333169.111406:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2880 00000100:00100000:1.0:1763333169.111415:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2419:x1848987613507584:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333169.111429:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333169.111433:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c53860 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x203:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968975 expref: 14 pid: 28651 timeout: 1373 lvb_type: 0 00010000:00010000:1.0:1763333169.111445:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c53860 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x203:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968975 expref: 14 pid: 28651 timeout: 1373 lvb_type: 0 00010000:00010000:1.0:1763333169.111464:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c53860 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x203:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968975 expref: 14 pid: 28651 timeout: 1373 lvb_type: 0 00010000:00010000:1.0:1763333169.111477:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333169.111479:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333169.111484:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c538bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.111494:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c538bb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.111520:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333169.111558:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2419:x1848987613507584:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 144us (5878us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333169.111565:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2880 00000100:00100000:1.0:1763333169.111579:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2881 00000100:00100000:1.0:1763333169.111597:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff4627e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2421:x1848987613507712:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333169.111605:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333169.111609:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c5386e lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x203:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968983 expref: 22 pid: 29013 timeout: 1373 lvb_type: 0 00010000:00010000:1.0:1763333169.111620:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c5386e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x203:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968983 expref: 22 pid: 29013 timeout: 1373 lvb_type: 0 00010000:00010000:1.0:1763333169.111633:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333169.111635:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333169.111638:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c538d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x203:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.111644:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c538d0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x203:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.111656:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333169.111673:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff4627e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2421:x1848987613507712:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 78us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333169.111680:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2881 00010000:00010000:3.0:1763333169.115626:0:8611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c5386e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968983 expref: 21 pid: 29013 timeout: 1373 lvb_type: 0 00000100:00100000:3.0:1763333169.115653:0:8611:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe438aad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8611:1848987627201152:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333169.115674:0:8404:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c538bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.115684:0:8611:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c538d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.115688:0:8404:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c538bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.115704:0:8611:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c538d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.115708:0:8404:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c538bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.115717:0:8611:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c538d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.115722:0:8404:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c538bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.115731:0:8611:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c538d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.115742:0:8611:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c538d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.115756:0:8404:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1763333169.117423:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+11:3654:x1848987627200000:12345-0@lo:6:osp-syn-0-1.0 Request processed in 17921us (18413us total) trans 21474838702 rc 0/0 00000100:00100000:0.0:1763333169.117436:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6102 00010000:00010000:3.0:1763333169.117704:0:8611:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1763333169.117941:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+25:3655:x1848987627200640:12345-0@lo:6:osp-syn-1-1.0 Request processed in 14927us (15057us total) trans 17179871397 rc 0/0 00000100:00100000:3.0:1763333169.117963:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6107 00010000:00010000:3.0:1763333169.117994:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1763333169.117998:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:3.0:1763333169.118005:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c538bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.118017:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdea00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333169.118022:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c538bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.118036:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c538bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.118061:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c538bb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.118068:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c538bb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.118087:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333169.118091:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c538d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.118097:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea800 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333169.118100:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c538d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.118107:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c538d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.118121:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c538d0 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.118128:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c538d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.118142:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333169.118144:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333169.118146:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763333169.118172:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7e120e00/2, rc 0, transno 17179871397 00000100:00100000:3.0:1763333169.118179:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e120e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627200640:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1763333169.118838:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763333169.119181:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.119288:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613507968 00000100:00100000:1.0:1763333169.119296:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613507968 00000100:00100000:1.0:1763333169.119368:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8789 00000100:00100000:1.0:1763333169.119383:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+214:56769:x1848987613507968:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333169.119403:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333169.119416:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e200/0xb32e3ef184c538ec lrc: 2/0,0 mode: --/CR res: [0x240000404:0x187:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968998 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.119464:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e200/0xb32e3ef184c538ec lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x187:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968998 expref: 215 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.119479:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e200/0xb32e3ef184c538ec lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x187:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968998 expref: 215 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.119496:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x187:0x0].0x0 (ffff92fe43ab5800) 00010000:00010000:1.0:1763333169.119499:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763333169.119503:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e200, rc 0) 00000100:00100000:1.0:1763333169.119556:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+215:56769:x1848987613507968:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 179us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333169.119563:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8789 00000100:00100000:0.0:1763333169.124493:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333169.124544:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333169.124738:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613508352 00000100:00100000:3.0:1763333169.124743:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613508352 00000100:00100000:3.0:1763333169.124784:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8790 00000100:00100000:3.0:1763333169.124791:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+214:56773:x1848987613508352:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333169.124801:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333169.124825:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42febe00/0xb32e3ef184c538f3 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696899f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.124883:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c538fa lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333169.124898:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c538fa lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.124908:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c538fa lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.124922:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c53901 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333169.124928:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c53901 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.124933:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c53901 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.125932:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c538fa lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.125940:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c538fa lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.125945:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c538fa lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.126029:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c538fa lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.126033:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333169.126036:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c538fa lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.126042:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c538fa lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.126057:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff80045900) 00010000:00010000:3.0:1763333169.126060:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333169.126064:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c538fa lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.126069:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c538fa lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.126081:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c53901 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.126086:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c53901 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.126091:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c53901 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.126094:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feb200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333169.126096:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c53901 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.126100:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c53901 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.126105:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045d00) 00010000:00010000:3.0:1763333169.126107:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333169.126109:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c53901 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.126112:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c53901 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.126139:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42febe00/0xb32e3ef184c538f3 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696899f expref: 215 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.126147:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff80045900) 00010000:00010000:3.0:1763333169.126149:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333169.126152:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42febe00/0xb32e3ef184c538f3 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696899f expref: 215 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.126165:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42febe00, rc 0) 00000100:00100000:3.0:1763333169.126207:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+214:56773:x1848987613508352:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1417us (1664us total) trans 0 rc 301/301 00000100:00100000:3.0:1763333169.126214:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8790 00000100:00100000:0.0:1763333169.129943:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333169.130086:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613508480 00000100:00100000:3.0:1763333169.130096:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613508480 00000100:00100000:3.0:1763333169.131136:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613508736 00000100:00100000:3.0:1763333169.131143:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613508736 00000100:00100000:3.0:1763333169.131199:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8791 00000100:00100000:1.0:1763333169.131206:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8792 00000100:00100000:3.0:1763333169.131210:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+215:56773:x1848987613508480:12345-192.168.204.28@tcp:101:lfs.0 00000100:00100000:1.0:1763333169.131214:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+215:56769:x1848987613508736:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333169.131240:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333169.131247:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333169.131267:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5390f lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369689a6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.131267:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c53916 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369689ad expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.131331:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5391d lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333169.131338:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53924 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333169.131345:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5391d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.131376:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5391d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:3.0:1763333169.131429:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1763333169.131434:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1763333169.132126:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53924 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.132139:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53924 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.132159:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5392b lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333169.132167:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5392b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.132173:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5392b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.132209:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53924 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.132216:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53924 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.132222:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53924 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.132229:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53924 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.132236:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333169.132239:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53924 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.132246:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53924 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.132258:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff80045a00) 00010000:00010000:1.0:1763333169.132261:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333169.132265:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53924 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.132270:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53924 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.132281:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5392b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.132287:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5392b lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.132292:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5392b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.132297:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333169.132300:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5392b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.132305:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5392b lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.132311:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6055a300) 00010000:00010000:1.0:1763333169.132313:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333169.132315:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5392b lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.132321:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5392b lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.132383:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c53916 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689ad expref: 217 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.132394:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff80045a00) 00010000:00010000:1.0:1763333169.132396:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763333169.132400:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c53916 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689ad expref: 217 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.132408:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7ec00, rc 0) 00000100:00100000:1.0:1763333169.132483:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+216:56769:x1848987613508736:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1268us (2307us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333169.132492:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8792 00010000:00010000:3.0:1763333169.133973:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5390f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689a6 expref: 216 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.134001:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5391d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689a6 expref: 215 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.134009:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff80045a00) 00010000:00010000:3.0:1763333169.134011:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1763333169.134014:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feba00, rc 0) 00000100:00100000:3.0:1763333169.134060:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+215:56773:x1848987613508480:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 2851us (4129us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333169.134069:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8791 00000100:00100000:3.0:1763333169.144827:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613508992 00000100:00100000:3.0:1763333169.144840:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613508992 00000100:00100000:3.0:1763333169.144901:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8793 00000100:00100000:3.0:1763333169.144910:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+215:56773:x1848987613508992:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333169.144930:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333169.144933:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763333169.144973:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5391d lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689a6 expref: 215 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.144991:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff80045a00) 00010000:00010000:3.0:1763333169.145002:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333169.145016:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42febe00/0xb32e3ef184c53932 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369689b4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.145124:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c53939 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333169.145137:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c53939 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.145147:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c53939 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.145164:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c53940 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333169.145171:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c53940 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.145176:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c53940 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.145693:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c53947 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333169.145703:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c53947 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.145711:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c53947 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:0.0:1763333169.145721:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x18a:0x0]: returning size 0 00010000:00010000:0.0:1763333169.145749:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c53939 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.145755:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c53939 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.145761:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c53939 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.145766:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c53939 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.145772:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feb200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333169.145776:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c53939 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.145783:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c53939 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.145792:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff80045900) 00010000:00010000:0.0:1763333169.145795:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333169.145798:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c53939 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.145804:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c53939 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000004:00010000:0.0:1763333169.145814:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005f603229 reply state 00000000edf7e686 transno 4294971851 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c53940 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.145830:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c53940 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.145835:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045d00) 00010000:00010000:0.0:1763333169.145837:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333169.145839:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763333169.145863:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42febe00/0xb32e3ef184c53932 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689b4 expref: 217 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.145876:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c53947 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689b4 expref: 216 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.145883:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18a:0x0].0x0 (ffff92fe4345b100) 00010000:00010000:0.0:1763333169.145885:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333169.145887:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdf600, rc 0) 00000100:00100000:0.0:1763333169.146890:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+217:56773:x1848987613508992:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1975us (2146us total) trans 4294971851 rc 0/0 00000100:00100000:0.0:1763333169.146900:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8793 00000100:00100000:0.0:1763333169.152578:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333169.156963:0:6521:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e122300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6521:1848987627201280:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333169.156997:0:6521:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5395c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000100:00100000:3.0:1763333169.158666:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.159687:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613509504 00000100:00100000:1.0:1763333169.159699:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613509504 00000100:00100000:0.0:1763333169.160260:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613509632 00000100:00100000:0.0:1763333169.160268:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613509632 00010000:00010000:0.0:1763333169.160302:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c53947 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689b4 expref: 220 pid: 6521 timeout: 1373 lvb_type: 0 00000100:00100000:1.0:1763333169.160467:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8795 00000100:00100000:1.0:1763333169.160478:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+220:56774:x1848987613509504:12345-192.168.204.28@tcp:101:lfs.0 00000100:00100000:0.0:1763333169.160528:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2882 00000100:00100000:0.0:1763333169.160536:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+220:2420:x1848987613509632:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333169.160550:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333169.160557:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c53947 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689b4 expref: 220 pid: 6521 timeout: 1373 lvb_type: 0 00010000:00010000:0.0:1763333169.160569:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c53947 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689b4 expref: 220 pid: 6521 timeout: 1373 lvb_type: 0 00010000:00010000:0.0:1763333169.160601:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c53947 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689b4 expref: 220 pid: 6521 timeout: 1373 lvb_type: 0 00010000:00010000:0.0:1763333169.160618:0:8423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18a:0x0].0x0 (ffff92fe4345b100) 00010000:00010000:0.0:1763333169.160624:0:8423:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5395c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.160633:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5395c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.160641:0:8423:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5395c lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.160681:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333169.160744:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:2420:x1848987613509632:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 209us (2087us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333169.160752:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2882 00010000:00010000:1.0:1763333169.160791:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333169.160808:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c53963 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369689c2 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.160905:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5396a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333169.160914:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5396a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.160923:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5396a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:1.0:1763333169.160929:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x18a:0x0]: returning size 0 00010000:00010000:1.0:1763333169.162401:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5396a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.162411:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5396a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x18a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.162416:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5396a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x18a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.162421:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333169.162423:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5396a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x18a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.162432:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5396a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x18a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.162440:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18a:0x0].0x0 (ffff92fe4345b100) 00010000:00010000:1.0:1763333169.162442:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1763333169.162445:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5396a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x18a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.162450:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5396a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x18a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.162476:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c53963 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x18a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689c2 expref: 220 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.162484:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18a:0x0].0x0 (ffff92fe4345b100) 00010000:00010000:1.0:1763333169.162486:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763333169.162489:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c53963 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x18a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689c2 expref: 220 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.162501:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7ec00, rc 0) 00000100:00100000:1.0:1763333169.163235:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+218:56774:x1848987613509504:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 2757us (6482us total) trans 4294971853 rc 301/301 00000100:00100000:1.0:1763333169.163242:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8795 00000100:00100000:0.0:1763333169.167720:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333169.167768:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.168547:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613510144 00000100:00100000:1.0:1763333169.168551:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613510144 00000100:00100000:0.0:1763333169.168654:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2998 00000100:00100000:0.0:1763333169.168660:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:56773:x1848987613510144:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333169.169059:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56773:x1848987613510144:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 398us (1289us total) trans 4294971854 rc 0/0 00000100:00100000:0.0:1763333169.169070:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2998 00000100:00100000:3.0:1763333169.173278:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333169.173395:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.173396:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613510400 00000100:00100000:1.0:1763333169.173407:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613510400 00000100:00100000:1.0:1763333169.173473:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8796 00000100:00100000:1.0:1763333169.173484:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+220:56774:x1848987613510400:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333169.173519:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333169.173546:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5397f lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369689c9 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.173642:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c53986 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333169.173657:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c53986 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.173668:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c53986 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.173679:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5398d lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333169.173687:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5398d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.173694:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5398d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.173812:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c53994 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333169.173821:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c53994 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.173827:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c53994 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:1.0:1763333169.173837:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x18a:0x0]: returning size 0 00010000:00010000:1.0:1763333169.173917:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c53986 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.173928:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c53986 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.173946:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c53986 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.173959:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c53986 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.173966:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333169.173970:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c53986 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.173978:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c53986 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.173992:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055a300) 00010000:00010000:1.0:1763333169.173995:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333169.174000:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c53986 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.174006:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c53986 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.174019:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5398d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.174024:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5398d lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.174030:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5398d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.174034:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333169.174037:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5398d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.174041:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5398d lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.174048:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045d00) 00010000:00010000:1.0:1763333169.174050:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333169.174053:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5398d lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.174058:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5398d lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.174097:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5397f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689c9 expref: 223 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.174116:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c53994 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689c9 expref: 222 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.174123:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18a:0x0].0x0 (ffff92ff6055a500) 00010000:00010000:1.0:1763333169.174126:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333169.174129:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f800, rc 0) 00000100:00100000:1.0:1763333169.174196:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:56774:x1848987613510400:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 713us (927us total) trans 4294971856 rc 0/0 00000100:00100000:1.0:1763333169.174203:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8796 00000100:00100000:0.0:1763333169.186490:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333169.186540:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333169.186591:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333169.186626:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613510784 00000100:00100000:0.0:1763333169.186638:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613510784 00000100:00100000:0.0:1763333169.186784:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6110 00000100:00100000:0.0:1763333169.186792:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2420:x1848987613510784:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333169.186799:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333169.186814:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c539a9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369689d0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763333169.186831:0:8404:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x206:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333169.186840:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333169.186841:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333169.186845:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c539a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689d0 expref: 14 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333169.186855:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c539a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689d0 expref: 14 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333169.186866:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdf600, rc 0) 00000100:00100000:3.0:1763333169.187023:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613511168 00000100:00100000:3.0:1763333169.187029:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613511168 00000100:00100000:3.0:1763333169.187074:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8797 00000100:00100000:3.0:1763333169.187082:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:55917:x1848987613511168:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333169.187099:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333169.187101:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763333169.187127:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c53994 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689c9 expref: 223 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.187145:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18a:0x0].0x0 (ffff92ff6055a500) 00000100:00100000:0.0:1763333169.187439:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2420:x1848987613510784:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 647us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333169.187447:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6110 00010000:00010000:3.0:1763333169.187734:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333169.187752:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c539b0 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369689de expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.187947:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c539b7 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333169.187960:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c539b7 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x18a:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.187971:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c539b7 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x18a:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:3.0:1763333169.187984:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x18a:0x0]: returning size 0 00010000:00010000:3.0:1763333169.188098:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c539b0 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689de expref: 225 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.188114:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c539b7 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x18a:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689de expref: 224 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.188121:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18a:0x0].0x0 (ffff92ff80045a00) 00010000:00010000:3.0:1763333169.188124:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:3.0:1763333169.188127:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feba00, rc 0) 00000100:00100000:3.0:1763333169.188173:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:55917:x1848987613511168:12345-192.168.204.28@tcp:101:bash.0 Request processed in 1092us (1696us total) trans 4294971858 rc 0/0 00000100:00100000:3.0:1763333169.188179:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8797 00000100:00100000:1.0:1763333169.192070:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333169.194759:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613511296 00000100:00100000:3.0:1763333169.194775:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613511296 00000100:00100000:3.0:1763333169.194845:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8798 00000100:00100000:3.0:1763333169.194856:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56774:x1848987613511296:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333169.194883:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333169.194908:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c539c5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369689e5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.194968:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c539c5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689e5 expref: 225 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.194983:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c539c5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689e5 expref: 225 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.195003:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18a:0x0].0x0 (ffff92ff80045a00) 00010000:00010000:3.0:1763333169.195006:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763333169.195009:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feaa00, rc 0) 00000100:00100000:3.0:1763333169.195090:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56774:x1848987613511296:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 235us (3032us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333169.195097:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8798 00000100:00100000:1.0:1763333169.197760:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333169.198060:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613511424 00000100:00100000:0.0:1763333169.198071:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613511424 00000100:00100000:0.0:1763333169.198133:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8799 00000100:00100000:0.0:1763333169.198142:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:55917:x1848987613511424:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333169.198167:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333169.198189:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c539cc lrc: 2/0,0 mode: --/PR res: [0x240000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369689ec expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.198229:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c539d3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333169.198242:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c539d3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333169.198254:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c539d3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333169.198517:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c539cc lrc: 0/0,0 mode: --/PR res: [0x240000404:0x18a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689ec expref: 227 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.198537:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c539d3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x18a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689ec expref: 226 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.198546:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18a:0x0].0x0 (ffff92ff80045a00) 00010000:00010000:0.0:1763333169.198549:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763333169.198552:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abde200, rc 0) 00000100:00100000:0.0:1763333169.198619:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:55917:x1848987613511424:12345-192.168.204.28@tcp:101:bash.0 Request processed in 478us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333169.198625:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8799 00000100:00100000:0.0:1763333169.204157:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613511680 00000100:00100000:0.0:1763333169.204167:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613511680 00000100:00100000:0.0:1763333169.204228:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3000 00000100:00100000:0.0:1763333169.204238:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56774:x1848987613511680:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333169.204502:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56774:x1848987613511680:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 265us (510us total) trans 4294971859 rc 0/0 00000100:00100000:0.0:1763333169.204510:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3000 00000100:00100000:1.0:1763333169.204683:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613511936 00000100:00100000:1.0:1763333169.204688:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613511936 00000100:00100000:1.0:1763333169.205183:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8800 00000100:00100000:1.0:1763333169.205193:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:55917:x1848987613511936:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:1.0:1763333169.205229:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333169.205256:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c539b7 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x18a:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689de expref: 227 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.205273:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18a:0x0].0x0 (ffff92ff80045a00) 00010000:00010000:1.0:1763333169.205278:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333169.205489:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c539da lrc: 3/0,1 mode: --/PW res: [0x240000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333169.205502:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c539da lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.205512:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c539da lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000001:00080000:1.0:1763333169.205555:0:12741:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294971860 00000004:00010000:1.0:1763333169.205590:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001cd4c988 reply state 000000001338cf3d transno 4294971861 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c539da lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.205602:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c539da lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.205608:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18a:0x0].0x0 (ffff92ff80045a00) 00010000:00010000:1.0:1763333169.205610:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333169.205613:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763333169.205685:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:55917:x1848987613511936:12345-192.168.204.28@tcp:36:bash.0 Request processed in 493us (1634us total) trans 4294971861 rc 0/0 00000100:00100000:1.0:1763333169.205694:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8800 00000020:00080000:1.0:1763333169.205699:0:12741:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763333169.210861:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613512192 00000100:00100000:1.0:1763333169.210872:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613512192 00000100:00100000:1.0:1763333169.210936:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8801 00000100:00100000:1.0:1763333169.210947:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56774:x1848987613512192:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333169.210976:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333169.211004:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c539e1 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369689f3 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.211084:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c539e8 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333169.211098:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c539e8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.211109:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c539e8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.211121:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c539ef lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333169.211128:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c539ef lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.211134:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c539ef lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.211256:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c539f6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333169.211265:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c539f6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.211271:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c539f6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:1.0:1763333169.211286:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x18a:0x0]: returning size 0 00010000:00010000:1.0:1763333169.211420:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c539e8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.211428:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c539e8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.211434:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c539e8 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.211441:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c539e8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.211447:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7ec00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333169.211451:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c539e8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.211459:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c539e8 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.211471:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055a300) 00010000:00010000:1.0:1763333169.211474:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333169.211479:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c539e8 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.211485:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c539e8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.211499:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c539ef lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.211505:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c539ef lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.211514:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c539ef lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.211519:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333169.211522:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c539ef lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.211527:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c539ef lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.211534:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045d00) 00010000:00010000:1.0:1763333169.211537:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333169.211539:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c539ef lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.211545:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c539ef lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.211596:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c539e1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689f3 expref: 232 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.211614:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c539f6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689f3 expref: 231 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.211623:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18a:0x0].0x0 (ffff92ff80045a00) 00010000:00010000:1.0:1763333169.211625:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333169.211627:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f200, rc 0) 00000100:00100000:1.0:1763333169.211696:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56774:x1848987613512192:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 751us (1115us total) trans 4294971862 rc 0/0 00000100:00100000:1.0:1763333169.211703:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8801 00000100:00100000:3.0:1763333169.212828:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333169.214933:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333169.215082:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613512704 00000100:00100000:0.0:1763333169.215089:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613512704 00000100:00100000:0.0:1763333169.215143:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3001 00000100:00100000:0.0:1763333169.215153:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6b3e8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56774:x1848987613512704:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333169.215804:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6b3e8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56774:x1848987613512704:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 652us (875us total) trans 4294971863 rc 0/0 00000100:00100000:0.0:1763333169.215819:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3001 00000100:00100000:1.0:1763333169.223218:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.223269:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333169.226721:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613512832 00000100:00100000:0.0:1763333169.226731:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613512832 00000100:00100000:0.0:1763333169.226771:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3002 00000100:00100000:0.0:1763333169.226779:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56774:x1848987613512832:12345-192.168.204.28@tcp:33:lfs.0 00000100:00100000:0.0:1763333169.226919:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56774:x1848987613512832:12345-192.168.204.28@tcp:33:lfs.0 Request processed in 140us (3714us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333169.226926:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3002 00010000:00010000:3.0:1763333169.227172:0:6521:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53a0b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x18a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.227182:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53a0b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x18a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000040:00080000:3.0:1763333169.227461:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1276, 88 off108544 00000004:00080000:3.0:1763333169.227469:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1273307119271ns, next at 1273519575533ns, rc = 0 00000040:00080000:3.0:1763333169.227507:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1277, 88 off108544 00000004:00080000:3.0:1763333169.227512:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1273307162799ns, next at 1273519604631ns, rc = 0 00000040:00080000:3.0:1763333169.227527:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1278, 88 off108632 00000004:00080000:3.0:1763333169.227530:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1273307181543ns, next at 1273519604631ns, rc = 0 00000040:00080000:3.0:1763333169.227539:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1277, 88 off108632 00000004:00080000:3.0:1763333169.227544:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1273307195068ns, next at 1273519575533ns, rc = 0 00000100:00100000:1.0:1763333169.234489:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe469a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627201792:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763333169.234489:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe469a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627202048:0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1763333169.234623:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c53940 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.234636:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c53940 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.234645:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c53940 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.234653:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333169.234661:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c53940 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.234670:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c53940 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.234690:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045d00) 00010000:00010000:3.0:1763333169.234694:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333169.234701:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c53940 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.234708:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c53940 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.234738:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c539da lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.234745:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c539da lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.234751:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c539da lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.234757:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333169.234761:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c539da lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.234767:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c539da lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.234775:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18a:0x0].0x0 (ffff92ff80045a00) 00010000:00010000:3.0:1763333169.234778:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333169.234781:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c539da lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.234788:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c539da lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.234884:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53a0b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x18a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689fa expref: 216 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.234894:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18a:0x0].0x0 (ffff92ff80045a00) 00010000:00010000:3.0:1763333169.234896:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763333169.234913:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c53a04 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689fa expref: 216 pid: 6521 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1763333169.234930:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53a0b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x18a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689fa expref: 215 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.234961:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18a:0x0].0x0 (ffff92ff80045a00) 00010000:00010000:3.0:1763333169.234964:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763333169.234967:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5400, rc 0) 00000100:00100000:1.0:1763333169.235058:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333169.235100:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4684ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627202304:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333169.235119:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333169.235147:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1763333169.235153:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4684f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627201920:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763333169.235172:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333169.235186:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe469a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627202432:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333169.235203:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333169.235237:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627201920 00000100:00100000:1.0:1763333169.235240:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627201920 00000100:00100000:1.0:1763333169.235271:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6112 00000100:00100000:1.0:1763333169.235276:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+27:3655:x1848987627201536:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763333169.235297:0:8611:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:513 count 1 00010000:00010000:1.0:1763333169.235319:0:8611:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c53a12 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x201:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.235338:0:8611:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c537cd lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x201:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696893d expref: 21 pid: 8407 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333169.235379:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333169.235381:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333169.235384:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c53a12 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x201:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.235415:0:8611:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c537cd lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x201:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696893d expref: 21 pid: 8407 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333169.235431:0:8611:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c537cd lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x201:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696893d expref: 21 pid: 8407 timeout: 1373 lvb_type: 1 00000100:00100000:1.0:1763333169.235446:0:8611:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe469a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8611:1848987627202688:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333169.235515:0:8611:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7df5dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1763333169.235534:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6113 00000100:00100000:1.0:1763333169.235542:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+27:3652:x1848987627202304:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333169.235693:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6114 00000100:00100000:3.0:1763333169.235701:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+12:3652:x1848987627202432:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1763333169.235729:0:29013:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x206:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333169.235733:0:29013:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x206:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763333169.235736:0:29013:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x206:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333169.235738:0:29013:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x206:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763333169.235741:0:29013:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x206:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1763333169.235796:0:8406:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x206:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333169.235800:0:8406:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x206:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763333169.235802:0:8406:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x206:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333169.235804:0:8406:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x206:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763333169.235806:0:8406:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x206:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333169.236206:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333169.236246:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627202048 00000100:00100000:0.0:1763333169.236251:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627202048 00000100:00100000:0.0:1763333169.236279:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6116 00000100:00100000:0.0:1763333169.236285:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50066d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+14:3654:x1848987627202048:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333169.236399:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50066d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+15:3654:x1848987627202048:12345-0@lo:2:osp-syn-0-1.0 Request processed in 113us (192us total) trans 21474838704 rc 0/0 00000100:00100000:1.0:1763333169.236403:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+28:3652:x1848987627202304:12345-0@lo:2:osp-syn-1-1.0 Request processed in 862us (1282us total) trans 17179871398 rc 0/0 00000100:00100000:0.0:1763333169.236407:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6116 00000100:00100000:1.0:1763333169.236409:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6113 00000100:00100000:1.0:1763333169.236436:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333169.236624:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+14:3652:x1848987627202432:12345-0@lo:2:osp-syn-0-1.0 Request processed in 924us (1419us total) trans 21474838703 rc 0/0 00000100:00100000:3.0:1763333169.236630:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6114 00000100:00100000:1.0:1763333169.238206:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4684c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627202176:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333169.238257:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333169.238290:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627201664 00000100:00100000:0.0:1763333169.238298:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627201664 00000100:00100000:0.0:1763333169.238370:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6117 00000100:00100000:0.0:1763333169.238379:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+14:3655:x1848987627201664:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1763333169.238406:0:17605:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:513 count 1 00010000:00010000:0.0:1763333169.238435:0:17605:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c53a27 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x201:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.238458:0:17605:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e400/0xb32e3ef184c536a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x201:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369688db expref: 13 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.238466:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333169.238468:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333169.238472:0:17605:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c53a27 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x201:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.238508:0:17605:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e400/0xb32e3ef184c536a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x201:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369688db expref: 13 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.238521:0:17605:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e400/0xb32e3ef184c536a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x201:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369688db expref: 13 pid: 8407 timeout: 1373 lvb_type: 0 00000100:00100000:0.0:1763333169.238534:0:17605:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff50065500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17605:1848987627202944:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333169.238614:0:17605:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4ce84840 going to sleep for 11 seconds 00000004:00080000:1.0:1763333169.244251:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4684c700/2, rc 0, transno 17179871399 00000100:00100000:1.0:1763333169.244265:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4684c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627202176:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333169.244559:0:29010:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42efb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:29010:1848987627202560:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333169.244595:0:29010:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c53a19 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333169.244626:0:17605:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff50065500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17605:1848987627202944:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333169.244640:0:17605:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c53a27 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x201:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333169.246930:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333169.246977:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.247717:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.247754:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.247775:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613513344 00000100:00100000:1.0:1763333169.247783:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613513344 00010000:00010000:1.0:1763333169.247832:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c53867 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696897c expref: 23 pid: 28651 timeout: 1373 lvb_type: 0 00000100:00100000:1.0:1763333169.247865:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613513216 00000100:00100000:1.0:1763333169.247869:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613513216 00000100:00100000:0.0:1763333169.247869:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613513472 00000100:00100000:0.0:1763333169.247872:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613513472 00010000:00010000:1.0:1763333169.247883:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97000/0xb32e3ef184c53859 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696896e expref: 15 pid: 29013 timeout: 1373 lvb_type: 0 00010000:00010000:0.0:1763333169.247889:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e400/0xb32e3ef184c536a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x201:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369688db expref: 15 pid: 8407 timeout: 1373 lvb_type: 0 00000100:00100000:1.0:1763333169.248393:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2886 00000100:00100000:1.0:1763333169.248400:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2419:x1848987613513216:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333169.248411:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333169.248416:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97000/0xb32e3ef184c53859 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696896e expref: 15 pid: 29013 timeout: 1373 lvb_type: 0 00010000:00010000:1.0:1763333169.248425:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97000/0xb32e3ef184c53859 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696896e expref: 15 pid: 29013 timeout: 1373 lvb_type: 0 00010000:00010000:1.0:1763333169.248439:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97000/0xb32e3ef184c53859 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x202:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696896e expref: 15 pid: 29013 timeout: 1373 lvb_type: 0 00010000:00010000:1.0:1763333169.248448:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333169.248450:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333169.248453:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c53a19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.248459:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c53a19 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.248492:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333169.248512:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2419:x1848987613513216:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 112us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333169.248518:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2886 00000100:00100000:1.0:1763333169.248568:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000004:00080000:1.0:1763333169.248722:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4684ca80/2, rc 0, transno 17179871400 00000100:00100000:1.0:1763333169.248729:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4684ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627201536:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1763333169.248762:0:29010:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c53a19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.248769:0:29010:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c53a19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.248776:0:29010:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c53a19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.248783:0:29010:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c53a19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.248796:0:29010:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1763333169.249428:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+15:3652:x1848987627201792:12345-0@lo:6:osp-syn-0-1.0 Request processed in 14154us (14369us total) trans 21474838705 rc 0/0 00000100:00100000:1.0:1763333169.249435:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6111 00010000:00010000:1.0:1763333169.249452:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333169.249456:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c53a20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.249468:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5c00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333169.249471:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c53a20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.249479:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c53a20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.249490:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c53a20 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.250005:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c53a20 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.250029:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333169.250031:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333169.250033:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333169.250044:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763333169.250499:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2887 00000100:00100000:0.0:1763333169.250515:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2419:x1848987613513472:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333169.250532:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333169.250539:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e400/0xb32e3ef184c536a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x201:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369688db expref: 13 pid: 8407 timeout: 1373 lvb_type: 0 00010000:00010000:0.0:1763333169.250551:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e400/0xb32e3ef184c536a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x201:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369688db expref: 13 pid: 8407 timeout: 1373 lvb_type: 0 00010000:00010000:0.0:1763333169.250568:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e400/0xb32e3ef184c536a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x201:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369688db expref: 13 pid: 8407 timeout: 1373 lvb_type: 0 00010000:00010000:0.0:1763333169.250588:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333169.250592:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333169.250597:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c53a27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x201:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.250606:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c53a27 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x201:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.250632:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333169.250673:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:2419:x1848987613513472:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 166us (2918us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333169.250681:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2887 00010000:00010000:0.0:1763333169.250705:0:17605:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c53a27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.250713:0:17605:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c53a27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.250721:0:17605:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c53a27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.250727:0:17605:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c53a27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.250743:0:17605:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763333169.250938:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+15:3655:x1848987627201664:12345-0@lo:6:osp-syn-0-1.0 Request processed in 12559us (14500us total) trans 21474838706 rc 0/0 00000100:00100000:0.0:1763333169.250947:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6117 00010000:00010000:0.0:1763333169.250983:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333169.250989:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c53a27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.250997:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdfe00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333169.251002:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c53a27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.251009:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c53a27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.251021:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c53a27 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.251028:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c53a27 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.251043:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333169.251045:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333169.251046:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763333169.251068:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe469a2a00/2, rc 0, transno 21474838706 00000100:00100000:1.0:1763333169.251075:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe469a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627201664:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763333169.254014:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333169.254490:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613513728 00000100:00100000:0.0:1763333169.254497:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613513728 00000100:00100000:0.0:1763333169.254550:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6120 00000100:00100000:0.0:1763333169.254560:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:55917:x1848987613513728:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333169.254578:0:17605:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333169.254611:0:17605:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdee00/0xb32e3ef184c53a35 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x205:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968a08 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763333169.254636:0:17605:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x205:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333169.254660:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333169.254663:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333169.254672:0:17605:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdee00/0xb32e3ef184c53a35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a08 expref: 13 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.254687:0:17605:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdee00/0xb32e3ef184c53a35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a08 expref: 13 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.254699:0:17605:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdee00, rc 0) 00000100:00100000:0.0:1763333169.254754:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:55917:x1848987613513728:12345-192.168.204.28@tcp:101:bash.0 Request processed in 196us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333169.254762:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6120 00000100:00100000:3.0:1763333169.257340:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333169.257427:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333169.257553:0:28430:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613513856 00000100:00100000:0.0:1763333169.257564:0:28430:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613513856 00002000:00010000:0.0:1763333169.257621:0:28430:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/517 (0->18446744073709551615) 00002000:00100000:0.0:1763333169.257626:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe438aaa00 with x1848987613513856 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333169.257644:0:28430:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe438aaa00. 00000100:00100000:0.0:1763333169.257673:0:28430:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613513984 00000100:00100000:0.0:1763333169.257677:0:28430:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613513984 00002000:00010000:0.0:1763333169.257689:0:28430:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/517 (0->18446744073709551615) 00002000:00100000:0.0:1763333169.257693:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe438a8700 with x1848987613513984 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333169.257700:0:28430:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe438a8700. 00000100:00100000:0.0:1763333169.257725:0:28430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1530 00000100:00100000:0.0:1763333169.257734:0:28430:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2421:x1848987613513856:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:0.0:1763333169.257995:0:28430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x205:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333169.258001:0:28430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x205:0x0] updating lvb mtime from disk: 0 -> 1763333169 00002000:00010000:0.0:1763333169.258004:0:28430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x205:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333169.258006:0:28430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x205:0x0] updating lvb ctime from disk: 0 -> 1763333169 00002000:00010000:0.0:1763333169.258010:0:28430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x205:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333169.258015:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1531 00000100:00100000:1.0:1763333169.258025:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2421:x1848987613513984:12345-192.168.204.28@tcp:10:bash.0 00000100:00100000:0.0:1763333169.258079:0:28430:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2421:x1848987613513856:12345-192.168.204.28@tcp:10:bash.0 Request processed in 346us (754us total) trans 17179871402 rc 0/0 00000100:00100000:0.0:1763333169.258088:0:28430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1530 00002000:00010000:0.0:1763333169.258092:0:28430:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/517 (0->18446744073709551615) 00002000:00100000:0.0:1763333169.258095:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe438aaa00 with x1848987613513856 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333169.258100:0:28430:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe438aaa00. 00002000:00010000:1.0:1763333169.258143:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x205:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333169.258147:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x205:0x0] updating lvb mtime from disk: 0 -> 1763333169 00002000:00010000:1.0:1763333169.258149:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x205:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333169.258151:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x205:0x0] updating lvb ctime from disk: 0 -> 1763333169 00002000:00010000:1.0:1763333169.258153:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x205:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333169.258177:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2421:x1848987613513984:12345-192.168.204.28@tcp:10:bash.0 Request processed in 154us (749us total) trans 21474838707 rc 0/0 00000100:00100000:1.0:1763333169.258184:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1531 00002000:00010000:1.0:1763333169.258187:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/517 (0->18446744073709551615) 00002000:00100000:1.0:1763333169.258190:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe438a8700 with x1848987613513984 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333169.258194:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe438a8700. 00000100:00100000:3.0:1763333169.262125:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333169.262169:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.262245:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613514240 00000100:00100000:1.0:1763333169.262259:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613514240 00000100:00100000:1.0:1763333169.262330:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8803 00000100:00100000:1.0:1763333169.262341:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+215:56775:x1848987613514240:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333169.262397:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333169.262424:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53a3c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968a0f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333169.262496:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613514496 00000100:00100000:0.0:1763333169.262501:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613514496 00010000:00010000:1.0:1763333169.262510:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53a43 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333169.262524:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53a43 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00000100:00100000:0.0:1763333169.262534:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3003 00010000:00010000:1.0:1763333169.262536:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53a43 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000100:00100000:0.0:1763333169.262541:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+217:55917:x1848987613514496:12345-192.168.204.28@tcp:35:bash.0 00010000:00010000:1.0:1763333169.262547:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53a4a lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333169.262554:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53a4a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.262561:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53a4a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.262778:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c53a51 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333169.262787:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c53a51 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.262793:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c53a51 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:1.0:1763333169.262819:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x18a:0x0]: returning size 5 00010000:00010000:1.0:1763333169.262870:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53a43 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.262877:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53a43 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.262885:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53a43 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.262893:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53a43 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.262899:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333169.262904:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53a43 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.262912:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53a43 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.262924:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055a300) 00010000:00010000:1.0:1763333169.262928:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333169.262933:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53a43 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.262943:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53a43 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.262962:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53a4a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.262967:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53a4a lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.262972:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53a4a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.262977:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333169.262980:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53a4a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.262985:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53a4a lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.262992:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6055a000) 00010000:00010000:1.0:1763333169.262995:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333169.262998:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53a4a lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.263002:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53a4a lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.263037:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53a3c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a0f expref: 220 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.263052:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c53a51 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a0f expref: 219 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.263065:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18a:0x0].0x0 (ffff92ff80045a00) 00010000:00010000:1.0:1763333169.263067:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333169.263070:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e800, rc 0) 00000100:00100000:0.0:1763333169.263165:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:55917:x1848987613514496:12345-192.168.204.28@tcp:35:bash.0 Request processed in 623us (1048us total) trans 4294971865 rc 0/0 00000100:00100000:0.0:1763333169.263173:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3003 00000100:00100000:1.0:1763333169.263509:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+218:56775:x1848987613514240:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1169us (1338us total) trans 4294971866 rc 0/0 00000100:00100000:1.0:1763333169.263515:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8803 00000100:00100000:0.0:1763333169.267819:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613514752 00000100:00100000:0.0:1763333169.267830:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613514752 00000100:00100000:0.0:1763333169.267891:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3004 00000100:00100000:0.0:1763333169.267902:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+218:56775:x1848987613514752:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333169.269356:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:56775:x1848987613514752:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 1438us (1675us total) trans 4294971867 rc 0/0 00000100:00100000:0.0:1763333169.269369:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3004 00000100:00100000:3.0:1763333169.271228:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.271341:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613515008 00000100:00100000:1.0:1763333169.271366:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613515008 00000100:00100000:1.0:1763333169.271418:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8804 00000100:00100000:1.0:1763333169.271426:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:56776:x1848987613515008:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:1.0:1763333169.271478:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1763333169.271507:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53a0b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x18a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689fa expref: 219 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.271535:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c53a51 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a0f expref: 218 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.271547:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c539d3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x18a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689ec expref: 217 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.271558:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18a:0x0].0x0 (ffff92ff80045a00) 00010000:00010000:1.0:1763333169.271567:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333169.271606:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53a5f lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333169.271619:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53a5f lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.271633:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53a5f lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.271644:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c53a66 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333169.271650:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c53a66 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.271656:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c53a66 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.271734:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53a6d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333169.271742:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53a6d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x18a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.271748:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53a6d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x18a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000040:00080000:1.0:1763333169.272009:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1278, 64 off108696 00000040:00080000:1.0:1763333169.272036:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1279, 64 off108696 00000040:00080000:1.0:1763333169.272047:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1280, 64 off108760 00000040:00080000:1.0:1763333169.272056:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1279, 64 off108760 00010000:00010000:1.0:1763333169.272108:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53a74 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333169.272117:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53a74 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x18a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.272125:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53a74 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x18a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.272135:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53a74 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x18a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.272140:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53a74 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x18a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.272146:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53a74 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x18a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.272175:0:6521:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763333169.272192:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53a6d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x18a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.272197:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53a6d lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x18a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.272203:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53a6d lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x18a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.272208:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333169.272212:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53a6d lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x18a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.272218:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53a6d lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x18a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.272225:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18a:0x0].0x0 (ffff92ff6055ae00) 00010000:00010000:1.0:1763333169.272227:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763333169.272231:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53a6d lrc: 2/0,0 mode: --/EX res: [0x240000404:0x18a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.272236:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53a6d lrc: 0/0,0 mode: --/EX res: [0x240000404:0x18a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.272399:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53a5f lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.272406:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53a5f lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.272411:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53a5f lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.272416:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53a5f lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.272420:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7ea00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333169.272423:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53a5f lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.272428:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53a5f lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.272434:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055ad00) 00010000:00010000:1.0:1763333169.272436:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333169.272439:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53a5f lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.272443:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53a5f lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000004:00010000:1.0:1763333169.272456:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000aa94eaf1 reply state 000000000ef9c8fb transno 4294971868 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c53a66 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.272466:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c53a66 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.272471:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6055af00) 00010000:00010000:1.0:1763333169.272474:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333169.272476:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763333169.272541:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+218:56776:x1848987613515008:12345-192.168.204.28@tcp:36:rm.0 Request processed in 1114us (1319us total) trans 4294971868 rc 0/0 00000100:00100000:1.0:1763333169.272549:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8804 00010000:00010000:3.0:1763333169.272969:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333169.272977:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53a74 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x18a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.272984:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fc00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333169.272988:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53a74 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x18a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.272994:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53a74 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x18a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.273004:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18a:0x0].0x0 (ffff92ff6055ae00) 00010000:00010000:3.0:1763333169.273006:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763333169.273009:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53a74 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x18a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.273019:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53a74 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x18a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.273034:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333169.273036:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333169.273038:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763333169.275974:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333169.293701:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.293807:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613515264 00000100:00100000:1.0:1763333169.293819:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613515264 00000100:00100000:1.0:1763333169.293895:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8806 00000100:00100000:1.0:1763333169.293905:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50065500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+218:56777:x1848987613515264:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333169.293927:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333169.293964:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53a90 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968a1d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.294035:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53a97 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333169.294049:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53a97 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.294061:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53a97 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.294070:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c53a9e lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333169.294077:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c53a9e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.294082:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c53a9e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.294132:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53a97 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.294139:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53a97 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.294145:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53a97 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.294150:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53a97 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.294156:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333169.294160:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53a97 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.294167:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53a97 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.294177:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055ad00) 00010000:00010000:1.0:1763333169.294180:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333169.294184:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53a97 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.294189:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53a97 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.294203:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c53a9e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.294208:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c53a9e lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.294213:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c53a9e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.294219:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333169.294221:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c53a9e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.294226:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c53a9e lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.294231:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6055af00) 00010000:00010000:1.0:1763333169.294233:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333169.294236:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c53a9e lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.294240:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c53a9e lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.294262:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53a90 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a1d expref: 219 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.294270:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055ad00) 00010000:00010000:1.0:1763333169.294272:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333169.294275:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53a90 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a1d expref: 219 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.294287:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7ea00, rc 0) 00000100:00100000:1.0:1763333169.294380:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50065500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+218:56777:x1848987613515264:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 476us (697us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333169.294387:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8806 00000100:00100000:3.0:1763333169.301815:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333169.305895:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.305995:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613515520 00000100:00100000:1.0:1763333169.306004:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613515520 00000100:00100000:1.0:1763333169.306061:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8808 00000100:00100000:1.0:1763333169.306070:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+218:56777:x1848987613515520:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333169.306090:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333169.306112:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53aba lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968a2b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.306171:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c53ac1 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333169.306183:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c53ac1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.306193:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c53ac1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:1.0:1763333169.306237:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1763333169.306242:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1763333169.306274:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53aba lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a2b expref: 220 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.306291:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c53ac1 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a2b expref: 219 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.306299:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055ad00) 00010000:00010000:1.0:1763333169.306301:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1763333169.306304:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e800, rc 0) 00000100:00100000:1.0:1763333169.306406:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:56777:x1848987613515520:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 337us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333169.306413:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8808 00000100:00100000:0.0:1763333169.312693:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.313746:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8809 00000100:00100000:1.0:1763333169.313759:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:56778:x1848987613515776:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333169.313780:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333169.313801:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53ac8 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968a32 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.313882:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53acf lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333169.313896:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53acf lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.313907:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53acf lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.313918:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53ad6 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333169.313925:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53ad6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.313931:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53ad6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.314018:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53acf lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.314024:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53acf lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.314030:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53acf lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.314036:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53acf lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.314045:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333169.314048:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53acf lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.314055:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53acf lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.314066:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055ad00) 00010000:00010000:1.0:1763333169.314069:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333169.314073:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53acf lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.314079:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53acf lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.314092:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53ad6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.314098:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53ad6 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.314103:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53ad6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.314109:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333169.314111:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53ad6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.314117:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53ad6 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.314124:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6055af00) 00010000:00010000:1.0:1763333169.314127:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333169.314131:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53ad6 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.314136:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53ad6 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.314165:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53ac8 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a32 expref: 220 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.314175:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055ad00) 00010000:00010000:1.0:1763333169.314178:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763333169.314181:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53ac8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a32 expref: 220 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.314190:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7ea00, rc 0) 00000100:00100000:1.0:1763333169.314259:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:56778:x1848987613515776:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 503us (1577us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333169.314267:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8809 00000100:00100000:3.0:1763333169.319328:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.319459:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613516032 00000100:00100000:1.0:1763333169.319471:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613516032 00000100:00100000:1.0:1763333169.319538:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8810 00000100:00100000:1.0:1763333169.319548:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:56777:x1848987613516032:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333169.319570:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333169.319573:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763333169.319610:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c53ac1 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a2b expref: 219 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.319777:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055ad00) 00010000:00010000:1.0:1763333169.319789:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333169.319811:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53add lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968a39 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.319928:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53ae4 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333169.320214:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53ae4 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.320226:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53ae4 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.320239:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c53aeb lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333169.320247:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c53aeb lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.320254:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c53aeb lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.320700:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53af2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333169.320709:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53af2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.320716:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53af2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:1.0:1763333169.320724:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x18b:0x0]: returning size 0 00010000:00010000:1.0:1763333169.320747:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53ae4 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.320753:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53ae4 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.320760:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53ae4 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.320766:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53ae4 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.320771:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333169.320775:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53ae4 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.320782:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53ae4 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.320790:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055a300) 00010000:00010000:1.0:1763333169.320792:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333169.320795:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53ae4 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.320800:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53ae4 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000004:00010000:1.0:1763333169.320811:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004b6682b2 reply state 0000000057dddd7c transno 4294971869 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c53aeb lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.320821:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c53aeb lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.320826:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6055af00) 00010000:00010000:1.0:1763333169.320828:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333169.320830:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763333169.320856:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53add lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a39 expref: 221 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.320875:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53af2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a39 expref: 220 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.320881:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18b:0x0].0x0 (ffff92ff6055a000) 00010000:00010000:1.0:1763333169.320883:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333169.320885:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7fe00, rc 0) 00000100:00100000:1.0:1763333169.321233:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56777:x1848987613516032:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1685us (1914us total) trans 4294971869 rc 0/0 00000100:00100000:1.0:1763333169.321242:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8810 00000100:00100000:3.0:1763333169.328424:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.328516:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613516288 00000100:00100000:1.0:1763333169.328528:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613516288 00000100:00100000:1.0:1763333169.328607:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8811 00000100:00100000:1.0:1763333169.328617:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56777:x1848987613516288:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333169.328642:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333169.328663:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c53b00 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968a40 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.328772:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53b07 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333169.328788:0:6521:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53af2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a39 expref: 222 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.328799:0:6521:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53b07 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.328835:0:6521:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53af2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a39 expref: 222 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.328849:0:6521:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53af2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a39 expref: 222 pid: 6521 timeout: 1373 lvb_type: 0 00000100:00100000:1.0:1763333169.328863:0:6521:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77c6c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6521:1848987627203072:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333169.328965:0:6521:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff47e19540 going to sleep for 11 seconds 00000100:00100000:0.0:1763333169.335865:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.335971:0:6521:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77c6c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6521:1848987627203072:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333169.336005:0:6521:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53b07 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000100:00100000:3.0:1763333169.336143:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613516416 00000100:00100000:3.0:1763333169.336155:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613516416 00010000:00010000:3.0:1763333169.336192:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53af2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a39 expref: 223 pid: 6521 timeout: 1373 lvb_type: 0 00000100:00100000:3.0:1763333169.336232:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2888 00000100:00100000:3.0:1763333169.336241:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff4627fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:2420:x1848987613516416:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333169.336256:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333169.336263:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53af2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a39 expref: 223 pid: 6521 timeout: 1373 lvb_type: 0 00010000:00010000:3.0:1763333169.336274:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53af2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a39 expref: 223 pid: 6521 timeout: 1373 lvb_type: 0 00010000:00010000:3.0:1763333169.336295:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53af2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a39 expref: 223 pid: 6521 timeout: 1373 lvb_type: 0 00010000:00010000:3.0:1763333169.336312:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18b:0x0].0x0 (ffff92ff6055a000) 00010000:00010000:3.0:1763333169.336318:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53b07 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.336327:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53b07 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.336335:0:6504:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53b07 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.336393:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333169.336449:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff4627fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:2420:x1848987613516416:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 208us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333169.336457:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2888 00010000:00010000:0.0:1763333169.336586:0:6521:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53b07 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.336597:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53b07 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:0.0:1763333169.336621:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x18b:0x0]: returning size 0 00000004:00080000:0.0:1763333169.336797:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x207:0x0], index 0: 0 00000004:00080000:0.0:1763333169.336805:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x207:0x0], index 1: 0 00000004:00080000:0.0:1763333169.336810:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x208:0x0], index 1: 0 00000004:00080000:0.0:1763333169.336814:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x208:0x0], index 0: 0 00010000:00010000:0.0:1763333169.336916:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53b07 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.336924:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53b07 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.336930:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53b07 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.336935:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7ea00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333169.336939:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53b07 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.336945:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53b07 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.336969:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18b:0x0].0x0 (ffff92ff6055a000) 00010000:00010000:0.0:1763333169.336972:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333169.336976:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53b07 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.336982:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53b07 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.337035:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c53b00 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a40 expref: 222 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.337044:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18b:0x0].0x0 (ffff92ff6055a000) 00010000:00010000:0.0:1763333169.337046:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763333169.337049:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c53b00 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a40 expref: 222 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.337063:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e800, rc 0) 00000100:00100000:0.0:1763333169.337843:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56777:x1848987613516288:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 9223us (9495us total) trans 4294971870 rc 301/301 00000100:00100000:0.0:1763333169.337853:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8811 00000100:00100000:0.0:1763333169.341307:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.341532:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613516672 00000100:00100000:1.0:1763333169.341543:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613516672 00000100:00100000:1.0:1763333169.341611:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3005 00000100:00100000:1.0:1763333169.341623:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50064700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56777:x1848987613516672:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1763333169.341936:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50064700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:56777:x1848987613516672:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 314us (639us total) trans 4294971871 rc 0/0 00000100:00100000:1.0:1763333169.341945:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3005 00000100:00100000:3.0:1763333169.345215:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333169.345262:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.346544:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613517184 00000100:00100000:1.0:1763333169.346550:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613517184 00000100:00100000:1.0:1763333169.346591:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3006 00000100:00100000:1.0:1763333169.346599:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56777:x1848987613517184:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1763333169.346700:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56777:x1848987613517184:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 101us (1437us total) trans 4294971873 rc 0/0 00000100:00100000:1.0:1763333169.346706:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3006 00000100:00100000:0.0:1763333169.351542:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.352511:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613517312 00000100:00100000:1.0:1763333169.352523:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613517312 00000100:00100000:1.0:1763333169.352593:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6121 00000100:00100000:1.0:1763333169.352602:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50065180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2421:x1848987613517312:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333169.352619:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333169.352640:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53b38 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968a4e expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333169.352662:0:8404:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x207:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333169.352679:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333169.352681:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333169.352691:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53b38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a4e expref: 15 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333169.352707:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53b38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a4e expref: 15 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333169.352720:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f400, rc 0) 00000100:00100000:1.0:1763333169.352781:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50065180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2421:x1848987613517312:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 180us (1252us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333169.352788:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6121 00000100:00100000:0.0:1763333169.353847:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333169.354163:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613517440 00000100:00100000:3.0:1763333169.354169:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613517440 00000100:00100000:3.0:1763333169.354221:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8813 00000100:00100000:3.0:1763333169.354231:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50066a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:55917:x1848987613517440:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333169.354249:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333169.354268:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c53b3f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968a55 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.354298:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c53b46 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333169.354311:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c53b46 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.354323:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c53b46 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.354477:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c53b3f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a55 expref: 227 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.354493:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c53b46 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a55 expref: 226 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.354501:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18b:0x0].0x0 (ffff92ff44d03100) 00010000:00010000:3.0:1763333169.354504:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763333169.354508:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feaa00, rc 0) 00000100:00100000:3.0:1763333169.354542:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50066a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:55917:x1848987613517440:12345-192.168.204.28@tcp:101:bash.0 Request processed in 313us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333169.354548:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8813 00000100:00100000:3.0:1763333169.357337:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333169.357769:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333169.362572:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.362723:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613518080 00000100:00100000:1.0:1763333169.362735:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613518080 00000100:00100000:1.0:1763333169.362785:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8816 00000100:00100000:1.0:1763333169.362793:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56778:x1848987613518080:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333169.362817:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333169.362840:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53b69 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968a63 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333169.364033:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:1.0:1763333169.364166:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53b70 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333169.364185:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53b70 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333169.364198:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53b70 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:1.0:1763333169.364239:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x18b:0x0]: returning size 0 00000004:00200000:1.0:1763333169.364243:0:8606:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1763333169.364247:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613518336 00000100:00100000:0.0:1763333169.364253:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613518336 00000004:00010000:1.0:1763333169.364262:0:8606:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53b70 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333169.364297:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53b69 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a63 expref: 233 pid: 8606 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333169.364309:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8817 00010000:00010000:1.0:1763333169.364316:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53b70 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a63 expref: 232 pid: 8606 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333169.364318:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:55917:x1848987613518336:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333169.364333:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333169.364336:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763333169.364372:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c53b54 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x18b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a5c expref: 232 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.364385:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18b:0x0].0x0 (ffff92ff44d03100) 00010000:00010000:0.0:1763333169.364391:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333169.364570:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c53b77 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968a6a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.364619:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c53b7e lrc: 3/0,1 mode: --/EX res: [0x240000404:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333169.364629:0:6521:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53b70 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a63 expref: 232 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.364637:0:6521:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c53b7e lrc: 4/0,1 mode: --/EX res: [0x240000404:0x18b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.364672:0:6521:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53b70 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a63 expref: 232 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.364686:0:6521:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53b70 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a63 expref: 232 pid: 8606 timeout: 1373 lvb_type: 0 00000100:00100000:0.0:1763333169.364699:0:6521:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff50065f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6521:1848987627203200:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333169.364796:0:6521:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4ce84600 going to sleep for 11 seconds 00010000:00010000:1.0:1763333169.365884:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e600, rc 0) 00000100:00100000:1.0:1763333169.365949:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56778:x1848987613518080:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 3154us (3386us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333169.365959:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8816 00000100:00100000:1.0:1763333169.367182:0:6521:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff50065f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6521:1848987627203200:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333169.367216:0:6521:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c53b7e lrc: 3/0,1 mode: --/EX res: [0x240000404:0x18b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000100:00100000:3.0:1763333169.370917:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613518720 00000100:00100000:3.0:1763333169.370928:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613518720 00010000:00010000:3.0:1763333169.370983:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53b70 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a63 expref: 232 pid: 8606 timeout: 1373 lvb_type: 0 00000100:00100000:3.0:1763333169.371027:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2889 00000100:00100000:3.0:1763333169.371039:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:2418:x1848987613518720:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333169.371056:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333169.371062:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53b70 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a63 expref: 232 pid: 8606 timeout: 1373 lvb_type: 0 00010000:00010000:3.0:1763333169.371080:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53b70 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a63 expref: 232 pid: 8606 timeout: 1373 lvb_type: 0 00010000:00010000:3.0:1763333169.371106:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53b70 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a63 expref: 232 pid: 8606 timeout: 1373 lvb_type: 0 00010000:00010000:3.0:1763333169.371124:0:28428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18b:0x0].0x0 (ffff92ff44d03100) 00010000:00010000:3.0:1763333169.371130:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c53b7e lrc: 3/0,1 mode: --/EX res: [0x240000404:0x18b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.371141:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c53b7e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x18b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.371149:0:28428:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c53b7e lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x18b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.371187:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333169.371240:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:2418:x1848987613518720:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 204us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333169.371248:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2889 00000100:00100000:1.0:1763333169.372789:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613518592 00000100:00100000:1.0:1763333169.372811:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613518592 00000100:00100000:1.0:1763333169.372869:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3007 00000100:00100000:1.0:1763333169.372879:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6b3e8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56778:x1848987613518592:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1763333169.373081:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6b3e8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56778:x1848987613518592:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 203us (2650us total) trans 4294971878 rc 0/0 00000100:00100000:1.0:1763333169.373089:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3007 00010000:00010000:0.0:1763333169.374488:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c53a66 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.374503:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c53a66 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.374511:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c53a66 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.374517:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333169.374522:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c53a66 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.374534:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c53a66 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.374551:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6055af00) 00010000:00010000:0.0:1763333169.374555:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333169.374560:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c53a66 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.374567:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c53a66 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.374594:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c53aeb lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.374601:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c53aeb lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.374606:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c53aeb lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.374611:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7ec00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333169.374614:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c53aeb lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.374619:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c53aeb lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.374626:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6055af00) 00010000:00010000:0.0:1763333169.374628:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333169.374631:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c53aeb lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.374636:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c53aeb lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.374656:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c53b62 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.374662:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c53b62 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.374667:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c53b62 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.374671:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333169.374675:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c53b62 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.374680:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c53b62 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.374688:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18b:0x0].0x0 (ffff92ff44d03100) 00010000:00010000:0.0:1763333169.374690:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333169.374693:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c53b62 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.374699:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c53b62 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.374943:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c53b7e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x18b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a6a expref: 217 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.374953:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18b:0x0].0x0 (ffff92ff44d03100) 00010000:00010000:1.0:1763333169.374956:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763333169.374971:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c53b77 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a6a expref: 217 pid: 6521 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763333169.374985:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c53b7e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x18b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a6a expref: 216 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.375012:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18b:0x0].0x0 (ffff92ff44d03100) 00010000:00010000:1.0:1763333169.375015:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763333169.375017:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdea00, rc 0) 00000100:00100000:1.0:1763333169.375081:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+216:55917:x1848987613518336:12345-192.168.204.28@tcp:101:bash.0 Request processed in 10763us (11055us total) trans 4294971877 rc 0/0 00000100:00100000:1.0:1763333169.375089:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8817 00000100:00100000:1.0:1763333169.375653:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627203328 00000100:00100000:1.0:1763333169.375660:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627203328 00000100:00100000:1.0:1763333169.375698:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6122 00000100:00100000:1.0:1763333169.375706:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+15:3654:x1848987627203328:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1763333169.375732:0:17605:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:517 count 1 00010000:00010000:1.0:1763333169.375752:0:17605:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53b85 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x205:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.375767:0:17605:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdee00/0xb32e3ef184c53a35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x205:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a08 expref: 14 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.375774:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333169.375777:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333169.375780:0:17605:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53b85 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x205:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.375819:0:17605:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdee00/0xb32e3ef184c53a35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x205:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a08 expref: 14 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.375832:0:17605:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdee00/0xb32e3ef184c53a35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x205:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a08 expref: 14 pid: 17605 timeout: 1373 lvb_type: 0 00000100:00100000:1.0:1763333169.375843:0:17605:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77c6c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17605:1848987627203456:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333169.375886:0:17605:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff47d41480 going to sleep for 11 seconds 00000100:00100000:1.0:1763333169.376533:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627203584 00000100:00100000:1.0:1763333169.376537:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627203584 00000100:00100000:1.0:1763333169.376563:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6123 00000100:00100000:1.0:1763333169.376570:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+16:3654:x1848987627203584:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1763333169.376594:0:8404:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:518 count 1 00010000:00010000:1.0:1763333169.376609:0:8404:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53b8c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.376627:0:8404:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c539a9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689d0 expref: 14 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333169.376633:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333169.376635:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333169.376637:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53b8c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.376657:0:8404:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c539a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689d0 expref: 14 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333169.376667:0:8404:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c539a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689d0 expref: 14 pid: 8404 timeout: 1373 lvb_type: 1 00000100:00100000:1.0:1763333169.376677:0:8404:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77c6e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8404:1848987627203712:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333169.376710:0:8404:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff5c737f00 going to sleep for 11 seconds 00000100:00100000:1.0:1763333169.377165:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff6bc10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627203840:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763333169.377197:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333169.377216:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff6bc11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627204352:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333169.377237:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333169.377255:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763333169.377260:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff6bc11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627203968:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763333169.377277:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333169.377304:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627203840 00000100:00100000:1.0:1763333169.377308:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627203840 00000100:00100000:1.0:1763333169.377334:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627204352 00000100:00100000:1.0:1763333169.377337:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627204352 00000100:00100000:1.0:1763333169.377376:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627203968 00000100:00100000:1.0:1763333169.377379:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627203968 00000100:00100000:1.0:1763333169.377401:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6124 00000100:00100000:1.0:1763333169.377407:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+31:3652:x1848987627203840:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763333169.377422:0:8406:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:517 count 1 00010000:00010000:1.0:1763333169.377441:0:8406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c53b93 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x205:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.377456:0:8406:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c53a2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x205:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a01 expref: 21 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.377462:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333169.377464:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333169.377467:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c53b93 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x205:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.377489:0:8406:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c53a2e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x205:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a01 expref: 21 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.377499:0:8406:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c53a2e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x205:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a01 expref: 21 pid: 8611 timeout: 1373 lvb_type: 0 00000100:00100000:1.0:1763333169.377510:0:8406:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8406:1848987627204480:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333169.377549:0:8406:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7dfd80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763333169.377568:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6125 00000100:00100000:1.0:1763333169.377575:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+31:3652:x1848987627204352:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333169.377751:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6126 00000100:00100000:1.0:1763333169.377753:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+32:3652:x1848987627204352:12345-0@lo:2:osp-syn-1-1.0 Request processed in 179us (515us total) trans 17179871403 rc 0/0 00000100:00100000:0.0:1763333169.377760:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+32:3652:x1848987627203968:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763333169.377761:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6125 00002000:00080000:0.0:1763333169.377772:0:8407:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:518 count 1 00010000:00010000:0.0:1763333169.377784:0:8407:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c53b9a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.377795:0:8407:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c539a2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689d7 expref: 21 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333169.377802:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333169.377804:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333169.377807:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c53b9a lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.377828:0:8407:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c539a2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689d7 expref: 21 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333169.377836:0:8407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c539a2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689d7 expref: 21 pid: 8611 timeout: 1373 lvb_type: 1 00000100:00100000:0.0:1763333169.377846:0:8407:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff50065880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8407:1848987627204608:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333169.377871:0:8407:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4ce84600 going to sleep for 11 seconds 00000100:00100000:0.0:1763333169.379640:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627204224 00000100:00100000:0.0:1763333169.379647:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627204224 00000100:00100000:0.0:1763333169.379688:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6127 00000100:00100000:0.0:1763333169.379698:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+17:3655:x1848987627204224:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1763333169.379821:0:29010:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x207:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333169.379825:0:29010:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x207:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763333169.379827:0:29010:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x207:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333169.379829:0:29010:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x207:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763333169.379831:0:29010:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x207:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333169.379869:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+18:3655:x1848987627204224:12345-0@lo:2:osp-syn-0-1.0 Request processed in 173us (397us total) trans 21474838708 rc 0/0 00000100:00100000:0.0:1763333169.379876:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6127 00000004:00080000:0.0:1763333169.379916:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe434c7480/2, rc 0, transno 21474838708 00000100:00100000:0.0:1763333169.379923:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe434c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627204224:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1763333169.380128:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff6bc10e00/2, rc 0, transno 17179871404 00000100:00100000:0.0:1763333169.380134:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff6bc10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627204096:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333169.380451:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe434c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627204736:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333169.380458:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333169.380487:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333169.380529:0:17605:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77c6c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17605:1848987627203456:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333169.380531:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627204736 00000100:00100000:3.0:1763333169.380537:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627204736 00010000:00010000:0.0:1763333169.380556:0:17605:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53b85 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x205:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333169.380561:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6129 00000100:00100000:3.0:1763333169.380570:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+18:3653:x1848987627204736:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333169.380659:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333169.380675:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+19:3653:x1848987627204736:12345-0@lo:2:osp-syn-0-1.0 Request processed in 105us (187us total) trans 21474838709 rc 0/0 00000100:00100000:0.0:1763333169.380684:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613519104 00000100:00100000:3.0:1763333169.380685:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6129 00000004:00080000:1.0:1763333169.380686:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff6bc11c00/2, rc 0, transno 17179871403 00000100:00100000:0.0:1763333169.380691:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613519104 00000100:00100000:1.0:1763333169.380692:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff6bc11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627204352:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763333169.380716:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe434c6d80/2, rc 0, transno 21474838709 00000100:00100000:3.0:1763333169.380721:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe434c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627204736:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333169.380727:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6130 00000100:00100000:1.0:1763333169.380730:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613518976 00000100:00100000:1.0:1763333169.380736:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613518976 00000100:00100000:0.0:1763333169.380739:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50067800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:55917:x1848987613519104:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333169.380750:0:8611:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333169.380764:0:8611:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf400/0xb32e3ef184c53ba1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968a78 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333169.380785:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8818 00000100:00100000:1.0:1763333169.380793:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50064e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+216:56778:x1848987613518976:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333169.380815:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333169.380832:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53ba8 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968a71 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.380899:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53baf lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333169.380912:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53baf lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.380922:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53baf lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.380934:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c53bb6 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333169.381445:0:8611:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53b38 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a4e expref: 16 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333169.381455:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333169.381458:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333169.381463:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf400/0xb32e3ef184c53ba1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a78 expref: 16 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.381493:0:8611:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53b38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a4e expref: 16 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333169.381505:0:8611:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53b38 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a4e expref: 16 pid: 8404 timeout: 1373 lvb_type: 1 00000100:00100000:0.0:1763333169.381517:0:8611:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff50067b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8611:1848987627204864:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333169.381605:0:8611:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4ce84cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1763333169.382096:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c53bb6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.382106:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c53bb6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.382231:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53bbd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333169.382241:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53bbd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.382248:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53bbd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:1.0:1763333169.382261:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x18b:0x0]: returning size 2 00010000:00010000:1.0:1763333169.382361:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53baf lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.382370:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53baf lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.382376:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53baf lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.382383:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53baf lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.382388:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fa00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333169.382392:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53baf lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.382399:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53baf lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.382411:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055a000) 00010000:00010000:1.0:1763333169.382414:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333169.382419:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53baf lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.382429:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53baf lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.382441:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c53bb6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.382447:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c53bb6 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.382452:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c53bb6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.382456:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333169.382459:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c53bb6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.382464:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c53bb6 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.382470:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6055ae00) 00010000:00010000:1.0:1763333169.382473:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333169.382476:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c53bb6 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.382481:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c53bb6 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.382532:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53ba8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a71 expref: 219 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.382551:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53bbd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a71 expref: 218 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.382563:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18b:0x0].0x0 (ffff92ff44d03100) 00010000:00010000:1.0:1763333169.382565:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333169.382568:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e600, rc 0) 00000100:00100000:1.0:1763333169.382641:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50064e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+218:56778:x1848987613518976:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1848us (2187us total) trans 4294971879 rc 0/0 00000100:00100000:1.0:1763333169.382651:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8818 00000100:00100000:3.0:1763333169.382891:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.384131:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613519232 00000100:00100000:1.0:1763333169.384141:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613519232 00010000:00010000:1.0:1763333169.384178:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdee00/0xb32e3ef184c53a35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x205:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a08 expref: 17 pid: 17605 timeout: 1373 lvb_type: 0 00000100:00100000:1.0:1763333169.384222:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2890 00000100:00100000:1.0:1763333169.384233:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2420:x1848987613519232:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333169.384247:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333169.384253:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdee00/0xb32e3ef184c53a35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x205:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a08 expref: 17 pid: 17605 timeout: 1373 lvb_type: 0 00010000:00010000:1.0:1763333169.384266:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdee00/0xb32e3ef184c53a35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x205:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a08 expref: 17 pid: 17605 timeout: 1373 lvb_type: 0 00010000:00010000:1.0:1763333169.384288:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdee00/0xb32e3ef184c53a35 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x205:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a08 expref: 17 pid: 17605 timeout: 1373 lvb_type: 0 00010000:00010000:1.0:1763333169.384304:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333169.384306:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333169.384310:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53b85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x205:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.384322:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53b85 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x205:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.384367:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333169.384422:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2420:x1848987613519232:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 191us (1532us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333169.384430:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2890 00010000:00010000:0.0:1763333169.384724:0:17605:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53b85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.384734:0:17605:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53b85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.384743:0:17605:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53b85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.384751:0:17605:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53b85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.384778:0:17605:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763333169.385025:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+19:3654:x1848987627203328:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9318us (9415us total) trans 21474838710 rc 0/0 00000100:00100000:0.0:1763333169.385035:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6122 00010000:00010000:1.0:1763333169.385211:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333169.385218:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53b85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.385226:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333169.385231:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53b85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.385240:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53b85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.385254:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53b85 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.385261:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53b85 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.385279:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333169.385281:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333169.385284:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763333169.385709:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333169.385736:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333169.385771:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.385808:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613519360 00000100:00100000:1.0:1763333169.385815:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613519360 00010000:00010000:1.0:1763333169.385840:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c539a9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689d0 expref: 16 pid: 8404 timeout: 1373 lvb_type: 1 00000100:00100000:1.0:1763333169.385875:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613519488 00000100:00100000:1.0:1763333169.385879:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613519488 00010000:00010000:1.0:1763333169.385890:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c53a2e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x205:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a01 expref: 22 pid: 8611 timeout: 1373 lvb_type: 0 00000100:00100000:1.0:1763333169.385906:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613519616 00000100:00100000:1.0:1763333169.385908:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613519616 00010000:00010000:1.0:1763333169.385920:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c539a2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689d7 expref: 23 pid: 8611 timeout: 1373 lvb_type: 1 00000100:00100000:1.0:1763333169.385934:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2891 00000100:00100000:1.0:1763333169.385941:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2418:x1848987613519360:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333169.385951:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333169.385955:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c539a9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x206:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689d0 expref: 16 pid: 8404 timeout: 1373 lvb_type: 1 00010000:00010000:1.0:1763333169.385966:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c539a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x206:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689d0 expref: 16 pid: 8404 timeout: 1373 lvb_type: 1 00010000:00010000:1.0:1763333169.385983:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333169.385984:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333169.385988:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53b8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x206:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.386003:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53b8c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x206:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.386019:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333169.386065:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2418:x1848987613519360:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 124us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333169.386073:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2891 00000100:00100000:1.0:1763333169.386088:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2892 00000100:00100000:1.0:1763333169.386094:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2418:x1848987613519488:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333169.386102:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333169.386106:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c53a2e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x205:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a01 expref: 23 pid: 8611 timeout: 1373 lvb_type: 0 00010000:00010000:1.0:1763333169.386115:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c53a2e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x205:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a01 expref: 23 pid: 8611 timeout: 1373 lvb_type: 0 00010000:00010000:1.0:1763333169.386129:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c53a2e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x205:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a01 expref: 23 pid: 8611 timeout: 1373 lvb_type: 0 00010000:00010000:1.0:1763333169.386138:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333169.386140:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333169.386143:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c53b93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x205:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.386150:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c53b93 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x205:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.386178:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333169.386204:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2418:x1848987613519488:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 110us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333169.386211:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2892 00000100:00100000:1.0:1763333169.386224:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2893 00000100:00100000:1.0:1763333169.386230:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2418:x1848987613519616:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333169.386237:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333169.386241:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c539a2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x206:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689d7 expref: 21 pid: 8611 timeout: 1373 lvb_type: 1 00010000:00010000:1.0:1763333169.386250:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c539a2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x206:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689d7 expref: 21 pid: 8611 timeout: 1373 lvb_type: 1 00010000:00010000:1.0:1763333169.386261:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333169.386263:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333169.386266:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c53b9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x206:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.386273:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c53b9a lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x206:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.386285:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333169.386304:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2418:x1848987613519616:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 74us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333169.386311:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2893 00010000:00010000:1.0:1763333169.386372:0:8404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c539a9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689d0 expref: 15 pid: 8404 timeout: 1373 lvb_type: 1 00000100:00100000:1.0:1763333169.386385:0:8404:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77c6e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8404:1848987627203712:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333169.386397:0:8404:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53b8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.386405:0:8404:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53b8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.386410:0:8404:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53b8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.386418:0:8404:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53b8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.386426:0:8404:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53b8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.386441:0:8404:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763333169.387216:0:8407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c539a2 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369689d7 expref: 20 pid: 8611 timeout: 1373 lvb_type: 1 00000100:00100000:0.0:1763333169.387229:0:8407:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff50065880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8407:1848987627204608:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333169.387246:0:8407:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c53b9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.387254:0:8407:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c53b9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.387260:0:8407:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c53b9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.387269:0:8407:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c53b9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.387277:0:8407:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c53b9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.387297:0:8407:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1763333169.387507:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+19:3654:x1848987627203584:12345-0@lo:6:osp-syn-0-1.0 Request processed in 10934us (10994us total) trans 21474838711 rc 0/0 00000100:00100000:1.0:1763333169.387519:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6123 00010000:00010000:1.0:1763333169.387549:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1763333169.387556:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53b8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.387564:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333169.387568:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53b8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.387588:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53b8c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.387605:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53b8c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.387612:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53b8c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.387631:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1763333169.387635:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c53b93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.387641:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f200 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333169.387644:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c53b93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.387651:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c53b93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.387660:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c53b93 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.387667:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c53b93 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.387685:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333169.387688:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c53b9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.387694:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abde400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333169.387697:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c53b9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.387704:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c53b9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.387712:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c53b9a lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.387719:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c53b9a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.387731:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333169.387733:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333169.387735:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763333169.387767:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff6bc11180/2, rc 0, transno 17179871406 00000100:00100000:1.0:1763333169.387773:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff6bc11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627203968:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1763333169.387788:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff6bc10700/2, rc 0, transno 17179871405 00000100:00100000:1.0:1763333169.387792:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff6bc10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627203840:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763333169.388505:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+34:3652:x1848987627203968:12345-0@lo:6:osp-syn-1-1.0 Request processed in 10743us (11223us total) trans 17179871406 rc 0/0 00000100:00100000:0.0:1763333169.388519:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6126 00010000:00010000:0.0:1763333169.388547:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333169.388557:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763333169.391548:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333169.391681:0:8611:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff50067b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8611:1848987627204864:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333169.391718:0:8611:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf400/0xb32e3ef184c53ba1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a78 expref: 14 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.391740:0:8611:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdf400, rc 0) 00000100:00100000:0.0:1763333169.391805:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50067800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:55917:x1848987613519104:12345-192.168.204.28@tcp:101:bash.0 Request processed in 11069us (11146us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333169.391814:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6130 00000100:00100000:1.0:1763333169.392194:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613519744 00000100:00100000:1.0:1763333169.392202:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613519744 00010000:00010000:1.0:1763333169.392234:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53b38 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a4e expref: 14 pid: 8404 timeout: 1373 lvb_type: 1 00000100:00100000:1.0:1763333169.392272:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2894 00000100:00100000:1.0:1763333169.392282:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2421:x1848987613519744:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333169.392296:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333169.392302:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53b38 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x207:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a4e expref: 14 pid: 8404 timeout: 1373 lvb_type: 1 00010000:00010000:1.0:1763333169.392314:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53b38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x207:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a4e expref: 14 pid: 8404 timeout: 1373 lvb_type: 1 00010000:00010000:1.0:1763333169.392339:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53b38 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x207:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a4e expref: 14 pid: 8404 timeout: 1373 lvb_type: 1 00010000:00010000:1.0:1763333169.392379:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333169.392381:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333169.392390:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf400/0xb32e3ef184c53ba1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a78 expref: 13 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.392400:0:28428:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf400/0xb32e3ef184c53ba1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a78 expref: 13 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.392434:0:28428:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf400/0xb32e3ef184c53ba1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a78 expref: 13 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333169.392447:0:28428:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:28428:1848987627204992:192.168.204.28@tcp:105: 00000100:00100000:1.0:1763333169.392514:0:28428:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7dfd8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1763333169.393893:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613520000 00000100:00100000:1.0:1763333169.393903:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613520000 00000100:00100000:1.0:1763333169.393953:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3008 00000100:00100000:1.0:1763333169.393962:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+218:56778:x1848987613520000:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1763333169.394203:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:56778:x1848987613520000:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 241us (1226us total) trans 4294971880 rc 0/0 00000100:00100000:1.0:1763333169.394210:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3008 00000100:00100000:3.0:1763333169.399309:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613520256 00000100:00100000:3.0:1763333169.399321:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613520256 00000100:00100000:3.0:1763333169.399410:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3009 00000100:00100000:3.0:1763333169.399420:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74038a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:56778:x1848987613520256:12345-192.168.204.28@tcp:33:lfs.0 00000100:00100000:0.0:1763333169.399594:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613520128 00000100:00100000:0.0:1763333169.399600:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613520128 00000100:00100000:3.0:1763333169.399617:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74038a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:56778:x1848987613520256:12345-192.168.204.28@tcp:33:lfs.0 Request processed in 197us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333169.399626:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3009 00000100:00100000:0.0:1763333169.399645:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6131 00000100:00100000:0.0:1763333169.399654:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74039c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:55917:x1848987613520128:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333169.399664:0:8611:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333169.399685:0:8611:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c53bcb lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968a7f expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763333169.399706:0:8611:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x207:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333169.399724:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333169.399727:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333169.399737:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c53bcb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a7f expref: 21 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.399753:0:8611:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c53bcb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a7f expref: 21 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.399764:0:8611:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdee00, rc 0) 00000100:00100000:0.0:1763333169.399788:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74039c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:55917:x1848987613520128:12345-192.168.204.28@tcp:101:bash.0 Request processed in 136us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333169.399794:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6131 00000100:00100000:1.0:1763333169.403325:0:28428:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:28428:1848987627204992:192.168.204.28@tcp:105: 00010000:00010000:1.0:1763333169.403391:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333169.403458:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2421:x1848987613519744:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 11176us (11918us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333169.403470:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2894 00000100:00100000:3.0:1763333169.412539:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613520384 00000100:00100000:3.0:1763333169.412554:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613520384 00000100:00100000:1.0:1763333169.412622:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613520512 00000100:00100000:1.0:1763333169.412627:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613520512 00002000:00010000:1.0:1763333169.412684:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/519 (0->18446744073709551615) 00002000:00100000:1.0:1763333169.412690:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff74039f80 with x1848987613520512 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333169.412706:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff74039f80. 00000100:00100000:1.0:1763333169.412754:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1532 00000100:00100000:1.0:1763333169.412765:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74039f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2420:x1848987613520512:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:1.0:1763333169.412977:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x207:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333169.412981:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x207:0x0] updating lvb mtime from disk: 0 -> 1763333169 00002000:00010000:1.0:1763333169.412984:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x207:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333169.412986:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x207:0x0] updating lvb ctime from disk: 0 -> 1763333169 00002000:00010000:1.0:1763333169.412988:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x207:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333169.414300:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74039f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2420:x1848987613520512:12345-192.168.204.28@tcp:10:bash.0 Request processed in 1529us (2546us total) trans 17179871407 rc 0/0 00000100:00100000:1.0:1763333169.414312:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1532 00002000:00010000:1.0:1763333169.414319:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/519 (0->18446744073709551615) 00002000:00100000:1.0:1763333169.414322:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff74039f80 with x1848987613520512 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333169.414329:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff74039f80. 00000100:00100000:3.0:1763333169.425436:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613520768 00000100:00100000:3.0:1763333169.425447:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613520768 00000100:00100000:3.0:1763333169.425514:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3010 00000100:00100000:3.0:1763333169.425525:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7403a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:55917:x1848987613520768:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:3.0:1763333169.426555:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7403a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+220:55917:x1848987613520768:12345-192.168.204.28@tcp:35:bash.0 Request processed in 1025us (2123us total) trans 4294971881 rc 0/0 00000100:00100000:3.0:1763333169.426567:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3010 00000100:00100000:0.0:1763333169.428068:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.428231:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613521024 00000100:00100000:1.0:1763333169.428243:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613521024 00000100:00100000:1.0:1763333169.428298:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8819 00000100:00100000:1.0:1763333169.428309:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50067b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+220:56779:x1848987613521024:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333169.428330:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333169.428385:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53bd2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968a86 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.428492:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c53bd9 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333169.428507:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c53bd9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x18b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.428518:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c53bd9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x18b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:1.0:1763333169.428529:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x18b:0x0]: returning size 5 00010000:00010000:1.0:1763333169.428653:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53bd2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a86 expref: 223 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.428673:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c53bd9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x18b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a86 expref: 222 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.428687:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18b:0x0].0x0 (ffff92ff44d03100) 00010000:00010000:1.0:1763333169.428690:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1763333169.428693:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f200, rc 0) 00000100:00100000:1.0:1763333169.428767:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50067b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:56779:x1848987613521024:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 460us (708us total) trans 4294971882 rc 0/0 00000100:00100000:1.0:1763333169.428775:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8819 00000100:00100000:3.0:1763333169.439787:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613521280 00000100:00100000:3.0:1763333169.439801:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613521280 00000100:00100000:3.0:1763333169.439967:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8820 00000100:00100000:3.0:1763333169.439984:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7403ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:56779:x1848987613521280:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333169.440013:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333169.440038:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c53be7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968a8d expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.440166:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c53bee lrc: 3/0,1 mode: --/CW res: [0x240000404:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333169.440185:0:8606:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53bbd lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a71 expref: 223 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.440196:0:8606:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c53bee lrc: 4/0,1 mode: --/CW res: [0x240000404:0x18b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333169.440245:0:8606:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53bbd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a71 expref: 223 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.440259:0:8606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53bbd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a71 expref: 223 pid: 6521 timeout: 1373 lvb_type: 0 00000100:00100000:3.0:1763333169.440275:0:8606:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe438a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627205120:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333169.446922:0:8606:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff742b9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1763333169.447979:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613521536 00000100:00100000:3.0:1763333169.447993:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613521536 00000100:00100000:3.0:1763333169.448070:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3011 00000100:00100000:3.0:1763333169.448080:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56780:x1848987613521536:12345-192.168.204.28@tcp:35:rm.0 00000100:00100000:3.0:1763333169.448485:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56780:x1848987613521536:12345-192.168.204.28@tcp:35:rm.0 Request processed in 405us (1261us total) trans 4294971883 rc 0/0 00000100:00100000:3.0:1763333169.448496:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3011 00000100:00100000:3.0:1763333169.452345:0:8606:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe438a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627205120:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333169.452557:0:8606:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c53bee lrc: 3/0,1 mode: --/CW res: [0x240000404:0x18b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000100:00100000:0.0:1763333169.458283:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.458429:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613521664 00000100:00100000:1.0:1763333169.458440:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613521664 00010000:00010000:1.0:1763333169.458486:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53bbd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a71 expref: 225 pid: 6521 timeout: 1373 lvb_type: 0 00010000:00010000:3.0:1763333169.459568:0:8606:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c53bee lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x18b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333169.459585:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c53bee lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x18b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:3.0:1763333169.459612:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x18b:0x0]: returning size 5 00010000:00010000:3.0:1763333169.459750:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c53be7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a8d expref: 225 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.459766:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c53bee lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x18b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a8d expref: 224 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.459773:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18b:0x0].0x0 (ffff92ff44d03100) 00010000:00010000:3.0:1763333169.459776:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1763333169.459778:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feb400, rc 0) 00000100:00100000:3.0:1763333169.460169:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7403ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56779:x1848987613521280:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 20191us (20530us total) trans 4294971884 rc 0/0 00000100:00100000:3.0:1763333169.460178:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8820 00000100:00100000:0.0:1763333169.467266:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333169.467402:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.467676:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613521920 00000100:00100000:1.0:1763333169.467701:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613521920 00000100:00100000:1.0:1763333169.467764:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613522048 00000100:00100000:1.0:1763333169.467768:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613522048 00000100:00100000:1.0:1763333169.467806:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8821 00000100:00100000:1.0:1763333169.467816:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50065880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56780:x1848987613521920:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:1.0:1763333169.467872:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1763333169.467900:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c53bd9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x18b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a86 expref: 225 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.467922:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c53b7e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x18b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a6a expref: 224 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.467936:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c53b46 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a55 expref: 223 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.467953:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18b:0x0].0x0 (ffff92ff44d03100) 00010000:00010000:1.0:1763333169.467958:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333169.467988:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53bfc lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333169.468003:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53bfc lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.468013:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53bfc lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.468028:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53c03 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333169.468039:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53c03 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.468046:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53c03 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.468145:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53c0a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333169.468156:0:6521:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c53bee lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x18b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a8d expref: 222 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.468163:0:6521:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53c0a lrc: 4/0,1 mode: --/EX res: [0x240000404:0x18b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.468207:0:6521:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c53bee lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x18b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a8d expref: 222 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.468225:0:6521:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c53bee lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x18b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a8d expref: 222 pid: 8606 timeout: 1373 lvb_type: 0 00000100:00100000:1.0:1763333169.468242:0:6521:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6521:1848987627205248:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333169.468323:0:6521:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7dfd8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1763333169.468496:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8822 00000100:00100000:0.0:1763333169.468507:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50064000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:56779:x1848987613522048:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333169.468524:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333169.468536:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c53c11 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968a94 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.468631:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c53c18 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333169.468641:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53c0a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x18b:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.468648:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c53c18 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.468660:0:6519:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53c0a lrc: 4/0,1 mode: --/EX res: [0x240000404:0x18b:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.468670:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c53c18 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000100:00100000:1.0:1763333169.476149:0:6521:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6521:1848987627205248:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333169.476192:0:6521:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53c0a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x18b:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT1 00000100:00100000:0.0:1763333169.479906:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.481690:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613522176 00000100:00100000:1.0:1763333169.481703:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613522176 00010000:00010000:1.0:1763333169.481754:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c53bee lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x18b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a8d expref: 224 pid: 8606 timeout: 1373 lvb_type: 0 00000100:00100000:1.0:1763333169.481802:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2896 00000100:00100000:1.0:1763333169.481813:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50064380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:2421:x1848987613522176:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333169.481828:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333169.481835:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c53bee lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x18b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a8d expref: 224 pid: 8606 timeout: 1373 lvb_type: 0 00010000:00010000:1.0:1763333169.481848:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c53bee lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x18b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a8d expref: 224 pid: 8606 timeout: 1373 lvb_type: 0 00010000:00010000:1.0:1763333169.481871:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c53bee lrc: 0/0,0 mode: --/CW res: [0x240000404:0x18b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a8d expref: 224 pid: 8606 timeout: 1373 lvb_type: 0 00010000:00010000:1.0:1763333169.481894:0:28428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18b:0x0].0x0 (ffff92ff44d03100) 00010000:00010000:1.0:1763333169.481899:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53c0a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x18b:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.481910:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53c0a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x18b:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.481917:0:28428:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53c0a lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x18b:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.481925:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c53c18 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.481931:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c53c18 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.481937:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c53c18 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.481958:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333169.482031:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50064380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:2421:x1848987613522176:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 219us (2136us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333169.482041:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2896 00010000:00010000:0.0:1763333169.482121:0:6521:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53c0a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x18b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.482129:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53c0a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x18b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT1 00000004:00080000:0.0:1763333169.482453:0:6521:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x18b:0x0] is inserted into orphan list, open count = 1 00010000:00010000:0.0:1763333169.482548:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53c0a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x18b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.482555:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53c0a lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x18b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.482566:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53c0a lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x18b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.482572:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333169.482589:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53c0a lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x18b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.482597:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53c0a lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x18b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.482606:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18b:0x0].0x0 (ffff92ff44d03100) 00010000:00010000:0.0:1763333169.482610:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1763333169.482612:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c53c18 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.482619:0:6521:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c53c18 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.482624:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c53c18 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.482649:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53c0a lrc: 2/0,0 mode: --/EX res: [0x240000404:0x18b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.482656:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53c0a lrc: 0/0,0 mode: --/EX res: [0x240000404:0x18b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.482670:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53bfc lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.482676:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53bfc lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.482681:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53bfc lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.482686:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53bfc lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.482691:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333169.482694:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53bfc lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.482700:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53bfc lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.482707:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055a000) 00010000:00010000:0.0:1763333169.482710:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333169.482713:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53bfc lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.482718:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53bfc lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000004:00010000:0.0:1763333169.482734:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007f92f237 reply state 00000000a7c82a4b transno 4294971885 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53c03 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.482744:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53c03 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.482750:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6055ae00) 00010000:00010000:0.0:1763333169.482753:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333169.482755:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763333169.482820:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50065880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56780:x1848987613521920:12345-192.168.204.28@tcp:36:rm.0 Request processed in 15004us (15566us total) trans 4294971885 rc 0/0 00000100:00100000:0.0:1763333169.482828:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8821 00010000:00010000:1.0:1763333169.483416:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c53c18 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.483425:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c53c18 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:1.0:1763333169.483461:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x18b:0x0]: returning size 5 00000004:00200000:1.0:1763333169.483465:0:6519:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763333169.483481:0:6519:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c53c18 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.483513:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c53c11 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a94 expref: 224 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.483529:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c53c18 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a94 expref: 223 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.483537:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18b:0x0].0x0 (ffff92ff44d03100) 00010000:00010000:1.0:1763333169.483539:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333169.483542:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abde200, rc 0) 00000100:00100000:1.0:1763333169.483590:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50064000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56779:x1848987613522048:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 15085us (16188us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333169.483596:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8822 00000100:00100000:3.0:1763333169.494413:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.496850:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613522432 00000100:00100000:1.0:1763333169.496875:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613522432 00000100:00100000:1.0:1763333169.496974:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8823 00000100:00100000:1.0:1763333169.496985:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56779:x1848987613522432:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333169.497014:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333169.497043:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c53c1f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968a9b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.497178:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c53c26 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333169.497194:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c53c26 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x18b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.497204:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c53c26 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x18b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:1.0:1763333169.497219:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x18b:0x0]: returning size 5 00010000:00010000:1.0:1763333169.497345:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c53c1f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a9b expref: 226 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.497411:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c53c26 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x18b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a9b expref: 225 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.497433:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18b:0x0].0x0 (ffff92ff44d03100) 00010000:00010000:1.0:1763333169.497437:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763333169.497441:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f600, rc 0) 00000100:00100000:1.0:1763333169.497531:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56779:x1848987613522432:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 547us (3181us total) trans 4294971886 rc 0/0 00000100:00100000:1.0:1763333169.497540:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8823 00000100:00100000:0.0:1763333169.503565:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.503655:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613522688 00000100:00100000:1.0:1763333169.503667:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613522688 00000100:00100000:1.0:1763333169.503731:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6132 00000100:00100000:1.0:1763333169.503740:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50065c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2418:x1848987613522688:12345-192.168.204.28@tcp:1:lfs.0 00010000:00010000:1.0:1763333169.503793:0:8406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53c34 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.503811:0:8406:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf400/0xb32e3ef184c53ba1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a78 expref: 14 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.503819:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333169.503822:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333169.503826:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53c34 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.503868:0:8406:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf400/0xb32e3ef184c53ba1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a78 expref: 14 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.503881:0:8406:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf400/0xb32e3ef184c53ba1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a78 expref: 14 pid: 8611 timeout: 1373 lvb_type: 0 00000100:00100000:1.0:1763333169.503896:0:8406:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8406:1848987627205376:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333169.510608:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613522560 00000100:00100000:1.0:1763333169.510618:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613522560 00000100:00100000:1.0:1763333169.510686:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8824 00000100:00100000:1.0:1763333169.510695:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56781:x1848987613522560:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333169.510723:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333169.510753:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53c3b lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968aa2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.510840:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53c42 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333169.510855:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53c42 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.510867:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53c42 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.510876:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53c49 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333169.510883:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53c49 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.510889:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53c49 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.511055:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53c42 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.511064:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53c42 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.511070:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53c42 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.511076:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53c42 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.511082:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333169.511086:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53c42 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.511093:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53c42 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.511105:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055a500) 00010000:00010000:1.0:1763333169.511108:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333169.511114:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53c42 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.511120:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53c42 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.511134:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53c49 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.511139:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53c49 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.511144:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53c49 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.511148:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fc00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333169.511151:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53c49 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.511156:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53c49 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.511162:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6055ae00) 00010000:00010000:1.0:1763333169.511164:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333169.511166:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53c49 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.511171:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53c49 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.511200:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53c3b lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968aa2 expref: 226 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.511209:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055a500) 00010000:00010000:1.0:1763333169.511212:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333169.511216:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53c3b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968aa2 expref: 226 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.511231:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7ea00, rc 0) 00000100:00100000:1.0:1763333169.511292:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56781:x1848987613522560:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 597us (919us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333169.511300:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8824 00000100:00100000:3.0:1763333169.512915:0:8406:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8406:1848987627205376:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333169.512942:0:8406:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53c34 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333169.525450:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613522944 00000100:00100000:1.0:1763333169.525464:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613522944 00000100:00100000:1.0:1763333169.525535:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8825 00000100:00100000:1.0:1763333169.525544:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56781:x1848987613522944:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333169.525572:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333169.525605:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53c50 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968aa9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.525684:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53c57 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333169.525699:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53c57 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.525711:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53c57 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.525720:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53c5e lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333169.525727:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53c5e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.525733:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53c5e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.525778:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53c57 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.525784:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53c57 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.525790:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53c57 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.525802:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53c57 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.525808:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fc00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333169.525813:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53c57 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.525822:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53c57 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.525836:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055a500) 00010000:00010000:1.0:1763333169.525840:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333169.525846:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53c57 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.525852:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53c57 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.525868:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53c5e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.525873:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53c5e lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.525878:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53c5e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.525883:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333169.525885:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53c5e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.525891:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53c5e lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.525901:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6055ae00) 00010000:00010000:1.0:1763333169.525903:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333169.525906:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53c5e lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.525911:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53c5e lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.525934:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53c50 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968aa9 expref: 226 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.525943:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055a500) 00010000:00010000:1.0:1763333169.525945:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333169.525961:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53c50 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968aa9 expref: 226 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.525975:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7ea00, rc 0) 00000100:00100000:3.0:1763333169.529543:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.529754:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56781:x1848987613522944:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 4205us (5474us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333169.529766:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8825 00010000:00010000:3.0:1763333169.531035:0:8406:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53c34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.531045:0:8406:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53c34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.531065:0:8406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53c34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.531074:0:8406:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53c34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.531082:0:8406:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53c34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.531090:0:8406:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fa00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333169.531094:0:8406:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53c34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.531102:0:8406:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53c34 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.531114:0:8406:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53c34 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.531127:0:8406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53c34 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333169.531172:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50065c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2418:x1848987613522688:12345-192.168.204.28@tcp:1:lfs.0 Request processed in 27433us (27620us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333169.531179:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6132 00000100:00100000:0.0:1763333169.538247:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.538660:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613523200 00000100:00100000:1.0:1763333169.538671:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613523200 00000100:00100000:0.0:1763333169.539153:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8826 00000100:00100000:0.0:1763333169.539164:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50064a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56781:x1848987613523200:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333169.539189:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333169.539221:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c53c65 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968ab0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.539295:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c53c6c lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333169.539311:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c53c6c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.539324:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c53c6c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:0.0:1763333169.539388:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1763333169.539394:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:3.0:1763333169.539434:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:0.0:1763333169.539436:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c53c65 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ab0 expref: 227 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.539453:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c53c6c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ab0 expref: 226 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.539462:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe4345b800) 00010000:00010000:0.0:1763333169.539466:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1763333169.539469:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdf600, rc 0) 00000100:00100000:0.0:1763333169.539537:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50064a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56781:x1848987613523200:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 373us (1301us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333169.539544:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8826 00000100:00100000:0.0:1763333169.539561:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613523456 00000100:00100000:0.0:1763333169.539566:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613523456 00000100:00100000:0.0:1763333169.539603:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8827 00000100:00100000:0.0:1763333169.539618:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56779:x1848987613523456:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:0.0:1763333169.539647:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333169.539664:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c53c18 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a94 expref: 226 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.539674:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18b:0x0].0x0 (ffff92ff44d03100) 00010000:00010000:0.0:1763333169.539678:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333169.539698:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c53c73 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333169.539707:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c53c73 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.539714:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c53c73 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000040:00080000:0.0:1763333169.539947:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1283, 88 off109024 00000004:00080000:0.0:1763333169.539967:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1273619617388ns, next at 1273519604631ns, rc = 0 00000040:00080000:0.0:1763333169.540215:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1282, 88 off109024 00000004:00080000:0.0:1763333169.540223:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1273619873816ns, next at 1273519575533ns, rc = 0 00000040:00080000:0.0:1763333169.540251:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1283, 88 off109112 00000004:00080000:0.0:1763333169.540255:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1273619906026ns, next at 1273519575533ns, rc = 0 00000040:00080000:0.0:1763333169.540265:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1284, 88 off109112 00000004:00080000:0.0:1763333169.540268:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1273619919144ns, next at 1273519604631ns, rc = 0 00000100:00100000:0.0:1763333169.545585:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627205632:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333169.545600:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff50065f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627205760:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333169.545668:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:0.0:1763333169.545704:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000cba0927 reply state 00000000685476ab transno 4294971887 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c53c73 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000100:00100000:1.0:1763333169.545712:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763333169.545718:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627205888:0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1763333169.545732:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c53c73 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00000100:00100000:1.0:1763333169.545736:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1763333169.545743:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18b:0x0].0x0 (ffff92ff44d03100) 00010000:00010000:0.0:1763333169.545747:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1763333169.545752:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763333169.545767:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627205760 00000100:00100000:1.0:1763333169.545774:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627205760 00000100:00100000:1.0:1763333169.545817:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627205888 00000100:00100000:1.0:1763333169.545820:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627205888 00000100:00100000:1.0:1763333169.545841:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6133 00000100:00100000:1.0:1763333169.545849:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+33:3652:x1848987627205760:12345-0@lo:2:osp-syn-1-1.0 00010000:00080000:0.0:1763333169.545849:0:6521:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1763333169.545861:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+217:56779:x1848987613523456:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 6250us (6426us total) trans 4294971887 rc 0/0 00000100:00100000:0.0:1763333169.545869:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8827 00010000:00010000:0.0:1763333169.545892:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c53c73 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.545899:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c53c73 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.545905:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c53c73 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.545911:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333169.545915:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c53c73 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.545922:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c53c73 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.545931:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18b:0x0].0x0 (ffff92ff44d03100) 00010000:00010000:0.0:1763333169.545934:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333169.545938:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c53c73 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.545943:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c53c73 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000100:00100000:0.0:1763333169.546265:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627205504 00000100:00100000:0.0:1763333169.546270:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627205504 00000100:00100000:0.0:1763333169.546305:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6134 00000100:00100000:0.0:1763333169.546312:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+19:3652:x1848987627205888:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333169.546447:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+20:3652:x1848987627205888:12345-0@lo:2:osp-syn-0-1.0 Request processed in 135us (709us total) trans 21474838714 rc 0/0 00000100:00100000:0.0:1763333169.546453:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6134 00000100:00100000:0.0:1763333169.546468:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6135 00000100:00100000:0.0:1763333169.546474:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+35:3654:x1848987627205504:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333169.547070:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+35:3652:x1848987627205760:12345-0@lo:2:osp-syn-1-1.0 Request processed in 1220us (1400us total) trans 17179871408 rc 0/0 00000100:00100000:1.0:1763333169.547077:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6133 00000100:00100000:1.0:1763333169.547111:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763333169.547122:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53c03 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.547132:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53c03 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.547139:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53c03 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00000100:00100000:1.0:1763333169.547143:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627205632 00010000:00010000:3.0:1763333169.547145:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f000 already unused, calling callback (ffffffffc17b3550) 00000100:00100000:1.0:1763333169.547147:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627205632 00010000:00010000:3.0:1763333169.547149:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53c03 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.547155:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53c03 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.547166:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6055ae00) 00000100:00100000:1.0:1763333169.547167:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6136 00010000:00010000:3.0:1763333169.547169:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333169.547172:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53c03 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000100:00100000:1.0:1763333169.547173:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+20:3655:x1848987627205632:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1763333169.547179:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53c03 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000100:00100000:1.0:1763333169.547283:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+21:3655:x1848987627205632:12345-0@lo:2:osp-syn-0-1.0 Request processed in 109us (171us total) trans 21474838715 rc 0/0 00000100:00100000:1.0:1763333169.547293:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6136 00000004:00080000:1.0:1763333169.547343:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe472f6a00/2, rc 0, transno 21474838714 00000100:00100000:1.0:1763333169.547367:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627205888:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1763333169.547382:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff50065f80/2, rc 0, transno 17179871408 00000100:00100000:1.0:1763333169.547386:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff50065f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627205760:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763333169.547664:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe472f5f80/2, rc 0, transno 21474838715 00000100:00100000:3.0:1763333169.547669:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627205632:0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1763333169.547799:0:17605:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x207:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333169.547803:0:17605:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x207:0x0] updating lvb mtime from disk: 1763333169 -> 1763333169 00002000:00010000:0.0:1763333169.547806:0:17605:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x207:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333169.547808:0:17605:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x207:0x0] updating lvb ctime from disk: 1763333169 -> 1763333169 00002000:00010000:0.0:1763333169.547811:0:17605:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x207:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333169.547846:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613523584 00000100:00100000:1.0:1763333169.547851:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613523584 00000100:00100000:0.0:1763333169.547856:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+35:3654:x1848987627205504:12345-0@lo:2:osp-syn-1-1.0 Request processed in 1382us (1724us total) trans 17179871409 rc 0/0 00000100:00100000:0.0:1763333169.547862:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6135 00000100:00100000:1.0:1763333169.547884:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8828 00000100:00100000:1.0:1763333169.547891:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+215:56781:x1848987613523584:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333169.547905:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333169.547921:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53c7a lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968ab7 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.548000:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53c81 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333169.548012:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53c81 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.548021:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53c81 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.548033:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53c88 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333169.548041:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53c88 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.548047:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53c88 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00080000:3.0:1763333169.548078:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff50064700/2, rc 0, transno 17179871409 00010000:00010000:1.0:1763333169.548079:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53c81 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000100:00100000:3.0:1763333169.548083:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff50064700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627205504:0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1763333169.548085:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53c81 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.548090:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53c81 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.548096:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53c81 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.548101:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333169.548104:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53c81 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.548114:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53c81 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.548122:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe4345b800) 00010000:00010000:1.0:1763333169.548124:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333169.548128:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53c81 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.548134:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53c81 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.548143:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53c88 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.548149:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53c88 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.548154:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53c88 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.548158:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fc00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333169.548161:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53c88 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.548167:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53c88 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.548174:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6055a500) 00010000:00010000:1.0:1763333169.548176:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333169.548178:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53c88 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.548184:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53c88 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.548216:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53c7a lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ab7 expref: 216 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.548226:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe4345b800) 00010000:00010000:1.0:1763333169.548229:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333169.548232:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53c7a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ab7 expref: 216 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.548241:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7ea00, rc 0) 00000100:00100000:1.0:1763333169.548284:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+215:56781:x1848987613523584:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 392us (797us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333169.548290:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8828 00000100:00100000:1.0:1763333169.548465:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613523712 00000100:00100000:1.0:1763333169.548470:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613523712 00000100:00100000:1.0:1763333169.548502:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8829 00000100:00100000:1.0:1763333169.548509:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+215:56779:x1848987613523712:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333169.548521:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333169.548530:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53c8f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968abe expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.548565:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53c8f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968abe expref: 216 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.548592:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53c8f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968abe expref: 216 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.548610:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18b:0x0].0x0 (ffff92ff44d03100) 00010000:00010000:1.0:1763333169.548613:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763333169.548615:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e400, rc 0) 00000100:00100000:1.0:1763333169.548636:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+216:56779:x1848987613523712:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 127us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333169.548642:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8829 00000100:00100000:1.0:1763333169.551147:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613523968 00000100:00100000:1.0:1763333169.551156:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613523968 00000100:00100000:1.0:1763333169.551210:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8830 00000100:00100000:1.0:1763333169.551221:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4399b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+216:56781:x1848987613523968:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333169.551238:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333169.551241:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763333169.551270:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c53c6c lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ab0 expref: 216 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.551289:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe4345b800) 00010000:00010000:1.0:1763333169.551298:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333169.551314:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53c96 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968ac5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.551438:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53c9d lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333169.551451:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53c9d lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.551464:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53c9d lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.551477:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c53ca4 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333169.551487:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c53ca4 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.551494:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c53ca4 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000100:00100000:3.0:1763333169.551709:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613524096 00000100:00100000:3.0:1763333169.551714:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613524096 00000100:00100000:3.0:1763333169.551750:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8831 00000100:00100000:3.0:1763333169.551757:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4399a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+217:56779:x1848987613524096:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333169.551766:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333169.551775:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c53cab lrc: 2/0,0 mode: --/CR res: [0x240000404:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968acc expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.551815:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c53cb2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333169.551825:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c53cb2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.551832:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c53cb2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:3.0:1763333169.551860:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x18b:0x0]: returning size 5 00000004:00200000:3.0:1763333169.551864:0:12741:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763333169.551874:0:12741:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c53cb2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.551881:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c53cb9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x18c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333169.551889:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c53cb9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.551895:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c53cab lrc: 0/0,0 mode: --/CR res: [0x240000404:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968acc expref: 220 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.551896:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c53cb9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:1.0:1763333169.551904:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x18c:0x0]: returning size 0 00010000:00010000:3.0:1763333169.551913:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c53cb2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968acc expref: 219 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.551920:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18b:0x0].0x0 (ffff92ff44d03100) 00010000:00010000:3.0:1763333169.551922:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1763333169.551925:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feba00, rc 0) 00010000:00010000:1.0:1763333169.551925:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53c9d lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.551931:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53c9d lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.551935:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53c9d lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.551941:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53c9d lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.551946:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e600 already unused, calling callback (ffffffffc17b3550) 00000100:00100000:3.0:1763333169.551988:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4399a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:56779:x1848987613524096:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 231us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333169.551995:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8831 00010000:00010000:1.0:1763333169.552549:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53c9d lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.552560:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53c9d lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.552585:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055a300) 00010000:00010000:1.0:1763333169.552588:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333169.552593:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53c9d lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.552599:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53c9d lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000004:00010000:1.0:1763333169.552610:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002c5b8027 reply state 000000007b48f770 transno 4294971888 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c53ca4 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.552620:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c53ca4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.552626:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6055ad00) 00010000:00010000:1.0:1763333169.552628:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333169.552630:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763333169.552657:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53c96 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ac5 expref: 219 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.552674:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c53cb9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ac5 expref: 218 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.552680:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18c:0x0].0x0 (ffff92ff6055a000) 00010000:00010000:1.0:1763333169.552683:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333169.552685:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7ec00, rc 0) 00000100:00100000:1.0:1763333169.552988:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4399b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:56781:x1848987613523968:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1768us (1999us total) trans 4294971888 rc 0/0 00000100:00100000:1.0:1763333169.552996:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8830 00000100:00100000:0.0:1763333169.557837:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333169.557917:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613524224 00000100:00100000:3.0:1763333169.557930:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613524224 00000100:00100000:1.0:1763333169.557976:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613524480 00000100:00100000:1.0:1763333169.557982:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613524480 00000100:00100000:3.0:1763333169.558041:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6137 00000100:00100000:1.0:1763333169.558041:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8832 00000100:00100000:3.0:1763333169.558052:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2420:x1848987613524224:12345-192.168.204.28@tcp:101:lfs.0 00000100:00100000:1.0:1763333169.558052:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:56781:x1848987613524480:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333169.558072:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333169.558073:0:17605:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333169.558092:0:17605:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c53cce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968ad3 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.558092:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c53cc7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x18c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968ada expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333169.558119:0:17605:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x207:0x0] initial LVB size: 5, mtime: 0x691a5431, atime: 0x0, ctime: 0x691a5431, blocks: 0x8 00010000:00010000:3.0:1763333169.558138:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333169.558140:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333169.558151:0:17605:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c53cce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ad3 expref: 16 pid: 17605 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333169.558216:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53cd5 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x18c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333169.558235:0:6521:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c53cb9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ac5 expref: 220 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.558243:0:6521:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53cd5 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x18c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.558266:0:17605:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c53cce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ad3 expref: 16 pid: 17605 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333169.558277:0:6521:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c53cb9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ac5 expref: 220 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.558286:0:17605:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea200, rc 0) 00010000:00010000:1.0:1763333169.558290:0:6521:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c53cb9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ac5 expref: 220 pid: 6521 timeout: 1373 lvb_type: 0 00000100:00100000:1.0:1763333169.558303:0:6521:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6521:1848987627206016:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333169.558608:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2420:x1848987613524224:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 557us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333169.558615:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6137 00000100:00100000:1.0:1763333169.558617:0:6521:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7dfd8300 going to sleep for 11 seconds 00000100:00100000:1.0:1763333169.561922:0:6521:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6521:1848987627206016:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333169.562215:0:6521:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53cd5 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x18c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000100:00100000:3.0:1763333169.562291:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613524608 00000100:00100000:3.0:1763333169.562299:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613524608 00010000:00010000:3.0:1763333169.562336:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c53cb9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ac5 expref: 221 pid: 6521 timeout: 1373 lvb_type: 0 00000100:00100000:3.0:1763333169.562411:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2898 00000100:00100000:3.0:1763333169.562421:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43998700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:2419:x1848987613524608:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333169.562440:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333169.562446:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c53cb9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ac5 expref: 221 pid: 6521 timeout: 1373 lvb_type: 0 00010000:00010000:3.0:1763333169.562457:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c53cb9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ac5 expref: 221 pid: 6521 timeout: 1373 lvb_type: 0 00010000:00010000:3.0:1763333169.562479:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c53cb9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ac5 expref: 221 pid: 6521 timeout: 1373 lvb_type: 0 00010000:00010000:3.0:1763333169.562494:0:28428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18c:0x0].0x0 (ffff92ff6055a000) 00010000:00010000:3.0:1763333169.562499:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53cd5 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x18c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.562508:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53cd5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x18c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.562515:0:28428:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53cd5 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x18c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.562536:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333169.562602:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43998700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+220:2419:x1848987613524608:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 183us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333169.562610:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2898 00010000:00010000:0.0:1763333169.562938:0:6521:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53cd5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x18c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.562947:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53cd5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x18c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:0.0:1763333169.563267:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x18c:0x0]: returning size 0 00000004:00080000:0.0:1763333169.563510:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x209:0x0], index 1: 0 00000004:00080000:0.0:1763333169.563518:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x209:0x0], index 0: 0 00000004:00080000:0.0:1763333169.563524:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x20a:0x0], index 0: 0 00000004:00080000:0.0:1763333169.563529:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x20a:0x0], index 1: 0 00010000:00010000:0.0:1763333169.563652:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53cd5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x18c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.563660:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53cd5 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x18c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.563667:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53cd5 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x18c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.563673:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333169.563676:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53cd5 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x18c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.563683:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53cd5 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x18c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.563693:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18c:0x0].0x0 (ffff92ff6055a000) 00010000:00010000:0.0:1763333169.563696:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333169.563700:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53cd5 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x18c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.563705:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53cd5 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x18c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.563751:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c53cc7 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x18c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ada expref: 220 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.563760:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18c:0x0].0x0 (ffff92ff6055a000) 00010000:00010000:0.0:1763333169.563762:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763333169.563765:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c53cc7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x18c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ada expref: 220 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.563783:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f800, rc 0) 00000100:00100000:0.0:1763333169.563834:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:56781:x1848987613524480:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 5784us (6007us total) trans 4294971889 rc 301/301 00000100:00100000:0.0:1763333169.563842:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8832 00000100:00100000:1.0:1763333169.568500:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613524864 00000100:00100000:1.0:1763333169.568514:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613524864 00000100:00100000:1.0:1763333169.568590:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3012 00000100:00100000:1.0:1763333169.568602:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4399b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:56781:x1848987613524864:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1763333169.569030:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4399b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+220:56781:x1848987613524864:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 428us (898us total) trans 4294971890 rc 0/0 00000100:00100000:1.0:1763333169.569039:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3012 00000100:00100000:3.0:1763333169.572635:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613525120 00000100:00100000:3.0:1763333169.572649:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613525120 00000100:00100000:3.0:1763333169.572719:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3013 00000100:00100000:3.0:1763333169.572729:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6b3e9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+220:56781:x1848987613525120:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333169.573302:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6b3e9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56781:x1848987613525120:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 572us (786us total) trans 4294971891 rc 0/0 00000100:00100000:3.0:1763333169.573309:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3013 00000100:00100000:0.0:1763333169.580074:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613525376 00000100:00100000:0.0:1763333169.580087:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613525376 00000100:00100000:0.0:1763333169.580161:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8833 00000100:00100000:0.0:1763333169.580171:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4399bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:55917:x1848987613525376:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333169.580203:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333169.580236:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c53ce3 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968ae1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.580440:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c53cea lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333169.580456:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c53cea lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.580468:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c53cea lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.580477:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c53cf1 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333169.580485:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c53cf1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.580490:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c53cf1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.580562:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c53cf8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x18c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333169.580569:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c53cf8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.580586:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c53cf8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:0.0:1763333169.580600:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x18c:0x0]: returning size 0 00010000:00010000:0.0:1763333169.580702:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c53cea lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.580711:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c53cea lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.580717:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c53cea lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.580724:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c53cea lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.580731:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333169.580736:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c53cea lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.580744:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c53cea lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.580758:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe4345b700) 00010000:00010000:0.0:1763333169.580761:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333169.580767:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c53cea lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.580776:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c53cea lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.580792:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c53cf1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.580797:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c53cf1 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.580802:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c53cf1 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.580807:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdea00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333169.580809:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c53cf1 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.580814:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c53cf1 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.580820:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6055ad00) 00010000:00010000:0.0:1763333169.580822:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333169.580824:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c53cf1 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.580829:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c53cf1 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.580866:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c53ce3 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ae1 expref: 224 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.580882:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c53cf8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ae1 expref: 223 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.580893:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18c:0x0].0x0 (ffff92fe4345be00) 00010000:00010000:0.0:1763333169.580896:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333169.580898:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abde400, rc 0) 00000100:00100000:0.0:1763333169.580984:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4399bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:55917:x1848987613525376:12345-192.168.204.28@tcp:101:bash.0 Request processed in 814us (1880us total) trans 4294971892 rc 0/0 00000100:00100000:0.0:1763333169.580992:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8833 00000100:00100000:1.0:1763333169.586255:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613525504 00000100:00100000:1.0:1763333169.586270:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613525504 00000100:00100000:1.0:1763333169.586444:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8834 00000100:00100000:1.0:1763333169.586457:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:55917:x1848987613525504:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333169.586491:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333169.586517:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53d06 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x18c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968ae8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.586556:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53d0d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x18c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333169.586570:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53d0d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.586594:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53d0d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.586716:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53d06 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x18c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ae8 expref: 225 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.586736:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53d0d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x18c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ae8 expref: 224 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.586745:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18c:0x0].0x0 (ffff92fe4345be00) 00010000:00010000:1.0:1763333169.586749:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763333169.586753:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7ea00, rc 0) 00000100:00100000:1.0:1763333169.586819:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:55917:x1848987613525504:12345-192.168.204.28@tcp:101:bash.0 Request processed in 365us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333169.586826:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8834 00000100:00100000:1.0:1763333169.589880:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333169.598253:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.598911:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613525888 00000100:00100000:1.0:1763333169.598922:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613525888 00000100:00100000:1.0:1763333169.598986:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8836 00000100:00100000:1.0:1763333169.598996:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:55917:x1848987613525888:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333169.599023:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333169.599045:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53d1b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x18c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968aef expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.599103:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53d1b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x18c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968aef expref: 227 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.599118:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53d1b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x18c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968aef expref: 227 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.599136:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18c:0x0].0x0 (ffff92fe4345be00) 00010000:00010000:1.0:1763333169.599140:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763333169.599144:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7fc00, rc 0) 00000100:00100000:1.0:1763333169.599201:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:55917:x1848987613525888:12345-192.168.204.28@tcp:101:bash.0 Request processed in 206us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333169.599208:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8836 00000100:00100000:3.0:1763333169.599474:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333169.599515:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613526016 00000100:00100000:3.0:1763333169.599521:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613526016 00000100:00100000:3.0:1763333169.599559:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6138 00000100:00100000:3.0:1763333169.599567:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74038e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2421:x1848987613526016:12345-192.168.204.28@tcp:23:lfs.0 00000100:00100000:3.0:1763333169.599655:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74038e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2421:x1848987613526016:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 89us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333169.599662:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6138 00000100:00100000:3.0:1763333169.602835:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.602901:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613526272 00000100:00100000:1.0:1763333169.602911:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613526272 00000100:00100000:1.0:1763333169.602974:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8837 00000100:00100000:1.0:1763333169.602984:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74038a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:55917:x1848987613526272:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333169.603002:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333169.603006:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763333169.603033:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53d1b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x18c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968aef expref: 227 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.603048:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18c:0x0].0x0 (ffff92fe4345be00) 00010000:00010000:1.0:1763333169.603053:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333169.603065:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53d22 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x18c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968af6 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.603111:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53d29 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x18c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333169.603123:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53d29 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x18c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.603133:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53d29 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x18c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000040:00080000:1.0:1763333169.603612:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1284, 88 off109200 00000004:00080000:1.0:1763333169.603620:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1273683270848ns, next at 1273519575533ns, rc = 0 00000040:00080000:1.0:1763333169.603860:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1285, 88 off109200 00000004:00080000:1.0:1763333169.603866:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1273683516802ns, next at 1273519604631ns, rc = 0 00000040:00080000:1.0:1763333169.604704:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1286, 88 off109288 00000004:00080000:1.0:1763333169.604713:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1273684363760ns, next at 1273519604631ns, rc = 0 00000040:00080000:1.0:1763333169.605561:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1285, 88 off109288 00000004:00080000:1.0:1763333169.605570:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1273685220999ns, next at 1273519575533ns, rc = 0 00000100:00100000:1.0:1763333169.611120:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333169.611502:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613526400 00000100:00100000:0.0:1763333169.611512:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613526400 00000100:00100000:0.0:1763333169.611582:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6139 00000100:00100000:0.0:1763333169.611594:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2418:x1848987613526400:12345-192.168.204.28@tcp:23:lfs.0 00000100:00100000:0.0:1763333169.611715:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2418:x1848987613526400:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 123us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333169.611723:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6139 00000001:00080000:3.0:1763333169.613760:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294971895 is committed 00000004:00080000:3.0:1763333169.613770:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 841 committed 00000004:00080000:3.0:1763333169.613788:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 844 committed 00000004:00080000:3.0:1763333169.613799:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 843 committed 00000004:00080000:3.0:1763333169.613805:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 840 committed 00010000:00010000:3.0:1763333169.613880:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53d29 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x18c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968af6 expref: 221 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.613894:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18c:0x0].0x0 (ffff92fe4345be00) 00010000:00010000:3.0:1763333169.613897:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763333169.613912:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53d22 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x18c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968af6 expref: 221 pid: 12741 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1763333169.613927:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53d29 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x18c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968af6 expref: 220 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.613964:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18c:0x0].0x0 (ffff92fe4345be00) 00010000:00010000:3.0:1763333169.613967:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763333169.613969:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f400, rc 0) 00000100:00100000:3.0:1763333169.614027:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74038a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+220:55917:x1848987613526272:12345-192.168.204.28@tcp:101:bash.0 Request processed in 11043us (11198us total) trans 4294971895 rc 0/0 00000100:00100000:3.0:1763333169.614035:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8837 00010000:00010000:0.0:1763333169.615315:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c53ca4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.615325:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c53ca4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.615333:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c53ca4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.615339:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333169.615342:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c53ca4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.615366:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c53ca4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.615381:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6055ad00) 00010000:00010000:0.0:1763333169.615383:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333169.615388:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c53ca4 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.615393:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c53ca4 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.615415:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c53d14 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x18c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.615421:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c53d14 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x18c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.615427:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c53d14 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x18c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.615432:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333169.615435:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c53d14 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x18c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.615441:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c53d14 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x18c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.615448:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18c:0x0].0x0 (ffff92fe4345be00) 00010000:00010000:0.0:1763333169.615451:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333169.615454:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c53d14 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x18c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.615459:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c53d14 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x18c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000100:00100000:0.0:1763333169.617473:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627206400:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333169.617546:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333169.617595:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1763333169.617602:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627206528:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333169.617623:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333169.617657:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627206400 00000100:00100000:0.0:1763333169.617663:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627206400 00000100:00100000:0.0:1763333169.617703:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627206528 00000100:00100000:0.0:1763333169.617706:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627206528 00000100:00100000:0.0:1763333169.617724:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6142 00000100:00100000:0.0:1763333169.617731:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+36:3652:x1848987627206400:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333169.617889:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+37:3652:x1848987627206400:12345-0@lo:2:osp-syn-1-1.0 Request processed in 156us (342us total) trans 17179871410 rc 0/0 00000100:00100000:0.0:1763333169.617911:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6142 00000100:00100000:0.0:1763333169.617927:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6143 00000100:00100000:0.0:1763333169.617934:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+36:3652:x1848987627206528:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333169.618009:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+37:3652:x1848987627206528:12345-0@lo:2:osp-syn-1-1.0 Request processed in 76us (385us total) trans 17179871411 rc 0/0 00000100:00100000:0.0:1763333169.618015:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6143 00000004:00080000:0.0:1763333169.618053:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe472f4700/2, rc 0, transno 17179871411 00000100:00100000:0.0:1763333169.618058:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627206528:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1763333169.618068:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe472f5180/2, rc 0, transno 17179871410 00000100:00100000:0.0:1763333169.618072:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627206400:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333169.620908:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333169.622053:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333169.626607:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333169.626842:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613526784 00000100:00100000:3.0:1763333169.626849:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613526784 00000100:00100000:3.0:1763333169.626897:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8838 00000100:00100000:3.0:1763333169.626905:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+218:56779:x1848987613526784:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333169.626925:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333169.626942:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c53d3e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968b04 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.626985:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42febe00/0xb32e3ef184c53d45 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333169.626999:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42febe00/0xb32e3ef184c53d45 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.627009:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42febe00/0xb32e3ef184c53d45 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.627116:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c53d3e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b04 expref: 220 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.627132:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42febe00/0xb32e3ef184c53d45 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x18b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b04 expref: 219 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.627140:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18b:0x0].0x0 (ffff92ff44d03100) 00010000:00010000:3.0:1763333169.627143:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763333169.627146:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42febe00, rc 0) 00000100:00100000:3.0:1763333169.627200:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:56779:x1848987613526784:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 295us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333169.627207:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8838 00000100:00100000:1.0:1763333169.629134:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333169.630816:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613526912 00000100:00100000:0.0:1763333169.630828:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613526912 00000100:00100000:0.0:1763333169.630894:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6145 00000100:00100000:0.0:1763333169.630904:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:55917:x1848987613526912:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333169.630924:0:8406:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333169.630947:0:8406:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c53d4c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968b0b expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763333169.630971:0:8406:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x209:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333169.630991:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333169.630993:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333169.631003:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c53d4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b0b expref: 17 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.631018:0:8406:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c53d4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b0b expref: 17 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.631030:0:8406:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdea00, rc 0) 00000100:00100000:0.0:1763333169.631095:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:55917:x1848987613526912:12345-192.168.204.28@tcp:101:bash.0 Request processed in 192us (1969us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333169.631102:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6145 00000100:00100000:1.0:1763333169.632444:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.636274:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.636314:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333169.636388:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613527168 00000100:00100000:0.0:1763333169.636399:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613527168 00002000:00010000:0.0:1763333169.636440:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/521 (0->18446744073709551615) 00002000:00100000:0.0:1763333169.636445:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe472f6680 with x1848987613527168 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333169.636457:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe472f6680. 00000100:00100000:0.0:1763333169.636489:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613527296 00000100:00100000:0.0:1763333169.636493:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613527296 00002000:00010000:0.0:1763333169.636509:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/521 (0->18446744073709551615) 00002000:00100000:0.0:1763333169.636512:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe472f4380 with x1848987613527296 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333169.636518:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe472f4380. 00000100:00100000:0.0:1763333169.636535:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1536 00000100:00100000:0.0:1763333169.636544:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+26:2421:x1848987613527168:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:0.0:1763333169.636716:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x209:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333169.636719:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x209:0x0] updating lvb mtime from disk: 0 -> 1763333169 00002000:00010000:0.0:1763333169.636722:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x209:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333169.636724:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x209:0x0] updating lvb ctime from disk: 0 -> 1763333169 00002000:00010000:0.0:1763333169.636726:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x209:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333169.636776:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+27:2421:x1848987613527168:12345-192.168.204.28@tcp:10:bash.0 Request processed in 232us (511us total) trans 17179871413 rc 0/0 00000100:00100000:0.0:1763333169.636784:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1536 00002000:00010000:0.0:1763333169.636788:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/521 (0->18446744073709551615) 00002000:00100000:0.0:1763333169.636790:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe472f6680 with x1848987613527168 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333169.636794:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe472f6680. 00000100:00100000:0.0:1763333169.636810:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1537 00000100:00100000:0.0:1763333169.636817:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2421:x1848987613527296:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:0.0:1763333169.636898:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x209:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333169.636901:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x209:0x0] updating lvb mtime from disk: 0 -> 1763333169 00002000:00010000:0.0:1763333169.636904:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x209:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333169.636906:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x209:0x0] updating lvb ctime from disk: 0 -> 1763333169 00002000:00010000:0.0:1763333169.636908:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x209:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333169.636931:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2421:x1848987613527296:12345-192.168.204.28@tcp:10:bash.0 Request processed in 115us (616us total) trans 21474838718 rc 0/0 00000100:00100000:0.0:1763333169.636938:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1537 00002000:00010000:0.0:1763333169.636940:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/521 (0->18446744073709551615) 00002000:00100000:0.0:1763333169.636943:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe472f4380 with x1848987613527296 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333169.636947:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe472f4380. 00000001:00080000:3.0:1763333169.640104:0:26035:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871412 is committed 00000001:00080000:3.0:1763333169.640123:0:26035:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871411 is committed 00000100:00100000:1.0:1763333169.642080:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333169.642229:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613527552 00000100:00100000:3.0:1763333169.642238:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613527552 00000100:00100000:3.0:1763333169.642288:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3014 00000100:00100000:3.0:1763333169.642297:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:55917:x1848987613527552:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:3.0:1763333169.642600:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+220:55917:x1848987613527552:12345-192.168.204.28@tcp:35:bash.0 Request processed in 304us (521us total) trans 4294971896 rc 0/0 00000100:00100000:3.0:1763333169.642607:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3014 00000100:00100000:1.0:1763333169.653151:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333169.653285:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613527680 00000100:00100000:0.0:1763333169.653296:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613527680 00000100:00100000:3.0:1763333169.653544:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8839 00000100:00100000:3.0:1763333169.653556:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+220:56782:x1848987613527680:12345-192.168.204.28@tcp:101:rm.0 00010000:00010000:3.0:1763333169.653588:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333169.653615:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c53d5a lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968b12 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.653690:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c53d61 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333169.653704:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c53d61 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.653715:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c53d61 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.653727:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c53d68 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333169.653734:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c53d68 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.653740:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c53d68 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.653821:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c53d6f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x18c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333169.653829:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c53d6f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.653835:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c53d6f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:3.0:1763333169.653878:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x18c:0x0]: returning size 5 00000004:00200000:3.0:1763333169.653884:0:12741:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763333169.653907:0:12741:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c53d6f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.653918:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c53d6f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.653927:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c53d61 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.653933:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c53d61 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.653939:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c53d61 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.653945:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c53d61 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.653951:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feb200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333169.653955:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c53d61 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.653962:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c53d61 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.653973:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:3.0:1763333169.653976:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333169.653981:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c53d61 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.653986:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c53d61 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.653998:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c53d68 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.654004:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c53d68 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.654009:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c53d68 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.654014:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333169.654017:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c53d68 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.654022:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c53d68 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.654029:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff8016f800) 00010000:00010000:3.0:1763333169.654032:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333169.654034:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c53d68 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.654040:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c53d68 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.654067:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c53d5a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b12 expref: 222 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.654082:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c53d6f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x18c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b12 expref: 221 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.654090:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18c:0x0].0x0 (ffff92fe4345be00) 00010000:00010000:3.0:1763333169.654092:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333169.654094:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feb400, rc 0) 00000100:00100000:3.0:1763333169.654163:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56782:x1848987613527680:12345-192.168.204.28@tcp:101:rm.0 Request processed in 609us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333169.654172:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8839 00000100:00100000:0.0:1763333169.659179:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613527936 00000100:00100000:0.0:1763333169.659189:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613527936 00010000:00010000:3.0:1763333169.662478:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333169.662484:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c53d92 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x18c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333169.662490:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4800 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333169.662493:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c53d92 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x18c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333169.662499:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c53d92 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x18c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333169.662507:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18c:0x0].0x0 (ffff92ff618aa200) 00010000:00010000:3.0:1763333169.662509:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763333169.662512:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c53d92 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x18c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333169.662517:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c53d92 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x18c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333169.662529:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333169.662531:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333169.662532:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763333169.665252:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.667584:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333169.668250:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613528448 00000100:00100000:0.0:1763333169.668261:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613528448 00000100:00100000:0.0:1763333169.668323:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6147 00000100:00100000:0.0:1763333169.668334:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:56779:x1848987613528448:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333169.668390:0:8406:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333169.668416:0:8406:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf400/0xb32e3ef184c53da0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968b20 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763333169.668444:0:8406:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x208:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333169.668468:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333169.668470:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333169.668478:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf400/0xb32e3ef184c53da0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b20 expref: 19 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.668493:0:8406:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf400/0xb32e3ef184c53da0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b20 expref: 19 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.668504:0:8406:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdf400, rc 0) 00000100:00100000:0.0:1763333169.668559:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:56779:x1848987613528448:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 227us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333169.668567:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6147 00000100:00100000:1.0:1763333169.673257:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.673553:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333169.674299:0:28429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1539 00000100:00100000:0.0:1763333169.674309:0:28429:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2420:x1848987613528704:12345-192.168.204.28@tcp:10:lfs.0 00002000:00010000:0.0:1763333169.674433:0:28429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x208:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333169.674436:0:28429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x208:0x0] updating lvb mtime from disk: 0 -> 1763333169 00002000:00010000:0.0:1763333169.674438:0:28429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x208:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333169.674441:0:28429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x208:0x0] updating lvb ctime from disk: 0 -> 1763333169 00002000:00010000:0.0:1763333169.674443:0:28429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x208:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333169.674466:0:28429:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2420:x1848987613528704:12345-192.168.204.28@tcp:10:lfs.0 Request processed in 160us (914us total) trans 21474838719 rc 0/0 00000100:00100000:0.0:1763333169.674473:0:28429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1539 00002000:00010000:0.0:1763333169.674476:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/520 (0->18446744073709551615) 00002000:00100000:0.0:1763333169.674478:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe472f4a80 with x1848987613528704 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333169.674482:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe472f4a80. 00000100:00100000:1.0:1763333169.674861:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333169.676395:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56783:x1848987613528832:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1369us (1530us total) trans 0 rc 301/301 00000100:00100000:0.0:1763333169.676405:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8842 00000100:00100000:1.0:1763333169.676915:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333169.677038:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613529088 00000100:00100000:0.0:1763333169.677045:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613529088 00000100:00100000:0.0:1763333169.677091:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8843 00000100:00100000:0.0:1763333169.677099:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56779:x1848987613529088:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:0.0:1763333169.677172:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c53dbc lrc: 3/0,1 mode: --/PW res: [0x240000404:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333169.677187:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c53dbc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.677196:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c53dbc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00010000:0.0:1763333169.677311:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000d883bc2 reply state 000000006d85755a transno 4294971899 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c53dbc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.677323:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c53dbc lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.677329:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18b:0x0].0x0 (ffff92ff44d03100) 00010000:00010000:0.0:1763333169.677331:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333169.677334:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763333169.677424:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56779:x1848987613529088:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 325us (511us total) trans 4294971899 rc 0/0 00000100:00100000:0.0:1763333169.677431:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8843 00000100:00100000:1.0:1763333169.678688:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333169.679270:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333169.679371:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613529344 00000100:00100000:0.0:1763333169.679377:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613529344 00000100:00100000:0.0:1763333169.679416:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8844 00000100:00100000:0.0:1763333169.679423:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7403a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56783:x1848987613529344:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333169.679438:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333169.679458:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c53dc3 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968b2e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.679515:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c53dca lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333169.679527:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c53dca lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.679538:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c53dca lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.679547:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c53dd1 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333169.679555:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c53dd1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.679562:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c53dd1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.679610:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c53dca lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.679617:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c53dca lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.679623:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c53dca lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.679629:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c53dca lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.679634:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333169.679638:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c53dca lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.679645:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c53dca lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.679656:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe4345bb00) 00010000:00010000:0.0:1763333169.679659:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333169.679663:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c53dca lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.679669:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c53dca lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.679682:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c53dd1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.679698:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c53dd1 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.679704:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c53dd1 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.679708:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdfe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333169.679710:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c53dd1 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.679715:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c53dd1 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.679722:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff618aa100) 00010000:00010000:0.0:1763333169.679725:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333169.679727:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c53dd1 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.679733:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c53dd1 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.679759:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c53dc3 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b2e expref: 224 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.679773:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe4345bb00) 00010000:00010000:0.0:1763333169.679775:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333169.679779:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c53dc3 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b2e expref: 224 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.679792:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdf600, rc 0) 00000100:00100000:0.0:1763333169.679832:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7403a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56783:x1848987613529344:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 409us (562us total) trans 0 rc 301/301 00000100:00100000:0.0:1763333169.679839:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8844 00000100:00100000:3.0:1763333169.681131:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.681200:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613529600 00000100:00100000:1.0:1763333169.681207:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613529600 00000100:00100000:1.0:1763333169.681249:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3015 00000100:00100000:1.0:1763333169.681258:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56779:x1848987613529600:12345-192.168.204.28@tcp:35:lfs.0 00000004:00010000:1.0:1763333169.681305:0:6522:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x240000404:0x18b:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c53c26 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x18b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a9b expref: 223 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.681381:0:6522:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c53dd8 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 00010000:00010000:1.0:1763333169.681393:0:6522:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53c8f lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968abe expref: 223 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.681402:0:6522:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c53dd8 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 00010000:00010000:1.0:1763333169.681439:0:6522:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53c8f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968abe expref: 223 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.681453:0:6522:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53c8f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968abe expref: 223 pid: 6519 timeout: 1373 lvb_type: 0 00000100:00100000:1.0:1763333169.681468:0:6522:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7dcfc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6522:1848987627206656:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333169.681535:0:6522:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7dfd8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1763333169.682251:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613529728 00000100:00100000:1.0:1763333169.682256:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613529728 00000100:00100000:1.0:1763333169.682330:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8845 00000100:00100000:1.0:1763333169.682339:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56783:x1848987613529728:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333169.682657:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333169.682682:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53ddf lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968b35 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.682749:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c53de6 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333169.682762:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c53de6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333169.682774:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c53de6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:1.0:1763333169.682829:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1763333169.682834:0:8606:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1763333169.682866:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53ddf lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b35 expref: 226 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.682887:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c53de6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b35 expref: 225 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.682897:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055a300) 00010000:00010000:1.0:1763333169.682900:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1763333169.682903:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7ec00, rc 0) 00000100:00100000:1.0:1763333169.682955:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56783:x1848987613529728:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 616us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333169.682963:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8845 00000100:00100000:1.0:1763333169.684145:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613529856 00000100:00100000:1.0:1763333169.684153:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613529856 00010000:00010000:1.0:1763333169.684184:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53c8f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968abe expref: 225 pid: 6519 timeout: 1373 lvb_type: 0 00000100:00100000:1.0:1763333169.684682:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2899 00000100:00100000:1.0:1763333169.684694:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43998000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:2421:x1848987613529856:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333169.684710:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333169.684718:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53c8f lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968abe expref: 225 pid: 6519 timeout: 1373 lvb_type: 0 00010000:00010000:1.0:1763333169.684733:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53c8f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968abe expref: 225 pid: 6519 timeout: 1373 lvb_type: 0 00010000:00010000:1.0:1763333169.684758:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53c8f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968abe expref: 225 pid: 6519 timeout: 1373 lvb_type: 0 00010000:00010000:1.0:1763333169.684775:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18b:0x0].0x0 (ffff92ff44d03100) 00010000:00010000:1.0:1763333169.684781:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c53dd8 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 00010000:00010000:1.0:1763333169.684792:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c53dd8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT1 00010000:00010000:1.0:1763333169.684800:0:6504:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c53dd8 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT1 00010000:00010000:1.0:1763333169.684832:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333169.684890:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43998000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:2421:x1848987613529856:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 197us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333169.684898:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2899 00000100:00100000:1.0:1763333169.687031:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613529984 00000100:00100000:1.0:1763333169.687040:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613529984 00000100:00100000:1.0:1763333169.687094:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8846 00000100:00100000:1.0:1763333169.687103:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4399a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56783:x1848987613529984:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333169.687122:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333169.687143:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53ded lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968b3c expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.687213:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53df4 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333169.687226:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53df4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333169.687237:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53df4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333169.687248:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53dfb lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333169.687260:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53dfb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333169.687266:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53dfb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333169.687298:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53df4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333169.687305:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53df4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333169.687311:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53df4 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333169.687317:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53df4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333169.687323:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333169.687327:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53df4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333169.687333:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53df4 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333169.687344:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055a300) 00010000:00010000:1.0:1763333169.687369:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333169.687376:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53df4 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333169.687382:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53df4 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333169.687394:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53dfb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333169.687400:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53dfb lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333169.687406:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53dfb lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333169.687410:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7ea00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333169.687413:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53dfb lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333169.687419:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53dfb lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333169.687427:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff618aa100) 00010000:00010000:1.0:1763333169.687430:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333169.687433:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53dfb lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333169.687438:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53dfb lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333169.687466:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53ded lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b3c expref: 226 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.687475:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055a300) 00010000:00010000:1.0:1763333169.687478:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333169.687481:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53ded lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b3c expref: 226 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.687490:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e000, rc 0) 00000100:00100000:1.0:1763333169.687547:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4399a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56783:x1848987613529984:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 445us (633us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333169.687555:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8846 00000001:00080000:3.0:1763333169.687802:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294971900 is committed 00000004:00080000:3.0:1763333169.687809:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 847 committed 00000004:00080000:3.0:1763333169.687823:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 844 committed 00000004:00080000:3.0:1763333169.687834:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 843 committed 00000004:00080000:3.0:1763333169.687836:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 846 committed 00000004:00080000:3.0:1763333169.687843:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 845 committed 00000004:00080000:3.0:1763333169.687846:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 842 committed 00010000:00010000:0.0:1763333169.687961:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c53d76 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.687968:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c53d76 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.687974:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c53d76 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.687979:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333169.687983:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c53d76 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.687988:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c53d76 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.687996:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18b:0x0].0x0 (ffff92ff44d03100) 00010000:00010000:0.0:1763333169.687998:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333169.688001:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c53d76 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.688006:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c53d76 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.688018:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c53d84 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.688023:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c53d84 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.688028:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c53d84 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.688036:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333169.688038:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c53d84 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.688043:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c53d84 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.688049:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff618aa100) 00010000:00010000:0.0:1763333169.688052:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333169.688054:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c53d84 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.688058:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c53d84 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.688072:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c53dbc lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.688077:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c53dbc lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.688083:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c53dbc lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.688087:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abde200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333169.688090:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c53dbc lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.688094:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c53dbc lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.688101:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18b:0x0].0x0 (ffff92ff44d03100) 00010000:00010000:0.0:1763333169.688103:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333169.688106:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c53dbc lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.688111:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c53dbc lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000100:00100000:3.0:1763333169.689046:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe43999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627206784:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763333169.689074:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333169.689101:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763333169.689106:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4399b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627206912:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763333169.689127:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333169.689210:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627206784 00000100:00100000:0.0:1763333169.689214:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627206784 00000100:00100000:0.0:1763333169.689243:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627206912 00000100:00100000:0.0:1763333169.689246:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627206912 00000100:00100000:0.0:1763333169.689258:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6151 00000100:00100000:0.0:1763333169.689264:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74039c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+26:3654:x1848987627206784:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1763333169.689275:0:8406:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:521 count 1 00010000:00010000:0.0:1763333169.689290:0:8406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c53e02 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x209:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.689304:0:8406:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c53d4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b0b expref: 20 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.689312:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333169.689314:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333169.689317:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c53e02 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.689340:0:8406:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c53d4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b0b expref: 20 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.689369:0:8406:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c53d4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b0b expref: 20 pid: 8406 timeout: 1373 lvb_type: 0 00000100:00100000:0.0:1763333169.689386:0:8406:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46e2e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8406:1848987627207296:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333169.689421:0:8406:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4ce84840 going to sleep for 11 seconds 00010000:00010000:0.0:1763333169.689434:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c53dd8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 00010000:00010000:0.0:1763333169.689440:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c53dd8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 00010000:00010000:0.0:1763333169.689445:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c53dd8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 00010000:00010000:0.0:1763333169.689450:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333169.689453:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c53dd8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 00010000:00010000:0.0:1763333169.689459:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c53dd8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 00010000:00010000:0.0:1763333169.689467:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18b:0x0].0x0 (ffff92ff44d03100) 00010000:00010000:0.0:1763333169.689469:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333169.689472:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c53dd8 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 00010000:00010000:0.0:1763333169.689478:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c53dd8 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 00000100:00100000:0.0:1763333169.689495:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6152 00000100:00100000:0.0:1763333169.689501:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74038e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+26:3654:x1848987627206912:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1763333169.689510:0:8407:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:522 count 1 00002000:00010000:0.0:1763333169.689525:0:8407:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x20a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333169.689530:0:8407:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c53e09 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.689538:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333169.689539:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333169.689543:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c53e09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.689552:0:8407:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c53e09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.689559:0:8407:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c53e09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.689566:0:8407:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c53e09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.689588:0:8407:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763333169.689746:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74038e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+27:3654:x1848987627206912:12345-0@lo:6:osp-syn-0-1.0 Request processed in 245us (618us total) trans 21474838723 rc 0/0 00000100:00100000:0.0:1763333169.689752:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6152 00000004:00080000:0.0:1763333169.689780:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4399b480/2, rc 0, transno 21474838723 00000100:00100000:0.0:1763333169.689784:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4399b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627206912:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1763333169.690034:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333169.690041:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c53e09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.690048:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdfe00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333169.690052:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c53e09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.690060:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c53e09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.690073:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c53e09 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.690081:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c53e09 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.690095:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333169.690096:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333169.690098:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763333169.690108:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7dcfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627207552:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763333169.690137:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333169.690155:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1763333169.690159:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7dcfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627207424:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763333169.690177:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333169.690195:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7dcfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627207680:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333169.690212:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333169.690223:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763333169.690227:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7dcfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627207808:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333169.690241:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333169.690259:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627207552 00000100:00100000:1.0:1763333169.690262:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627207552 00000100:00100000:1.0:1763333169.690282:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627207424 00000100:00100000:1.0:1763333169.690284:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627207424 00000100:00100000:1.0:1763333169.690294:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627207680 00000100:00100000:1.0:1763333169.690296:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627207680 00000100:00100000:1.0:1763333169.690303:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627207808 00000100:00100000:1.0:1763333169.690305:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627207808 00000100:00100000:1.0:1763333169.690314:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6153 00000100:00100000:1.0:1763333169.690319:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+8:3655:x1848987627207552:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763333169.690330:0:8404:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:522 count 1 00002000:00010000:1.0:1763333169.690366:0:8404:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x20a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333169.690371:0:8404:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53e10 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.690379:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333169.690381:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333169.690383:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53e10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.690392:0:8404:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53e10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.690399:0:8404:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53e10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.690410:0:8404:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53e10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.690423:0:8404:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763333169.690557:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+9:3655:x1848987627207552:12345-0@lo:6:osp-syn-1-1.0 Request processed in 237us (419us total) trans 17179871415 rc 0/0 00000100:00100000:1.0:1763333169.690562:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6153 00000100:00100000:1.0:1763333169.690608:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6154 00000100:00100000:1.0:1763333169.690614:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+8:3655:x1848987627207424:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763333169.690625:0:8404:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:521 count 1 00010000:00010000:1.0:1763333169.690635:0:8404:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53e17 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x209:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.690648:0:8404:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53d37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968afd expref: 15 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.690654:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333169.690656:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333169.690659:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53e17 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.690679:0:8404:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53d37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968afd expref: 15 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.690688:0:8404:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53d37 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968afd expref: 15 pid: 17605 timeout: 1373 lvb_type: 0 00000100:00100000:1.0:1763333169.690703:0:8404:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7dcfd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8404:1848987627207936:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333169.690739:0:8404:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7dfd8300 going to sleep for 11 seconds 00000100:00100000:1.0:1763333169.690757:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6155 00000100:00100000:1.0:1763333169.690765:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+8:3652:x1848987627207680:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1763333169.690832:0:29010:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x207:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333169.690835:0:29010:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x207:0x0] updating lvb mtime from disk: 1763333169 -> 1763333169 00002000:00010000:1.0:1763333169.690838:0:29010:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x207:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333169.690840:0:29010:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x207:0x0] updating lvb ctime from disk: 1763333169 -> 1763333169 00002000:00010000:1.0:1763333169.690843:0:29010:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x207:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333169.690872:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+9:3652:x1848987627207680:12345-0@lo:2:osp-syn-1-1.0 Request processed in 108us (659us total) trans 17179871416 rc 0/0 00000100:00100000:1.0:1763333169.690878:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6155 00000100:00100000:1.0:1763333169.690890:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6156 00000100:00100000:1.0:1763333169.690896:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+8:3652:x1848987627207808:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1763333169.690941:0:29010:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x208:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1763333169.690944:0:29010:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x208:0x0] updating lvb mtime from disk: 1763333169 -> 1763333169 00002000:00010000:1.0:1763333169.690946:0:29010:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x208:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333169.690948:0:29010:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x208:0x0] updating lvb ctime from disk: 1763333169 -> 1763333169 00002000:00010000:1.0:1763333169.690950:0:29010:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x208:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1763333169.690973:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+9:3652:x1848987627207808:12345-0@lo:2:osp-syn-1-1.0 Request processed in 78us (731us total) trans 17179871417 rc 0/0 00000100:00100000:1.0:1763333169.690979:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6156 00010000:00010000:1.0:1763333169.690999:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333169.691005:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53e10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.691012:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333169.691014:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53e10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.691021:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53e10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.691033:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53e10 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.691040:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53e10 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.691053:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333169.691055:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333169.691057:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763333169.691082:0:3652:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179871411 gen 2 00000004:00080000:1.0:1763333169.691087:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff6bc11500, transno 17179871372 00000004:00080000:1.0:1763333169.691094:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff6bc13800, transno 17179871373 00000004:00080000:1.0:1763333169.691097:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff6bc12300, transno 17179871374 00000004:00080000:1.0:1763333169.691100:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff6bc13100, transno 17179871375 00000004:00080000:1.0:1763333169.691103:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff75667b80, transno 17179871376 00000004:00080000:1.0:1763333169.691106:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff50049180, transno 17179871377 00000004:00080000:1.0:1763333169.691109:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff5004a680, transno 17179871378 00000004:00080000:1.0:1763333169.691111:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff5004b480, transno 17179871379 00000004:00080000:1.0:1763333169.691114:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe472f2300, transno 17179871381 00000004:00080000:1.0:1763333169.691116:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46e2c380, transno 17179871382 00000004:00080000:1.0:1763333169.691119:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46e2f800, transno 17179871383 00000004:00080000:1.0:1763333169.691122:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46e2dc00, transno 17179871384 00000004:00080000:1.0:1763333169.691125:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe42ef8e00, transno 17179871387 00000004:00080000:1.0:1763333169.691127:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe42ef9880, transno 17179871388 00000004:00080000:1.0:1763333169.691130:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe42ef8700, transno 17179871389 00000004:00080000:1.0:1763333169.691132:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe42efb480, transno 17179871390 00000004:00080000:1.0:1763333169.691134:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7e122d80, transno 17179871394 00000004:00080000:1.0:1763333169.691137:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7e120000, transno 17179871395 00000004:00080000:1.0:1763333169.691140:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7e122680, transno 17179871396 00000004:00080000:1.0:1763333169.691142:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7e120e00, transno 17179871397 00000004:00080000:1.0:1763333169.691145:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4684ed80, transno 17179871398 00000004:00080000:1.0:1763333169.691147:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4684c700, transno 17179871399 00000004:00080000:1.0:1763333169.691149:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4684ca80, transno 17179871400 00000004:00080000:1.0:1763333169.691151:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4684f800, transno 17179871401 00000004:00080000:1.0:1763333169.691154:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff6bc11c00, transno 17179871403 00000004:00080000:1.0:1763333169.691156:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff6bc10e00, transno 17179871404 00000004:00080000:1.0:1763333169.691158:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff6bc10700, transno 17179871405 00000004:00080000:1.0:1763333169.691160:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff6bc11180, transno 17179871406 00000004:00080000:1.0:1763333169.691162:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff50065f80, transno 17179871408 00000004:00080000:1.0:1763333169.691165:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff50064700, transno 17179871409 00000004:00080000:1.0:1763333169.691167:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe472f5180, transno 17179871410 00000004:00080000:1.0:1763333169.691169:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe472f4700, transno 17179871411 00000100:00100000:1.0:1763333169.691174:0:3652:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff92ff7dcfea00 x1848987627207808/t17179871417(17179871417) o2->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763333185 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1763333169.691183:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7dcfea00/2, rc 0, transno 17179871417 00000100:00100000:1.0:1763333169.691187:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7dcfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627207808:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1763333169.691197:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7dcfc380/2, rc 0, transno 17179871416 00000100:00100000:1.0:1763333169.691200:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7dcfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627207680:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1763333169.691399:0:9836:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 4 in progress, 2 in flight, 32 done 00000004:00080000:1.0:1763333169.691419:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7dcfdf80/2, rc 0, transno 17179871415 00000100:00100000:1.0:1763333169.691423:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7dcfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627207552:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763333169.692503:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613530240 00000100:00100000:0.0:1763333169.692516:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613530240 00000100:00100000:0.0:1763333169.692566:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8847 00000100:00100000:0.0:1763333169.692586:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+215:56783:x1848987613530240:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333169.692605:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333169.692609:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763333169.692635:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c53de6 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b35 expref: 215 pid: 8606 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333169.693639:0:8406:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46e2e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8406:1848987627207296:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333169.693666:0:8406:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c53e02 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.693833:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055a300) 00010000:00010000:0.0:1763333169.693847:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333169.693866:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c53e1e lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968b43 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.693979:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c53e25 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333169.693991:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c53e25 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.694001:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c53e25 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.694012:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c53e2c lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333169.694018:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c53e2c lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.694024:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c53e2c lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.694455:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c53e33 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333169.694464:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c53e33 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.694470:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c53e33 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:0.0:1763333169.694482:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x18e:0x0]: returning size 0 00010000:00010000:0.0:1763333169.694508:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c53e25 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.694515:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c53e25 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.694521:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c53e25 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.694527:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c53e25 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.694533:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abde400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333169.694537:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c53e25 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.694544:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c53e25 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00000100:00100000:3.0:1763333169.694551:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613530496 00010000:00010000:0.0:1763333169.694552:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe4345b800) 00010000:00010000:0.0:1763333169.694554:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763333169.694557:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613530496 00010000:00010000:0.0:1763333169.694558:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c53e25 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.694563:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c53e25 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000004:00010000:0.0:1763333169.694586:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000069d7efe5 reply state 00000000bdc62165 transno 4294971901 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c53e2c lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.694594:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c53d4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b0b expref: 21 pid: 8406 timeout: 1373 lvb_type: 0 00010000:00010000:0.0:1763333169.694597:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c53e2c lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.694606:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe4345b000) 00010000:00010000:0.0:1763333169.694608:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333169.694611:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763333169.694636:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c53e1e lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b43 expref: 217 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.694653:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c53e33 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b43 expref: 216 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.694660:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18e:0x0].0x0 (ffff92fe4345bc00) 00010000:00010000:0.0:1763333169.694662:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333169.694664:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe44c39000, rc 0) 00000100:00100000:1.0:1763333169.694675:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613530368 00000100:00100000:1.0:1763333169.694679:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613530368 00000100:00100000:1.0:1763333169.694711:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8848 00000100:00100000:1.0:1763333169.694719:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+218:56779:x1848987613530368:12345-192.168.204.28@tcp:101:lfs.0 00000100:00100000:0.0:1763333169.694720:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+218:56783:x1848987613530240:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 2147us (2325us total) trans 4294971901 rc 0/0 00000100:00100000:0.0:1763333169.694726:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8847 00010000:00010000:1.0:1763333169.694734:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333169.694745:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53e41 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968b4a expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.694776:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53e41 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b4a expref: 218 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.694787:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e400/0xb32e3ef184c53e41 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b4a expref: 218 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.694803:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18b:0x0].0x0 (ffff92ff44d03100) 00010000:00010000:1.0:1763333169.694806:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763333169.694808:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e400, rc 0) 00000100:00100000:1.0:1763333169.694846:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+218:56779:x1848987613530368:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 127us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333169.694856:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8848 00000100:00100000:3.0:1763333169.695032:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2900 00000100:00100000:3.0:1763333169.695040:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2418:x1848987613530496:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333169.695050:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333169.695055:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c53d4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x209:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b0b expref: 21 pid: 8406 timeout: 1373 lvb_type: 0 00010000:00010000:3.0:1763333169.695067:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c53d4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x209:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b0b expref: 21 pid: 8406 timeout: 1373 lvb_type: 0 00010000:00010000:3.0:1763333169.695085:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c53d4c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x209:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b0b expref: 21 pid: 8406 timeout: 1373 lvb_type: 0 00010000:00010000:3.0:1763333169.695098:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333169.695100:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333169.695105:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c53e02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.695119:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c53e02 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.695150:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333169.695171:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2418:x1848987613530496:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 132us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333169.695177:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2900 00010000:00010000:1.0:1763333169.695248:0:8406:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c53e02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.695257:0:8406:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c53e02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.695267:0:8406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c53e02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.695275:0:8406:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c53e02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.695603:0:8406:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763333169.695820:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74039c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+27:3654:x1848987627206784:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6554us (6744us total) trans 21474838724 rc 0/0 00000100:00100000:1.0:1763333169.695828:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6151 00000004:00080000:1.0:1763333169.695869:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe43999500/2, rc 0, transno 21474838724 00000100:00100000:1.0:1763333169.695874:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe43999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627206784:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1763333169.695947:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333169.696053:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c53e02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.696061:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf600 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333169.696064:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c53e02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.696073:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c53e02 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.696085:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c53e02 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.696092:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c53e02 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.696108:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333169.696109:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333169.696110:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763333169.696339:0:8404:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7dcfd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8404:1848987627207936:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333169.696421:0:8404:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53e17 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333169.696442:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613530624 00000100:00100000:3.0:1763333169.696450:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613530624 00010000:00010000:3.0:1763333169.696476:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53d37 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968afd expref: 16 pid: 17605 timeout: 1373 lvb_type: 0 00000100:00100000:3.0:1763333169.696510:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2901 00000100:00100000:3.0:1763333169.696519:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2419:x1848987613530624:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333169.696531:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333169.696868:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53d37 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x209:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968afd expref: 16 pid: 17605 timeout: 1373 lvb_type: 0 00010000:00010000:3.0:1763333169.696891:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53d37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x209:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968afd expref: 16 pid: 17605 timeout: 1373 lvb_type: 0 00010000:00010000:3.0:1763333169.696907:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53d37 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x209:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968afd expref: 16 pid: 17605 timeout: 1373 lvb_type: 0 00010000:00010000:3.0:1763333169.696918:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333169.696920:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333169.696924:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53e17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.696932:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53e17 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.697171:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333169.697217:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2419:x1848987613530624:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 700us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333169.697225:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2901 00010000:00010000:1.0:1763333169.697264:0:8404:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53e17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.697277:0:8404:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53e17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.697285:0:8404:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53e17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.697292:0:8404:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53e17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.697311:0:8404:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763333169.697718:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333169.697724:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53e17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.697732:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fc00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333169.697735:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53e17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.697745:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53e17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.697756:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53e17 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.697762:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53e17 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.697779:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333169.697782:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333169.697783:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763333169.699403:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+9:3655:x1848987627207424:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8779us (9214us total) trans 17179871418 rc 0/0 00000100:00100000:1.0:1763333169.699416:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6154 00000100:00100000:3.0:1763333169.702142:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613531136 00000100:00100000:3.0:1763333169.702151:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613531136 00000100:00100000:3.0:1763333169.702209:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3016 00000100:00100000:3.0:1763333169.702220:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+218:56779:x1848987613531136:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1763333169.702544:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000004:00080000:0.0:1763333169.703635:0:6522:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x18b:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1763333169.703689:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1291, 64 off109656 00000040:00080000:0.0:1763333169.703710:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1290, 64 off109656 00000040:00080000:0.0:1763333169.703719:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1291, 64 off109720 00000040:00080000:0.0:1763333169.703727:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1292, 64 off109720 00010000:00010000:0.0:1763333169.703777:0:6522:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c53e56 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 00010000:00010000:0.0:1763333169.703788:0:6522:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c53e56 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x18b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT1 00010000:00010000:0.0:1763333169.703799:0:6522:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c53e56 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x18b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT1 00010000:00010000:0.0:1763333169.703807:0:6522:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c53e56 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x18b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT1 00010000:00010000:0.0:1763333169.703814:0:6522:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c53e56 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x18b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT1 00010000:00010000:0.0:1763333169.703821:0:6522:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c53e56 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x18b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT1 00010000:00010000:0.0:1763333169.703847:0:6522:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763333169.704006:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56779:x1848987613531136:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 1787us (2139us total) trans 4294971902 rc 0/0 00000100:00100000:0.0:1763333169.704015:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3016 00010000:00010000:2.0:1763333169.704645:0:8422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1763333169.704650:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c53e56 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x18b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT1 00010000:00010000:2.0:1763333169.704656:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c53e56 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x18b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT1 00010000:00010000:2.0:1763333169.704666:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333169.704668:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333169.704669:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763333169.709764:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333169.709981:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333169.710048:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613531392 00000100:00100000:3.0:1763333169.710060:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613531392 00000100:00100000:3.0:1763333169.710113:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8850 00000100:00100000:3.0:1763333169.710122:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56779:x1848987613531392:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333169.710144:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333169.710164:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c53e5d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x18e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968b58 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.710277:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c53e64 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333169.710292:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c53e64 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333169.710303:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c53e64 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:3.0:1763333169.710314:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x18e:0x0]: returning size 0 00010000:00010000:3.0:1763333169.710427:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c53e64 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333169.710435:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c53e64 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333169.710442:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c53e64 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333169.710449:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333169.710454:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c53e64 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333169.710461:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c53e64 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333169.710474:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18e:0x0].0x0 (ffff92fe4345bc00) 00010000:00010000:3.0:1763333169.710477:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1763333169.710481:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c53e64 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333169.710487:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c53e64 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333169.710521:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c53e5d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x18e:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b58 expref: 223 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.710532:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18e:0x0].0x0 (ffff92fe4345bc00) 00010000:00010000:3.0:1763333169.710534:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763333169.710538:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c53e5d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x18e:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b58 expref: 223 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.710546:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea800, rc 0) 00000100:00100000:3.0:1763333169.710613:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:56779:x1848987613531392:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 491us (860us total) trans 4294971903 rc 301/301 00000100:00100000:3.0:1763333169.710621:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8850 00000100:00100000:0.0:1763333169.710717:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42efb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627208064:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333169.710743:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c53e4f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x18e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000100:00100000:1.0:1763333169.711039:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613531520 00000100:00100000:1.0:1763333169.711044:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613531520 00010000:00010000:1.0:1763333169.711066:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c53e33 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b43 expref: 222 pid: 6521 timeout: 1373 lvb_type: 0 00000100:00100000:1.0:1763333169.711096:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2902 00000100:00100000:1.0:1763333169.711103:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff4627d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:2421:x1848987613531520:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333169.711113:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333169.711119:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c53e33 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b43 expref: 222 pid: 6521 timeout: 1373 lvb_type: 0 00010000:00010000:1.0:1763333169.711131:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c53e33 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b43 expref: 222 pid: 6521 timeout: 1373 lvb_type: 0 00010000:00010000:1.0:1763333169.711146:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c53e33 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b43 expref: 222 pid: 6521 timeout: 1373 lvb_type: 0 00010000:00010000:1.0:1763333169.711157:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18e:0x0].0x0 (ffff92fe4345bc00) 00010000:00010000:1.0:1763333169.711161:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c53e4f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x18e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.711169:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c53e4f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x18e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.711176:0:6504:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c53e4f lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x18e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.711726:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333169.711779:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff4627d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:2421:x1848987613531520:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 674us (1796us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333169.711787:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2902 00010000:00010000:0.0:1763333169.712101:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c53e4f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x18e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.712109:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c53e4f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x18e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:0.0:1763333169.712133:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x18e:0x0]: returning size 0 00000004:00080000:0.0:1763333169.712331:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x20b:0x0], index 0: 0 00000004:00080000:0.0:1763333169.712339:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x20b:0x0], index 1: 0 00000004:00080000:0.0:1763333169.712343:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x20c:0x0], index 1: 0 00000004:00080000:0.0:1763333169.712376:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x20c:0x0], index 0: 0 00010000:00010000:0.0:1763333169.712509:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c53e4f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x18e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.712518:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c53e4f lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x18e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.712525:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c53e4f lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x18e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.712530:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333169.712534:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c53e4f lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x18e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.712540:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c53e4f lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x18e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.712555:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18e:0x0].0x0 (ffff92fe4345bc00) 00010000:00010000:0.0:1763333169.712557:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333169.712561:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c53e4f lrc: 2/0,0 mode: --/EX res: [0x240000404:0x18e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.712566:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c53e4f lrc: 0/0,0 mode: --/EX res: [0x240000404:0x18e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.712632:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53e48 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x18e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b51 expref: 221 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.712642:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18e:0x0].0x0 (ffff92fe4345bc00) 00010000:00010000:0.0:1763333169.712644:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763333169.712647:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53e48 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x18e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b51 expref: 221 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.712661:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5400, rc 0) 00000100:00100000:0.0:1763333169.712709:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+220:56783:x1848987613530880:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 9848us (10164us total) trans 4294971904 rc 301/301 00000100:00100000:0.0:1763333169.712717:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8849 00000100:00100000:2.0:1763333169.714227:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333169.714291:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613531776 00000100:00100000:0.0:1763333169.714301:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613531776 00000100:00100000:0.0:1763333169.714409:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3017 00000100:00100000:0.0:1763333169.714418:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+220:56779:x1848987613531776:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333169.714673:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56779:x1848987613531776:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 256us (452us total) trans 4294971905 rc 0/0 00000100:00100000:0.0:1763333169.714681:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3017 00000100:00100000:2.0:1763333169.715197:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333169.715245:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613532032 00000100:00100000:3.0:1763333169.715251:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613532032 00000100:00100000:3.0:1763333169.715287:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3018 00000100:00100000:3.0:1763333169.715294:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6b3e9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56783:x1848987613532032:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333169.715441:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6b3e9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:56783:x1848987613532032:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 147us (244us total) trans 4294971906 rc 0/0 00000100:00100000:3.0:1763333169.715448:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3018 00000100:00100000:1.0:1763333169.718752:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333169.718823:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613532288 00000100:00100000:0.0:1763333169.718833:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613532288 00000100:00100000:3.0:1763333169.720748:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3019 00000100:00100000:3.0:1763333169.720773:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:56783:x1848987613532288:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333169.721021:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56783:x1848987613532288:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 262us (2280us total) trans 4294971907 rc 0/0 00000100:00100000:3.0:1763333169.721029:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3019 00000100:00100000:2.0:1763333169.735613:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.735761:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613532544 00000100:00100000:1.0:1763333169.735770:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613532544 00000100:00100000:1.0:1763333169.735825:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8851 00000100:00100000:1.0:1763333169.735835:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:55917:x1848987613532544:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333169.735858:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333169.735883:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53e79 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968b5f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.736027:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53e80 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333169.736045:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53e80 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.736056:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53e80 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.736066:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53e87 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333169.736074:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53e87 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.736080:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53e87 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.736132:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53e8e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333169.736139:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53e8e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.736145:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53e8e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:1.0:1763333169.736155:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x18e:0x0]: returning size 0 00010000:00010000:1.0:1763333169.736222:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53e80 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.736230:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53e80 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.736236:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53e80 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.736243:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53e80 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.736249:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7ea00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333169.736253:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53e80 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.736260:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53e80 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.736271:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055a500) 00010000:00010000:1.0:1763333169.736273:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333169.736277:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53e80 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.736283:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53e80 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.736294:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53e87 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.736300:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53e87 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.736305:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53e87 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.736311:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333169.736313:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53e87 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.736319:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53e87 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.736325:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe4345b000) 00010000:00010000:1.0:1763333169.736327:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333169.736331:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53e87 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.736336:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53e87 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.736403:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53e79 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b5f expref: 226 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.736421:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53e8e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b5f expref: 225 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.736429:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18e:0x0].0x0 (ffff92ff6055af00) 00010000:00010000:1.0:1763333169.736431:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333169.736433:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f000, rc 0) 00000100:00100000:1.0:1763333169.736491:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:55917:x1848987613532544:12345-192.168.204.28@tcp:101:bash.0 Request processed in 658us (888us total) trans 4294971908 rc 0/0 00000100:00100000:1.0:1763333169.736499:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8851 00000100:00100000:2.0:1763333169.743602:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333169.744125:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613532672 00000100:00100000:0.0:1763333169.744136:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613532672 00000100:00100000:1.0:1763333169.744268:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8852 00000100:00100000:1.0:1763333169.744282:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:55917:x1848987613532672:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333169.744307:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333169.744327:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53e9c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968b66 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.744439:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53ea3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333169.744453:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53ea3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.744466:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53ea3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.744586:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53e9c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b66 expref: 227 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.744604:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53ea3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b66 expref: 226 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.744614:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18e:0x0].0x0 (ffff92ff6055af00) 00010000:00010000:1.0:1763333169.744617:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763333169.744621:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7ea00, rc 0) 00000100:00100000:1.0:1763333169.744687:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:55917:x1848987613532672:12345-192.168.204.28@tcp:101:bash.0 Request processed in 409us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333169.744694:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8852 00010000:00010000:1.0:1763333169.745827:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763333169.749410:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333169.749502:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613533184 00000100:00100000:0.0:1763333169.749513:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613533184 00000100:00100000:1.0:1763333169.749941:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333169.751653:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613532928 00000100:00100000:0.0:1763333169.751666:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613532928 00000100:00100000:0.0:1763333169.751734:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8853 00000100:00100000:0.0:1763333169.751744:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:55917:x1848987613533184:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:0.0:1763333169.751798:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333169.751832:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53e8e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b5f expref: 227 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.751851:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18e:0x0].0x0 (ffff92ff6055af00) 00010000:00010000:0.0:1763333169.751856:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333169.752037:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c53eaa lrc: 3/0,1 mode: --/PW res: [0x240000404:0x18e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333169.752051:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c53eaa lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x18e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.752060:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c53eaa lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x18e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000001:00080000:0.0:1763333169.752105:0:6519:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294971909 00000004:00010000:0.0:1763333169.752128:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d5e5bd6a reply state 000000002e2197d4 transno 4294971910 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c53eaa lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x18e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.752140:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c53eaa lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x18e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.752145:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18e:0x0].0x0 (ffff92ff6055af00) 00010000:00010000:0.0:1763333169.752149:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333169.752151:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763333169.752241:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:55917:x1848987613533184:12345-192.168.204.28@tcp:36:bash.0 Request processed in 498us (2839us total) trans 4294971910 rc 0/0 00000100:00100000:0.0:1763333169.752249:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8853 00000020:00080000:0.0:1763333169.752254:0:6519:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763333169.752270:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8854 00000100:00100000:0.0:1763333169.752277:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56784:x1848987613532928:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333169.752285:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333169.752294:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c53eb1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x18e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968b6d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.752370:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c53eb8 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x18e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333169.752379:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c53eb8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x18e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.752386:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c53eb8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x18e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:0.0:1763333169.752395:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x18e:0x0]: returning size 0 00010000:00010000:0.0:1763333169.752455:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c53eb1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x18e:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b6d expref: 231 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.752469:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c53eb8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x18e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b6d expref: 230 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.752476:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18e:0x0].0x0 (ffff92ff6055af00) 00010000:00010000:0.0:1763333169.752478:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1763333169.752480:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe467bf600, rc 0) 00000100:00100000:0.0:1763333169.752509:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56784:x1848987613532928:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 232us (2569us total) trans 4294971911 rc 0/0 00000100:00100000:0.0:1763333169.752516:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8854 00000100:00100000:0.0:1763333169.758429:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.758480:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613533312 00000100:00100000:1.0:1763333169.758495:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613533312 00000100:00100000:1.0:1763333169.758558:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8855 00000100:00100000:1.0:1763333169.758568:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:55917:x1848987613533312:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333169.758598:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333169.758619:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53ec6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x18e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968b74 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.758676:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53ec6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x18e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b74 expref: 231 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.758691:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53ec6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x18e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b74 expref: 231 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.758714:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18e:0x0].0x0 (ffff92ff6055af00) 00010000:00010000:1.0:1763333169.758718:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763333169.758721:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e000, rc 0) 00000100:00100000:1.0:1763333169.758789:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:55917:x1848987613533312:12345-192.168.204.28@tcp:101:bash.0 Request processed in 222us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333169.758796:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8855 00000100:00100000:1.0:1763333169.765706:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.765746:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333169.765778:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613533568 00000100:00100000:2.0:1763333169.765790:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613533568 00000100:00100000:3.0:1763333169.765811:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613533696 00000100:00100000:3.0:1763333169.765818:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613533696 00000100:00100000:2.0:1763333169.765860:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8856 00000100:00100000:3.0:1763333169.765869:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8857 00000100:00100000:2.0:1763333169.765874:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:55917:x1848987613533568:12345-192.168.204.28@tcp:101:bash.0 00000100:00100000:3.0:1763333169.765882:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56784:x1848987613533696:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333169.765906:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333169.765906:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333169.765912:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763333169.765930:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c53ecd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x18e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968b82 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333169.765942:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53ec6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x18e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b74 expref: 232 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333169.765961:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18e:0x0].0x0 (ffff92ff6055af00) 00010000:00010000:2.0:1763333169.765966:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333169.765977:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c53ed4 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x18e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968b7b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333169.766017:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c53edb lrc: 3/0,1 mode: --/EX res: [0x240000404:0x18e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333169.766030:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c53ee2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333169.766031:0:6521:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c53eb8 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x18e:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b6d expref: 233 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333169.766049:0:6521:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c53edb lrc: 4/0,1 mode: --/EX res: [0x240000404:0x18e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.766263:0:8606:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c53edb lrc: 4/0,1 mode: --/EX res: [0x240000404:0x18e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.766271:0:8606:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c53ee2 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333169.766285:0:8606:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c53edb lrc: 4/0,1 mode: --/EX res: [0x240000404:0x18e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.766297:0:8606:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c53ee2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.766306:0:6521:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c53eb8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x18e:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b6d expref: 233 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333169.766321:0:6521:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c53eb8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x18e:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b6d expref: 233 pid: 6519 timeout: 1373 lvb_type: 0 00000100:00100000:2.0:1763333169.766339:0:6521:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42ef9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6521:1848987627208192:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333169.766520:0:6521:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7df5de40 going to sleep for 11 seconds 00000100:00100000:0.0:1763333169.770949:0:6521:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42ef9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6521:1848987627208192:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333169.770981:0:6521:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c53edb lrc: 3/0,1 mode: --/EX res: [0x240000404:0x18e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT1 00000100:00100000:1.0:1763333169.771906:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333169.771985:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613533824 00000100:00100000:3.0:1763333169.771992:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613533824 00010000:00010000:3.0:1763333169.772028:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c53eb8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x18e:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b6d expref: 234 pid: 6519 timeout: 1373 lvb_type: 0 00000100:00100000:3.0:1763333169.772103:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2903 00000100:00100000:3.0:1763333169.772112:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:2420:x1848987613533824:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333169.772127:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333169.772134:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c53eb8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x18e:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b6d expref: 234 pid: 6519 timeout: 1373 lvb_type: 0 00010000:00010000:3.0:1763333169.772146:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c53eb8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x18e:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b6d expref: 234 pid: 6519 timeout: 1373 lvb_type: 0 00010000:00010000:3.0:1763333169.772168:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c53eb8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x18e:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b6d expref: 234 pid: 6519 timeout: 1373 lvb_type: 0 00010000:00010000:3.0:1763333169.772184:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18e:0x0].0x0 (ffff92ff6055af00) 00010000:00010000:3.0:1763333169.772189:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c53ee2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333169.772198:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c53edb lrc: 3/0,1 mode: --/EX res: [0x240000404:0x18e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.772206:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c53edb lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x18e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.772219:0:6504:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c53edb lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x18e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333169.772226:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c53ee2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333169.772232:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c53ee2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333169.772259:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333169.772437:0:6521:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c53edb lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x18e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.772446:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c53edb lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x18e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT1 00000040:00080000:0.0:1763333169.772712:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1293, 88 off109808 00000004:00080000:0.0:1763333169.772721:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1273852371689ns, next at 1274741703917ns, rc = 0 00000040:00080000:0.0:1763333169.774208:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1292, 88 off109808 00000004:00080000:0.0:1763333169.774220:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1273853871208ns, next at 1274741674609ns, rc = 0 00000040:00080000:0.0:1763333169.774255:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1293, 88 off109896 00000004:00080000:0.0:1763333169.774260:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1273853911053ns, next at 1274741674609ns, rc = 0 00000040:00080000:0.0:1763333169.774276:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1294, 88 off109896 00000004:00080000:0.0:1763333169.774280:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1273853931198ns, next at 1274741703917ns, rc = 0 00000100:00100000:3.0:1763333169.775410:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:2420:x1848987613533824:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 2623us (2832us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333169.775428:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2903 00000001:00080000:2.0:1763333169.782103:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294971912 is committed 00000004:00080000:2.0:1763333169.782120:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 849 committed 00000004:00080000:2.0:1763333169.782141:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 846 committed 00000004:00080000:2.0:1763333169.782155:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 845 committed 00000004:00080000:2.0:1763333169.782157:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 848 committed 00010000:00010000:2.0:1763333169.782256:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c53edb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x18e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b7b expref: 222 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333169.782271:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18e:0x0].0x0 (ffff92ff6055af00) 00010000:00010000:2.0:1763333169.782274:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763333169.782277:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c53ee2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.782292:0:6521:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c53ee2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.782298:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c53ee2 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.782344:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c53ed4 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x18e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b7b expref: 222 pid: 6521 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1763333169.782394:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c53edb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x18e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b7b expref: 221 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333169.782423:0:8606:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c53ee2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.782431:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c53ee2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:2.0:1763333169.782473:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x18e:0x0]: returning size 2 00000004:00200000:2.0:1763333169.782477:0:8606:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763333169.782498:0:8606:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c53ee2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.782524:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c53ecd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x18e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b82 expref: 222 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333169.782536:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c53ee2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b82 expref: 221 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333169.782542:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18e:0x0].0x0 (ffff92ff6055af00) 00010000:00010000:2.0:1763333169.782545:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1763333169.782548:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea000, rc 0) 00000100:00100000:2.0:1763333169.782638:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56784:x1848987613533696:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 16758us (16889us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333169.782648:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8857 00010000:00010000:2.0:1763333169.782799:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4400, rc 0) 00000100:00100000:2.0:1763333169.782843:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+220:55917:x1848987613533568:12345-192.168.204.28@tcp:101:bash.0 Request processed in 16974us (17146us total) trans 4294971912 rc 0/0 00000100:00100000:2.0:1763333169.782850:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8856 00000100:00100000:1.0:1763333169.783070:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe438abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627208576:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333169.783118:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333169.783149:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763333169.783156:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe43998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627208704:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333169.783176:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333169.783207:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627208576 00000100:00100000:1.0:1763333169.783213:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627208576 00000100:00100000:1.0:1763333169.783244:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627208704 00000100:00100000:1.0:1763333169.783247:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627208704 00000100:00100000:1.0:1763333169.783264:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6157 00000100:00100000:1.0:1763333169.783271:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+10:3652:x1848987627208576:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333169.783447:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+11:3652:x1848987627208576:12345-0@lo:2:osp-syn-1-1.0 Request processed in 176us (328us total) trans 17179871419 rc 0/0 00000100:00100000:1.0:1763333169.783454:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6157 00000100:00100000:1.0:1763333169.783467:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6158 00000100:00100000:1.0:1763333169.783473:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+10:3652:x1848987627208704:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333169.783541:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+11:3652:x1848987627208704:12345-0@lo:2:osp-syn-1-1.0 Request processed in 68us (363us total) trans 17179871420 rc 0/0 00000100:00100000:1.0:1763333169.783547:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6158 00000004:00080000:1.0:1763333169.783595:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe43998700/2, rc 0, transno 17179871420 00000100:00100000:1.0:1763333169.783600:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe43998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627208704:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1763333169.783609:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe438abb80/2, rc 0, transno 17179871419 00000100:00100000:1.0:1763333169.783612:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe438abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627208576:0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1763333169.784492:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c53e2c lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.784503:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c53e2c lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.784510:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c53e2c lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.784517:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe44c38800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333169.784521:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c53e2c lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.784529:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c53e2c lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.784544:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe4345b000) 00010000:00010000:0.0:1763333169.784547:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333169.784552:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c53e2c lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.784558:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c53e2c lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333169.784591:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c53eaa lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x18e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.784598:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c53eaa lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x18e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.784604:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c53eaa lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x18e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.784609:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe467be000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333169.784611:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c53eaa lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x18e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.784617:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c53eaa lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x18e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.784624:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18e:0x0].0x0 (ffff92ff6055af00) 00010000:00010000:0.0:1763333169.784627:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333169.784630:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c53eaa lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x18e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333169.784635:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c53eaa lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x18e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000100:00100000:1.0:1763333169.785339:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe469a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627209216:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333169.785411:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe469a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627209088:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333169.785464:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333169.785510:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627209088 00000100:00100000:0.0:1763333169.785515:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627209088 00000100:00100000:0.0:1763333169.785552:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6159 00000100:00100000:0.0:1763333169.785559:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+27:3652:x1848987627209088:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333169.785711:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+28:3652:x1848987627209088:12345-0@lo:2:osp-syn-0-1.0 Request processed in 151us (246us total) trans 21474838725 rc 0/0 00000100:00100000:0.0:1763333169.785718:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6159 00000004:00080000:0.0:1763333169.785753:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe469a1500/2, rc 0, transno 21474838725 00000100:00100000:0.0:1763333169.785758:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe469a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627209088:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333169.786378:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333169.786538:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7dcfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627208320:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763333169.786565:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333169.786596:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff74039180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627208832:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763333169.786612:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333169.786625:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1763333169.786629:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7dcfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627208448:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763333169.786643:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333169.786652:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe469a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627208960:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763333169.786664:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333169.786687:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627209216 00000100:00100000:2.0:1763333169.786691:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627209216 00000100:00100000:2.0:1763333169.786712:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627208320 00000100:00100000:2.0:1763333169.786715:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627208320 00000100:00100000:2.0:1763333169.786726:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627208832 00000100:00100000:2.0:1763333169.786728:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627208832 00000100:00100000:2.0:1763333169.786737:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627208448 00000100:00100000:2.0:1763333169.786739:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627208448 00000100:00100000:2.0:1763333169.786748:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627208960 00000100:00100000:2.0:1763333169.786749:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627208960 00000100:00100000:2.0:1763333169.786760:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6160 00000100:00100000:2.0:1763333169.786766:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+30:3653:x1848987627209216:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333169.786904:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6161 00000100:00100000:0.0:1763333169.786912:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+12:3654:x1848987627208320:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1763333169.786927:0:8404:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:519 count 1 00010000:00010000:0.0:1763333169.786952:0:8404:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c53ee9 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.786974:0:8404:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c53bcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a7f expref: 14 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.786983:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333169.786986:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333169.786990:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c53ee9 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.787026:0:8404:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c53bcb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a7f expref: 14 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.787041:0:8404:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c53bcb lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a7f expref: 14 pid: 8611 timeout: 1373 lvb_type: 0 00000100:00100000:0.0:1763333169.787053:0:8404:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46e2f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8404:1848987627209344:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333169.787119:0:8404:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4ce84840 going to sleep for 11 seconds 00000100:00100000:3.0:1763333169.787304:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6162 00000100:00100000:3.0:1763333169.787313:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+31:3654:x1848987627208832:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763333169.787401:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6163 00000100:00100000:1.0:1763333169.787410:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+12:3654:x1848987627208448:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763333169.787422:0:8407:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:520 count 1 00010000:00010000:1.0:1763333169.787436:0:8407:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53ef0 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.787448:0:8407:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c53d99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b19 expref: 14 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.787455:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333169.787456:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333169.787459:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53ef0 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.787477:0:8407:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c53d99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b19 expref: 14 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.787490:0:8407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c53d99 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b19 expref: 14 pid: 17605 timeout: 1373 lvb_type: 0 00000100:00100000:1.0:1763333169.787499:0:8407:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e122680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8407:1848987627209472:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333169.787537:0:8407:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7dfd8300 going to sleep for 11 seconds 00000100:00100000:1.0:1763333169.787552:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6164 00000100:00100000:1.0:1763333169.787558:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+31:3654:x1848987627208960:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763333169.787685:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+31:3653:x1848987627209216:12345-0@lo:2:osp-syn-0-1.0 Request processed in 917us (1308us total) trans 21474838726 rc 0/0 00000100:00100000:2.0:1763333169.787692:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6160 00000004:00080000:1.0:1763333169.788041:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe469a0000/2, rc 0, transno 21474838726 00000100:00100000:1.0:1763333169.788047:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe469a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627209216:0@lo:2:osp-syn-0-1.0 00002000:00080000:1.0:1763333169.788076:0:28650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:519 count 1 00010000:00010000:1.0:1763333169.788090:0:28650:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53ef7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.788102:0:28650:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c53cce lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ad3 expref: 19 pid: 17605 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333169.788108:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333169.788110:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333169.788112:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53ef7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.788129:0:28650:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c53cce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ad3 expref: 19 pid: 17605 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333169.788137:0:28650:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c53cce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ad3 expref: 19 pid: 17605 timeout: 1373 lvb_type: 1 00000100:00100000:1.0:1763333169.788147:0:28650:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e120e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28650:1848987627209600:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333169.788182:0:28650:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7dfd8f00 going to sleep for 11 seconds 00002000:00080000:2.0:1763333169.788621:0:8611:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:520 count 1 00010000:00010000:2.0:1763333169.788634:0:8611:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53efe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333169.788645:0:8611:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf400/0xb32e3ef184c53da0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b20 expref: 19 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333169.788652:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333169.788653:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333169.788656:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53efe lrc: 4/0,1 mode: --/PW res: [0x280000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333169.788671:0:8611:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf400/0xb32e3ef184c53da0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b20 expref: 19 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333169.788679:0:8611:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf400/0xb32e3ef184c53da0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b20 expref: 19 pid: 8406 timeout: 1373 lvb_type: 0 00000100:00100000:2.0:1763333169.788687:0:8611:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8611:1848987627209728:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333169.788727:0:8611:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7df5dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1763333169.795963:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333169.796005:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333169.796089:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333169.796124:0:8404:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46e2f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8404:1848987627209344:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333169.796126:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:0.0:1763333169.796153:0:8404:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c53ee9 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333169.796186:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333169.796227:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613534336 00000100:00100000:0.0:1763333169.796233:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613534336 00000100:00100000:3.0:1763333169.796246:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:0.0:1763333169.796265:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c53d99 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b19 expref: 15 pid: 17605 timeout: 1373 lvb_type: 0 00000100:00100000:0.0:1763333169.796307:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613534208 00000100:00100000:0.0:1763333169.796311:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613534208 00010000:00010000:0.0:1763333169.796323:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c53bcb lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a7f expref: 16 pid: 8611 timeout: 1373 lvb_type: 0 00000100:00100000:0.0:1763333169.796334:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613534592 00000100:00100000:0.0:1763333169.796337:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613534592 00010000:00010000:0.0:1763333169.796370:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf400/0xb32e3ef184c53da0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b20 expref: 20 pid: 8406 timeout: 1373 lvb_type: 0 00000100:00100000:0.0:1763333169.796383:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613534464 00000100:00100000:0.0:1763333169.796386:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613534464 00010000:00010000:0.0:1763333169.796398:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c53cce lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ad3 expref: 21 pid: 17605 timeout: 1373 lvb_type: 1 00000100:00100000:0.0:1763333169.796416:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2904 00000100:00100000:0.0:1763333169.796426:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2420:x1848987613534336:12345-192.168.204.28@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1763333169.796436:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2905 00010000:00010000:0.0:1763333169.796441:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333169.796448:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c53d99 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x208:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b19 expref: 16 pid: 17605 timeout: 1373 lvb_type: 0 00000100:00100000:3.0:1763333169.796451:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2420:x1848987613534208:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333169.796467:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333169.796467:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c53d99 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x208:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b19 expref: 16 pid: 17605 timeout: 1373 lvb_type: 0 00010000:00010000:3.0:1763333169.796476:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c53bcb lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x207:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a7f expref: 16 pid: 8611 timeout: 1373 lvb_type: 0 00010000:00010000:3.0:1763333169.796496:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c53bcb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x207:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a7f expref: 16 pid: 8611 timeout: 1373 lvb_type: 0 00010000:00010000:0.0:1763333169.796498:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333169.796502:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333169.796508:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53ef0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x208:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.796517:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c53bcb lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x207:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968a7f expref: 16 pid: 8611 timeout: 1373 lvb_type: 0 00010000:00010000:0.0:1763333169.796522:0:6506:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53ef0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x208:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.796538:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333169.796541:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333169.796545:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c53ee9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.796546:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333169.796566:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c53ee9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.796595:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333169.796610:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2420:x1848987613534336:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 185us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333169.796622:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2420:x1848987613534208:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 175us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333169.796623:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2904 00000100:00100000:3.0:1763333169.796635:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2905 00000100:00100000:0.0:1763333169.796648:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2906 00000100:00100000:3.0:1763333169.796660:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2907 00000100:00100000:0.0:1763333169.796661:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2419:x1848987613534592:12345-192.168.204.28@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1763333169.796674:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2419:x1848987613534464:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333169.796674:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333169.796683:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf400/0xb32e3ef184c53da0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x208:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b20 expref: 21 pid: 8406 timeout: 1373 lvb_type: 0 00010000:00010000:3.0:1763333169.796686:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333169.796695:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c53cce lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x207:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ad3 expref: 21 pid: 17605 timeout: 1373 lvb_type: 1 00010000:00010000:0.0:1763333169.796698:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf400/0xb32e3ef184c53da0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x208:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b20 expref: 21 pid: 8406 timeout: 1373 lvb_type: 0 00010000:00010000:3.0:1763333169.796718:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c53cce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x207:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ad3 expref: 21 pid: 17605 timeout: 1373 lvb_type: 1 00010000:00010000:0.0:1763333169.796723:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333169.796726:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333169.796731:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53efe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x208:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.796741:0:6506:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53efe lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x208:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.796745:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333169.796749:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333169.796754:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53ef7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x207:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.796757:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333169.796765:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53ef7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x207:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.796780:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333169.796782:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2419:x1848987613534592:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 125us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333169.796791:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2906 00000100:00100000:3.0:1763333169.796806:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2419:x1848987613534464:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 135us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333169.796814:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2907 00010000:00010000:0.0:1763333169.798762:0:8404:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c53ee9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.798779:0:8404:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c53ee9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.798789:0:8404:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c53ee9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.798798:0:8404:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c53ee9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.798819:0:8404:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763333169.799104:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+13:3654:x1848987627208320:12345-0@lo:6:osp-syn-1-1.0 Request processed in 12189us (12533us total) trans 17179871421 rc 0/0 00000100:00100000:0.0:1763333169.799113:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6161 00010000:00010000:3.0:1763333169.799330:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333169.799338:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c53ee9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.799383:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abde400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333169.799389:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c53ee9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.799401:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c53ee9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333169.799402:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613533952 00000100:00100000:2.0:1763333169.799412:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613533952 00010000:00010000:3.0:1763333169.799425:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c53ee9 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.799434:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c53ee9 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.799456:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333169.799458:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333169.799461:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763333169.799470:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613534080 00000100:00100000:2.0:1763333169.799476:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613534080 00000100:00100000:2.0:1763333169.799505:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6165 00000100:00100000:2.0:1763333169.799513:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:55917:x1848987613533952:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333169.799536:0:29013:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333169.799557:0:29013:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5000/0xb32e3ef184c53f05 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968b89 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763333169.799590:0:29013:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x20b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763333169.799610:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333169.799612:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333169.799621:0:29013:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5000/0xb32e3ef184c53f05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b89 expref: 22 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333169.799634:0:29013:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5000/0xb32e3ef184c53f05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b89 expref: 22 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333169.799646:0:29013:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5000, rc 0) 00000100:00100000:2.0:1763333169.799698:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:55917:x1848987613533952:12345-192.168.204.28@tcp:101:bash.0 Request processed in 186us (3744us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333169.799704:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6165 00000100:00100000:2.0:1763333169.799720:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6166 00000100:00100000:2.0:1763333169.799727:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2421:x1848987613534080:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333169.799734:0:29013:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333169.799747:0:29013:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c53f0c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968b90 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333169.799788:0:29013:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29013:1848987627209856:192.168.204.28@tcp:106: 00000100:00100000:2.0:1763333169.799843:0:29013:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7df5d840 going to sleep for 11 seconds 00010000:00010000:2.0:1763333169.799901:0:8611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf400/0xb32e3ef184c53da0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b20 expref: 22 pid: 8406 timeout: 1373 lvb_type: 0 00000100:00100000:2.0:1763333169.799913:0:8611:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8611:1848987627209728:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333169.799933:0:8611:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53efe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333169.799942:0:8611:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53efe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333169.799948:0:8611:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53efe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333169.799956:0:8611:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53efe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333169.799963:0:8611:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53efe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333169.799980:0:8611:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763333169.800125:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+31:3654:x1848987627208960:12345-0@lo:6:osp-syn-0-1.0 Request processed in 12566us (13458us total) trans 21474838727 rc 0/0 00000100:00100000:2.0:1763333169.800133:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6164 00010000:00010000:2.0:1763333169.800153:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333169.800158:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53efe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333169.800164:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333169.800168:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53efe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.800539:0:8407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c53d99 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b19 expref: 13 pid: 17605 timeout: 1373 lvb_type: 0 00000100:00100000:1.0:1763333169.800551:0:8407:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e122680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8407:1848987627209472:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333169.800565:0:8407:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53ef0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.800583:0:8407:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53ef0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.800590:0:8407:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53ef0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.800599:0:8407:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53ef0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.800605:0:8407:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53ef0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.800621:0:8407:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763333169.800828:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+13:3654:x1848987627208448:12345-0@lo:6:osp-syn-1-1.0 Request processed in 13419us (14182us total) trans 17179871422 rc 0/0 00000100:00100000:1.0:1763333169.800835:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6163 00010000:00010000:1.0:1763333169.800869:0:28650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c53cce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ad3 expref: 21 pid: 17605 timeout: 1373 lvb_type: 1 00000100:00100000:1.0:1763333169.800879:0:28650:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e120e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28650:1848987627209600:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333169.800890:0:28650:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53ef7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.800898:0:28650:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53ef7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.800905:0:28650:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53ef7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.800913:0:28650:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53ef7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.800920:0:28650:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53ef7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.800933:0:28650:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1763333169.801078:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+31:3654:x1848987627208832:12345-0@lo:6:osp-syn-0-1.0 Request processed in 13766us (14463us total) trans 21474838728 rc 0/0 00000100:00100000:1.0:1763333169.801085:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6162 00010000:00010000:1.0:1763333169.801102:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1763333169.801107:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53ef0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.801114:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fa00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333169.801117:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53ef0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.801124:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53ef0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.801137:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53ef0 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.801144:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53ef0 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.801162:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333169.801165:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53ef7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.801171:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e600 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333169.801173:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53ef7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.801179:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53ef7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.801189:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53ef7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.801195:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53ef7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.801210:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333169.801212:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333169.801213:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763333169.801264:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7dcfc700/2, rc 0, transno 17179871422 00000100:00100000:1.0:1763333169.801271:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7dcfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627208448:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1763333169.801282:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe469a0700/2, rc 0, transno 21474838727 00000100:00100000:1.0:1763333169.801285:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe469a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627208960:0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1763333169.801294:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7dcfd180/2, rc 0, transno 17179871421 00000100:00100000:1.0:1763333169.801296:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7dcfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627208320:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1763333169.801303:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff74039180/2, rc 0, transno 21474838728 00000100:00100000:1.0:1763333169.801306:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff74039180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627208832:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1763333169.801503:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53efe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333169.801514:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53efe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333169.801520:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53efe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333169.801535:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333169.801536:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333169.801538:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333169.801544:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763333169.803787:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.804219:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613534720 00000100:00100000:1.0:1763333169.804230:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613534720 00000100:00100000:1.0:1763333169.804294:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6167 00000100:00100000:1.0:1763333169.804305:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:55917:x1848987613534720:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333169.804324:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333169.804383:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c53f13 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968b97 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333169.804412:0:8404:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x20b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333169.804434:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333169.804437:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333169.804447:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c53f13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b97 expref: 14 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.804467:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c53f13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b97 expref: 14 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.804479:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f200, rc 0) 00000100:00100000:1.0:1763333169.804540:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:55917:x1848987613534720:12345-192.168.204.28@tcp:101:bash.0 Request processed in 238us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333169.804548:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6167 00002000:00010000:2.0:1763333169.804688:0:29013:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x20b:0x0] updating lvb mtime: 0 -> 1763333170 00002000:00010000:2.0:1763333169.804692:0:29013:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x20b:0x0] updating lvb atime: 0 -> 1763333170 00002000:00010000:2.0:1763333169.804694:0:29013:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x20b:0x0] updating lvb ctime: 0 -> 1763333170 00000100:00100000:2.0:1763333169.804707:0:29013:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29013:1848987627209856:192.168.204.28@tcp:106: 00010000:00010000:2.0:1763333169.804741:0:29013:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c53f0c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b90 expref: 20 pid: 29013 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333169.804755:0:29013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c53f0c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b90 expref: 20 pid: 29013 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333169.804765:0:29013:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4c00, rc 0) 00000100:00100000:2.0:1763333169.804788:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2421:x1848987613534080:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 5062us (8783us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333169.804794:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6166 00000100:00100000:3.0:1763333169.808821:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333169.808870:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.808896:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613534848 00000100:00100000:0.0:1763333169.808913:0:28429:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613534976 00000100:00100000:1.0:1763333169.808917:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613534848 00000100:00100000:3.0:1763333169.808919:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333169.808920:0:28429:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613534976 00002000:00010000:1.0:1763333169.808962:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/523 (0->18446744073709551615) 00002000:00100000:1.0:1763333169.808968:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe469a2d80 with x1848987613534848 ext(0->18446744073709551615) 00000100:00100000:2.0:1763333169.808979:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613535232 00002000:00010000:1.0:1763333169.808980:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe469a2d80. 00000100:00100000:2.0:1763333169.808983:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613535232 00000100:00100000:2.0:1763333169.809016:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3020 00000100:00100000:1.0:1763333169.809016:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1540 00000100:00100000:2.0:1763333169.809025:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+218:56784:x1848987613535232:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1763333169.809025:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2420:x1848987613534848:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:1.0:1763333169.809192:0:24027:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x20b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333169.809195:0:24027:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x20b:0x0] updating lvb mtime from disk: 1763333170 -> 1763333170 00002000:00010000:1.0:1763333169.809198:0:24027:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x20b:0x0] updating lvb atime from disk: 1763333170 -> 0 00002000:00010000:1.0:1763333169.809200:0:24027:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x20b:0x0] updating lvb ctime from disk: 1763333170 -> 1763333170 00002000:00010000:1.0:1763333169.809202:0:24027:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x20b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333169.809250:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2420:x1848987613534848:12345-192.168.204.28@tcp:10:bash.0 Request processed in 225us (439us total) trans 21474838729 rc 0/0 00000100:00100000:1.0:1763333169.809258:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1540 00002000:00010000:1.0:1763333169.809262:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/523 (0->18446744073709551615) 00002000:00100000:1.0:1763333169.809265:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe469a2d80 with x1848987613534848 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333169.809271:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe469a2d80. 00000100:00100000:2.0:1763333169.809983:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:56784:x1848987613535232:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 955us (1063us total) trans 4294971913 rc 0/0 00000100:00100000:2.0:1763333169.809991:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3020 00002000:00010000:0.0:1763333169.810749:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/523 (0->18446744073709551615) 00002000:00100000:0.0:1763333169.810756:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe469a3800 with x1848987613534976 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333169.810765:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe469a3800. 00000100:00100000:0.0:1763333169.810787:0:28429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1541 00000100:00100000:0.0:1763333169.810805:0:28429:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2421:x1848987613534976:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:0.0:1763333169.810952:0:28429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x20b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333169.810956:0:28429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x20b:0x0] updating lvb mtime from disk: 0 -> 1763333170 00002000:00010000:0.0:1763333169.810959:0:28429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x20b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333169.810961:0:28429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x20b:0x0] updating lvb ctime from disk: 0 -> 1763333170 00002000:00010000:0.0:1763333169.810963:0:28429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x20b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333169.811021:0:28429:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2421:x1848987613534976:12345-192.168.204.28@tcp:10:bash.0 Request processed in 226us (2151us total) trans 17179871423 rc 0/0 00000100:00100000:0.0:1763333169.811032:0:28429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1541 00002000:00010000:0.0:1763333169.811035:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/523 (0->18446744073709551615) 00002000:00100000:0.0:1763333169.811038:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe469a3800 with x1848987613534976 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333169.811043:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe469a3800. 00000100:00100000:3.0:1763333169.815655:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333169.815794:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333169.815874:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613535488 00000100:00100000:2.0:1763333169.815885:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613535488 00000100:00100000:2.0:1763333169.815947:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8858 00000100:00100000:2.0:1763333169.815958:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:56784:x1848987613535488:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333169.815983:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333169.816008:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c53f1a lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968b9e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333169.816087:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53f21 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333169.816102:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53f21 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333169.816114:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53f21 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333169.816128:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c53f28 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333169.816135:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c53f28 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333169.816142:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c53f28 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333169.816251:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c53f2f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333169.816260:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c53f2f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333169.816266:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c53f2f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:2.0:1763333169.816276:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x18e:0x0]: returning size 2 00010000:00010000:2.0:1763333169.816387:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53f21 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333169.816395:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53f21 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333169.816401:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53f21 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333169.816407:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53f21 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333169.816412:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333169.816416:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53f21 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333169.816423:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53f21 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333169.816434:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab2100) 00010000:00010000:2.0:1763333169.816437:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333169.816442:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53f21 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333169.816448:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53f21 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333169.816461:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c53f28 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333169.816467:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c53f28 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333169.816472:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c53f28 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333169.816476:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333169.816479:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c53f28 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333169.816483:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c53f28 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333169.816488:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43ab2900) 00010000:00010000:2.0:1763333169.816490:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333169.816493:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c53f28 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333169.816497:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c53f28 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333169.816534:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c53f1a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b9e expref: 222 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333169.816547:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c53f2f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b9e expref: 221 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333169.816554:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18e:0x0].0x0 (ffff92ff6055af00) 00010000:00010000:2.0:1763333169.816556:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333169.816559:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4600, rc 0) 00000100:00100000:2.0:1763333169.816628:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56784:x1848987613535488:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 672us (982us total) trans 4294971914 rc 0/0 00000100:00100000:2.0:1763333169.816635:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8858 00000100:00100000:0.0:1763333169.816760:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613535744 00000100:00100000:0.0:1763333169.816765:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613535744 00000100:00100000:0.0:1763333169.816802:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3021 00000100:00100000:0.0:1763333169.816810:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:55917:x1848987613535744:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:0.0:1763333169.817000:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:55917:x1848987613535744:12345-192.168.204.28@tcp:35:bash.0 Request processed in 191us (1206us total) trans 4294971915 rc 0/0 00000100:00100000:0.0:1763333169.817008:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3021 00000100:00100000:2.0:1763333169.832455:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333169.832509:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333169.832513:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613536000 00000100:00100000:0.0:1763333169.832525:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613536000 00000100:00100000:3.0:1763333169.833744:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613536256 00000100:00100000:3.0:1763333169.833752:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613536256 00000100:00100000:3.0:1763333169.833811:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8859 00000100:00100000:3.0:1763333169.833823:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56785:x1848987613536256:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:3.0:1763333169.833885:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1763333169.833913:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c53edb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x18e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b7b expref: 223 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.833934:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c53f2f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b9e expref: 222 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.833945:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c53ee2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b82 expref: 221 pid: 8606 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333169.834445:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3022 00000100:00100000:0.0:1763333169.834456:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56784:x1848987613536000:12345-192.168.204.28@tcp:35:lfs.0 00010000:00010000:3.0:1763333169.834566:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53ea3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x18e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b66 expref: 220 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.834589:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18e:0x0].0x0 (ffff92ff6055af00) 00010000:00010000:3.0:1763333169.834602:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333169.834631:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c53f3d lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333169.834645:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c53f3d lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333169.834655:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c53f3d lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333169.834667:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c53f44 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333169.834674:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c53f44 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333169.834681:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c53f44 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333169.834752:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c53f4b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x18e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333169.834760:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c53f4b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x18e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333169.834766:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c53f4b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x18e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000100:00100000:0.0:1763333169.835631:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+220:56784:x1848987613536000:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 1173us (3181us total) trans 4294971916 rc 0/0 00000100:00100000:0.0:1763333169.835640:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3022 00000040:00080000:2.0:1763333169.836299:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1295, 64 off109960 00000040:00080000:2.0:1763333169.836329:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1294, 64 off109960 00000040:00080000:2.0:1763333169.836339:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1295, 64 off110024 00000040:00080000:2.0:1763333169.836379:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1296, 64 off110024 00010000:00010000:2.0:1763333169.836442:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c53f52 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x18e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333169.836457:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c53f52 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x18e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.836468:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c53f52 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x18e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.836476:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c53f52 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x18e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.836483:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c53f52 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x18e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.836488:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c53f52 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x18e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.836508:0:8606:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763333169.836528:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c53f4b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x18e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.836533:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c53f4b lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x18e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.836540:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c53f4b lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x18e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.836546:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333169.836561:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c53f4b lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x18e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.836578:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c53f4b lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x18e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.836590:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18e:0x0].0x0 (ffff92ff8016f400) 00010000:00010000:2.0:1763333169.836593:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763333169.836597:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c53f4b lrc: 2/0,0 mode: --/EX res: [0x240000404:0x18e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.836604:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c53f4b lrc: 0/0,0 mode: --/EX res: [0x240000404:0x18e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.836726:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c53f3d lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.836734:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c53f3d lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.836740:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c53f3d lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.836746:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c53f3d lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.836756:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feb200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333169.836759:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c53f3d lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.836765:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c53f3d lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.836773:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff8016fb00) 00010000:00010000:2.0:1763333169.836775:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333169.836779:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c53f3d lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.836785:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c53f3d lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000004:00010000:2.0:1763333169.836799:0:8606:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a1cbbea8 reply state 000000002f81a073 transno 4294971917 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c53f44 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.836810:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c53f44 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.836816:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff8016f200) 00010000:00010000:2.0:1763333169.836819:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333169.836821:0:8606:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763333169.836875:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56785:x1848987613536256:12345-192.168.204.28@tcp:36:rm.0 Request processed in 3053us (4364us total) trans 4294971917 rc 0/0 00000100:00100000:2.0:1763333169.836890:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8859 00010000:00010000:3.0:1763333169.839485:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333169.839498:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c53f52 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x18e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333169.839508:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4c00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333169.839512:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c53f52 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x18e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333169.839520:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c53f52 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x18e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333169.839538:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x18e:0x0].0x0 (ffff92ff8016f400) 00010000:00010000:3.0:1763333169.839542:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763333169.839547:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c53f52 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x18e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333169.839553:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c53f52 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x18e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333169.839586:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333169.839588:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333169.839590:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763333169.848851:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333169.848967:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613536512 00000100:00100000:2.0:1763333169.848980:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613536512 00000100:00100000:2.0:1763333169.849043:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8860 00000100:00100000:2.0:1763333169.849055:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56784:x1848987613536512:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333169.849082:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333169.849106:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c53f59 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968ba5 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333169.849189:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53f60 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333169.849203:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53f60 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.849215:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53f60 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.849226:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53f67 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333169.849232:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53f67 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.849238:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53f67 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.849286:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53f60 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.849293:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53f60 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.849298:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53f60 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.849305:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53f60 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.849310:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333169.849315:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53f60 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.849322:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53f60 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.849333:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab2100) 00010000:00010000:2.0:1763333169.849336:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333169.849341:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53f60 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.849385:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53f60 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.849401:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53f67 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.849407:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53f67 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.849412:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53f67 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.849417:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333169.849420:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53f67 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.849426:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53f67 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.849433:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff8016f200) 00010000:00010000:2.0:1763333169.849436:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333169.849439:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53f67 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.849447:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53f67 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.849479:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c53f59 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ba5 expref: 222 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333169.849489:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab2100) 00010000:00010000:2.0:1763333169.849491:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763333169.849495:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c53f59 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ba5 expref: 222 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333169.849509:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5c00, rc 0) 00000100:00100000:2.0:1763333169.849585:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56784:x1848987613536512:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 533us (745us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333169.849593:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8860 00000100:00100000:1.0:1763333169.868531:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333169.868776:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613536640 00000100:00100000:2.0:1763333169.868788:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613536640 00000100:00100000:2.0:1763333169.868851:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8861 00000100:00100000:2.0:1763333169.868861:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56786:x1848987613536640:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333169.868880:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333169.868903:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c53f6e lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968bac expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333169.868990:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53f75 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333169.869004:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53f75 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.869018:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53f75 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.869027:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53f7c lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333169.869033:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53f7c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.869038:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53f7c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.869081:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53f75 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.869088:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53f75 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.869093:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53f75 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.869100:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53f75 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.869106:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333169.869110:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53f75 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.869116:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53f75 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.869127:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab2100) 00010000:00010000:2.0:1763333169.869129:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333169.869133:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53f75 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.869139:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53f75 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.869151:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53f7c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.869156:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53f7c lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.869161:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53f7c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.869165:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333169.869167:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53f7c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.869172:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53f7c lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.869177:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff8016f200) 00010000:00010000:2.0:1763333169.869179:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333169.869181:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53f7c lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.869186:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53f7c lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.869207:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c53f6e lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968bac expref: 222 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333169.869215:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab2100) 00010000:00010000:2.0:1763333169.869218:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333169.869221:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c53f6e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968bac expref: 222 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333169.869232:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5c00, rc 0) 00000100:00100000:2.0:1763333169.869290:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56786:x1848987613536640:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 431us (771us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333169.869297:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8861 00000100:00100000:0.0:1763333169.880281:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.880405:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613536768 00000100:00100000:1.0:1763333169.880416:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613536768 00000100:00100000:1.0:1763333169.880489:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8862 00000100:00100000:1.0:1763333169.880501:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56786:x1848987613536768:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333169.880526:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333169.880566:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53f83 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968bb3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.880674:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53f8a lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333169.880689:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53f8a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.880701:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53f8a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.880711:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53f91 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333169.880719:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53f91 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.880725:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53f91 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.880774:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53f8a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.880782:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53f8a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.880789:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53f8a lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.880795:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53f8a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.880800:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fa00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333169.880804:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53f8a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.880811:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53f8a lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.880823:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055ad00) 00010000:00010000:1.0:1763333169.880826:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333169.880831:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53f8a lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.880838:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c53f8a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.880851:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53f91 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.880857:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53f91 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.880863:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53f91 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.880868:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333169.880870:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53f91 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.880880:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53f91 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.880887:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff8016f200) 00010000:00010000:1.0:1763333169.880889:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333169.880892:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53f91 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.880897:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c53f91 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333169.880924:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53f83 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968bb3 expref: 222 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.880934:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055ad00) 00010000:00010000:1.0:1763333169.880936:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333169.880940:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c53f83 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968bb3 expref: 222 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.880954:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7ea00, rc 0) 00000100:00100000:1.0:1763333169.881024:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56786:x1848987613536768:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 525us (756us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333169.881033:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8862 00000100:00100000:3.0:1763333169.887119:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333169.887166:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.888893:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613537024 00000100:00100000:1.0:1763333169.888908:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613537024 00000100:00100000:1.0:1763333169.888974:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613537152 00000100:00100000:1.0:1763333169.888979:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613537152 00000100:00100000:1.0:1763333169.889017:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8863 00000100:00100000:1.0:1763333169.889027:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:56787:x1848987613537024:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333169.889055:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333169.889082:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53f98 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968bba expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.889162:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53f9f lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333169.889176:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53f9f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.889188:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53f9f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.889199:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53fa6 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333169.889205:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53fa6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.889212:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53fa6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.889253:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53f9f lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.889260:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53f9f lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.889266:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53f9f lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.889273:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53f9f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.889279:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333169.889284:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53f9f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.889292:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53f9f lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.889304:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055a000) 00010000:00010000:1.0:1763333169.889307:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333169.889311:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53f9f lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.889317:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c53f9f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.889332:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53fa6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.889338:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53fa6 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.889343:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53fa6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.889374:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333169.889377:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53fa6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.889383:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53fa6 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.889390:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff8016f200) 00010000:00010000:1.0:1763333169.889393:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333169.889396:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53fa6 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.889406:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c53fa6 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.889435:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53f98 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968bba expref: 223 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.889445:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055a000) 00010000:00010000:1.0:1763333169.889447:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763333169.889450:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c53f98 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968bba expref: 223 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.889463:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7fe00, rc 0) 00000100:00100000:1.0:1763333169.889527:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:56787:x1848987613537024:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 502us (2418us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333169.889534:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8863 00000100:00100000:1.0:1763333169.889555:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8864 00000100:00100000:1.0:1763333169.889563:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56786:x1848987613537152:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333169.889578:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333169.889587:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53fad lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968bc1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.889613:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53fb4 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333169.889620:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53fb4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333169.889626:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53fb4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:1.0:1763333169.889664:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1763333169.889669:0:6519:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1763333169.889690:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c53fad lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968bc1 expref: 223 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.889702:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53fb4 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968bc1 expref: 222 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.889708:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055ae00) 00010000:00010000:1.0:1763333169.889710:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1763333169.889712:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7fc00, rc 0) 00000100:00100000:1.0:1763333169.889729:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:56786:x1848987613537152:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 168us (2564us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333169.889734:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8864 00000100:00100000:0.0:1763333169.895027:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333169.895129:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613537408 00000100:00100000:2.0:1763333169.895141:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613537408 00000100:00100000:2.0:1763333169.895207:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8865 00000100:00100000:2.0:1763333169.895218:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:56786:x1848987613537408:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333169.895240:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333169.895243:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763333169.895275:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c53fb4 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968bc1 expref: 222 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333169.895296:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055ae00) 00010000:00010000:2.0:1763333169.895308:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333169.895323:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c53fbb lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968bc8 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333169.895463:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53fc2 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333169.895476:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53fc2 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.895486:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53fc2 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.895501:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53fc9 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333169.895508:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53fc9 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.895514:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53fc9 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.895980:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c53fd0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333169.895990:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c53fd0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.895997:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c53fd0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:2.0:1763333169.896008:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x190:0x0]: returning size 0 00010000:00010000:2.0:1763333169.896034:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53fc2 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.896041:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53fc2 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.896048:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53fc2 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.896055:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53fc2 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.896060:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333169.896065:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53fc2 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.896076:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53fc2 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.896084:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab2100) 00010000:00010000:2.0:1763333169.896087:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333169.896090:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53fc2 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.896096:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53fc2 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000004:00010000:2.0:1763333169.896108:0:8606:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000096ba9c40 reply state 0000000099c23692 transno 4294971918 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53fc9 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.896118:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53fc9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.896128:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff8016f200) 00010000:00010000:2.0:1763333169.896130:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333169.896133:0:8606:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763333169.896161:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c53fbb lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968bc8 expref: 224 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333169.896180:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c53fd0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968bc8 expref: 223 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333169.896187:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92fe43ab2900) 00010000:00010000:2.0:1763333169.896189:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333169.896191:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4c00, rc 0) 00000100:00100000:2.0:1763333169.896275:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56786:x1848987613537408:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1059us (1261us total) trans 4294971918 rc 0/0 00000100:00100000:2.0:1763333169.896286:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8865 00000100:00100000:1.0:1763333169.908701:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333169.908763:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613537664 00000100:00100000:3.0:1763333169.908775:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613537664 00000100:00100000:3.0:1763333169.908846:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8866 00000100:00100000:3.0:1763333169.908856:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56786:x1848987613537664:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333169.908883:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333169.908905:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c53fde lrc: 2/0,0 mode: --/CR res: [0x240000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968bcf expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.909023:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c53fe5 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333169.909039:0:12741:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c53fd0 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968bc8 expref: 225 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.909048:0:12741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c53fe5 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.909088:0:12741:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c53fd0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968bc8 expref: 225 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.909105:0:12741:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c53fd0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968bc8 expref: 225 pid: 8606 timeout: 1373 lvb_type: 0 00000100:00100000:3.0:1763333169.909119:0:12741:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e00f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627209984:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333169.909208:0:12741:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff801bc480 going to sleep for 11 seconds 00000100:00100000:0.0:1763333169.918681:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333169.919008:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613537920 00000100:00100000:2.0:1763333169.919021:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613537920 00000100:00100000:2.0:1763333169.919102:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8867 00000100:00100000:2.0:1763333169.919113:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56788:x1848987613537920:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333169.919135:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333169.919158:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c53fec lrc: 2/0,0 mode: --/CR res: [0x240000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968bd6 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333169.919271:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53ff3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333169.919287:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53ff3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.919299:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53ff3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:2.0:1763333169.919311:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x190:0x0]: returning size 0 00010000:00010000:2.0:1763333169.919441:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53ff3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.919449:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53ff3 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.919456:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53ff3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.919462:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333169.919466:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53ff3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.919478:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53ff3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.919491:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92fe43ab2900) 00010000:00010000:2.0:1763333169.919494:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1763333169.919499:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53ff3 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x190:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.919506:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c53ff3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x190:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333169.919552:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c53fec lrc: 1/0,0 mode: --/CR res: [0x240000404:0x190:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968bd6 expref: 228 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333169.919562:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92fe43ab2900) 00010000:00010000:2.0:1763333169.919565:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763333169.919581:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c53fec lrc: 0/0,0 mode: --/CR res: [0x240000404:0x190:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968bd6 expref: 228 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333169.919591:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5c00, rc 0) 00000100:00100000:2.0:1763333169.919662:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56788:x1848987613537920:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 550us (992us total) trans 4294971919 rc 301/301 00000100:00100000:2.0:1763333169.919669:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8867 00000100:00100000:0.0:1763333169.936810:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333169.936895:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613538048 00000100:00100000:2.0:1763333169.936907:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613538048 00010000:00010000:2.0:1763333169.936962:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c53fd0 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968bc8 expref: 227 pid: 8606 timeout: 1373 lvb_type: 0 00000100:00100000:2.0:1763333169.937017:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2908 00000100:00100000:2.0:1763333169.937030:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:2420:x1848987613538048:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333169.937050:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333169.937057:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c53fd0 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968bc8 expref: 227 pid: 8606 timeout: 1373 lvb_type: 0 00010000:00010000:2.0:1763333169.937071:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c53fd0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968bc8 expref: 227 pid: 8606 timeout: 1373 lvb_type: 0 00010000:00010000:2.0:1763333169.937100:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92fe43ab2900) 00010000:00010000:2.0:1763333169.937105:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c53fe5 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333169.937115:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c53fe5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333169.937122:0:6504:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c53fe5 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333169.937143:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333169.937198:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:2420:x1848987613538048:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 169us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333169.937205:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2908 00010000:00010000:3.0:1763333169.937223:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c53fd0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968bc8 expref: 226 pid: 8606 timeout: 1373 lvb_type: 0 00000100:00100000:3.0:1763333169.937238:0:12741:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e00f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627209984:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333169.937248:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:3.0:1763333169.937260:0:12741:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c53fe5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.937268:0:12741:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c53fe5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.937273:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c53fe5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:3.0:1763333169.937297:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x190:0x0]: returning size 0 00000004:00080000:3.0:1763333169.937534:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x20d:0x0], index 1: 0 00000004:00080000:3.0:1763333169.937542:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x20d:0x0], index 0: 0 00000004:00080000:3.0:1763333169.937546:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x20e:0x0], index 0: 0 00000004:00080000:3.0:1763333169.937551:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x20e:0x0], index 1: 0 00010000:00010000:3.0:1763333169.937661:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c53fe5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.937674:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c53fe5 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.937681:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c53fe5 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.937686:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333169.937690:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c53fe5 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.937697:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c53fe5 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.937708:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92fe43ab2900) 00010000:00010000:3.0:1763333169.937711:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763333169.937715:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c53fe5 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.937721:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c53fe5 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.937764:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c53fde lrc: 1/0,0 mode: --/CR res: [0x240000404:0x190:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968bcf expref: 226 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.937773:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92fe43ab2900) 00010000:00010000:3.0:1763333169.937775:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763333169.937778:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c53fde lrc: 0/0,0 mode: --/CR res: [0x240000404:0x190:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968bcf expref: 226 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.937793:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea000, rc 0) 00000100:00100000:3.0:1763333169.937834:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56786:x1848987613537664:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 28980us (29142us total) trans 4294971920 rc 301/301 00000100:00100000:3.0:1763333169.937842:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8866 00000100:00100000:0.0:1763333169.938210:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613538304 00000100:00100000:0.0:1763333169.938216:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613538304 00000100:00100000:0.0:1763333169.938258:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3023 00000100:00100000:0.0:1763333169.938266:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56788:x1848987613538304:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333169.938476:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56788:x1848987613538304:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 210us (1226us total) trans 4294971921 rc 0/0 00000100:00100000:0.0:1763333169.938483:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3023 00000100:00100000:2.0:1763333169.942805:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333169.942907:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613538816 00000100:00100000:0.0:1763333169.942921:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613538816 00000100:00100000:0.0:1763333169.942992:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3024 00000100:00100000:0.0:1763333169.943002:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6b3e9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56786:x1848987613538816:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333169.943256:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6b3e9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56786:x1848987613538816:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 254us (460us total) trans 4294971922 rc 0/0 00000100:00100000:0.0:1763333169.943263:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3024 00000100:00100000:0.0:1763333169.948608:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333169.948691:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613538560 00000100:00100000:3.0:1763333169.948702:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613538560 00000100:00100000:3.0:1763333169.948767:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8868 00000100:00100000:3.0:1763333169.948776:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56788:x1848987613538560:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333169.948799:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333169.948831:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c54008 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968bdd expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.949144:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5400f lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333169.949159:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5400f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.949170:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5400f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.949180:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c54016 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333169.949188:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c54016 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.949194:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c54016 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.949726:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c5401d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333169.949735:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c5401d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.949743:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c5401d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:3.0:1763333169.949755:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x190:0x0]: returning size 0 00010000:00010000:3.0:1763333169.949840:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5400f lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.949848:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5400f lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.949853:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5400f lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.949861:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5400f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.949867:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333169.949871:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5400f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.949879:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5400f lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.949893:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff8016f400) 00010000:00010000:3.0:1763333169.949896:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333169.949901:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5400f lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.949907:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5400f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.949922:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c54016 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.949932:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c54016 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.949937:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c54016 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.949941:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feba00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333169.949944:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c54016 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.949948:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c54016 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.949955:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff8016f200) 00010000:00010000:3.0:1763333169.949958:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333169.949960:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c54016 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.949965:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c54016 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000100:00100000:2.0:1763333169.951187:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333169.951323:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613539072 00000100:00100000:0.0:1763333169.951332:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613539072 00000100:00100000:1.0:1763333169.952306:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3025 00000100:00100000:1.0:1763333169.952327:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56786:x1848987613539072:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1763333169.952641:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56786:x1848987613539072:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 321us (1464us total) trans 4294971924 rc 0/0 00000100:00100000:1.0:1763333169.952650:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3025 00010000:00010000:3.0:1763333169.953688:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c54008 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968bdd expref: 231 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.953723:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c5401d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968bdd expref: 230 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.953733:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92ff8016ff00) 00010000:00010000:3.0:1763333169.953737:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333169.953740:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feb400, rc 0) 00000100:00100000:3.0:1763333169.953781:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56788:x1848987613538560:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 5006us (5183us total) trans 4294971923 rc 0/0 00000100:00100000:3.0:1763333169.953791:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8868 00000100:00100000:3.0:1763333169.968812:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333169.968859:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333169.968997:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613539328 00000100:00100000:0.0:1763333169.969010:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613539328 00000100:00100000:0.0:1763333169.969073:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8869 00000100:00100000:0.0:1763333169.969082:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:55917:x1848987613539328:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333169.969110:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333169.969131:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c5402b lrc: 2/0,0 mode: --/CW res: [0x240000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968be4 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333169.969272:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:0.0:1763333169.969286:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54032 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00000100:00100000:1.0:1763333169.969296:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613539456 00000100:00100000:1.0:1763333169.969302:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613539456 00010000:00010000:0.0:1763333169.969304:0:12741:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c5401d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968bdd expref: 231 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333169.969321:0:12741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54032 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x190:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00000100:00100000:1.0:1763333169.969345:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6168 00000100:00100000:1.0:1763333169.969389:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2418:x1848987613539456:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333169.969397:0:12741:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c5401d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968bdd expref: 231 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333169.969401:0:8406:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333169.969415:0:12741:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c5401d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968bdd expref: 231 pid: 12741 timeout: 1374 lvb_type: 0 00010000:00010000:1.0:1763333169.969421:0:8406:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54039 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968beb expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333169.969433:0:12741:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46e2e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627210112:192.168.204.28@tcp:104: 00002000:00010000:1.0:1763333169.969446:0:8406:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x20e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333169.969466:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333169.969481:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333169.969492:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54039 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968beb expref: 21 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333169.969512:0:8406:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54039 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968beb expref: 21 pid: 8406 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1763333169.969517:0:12741:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4ce84840 going to sleep for 11 seconds 00010000:00010000:1.0:1763333169.969525:0:8406:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f400, rc 0) 00000100:00100000:1.0:1763333169.969560:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2418:x1848987613539456:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 173us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333169.969578:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6168 00000100:00100000:1.0:1763333169.970070:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613539584 00000100:00100000:1.0:1763333169.970076:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613539584 00000100:00100000:1.0:1763333169.970112:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6169 00000100:00100000:1.0:1763333169.970119:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2418:x1848987613539584:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333169.970129:0:29013:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333169.970143:0:29013:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c54040 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968bf2 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333169.970159:0:29013:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x20e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333169.970169:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333169.970171:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333169.970177:0:29013:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c54040 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968bf2 expref: 16 pid: 29013 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333169.970191:0:29013:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c54040 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968bf2 expref: 16 pid: 29013 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333169.970201:0:29013:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7fe00, rc 0) 00000100:00100000:1.0:1763333169.970239:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2418:x1848987613539584:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 119us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333169.970246:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6169 00000100:00100000:0.0:1763333169.981390:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333169.981442:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333169.981893:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613539968 00000100:00100000:2.0:1763333169.981904:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613539968 00000100:00100000:2.0:1763333169.981962:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3026 00000100:00100000:2.0:1763333169.981970:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56788:x1848987613539968:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333169.982213:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56788:x1848987613539968:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 240us (870us total) trans 4294971925 rc 0/0 00000100:00100000:2.0:1763333169.982220:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3026 00000100:00100000:1.0:1763333169.982488:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613539840 00000100:00100000:1.0:1763333169.982494:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613539840 00010000:00010000:1.0:1763333169.982521:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c5401d lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968bdd expref: 233 pid: 12741 timeout: 1374 lvb_type: 0 00000100:00100000:1.0:1763333169.982561:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2909 00000100:00100000:1.0:1763333169.982578:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff4627ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:2421:x1848987613539840:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333169.982591:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333169.982599:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c5401d lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968bdd expref: 233 pid: 12741 timeout: 1374 lvb_type: 0 00010000:00010000:1.0:1763333169.982613:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c5401d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968bdd expref: 233 pid: 12741 timeout: 1374 lvb_type: 0 00010000:00010000:1.0:1763333169.982639:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92ff8016ff00) 00010000:00010000:1.0:1763333169.982644:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54032 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x190:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.982654:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54032 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x190:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.982663:0:6505:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54032 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x190:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333169.982683:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333169.982719:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff4627ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:2421:x1848987613539840:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 151us (1276us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333169.982727:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2909 00010000:00010000:3.0:1763333169.986987:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c5401d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968bdd expref: 232 pid: 12741 timeout: 1374 lvb_type: 0 00000100:00100000:3.0:1763333169.987012:0:12741:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46e2e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627210112:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333169.987075:0:12741:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54032 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x190:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.987086:0:12741:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54032 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x190:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.987092:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54032 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x190:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:3.0:1763333169.987127:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x190:0x0]: returning size 0 00010000:00010000:3.0:1763333169.987297:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c5402b lrc: 0/0,0 mode: --/CW res: [0x240000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968be4 expref: 233 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.987314:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54032 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x190:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968be4 expref: 232 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.987327:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92ff8016ff00) 00010000:00010000:3.0:1763333169.987330:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1763333169.987334:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdf600, rc 0) 00000100:00100000:3.0:1763333169.987473:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:55917:x1848987613539328:12345-192.168.204.28@tcp:101:bash.0 Request processed in 18390us (18673us total) trans 4294971926 rc 0/0 00000100:00100000:3.0:1763333169.987486:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8869 00000100:00100000:2.0:1763333169.991788:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333169.991870:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613540096 00000100:00100000:3.0:1763333169.991882:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613540096 00000100:00100000:3.0:1763333169.991942:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8870 00000100:00100000:3.0:1763333169.991952:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:55917:x1848987613540096:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333169.991986:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333169.992009:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c5404e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968bf9 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.992050:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c54055 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333169.992066:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c54055 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.992078:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c54055 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333169.992190:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c5404e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x190:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968bf9 expref: 234 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.992208:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c54055 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968bf9 expref: 233 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333169.992217:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92ff8016ff00) 00010000:00010000:3.0:1763333169.992221:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763333169.992224:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea000, rc 0) 00000100:00100000:3.0:1763333169.999550:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:55917:x1848987613540096:12345-192.168.204.28@tcp:101:bash.0 Request processed in 7584us (7755us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333169.999578:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8870 00000100:00100000:2.0:1763333169.999777:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333169.999811:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333169.999891:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613540352 00000100:00100000:1.0:1763333169.999902:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613540352 00000100:00100000:1.0:1763333169.999955:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613540608 00000100:00100000:1.0:1763333169.999959:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613540608 00000100:00100000:1.0:1763333169.999999:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8871 00000100:00100000:1.0:1763333170.000009:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:56788:x1848987613540352:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333170.000032:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333170.000057:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5405c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968c00 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.000137:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54063 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333170.000150:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54063 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.000161:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54063 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.000171:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c5406a lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333170.000177:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c5406a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.000185:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c5406a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.000306:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54071 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333170.000316:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54071 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.000323:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54071 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:1.0:1763333170.000334:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x190:0x0]: returning size 0 00010000:00010000:1.0:1763333170.000452:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54063 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.000460:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54063 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.000466:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54063 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.000473:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54063 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.000479:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333170.000484:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54063 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.000491:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54063 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00000100:00100000:3.0:1763333170.000494:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8872 00010000:00010000:1.0:1763333170.000509:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe4388e600) 00010000:00010000:1.0:1763333170.000513:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333170.000521:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54063 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000100:00100000:3.0:1763333170.000527:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:55917:x1848987613540608:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:1.0:1763333170.000533:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54063 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.000548:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c5406a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.000554:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c5406a lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.000559:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c5406a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.000564:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7ea00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333170.000577:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c5406a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.000583:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c5406a lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.000590:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff8016f200) 00010000:00010000:1.0:1763333170.000593:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333170.000596:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c5406a lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.000601:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c5406a lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000100:00080000:1.0:1763333170.000620:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1763333170.000653:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5405c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c00 expref: 238 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.000670:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54071 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c00 expref: 237 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.000679:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92ff8016ff00) 00010000:00010000:1.0:1763333170.000682:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1763333170.000685:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e600, rc 0) 00010000:00010000:3.0:1763333170.000686:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5407f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333170.000700:0:12741:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54071 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c00 expref: 237 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.000709:0:12741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5407f lrc: 4/0,1 mode: --/PW res: [0x240000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00000100:00100000:1.0:1763333170.000740:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56788:x1848987613540352:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 732us (963us total) trans 4294971927 rc 0/0 00010000:00010000:3.0:1763333170.000743:0:12741:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54071 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c00 expref: 237 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333170.000756:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8871 00010000:00010000:3.0:1763333170.000764:0:12741:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54071 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c00 expref: 237 pid: 6519 timeout: 1374 lvb_type: 0 00000100:00100000:3.0:1763333170.000779:0:12741:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e00dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627210240:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333170.002432:0:12741:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff801bc480 going to sleep for 11 seconds 00000100:00100000:0.0:1763333170.011025:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.011122:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613540864 00000100:00100000:1.0:1763333170.011132:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613540864 00000100:00100000:1.0:1763333170.011191:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3027 00000100:00100000:1.0:1763333170.011201:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56788:x1848987613540864:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1763333170.011472:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56788:x1848987613540864:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 271us (458us total) trans 4294971929 rc 0/0 00000100:00100000:1.0:1763333170.011486:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3027 00000100:00100000:2.0:1763333170.011811:0:12741:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e00dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627210240:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333170.011836:0:12741:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5407f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000100:00100000:0.0:1763333170.018303:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.018395:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.018495:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613540992 00000100:00100000:2.0:1763333170.018505:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613540992 00010000:00010000:2.0:1763333170.018558:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54071 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c00 expref: 238 pid: 6519 timeout: 1374 lvb_type: 0 00000100:00100000:2.0:1763333170.018602:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2910 00000100:00100000:2.0:1763333170.018613:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:2418:x1848987613540992:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333170.018630:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333170.018637:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54071 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c00 expref: 238 pid: 6519 timeout: 1374 lvb_type: 0 00010000:00010000:2.0:1763333170.018651:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54071 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c00 expref: 238 pid: 6519 timeout: 1374 lvb_type: 0 00010000:00010000:2.0:1763333170.018674:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54071 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c00 expref: 238 pid: 6519 timeout: 1374 lvb_type: 0 00010000:00010000:2.0:1763333170.018696:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92ff8016ff00) 00000100:00100000:3.0:1763333170.018702:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613541120 00010000:00010000:2.0:1763333170.018703:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5407f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000100:00100000:3.0:1763333170.018710:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613541120 00010000:00010000:2.0:1763333170.018717:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5407f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.018726:0:6504:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5407f lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12741 initiator: MDT1 00000100:00100000:3.0:1763333170.018756:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3028 00010000:00010000:2.0:1763333170.018757:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333170.018769:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56788:x1848987613541120:12345-192.168.204.28@tcp:33:lfs.0 00000100:00100000:2.0:1763333170.018813:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:2418:x1848987613540992:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 200us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333170.018821:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2910 00010000:00010000:2.0:1763333170.018855:0:12741:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5407f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.018863:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5407f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000001:00080000:2.0:1763333170.018950:0:12741:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294971928 00000004:00010000:2.0:1763333170.018999:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f55afb64 reply state 00000000f62d5ec1 transno 4294971930 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5407f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.019013:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5407f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.019019:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92ff8016ff00) 00010000:00010000:2.0:1763333170.019022:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333170.019025:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763333170.019075:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:55917:x1848987613540608:12345-192.168.204.28@tcp:36:bash.0 Request processed in 18570us (19263us total) trans 4294971930 rc 0/0 00000100:00100000:2.0:1763333170.019083:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8872 00000020:00080000:2.0:1763333170.019086:0:12741:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763333170.020133:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56788:x1848987613541120:12345-192.168.204.28@tcp:33:lfs.0 Request processed in 1362us (1777us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333170.020143:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3028 00000100:00100000:3.0:1763333170.024003:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.025496:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613541248 00000100:00100000:2.0:1763333170.025511:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613541248 00000100:00100000:2.0:1763333170.025586:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8873 00000100:00100000:2.0:1763333170.025597:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:55917:x1848987613541248:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333170.025623:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333170.025642:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54086 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968c07 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.025702:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54086 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c07 expref: 239 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.025717:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54086 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c07 expref: 239 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.025734:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92ff8016ff00) 00010000:00010000:2.0:1763333170.025737:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333170.025741:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4a00, rc 0) 00000100:00100000:2.0:1763333170.025819:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:55917:x1848987613541248:12345-192.168.204.28@tcp:101:bash.0 Request processed in 223us (1825us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333170.025826:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8873 00000100:00100000:1.0:1763333170.035527:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.035803:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613541504 00000100:00100000:0.0:1763333170.035816:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613541504 00000100:00100000:0.0:1763333170.035896:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8874 00000100:00100000:0.0:1763333170.035907:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:55917:x1848987613541504:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333170.035930:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333170.035934:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763333170.035965:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54086 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c07 expref: 239 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.035987:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92ff8016ff00) 00010000:00010000:0.0:1763333170.035993:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333170.036006:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c5408d lrc: 2/0,0 mode: --/EX res: [0x240000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968c0e expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.036056:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54094 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333170.036070:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54094 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x190:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.036080:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54094 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x190:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000040:00080000:0.0:1763333170.036310:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1296, 88 off110112 00000004:00080000:0.0:1763333170.036320:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1274115970923ns, next at 1274741674609ns, rc = 0 00000040:00080000:0.0:1763333170.036395:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1297, 88 off110112 00000004:00080000:0.0:1763333170.036403:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1274116053585ns, next at 1274741703917ns, rc = 0 00000040:00080000:0.0:1763333170.036431:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1298, 88 off110200 00000004:00080000:0.0:1763333170.036436:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1274116086861ns, next at 1274741703917ns, rc = 0 00000040:00080000:0.0:1763333170.036446:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1297, 88 off110200 00000004:00080000:0.0:1763333170.036450:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1274116100736ns, next at 1274741674609ns, rc = 0 00000100:00100000:2.0:1763333170.042187:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.042463:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613541760 00000100:00100000:0.0:1763333170.042483:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613541760 00000100:00100000:0.0:1763333170.042549:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8875 00000100:00100000:0.0:1763333170.042561:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56789:x1848987613541760:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333170.042601:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333170.042626:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c5409b lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968c15 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.042718:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c540a2 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333170.042739:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c540a2 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333170.042751:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c540a2 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333170.042763:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c540a9 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333170.042771:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c540a9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333170.042777:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c540a9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333170.042908:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c540b0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333170.042917:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c540b0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333170.042925:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c540b0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:0.0:1763333170.042935:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x190:0x0]: returning size 2 00010000:00010000:0.0:1763333170.043026:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c540b0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333170.043034:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c540b0 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333170.043040:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c540b0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333170.043062:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abde400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333170.043066:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c540b0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333170.043073:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c540b0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333170.043085:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92ff8016ff00) 00010000:00010000:0.0:1763333170.043088:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1763333170.043093:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c540b0 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x190:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333170.043098:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c540b0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x190:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333170.043114:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c540a2 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333170.043120:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c540a2 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333170.043125:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c540a2 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333170.043130:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c540a2 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333170.043135:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdea00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333170.043137:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c540a2 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333170.043142:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c540a2 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333170.043152:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe4345b000) 00010000:00010000:0.0:1763333170.043154:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333170.043157:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c540a2 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333170.043162:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c540a2 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333170.043169:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c540a9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333170.043175:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c540a9 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333170.043179:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c540a9 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333170.043184:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333170.043187:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c540a9 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333170.043192:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c540a9 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333170.043197:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff8016f200) 00010000:00010000:0.0:1763333170.043199:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333170.043201:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c540a9 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333170.043206:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c540a9 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333170.043241:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c5409b lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c15 expref: 243 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.043251:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe4345b000) 00010000:00010000:0.0:1763333170.043254:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763333170.043257:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c5409b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c15 expref: 243 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.043271:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdfe00, rc 0) 00000100:00100000:0.0:1763333170.043341:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:56789:x1848987613541760:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 781us (1165us total) trans 4294971932 rc 301/301 00000001:00080000:1.0:1763333170.044341:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294971931 is committed 00000004:00080000:1.0:1763333170.044364:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 848 committed 00000004:00080000:1.0:1763333170.044373:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 851 committed 00000004:00080000:1.0:1763333170.044379:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 850 committed 00000004:00080000:1.0:1763333170.044382:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 847 committed 00000100:00100000:1.0:1763333170.044530:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe469a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627210368:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763333170.044600:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333170.044640:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1763333170.044646:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe469a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627210496:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763333170.044667:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333170.044697:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe469a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627210624:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333170.044719:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333170.044735:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763333170.044740:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4684ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627210752:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333170.044761:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1763333170.044891:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c53f44 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.044905:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c53f44 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.044913:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c53f44 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.044920:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feaa00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333170.044925:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c53f44 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.044933:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c53f44 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.044950:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff8016f200) 00010000:00010000:2.0:1763333170.044954:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333170.044959:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c53f44 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.044965:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c53f44 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.044983:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53fc9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.044989:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53fc9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.044995:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53fc9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.045000:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333170.045003:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53fc9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.045008:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53fc9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.045015:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff8016f200) 00010000:00010000:2.0:1763333170.045017:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333170.045020:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53fc9 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.045026:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c53fc9 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.045092:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5407f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.045102:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5407f lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.045108:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5407f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.045113:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feba00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333170.045116:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5407f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.045122:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5407f lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.045130:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92ff8016ff00) 00010000:00010000:2.0:1763333170.045133:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333170.045136:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5407f lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.045142:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5407f lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000100:00100000:1.0:1763333170.045497:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627210368 00000100:00100000:1.0:1763333170.045504:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627210368 00000100:00100000:1.0:1763333170.045554:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627210496 00000100:00100000:1.0:1763333170.045557:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627210496 00000100:00100000:1.0:1763333170.045584:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627210624 00000100:00100000:1.0:1763333170.045587:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627210624 00000100:00100000:1.0:1763333170.045602:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627210752 00000100:00100000:1.0:1763333170.045605:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627210752 00000100:00100000:1.0:1763333170.045623:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6170 00000100:00100000:1.0:1763333170.045631:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+16:3654:x1848987627210368:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763333170.045657:0:29013:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:523 count 1 00010000:00010000:1.0:1763333170.045680:0:29013:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c540be lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.045698:0:29013:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c53f13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b97 expref: 15 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.045706:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333170.045708:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333170.045711:0:29013:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c540be lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.045740:0:29013:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c53f13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b97 expref: 15 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.045780:0:29013:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c53f13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b97 expref: 15 pid: 8404 timeout: 1374 lvb_type: 0 00000100:00100000:3.0:1763333170.045789:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e00ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627211392:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333170.045795:0:29013:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:29013:1848987627210880:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333170.045850:0:29013:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7dfd8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1763333170.045873:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6171 00000100:00100000:1.0:1763333170.045881:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+16:3654:x1848987627210496:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763333170.045893:0:28650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:524 count 1 00002000:00010000:1.0:1763333170.045916:0:28650:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x20c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333170.045927:0:28650:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c540c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.045934:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333170.045936:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333170.045941:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c540c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.045953:0:28650:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c540c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.045962:0:28650:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c540c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.045968:0:28650:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c540c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333170.045983:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1763333170.045993:0:28650:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763333170.046007:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763333170.046012:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e00c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627211264:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333170.046035:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333170.046070:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627211392 00000100:00100000:3.0:1763333170.046074:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627211392 00000100:00100000:3.0:1763333170.046092:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627211264 00000100:00100000:3.0:1763333170.046095:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627211264 00000100:00100000:3.0:1763333170.046104:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6172 00000100:00100000:3.0:1763333170.046110:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+17:3652:x1848987627210624:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333170.046214:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+18:3652:x1848987627210624:12345-0@lo:2:osp-syn-1-1.0 Request processed in 101us (1492us total) trans 17179871425 rc 0/0 00000100:00100000:1.0:1763333170.046214:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+18:3654:x1848987627210496:12345-0@lo:6:osp-syn-1-1.0 Request processed in 332us (1544us total) trans 17179871424 rc 0/0 00000100:00100000:3.0:1763333170.046221:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6172 00000100:00100000:0.0:1763333170.046284:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8875 00010000:00010000:0.0:1763333170.046373:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54094 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x190:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c0e expref: 220 pid: 8606 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1763333170.046401:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1763333170.046405:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1763333170.046434:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e00e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627211008:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763333170.046463:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1763333170.046495:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe469a3480/2, rc 0, transno 17179871424 00000100:00100000:2.0:1763333170.046502:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe469a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627210496:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763333170.046510:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1763333170.046515:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e00c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627211136:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763333170.046534:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333170.046553:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627211008 00000100:00100000:2.0:1763333170.046557:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627211008 00000100:00100000:1.0:1763333170.046616:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6171 00000100:00100000:1.0:1763333170.046629:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627211136 00000100:00100000:1.0:1763333170.046632:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627211136 00000100:00100000:1.0:1763333170.046645:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6173 00000100:00100000:1.0:1763333170.046651:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+16:3652:x1848987627210752:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1763333170.046732:0:28650:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x20e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333170.046735:0:28650:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x20e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763333170.046738:0:28650:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x20e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333170.046740:0:28650:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x20e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763333170.046742:0:28650:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x20e:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333170.046782:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+17:3652:x1848987627210752:12345-0@lo:2:osp-syn-1-1.0 Request processed in 130us (2018us total) trans 17179871426 rc 0/0 00000100:00100000:1.0:1763333170.046789:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6173 00000100:00100000:1.0:1763333170.046801:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6174 00000100:00100000:1.0:1763333170.046807:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+34:3653:x1848987627211392:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1763333170.046964:0:28650:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x20e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333170.046967:0:28650:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x20e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763333170.046970:0:28650:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x20e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333170.046972:0:28650:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x20e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763333170.046974:0:28650:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x20e:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333170.047006:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+35:3653:x1848987627211392:12345-0@lo:2:osp-syn-0-1.0 Request processed in 199us (1023us total) trans 21474838730 rc 0/0 00000100:00100000:1.0:1763333170.047017:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6174 00000100:00100000:1.0:1763333170.047036:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6175 00000100:00100000:1.0:1763333170.047093:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff742b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+34:3653:x1848987627211264:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333170.047171:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff742b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+35:3653:x1848987627211264:12345-0@lo:2:osp-syn-0-1.0 Request processed in 128us (1134us total) trans 21474838731 rc 0/0 00000100:00100000:1.0:1763333170.047177:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6175 00000100:00100000:1.0:1763333170.047190:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6176 00000100:00100000:1.0:1763333170.047197:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+34:3654:x1848987627211136:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1763333170.047208:0:28650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:524 count 1 00002000:00010000:1.0:1763333170.047228:0:28650:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x20c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333170.047234:0:28650:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c540cc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.047244:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333170.047246:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333170.047250:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c540cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.047261:0:28650:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c540cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.047269:0:28650:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c540cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.047278:0:28650:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c540cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.047304:0:28650:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1763333170.047520:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92ff8016ff00) 00010000:00010000:0.0:1763333170.047523:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763333170.047539:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c5408d lrc: 0/0,0 mode: --/EX res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c0e expref: 220 pid: 8606 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1763333170.047555:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54094 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x190:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c0e expref: 219 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.047590:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92ff8016ff00) 00010000:00010000:0.0:1763333170.047593:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763333170.047595:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdf400, rc 0) 00000100:00100000:0.0:1763333170.047623:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:55917:x1848987613541504:12345-192.168.204.28@tcp:101:bash.0 Request processed in 11718us (12107us total) trans 4294971931 rc 0/0 00000100:00100000:0.0:1763333170.047629:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8874 00000004:00080000:3.0:1763333170.047943:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4684ed80/2, rc 0, transno 17179871426 00000100:00100000:3.0:1763333170.047950:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4684ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627210752:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763333170.047959:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe469a1880/2, rc 0, transno 17179871425 00000100:00100000:3.0:1763333170.047963:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe469a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627210624:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333170.047979:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6177 00000004:00080000:3.0:1763333170.047984:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7e00c000/2, rc 0, transno 21474838731 00000100:00100000:3.0:1763333170.047988:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e00c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627211264:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333170.047989:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+35:3654:x1848987627211008:12345-0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1763333170.047995:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7e00ca80/2, rc 0, transno 21474838730 00000100:00100000:3.0:1763333170.047998:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e00ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627211392:0@lo:2:osp-syn-0-1.0 00002000:00080000:2.0:1763333170.048015:0:8406:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:523 count 1 00010000:00010000:2.0:1763333170.048032:0:8406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c540d3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.048053:0:8406:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5000/0xb32e3ef184c53f05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b89 expref: 20 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.048060:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333170.048062:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333170.048065:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c540d3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.048098:0:8406:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5000/0xb32e3ef184c53f05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b89 expref: 20 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.048114:0:8406:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5000/0xb32e3ef184c53f05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b89 expref: 20 pid: 29013 timeout: 1374 lvb_type: 0 00000100:00100000:2.0:1763333170.048125:0:8406:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff6bc11880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8406:1848987627211520:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333170.048175:0:8406:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe448ea540 going to sleep for 11 seconds 00010000:00010000:3.0:1763333170.048216:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1763333170.048223:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c540c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.048231:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7ea00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333170.048234:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c540c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.048243:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c540c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.048258:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c540c5 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.048265:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c540c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.048280:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333170.048284:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c540cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.048290:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333170.048293:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c540cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333170.048295:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+35:3654:x1848987627211136:12345-0@lo:6:osp-syn-0-1.0 Request processed in 1098us (1760us total) trans 21474838732 rc 0/0 00010000:00010000:3.0:1763333170.048301:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c540cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333170.048302:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6176 00010000:00010000:3.0:1763333170.048310:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c540cc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.048317:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c540cc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.048319:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333170.048332:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333170.048333:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333170.048335:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763333170.048335:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7e00c700/2, rc 0, transno 21474838732 00000100:00100000:1.0:1763333170.048339:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e00c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627211136:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763333170.052779:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333170.052848:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.052903:0:29013:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:29013:1848987627210880:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333170.052940:0:29013:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c540be lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333170.053041:0:8406:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff6bc11880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8406:1848987627211520:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333170.053065:0:8406:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c540d3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333170.053304:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613541888 00000100:00100000:2.0:1763333170.053313:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613541888 00010000:00010000:2.0:1763333170.053401:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c53f13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b97 expref: 16 pid: 8404 timeout: 1374 lvb_type: 0 00000100:00080000:1.0:1763333170.053429:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1763333170.053444:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613542016 00000100:00100000:2.0:1763333170.053448:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613542016 00010000:00010000:2.0:1763333170.053474:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5000/0xb32e3ef184c53f05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b89 expref: 21 pid: 29013 timeout: 1374 lvb_type: 0 00000100:00100000:2.0:1763333170.053498:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2911 00000100:00100000:2.0:1763333170.053507:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2418:x1848987613541888:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333170.053523:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333170.053528:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c53f13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x20b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b97 expref: 16 pid: 8404 timeout: 1374 lvb_type: 0 00010000:00010000:2.0:1763333170.053541:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c53f13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b97 expref: 16 pid: 8404 timeout: 1374 lvb_type: 0 00010000:00010000:2.0:1763333170.053576:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c53f13 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x20b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b97 expref: 16 pid: 8404 timeout: 1374 lvb_type: 0 00010000:00010000:2.0:1763333170.053593:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333170.053596:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333170.053601:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c540be lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.053611:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c540be lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.053636:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333170.053688:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2418:x1848987613541888:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 182us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333170.053696:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2911 00000100:00100000:2.0:1763333170.053714:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2912 00000100:00100000:2.0:1763333170.053721:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2418:x1848987613542016:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333170.053730:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333170.053735:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5000/0xb32e3ef184c53f05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b89 expref: 21 pid: 29013 timeout: 1374 lvb_type: 0 00010000:00010000:2.0:1763333170.053745:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5000/0xb32e3ef184c53f05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b89 expref: 21 pid: 29013 timeout: 1374 lvb_type: 0 00010000:00010000:2.0:1763333170.053760:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5000/0xb32e3ef184c53f05 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968b89 expref: 21 pid: 29013 timeout: 1374 lvb_type: 0 00010000:00010000:2.0:1763333170.053770:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333170.053772:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333170.053775:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c540d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.053783:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c540d3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.053808:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333170.053829:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2418:x1848987613542016:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 108us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333170.053835:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2912 00000100:00080000:1.0:1763333170.053959:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1763333170.053971:0:29013:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c540be lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.053980:0:29013:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c540be lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.053990:0:29013:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c540be lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.053997:0:29013:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c540be lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.054023:0:29013:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763333170.054288:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+17:3654:x1848987627210368:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8656us (9686us total) trans 17179871427 rc 0/0 00000100:00100000:1.0:1763333170.054297:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6170 00000004:00080000:1.0:1763333170.054466:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe469a3100/2, rc 0, transno 17179871427 00000100:00100000:1.0:1763333170.054473:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe469a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627210368:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1763333170.054545:0:8406:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c540d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.054555:0:8406:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c540d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.054572:0:8406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c540d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.054579:0:8406:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c540d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.054601:0:8406:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1763333170.054702:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1763333170.054710:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c540be lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.054718:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333170.054722:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c540be lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.054730:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c540be lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.054745:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c540be lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333170.054750:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+35:3654:x1848987627211008:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6764us (8286us total) trans 21474838733 rc 0/0 00010000:00010000:3.0:1763333170.054753:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c540be lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333170.054757:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6177 00010000:00010000:3.0:1763333170.054774:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333170.054779:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c540d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.054786:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4a00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333170.054790:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c540d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.054796:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c540d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.054806:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c540d3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.054813:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c540d3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.054825:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333170.054827:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333170.054828:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333170.055733:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763333170.055999:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333170.056041:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000004:00080000:1.0:1763333170.056327:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7e00e680/2, rc 0, transno 21474838733 00000100:00100000:1.0:1763333170.056336:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e00e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627211008:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763333170.056483:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613542144 00000100:00100000:0.0:1763333170.056491:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613542144 00000100:00100000:0.0:1763333170.056547:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6178 00000100:00100000:0.0:1763333170.056556:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:55917:x1848987613542144:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333170.056585:0:8406:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333170.056609:0:8406:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c540da lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968c1c expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763333170.056641:0:8406:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x20d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333170.056668:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333170.056670:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333170.056680:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c540da lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c1c expref: 16 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.056695:0:8406:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c540da lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c1c expref: 16 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.056709:0:8406:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abde200, rc 0) 00000100:00100000:0.0:1763333170.056758:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:55917:x1848987613542144:12345-192.168.204.28@tcp:101:bash.0 Request processed in 203us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333170.056764:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6178 00000100:00100000:2.0:1763333170.057582:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613542272 00000100:00100000:2.0:1763333170.057592:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613542272 00000100:00100000:2.0:1763333170.057643:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8876 00000100:00100000:2.0:1763333170.057652:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:56789:x1848987613542272:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333170.057670:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333170.057688:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c540e1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968c23 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.057793:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c540e8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333170.057808:0:8606:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54032 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x190:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968be4 expref: 220 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.057817:0:8606:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c540e8 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x190:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.057852:0:8606:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54032 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x190:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968be4 expref: 220 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.057872:0:8606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54032 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x190:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968be4 expref: 220 pid: 12741 timeout: 1374 lvb_type: 0 00000100:00100000:2.0:1763333170.057891:0:8606:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff6bc11880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627211648:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333170.057985:0:8606:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe448eab40 going to sleep for 11 seconds 00000100:00100000:3.0:1763333170.061532:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.061664:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613542400 00000100:00100000:1.0:1763333170.061676:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613542400 00000100:00100000:1.0:1763333170.061735:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6179 00000100:00100000:1.0:1763333170.061747:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:55917:x1848987613542400:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333170.061769:0:29013:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333170.061797:0:29013:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c540ef lrc: 2/0,0 mode: --/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968c2a expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333170.061823:0:29013:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x20d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333170.061846:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333170.061849:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333170.061868:0:29013:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c540ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c2a expref: 21 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.061886:0:29013:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c540ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c2a expref: 21 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.061901:0:29013:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7fa00, rc 0) 00000100:00100000:1.0:1763333170.061975:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:55917:x1848987613542400:12345-192.168.204.28@tcp:101:bash.0 Request processed in 230us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333170.061986:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6179 00000100:00100000:0.0:1763333170.064096:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.064192:0:8606:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff6bc11880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627211648:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333170.064221:0:8606:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c540e8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x190:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000100:00100000:3.0:1763333170.064623:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613542528 00000100:00100000:3.0:1763333170.064633:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613542528 00010000:00010000:3.0:1763333170.064670:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54032 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x190:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968be4 expref: 221 pid: 12741 timeout: 1374 lvb_type: 0 00000100:00100000:3.0:1763333170.064708:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2913 00000100:00100000:3.0:1763333170.064717:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:2421:x1848987613542528:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333170.064731:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333170.064737:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54032 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x190:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968be4 expref: 221 pid: 12741 timeout: 1374 lvb_type: 0 00010000:00010000:3.0:1763333170.064756:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54032 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x190:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968be4 expref: 221 pid: 12741 timeout: 1374 lvb_type: 0 00010000:00010000:3.0:1763333170.064778:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54032 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x190:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968be4 expref: 221 pid: 12741 timeout: 1374 lvb_type: 0 00010000:00010000:3.0:1763333170.064796:0:28428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92ff8016ff00) 00010000:00010000:3.0:1763333170.064800:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c540e8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x190:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333170.064810:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c540e8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333170.064818:0:28428:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c540e8 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333170.064853:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333170.064906:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+220:2421:x1848987613542528:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 189us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333170.064914:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2913 00010000:00010000:0.0:1763333170.065293:0:8606:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c540e8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.065303:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c540e8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:0.0:1763333170.065391:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x190:0x0]: returning size 2 00000004:00200000:0.0:1763333170.065396:0:8606:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763333170.065417:0:8606:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c540e8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.065453:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c540e1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c23 expref: 220 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.065468:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c540e8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c23 expref: 219 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.065476:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92ff8016ff00) 00010000:00010000:0.0:1763333170.065479:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333170.065481:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4400, rc 0) 00000100:00100000:0.0:1763333170.065524:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:56789:x1848987613542272:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 7873us (9482us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333170.065531:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8876 00000100:00100000:2.0:1763333170.067153:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.067196:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.067246:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613542784 00000100:00100000:1.0:1763333170.067255:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613542784 00000100:00100000:0.0:1763333170.067261:0:28429:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613542656 00000100:00100000:0.0:1763333170.067264:0:28429:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613542656 00002000:00010000:1.0:1763333170.067293:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/525 (0->18446744073709551615) 00002000:00010000:0.0:1763333170.067293:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/525 (0->18446744073709551615) 00002000:00100000:0.0:1763333170.067297:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff6bc11500 with x1848987613542656 ext(0->18446744073709551615) 00002000:00100000:1.0:1763333170.067298:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff6bc11880 with x1848987613542784 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333170.067310:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff6bc11880. 00002000:00010000:0.0:1763333170.067310:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff6bc11500. 00000100:00100000:0.0:1763333170.067338:0:28429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1542 00000100:00100000:1.0:1763333170.067343:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1543 00000100:00100000:0.0:1763333170.067369:0:28429:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2418:x1848987613542656:12345-192.168.204.28@tcp:10:bash.0 00000100:00100000:1.0:1763333170.067370:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2418:x1848987613542784:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:1.0:1763333170.067520:0:24027:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x20d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333170.067520:0:28429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x20d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333170.067524:0:24027:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x20d:0x0] updating lvb mtime from disk: 0 -> 1763333170 00002000:00010000:0.0:1763333170.067524:0:28429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x20d:0x0] updating lvb mtime from disk: 0 -> 1763333170 00002000:00010000:1.0:1763333170.067527:0:24027:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x20d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333170.067527:0:28429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x20d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333170.067530:0:24027:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x20d:0x0] updating lvb ctime from disk: 0 -> 1763333170 00002000:00010000:0.0:1763333170.067530:0:28429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x20d:0x0] updating lvb ctime from disk: 0 -> 1763333170 00002000:00010000:1.0:1763333170.067533:0:24027:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x20d:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1763333170.067533:0:28429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x20d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333170.067589:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2418:x1848987613542784:12345-192.168.204.28@tcp:10:bash.0 Request processed in 238us (442us total) trans 21474838734 rc 0/0 00000100:00100000:0.0:1763333170.067589:0:28429:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2418:x1848987613542656:12345-192.168.204.28@tcp:10:bash.0 Request processed in 242us (391us total) trans 17179871428 rc 0/0 00000100:00100000:0.0:1763333170.067596:0:28429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1542 00000100:00100000:1.0:1763333170.067599:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1543 00002000:00010000:0.0:1763333170.067599:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/525 (0->18446744073709551615) 00002000:00010000:1.0:1763333170.067601:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/525 (0->18446744073709551615) 00002000:00100000:0.0:1763333170.067602:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff6bc11500 with x1848987613542656 ext(0->18446744073709551615) 00002000:00100000:1.0:1763333170.067604:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff6bc11880 with x1848987613542784 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333170.067606:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff6bc11500. 00002000:00010000:1.0:1763333170.067607:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff6bc11880. 00000100:00100000:2.0:1763333170.071733:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.071825:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613543040 00000100:00100000:0.0:1763333170.071839:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613543040 00000100:00100000:0.0:1763333170.071909:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3029 00000100:00100000:0.0:1763333170.071919:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50064380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:55917:x1848987613543040:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:0.0:1763333170.072549:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50064380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+220:55917:x1848987613543040:12345-192.168.204.28@tcp:35:bash.0 Request processed in 628us (824us total) trans 4294971933 rc 0/0 00000100:00100000:0.0:1763333170.072557:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3029 00000100:00100000:1.0:1763333170.085960:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.086066:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613543296 00000100:00100000:0.0:1763333170.086079:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613543296 00000100:00100000:1.0:1763333170.086728:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3030 00000100:00100000:1.0:1763333170.086743:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6b3ea050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+220:56789:x1848987613543296:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1763333170.086967:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6b3ea050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56789:x1848987613543296:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 227us (1016us total) trans 4294971934 rc 0/0 00000100:00100000:1.0:1763333170.086979:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3030 00000100:00100000:2.0:1763333170.091420:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.091490:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613543424 00000100:00100000:0.0:1763333170.091500:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613543424 00000100:00100000:0.0:1763333170.092090:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8877 00000100:00100000:0.0:1763333170.092103:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50065f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56790:x1848987613543424:12345-192.168.204.28@tcp:101:rm.0 00010000:00010000:0.0:1763333170.092130:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333170.092158:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c540f6 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968c31 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.092235:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c540fd lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333170.092252:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c540fd lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.092264:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c540fd lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.092290:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54104 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333170.092298:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54104 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.092306:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54104 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.092471:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5410b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333170.092484:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5410b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.092490:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5410b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:0.0:1763333170.092536:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x190:0x0]: returning size 5 00000004:00200000:0.0:1763333170.092541:0:8606:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763333170.092573:0:8606:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5410b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.092586:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5410b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.092596:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c540fd lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.092604:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c540fd lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.092611:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c540fd lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.092618:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c540fd lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.092624:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdea00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333170.092628:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c540fd lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.092636:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c540fd lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.092649:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe4345b700) 00010000:00010000:0.0:1763333170.092652:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333170.092656:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c540fd lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.092662:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c540fd lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.092674:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54104 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.092680:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54104 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.092686:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54104 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.092692:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abde400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333170.092695:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54104 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.092700:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54104 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.092706:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe4345b800) 00010000:00010000:0.0:1763333170.092708:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333170.092710:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54104 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.092716:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54104 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.092745:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c540f6 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c31 expref: 223 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.092761:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5410b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c31 expref: 222 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.092769:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92ff8016ff00) 00010000:00010000:0.0:1763333170.092771:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333170.092774:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdee00, rc 0) 00000100:00100000:0.0:1763333170.092829:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50065f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:56790:x1848987613543424:12345-192.168.204.28@tcp:101:rm.0 Request processed in 730us (1421us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333170.092838:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8877 00000100:00100000:0.0:1763333170.097561:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.097776:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613543552 00000100:00100000:2.0:1763333170.097791:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613543552 00000100:00100000:2.0:1763333170.097862:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 403 00000100:00100000:2.0:1763333170.097873:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:2419:x1848987613543552:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333170.097889:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333170.097916:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5410b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c31 expref: 222 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.097936:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92ff8016ff00) 00010000:00010000:2.0:1763333170.097942:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333170.098007:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:2419:x1848987613543552:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 135us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333170.098019:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 403 00000100:00100000:1.0:1763333170.099064:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.099137:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613543680 00000100:00100000:0.0:1763333170.099143:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613543680 00000100:00100000:0.0:1763333170.099189:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8878 00000100:00100000:0.0:1763333170.099198:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56789:x1848987613543680:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333170.099219:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333170.099240:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c54112 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968c38 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.099315:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c54119 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333170.099329:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c54119 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.099340:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c54119 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.099747:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c54120 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333170.099757:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c54120 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.099764:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c54120 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.099853:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c54127 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333170.099863:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c54127 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.099870:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c54127 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:0.0:1763333170.099911:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x190:0x0]: returning size 5 00000004:00200000:0.0:1763333170.099916:0:8606:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763333170.099934:0:8606:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c54127 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.099945:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c54127 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.099957:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c54119 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.099963:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c54119 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.099970:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c54119 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.099982:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c54119 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.099988:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe467be000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333170.099992:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c54119 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.100001:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c54119 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.100012:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe4345b200) 00010000:00010000:0.0:1763333170.100015:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333170.100019:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c54119 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.100025:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c54119 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.100037:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c54120 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.100043:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c54120 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.100047:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c54120 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.100053:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe467bf600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333170.100055:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c54120 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.100061:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c54120 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.100071:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe4345b700) 00010000:00010000:0.0:1763333170.100074:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333170.100076:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c54120 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.100082:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c54120 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.100111:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c54112 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c38 expref: 223 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.100125:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c54127 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c38 expref: 222 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.100131:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92ff8016ff00) 00010000:00010000:0.0:1763333170.100134:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333170.100137:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe467bf200, rc 0) 00000100:00100000:0.0:1763333170.100202:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:56789:x1848987613543680:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1005us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333170.100209:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8878 00000100:00100000:0.0:1763333170.107101:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333170.107197:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613543808 00000100:00100000:3.0:1763333170.107208:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613543808 00000100:00100000:3.0:1763333170.111680:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 404 00000100:00100000:3.0:1763333170.111710:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:2419:x1848987613543808:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333170.111732:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333170.111761:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c54127 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c38 expref: 222 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.111787:0:28428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92ff8016ff00) 00010000:00010000:3.0:1763333170.111793:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333170.111858:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:2419:x1848987613543808:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 163us (4772us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333170.111866:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 404 00000100:00100000:2.0:1763333170.113138:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.113180:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333170.113249:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613544064 00000100:00100000:3.0:1763333170.113259:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613544064 00000100:00100000:3.0:1763333170.113314:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613544320 00000100:00100000:3.0:1763333170.113318:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613544320 00000100:00100000:3.0:1763333170.113337:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8879 00000100:00100000:3.0:1763333170.113344:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50064700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:56789:x1848987613544064:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333170.113385:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333170.113406:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c5412e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968c3f expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.113520:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54135 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333170.113535:0:12741:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c540e8 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c23 expref: 223 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.113545:0:12741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54135 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x190:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333170.113586:0:12741:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c540e8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c23 expref: 223 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.113599:0:12741:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c540e8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c23 expref: 223 pid: 8606 timeout: 1374 lvb_type: 0 00000100:00100000:3.0:1763333170.113614:0:12741:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e00d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627211776:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333170.113679:0:12741:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff801bc240 going to sleep for 11 seconds 00000100:00100000:2.0:1763333170.113744:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8880 00000100:00100000:2.0:1763333170.113756:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50066d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56790:x1848987613544320:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:2.0:1763333170.113781:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1763333170.113798:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54094 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x190:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c0e expref: 223 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.113814:0:6521:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c540e8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c23 expref: 222 pid: 8606 timeout: 1374 lvb_type: 0 00010000:00010000:2.0:1763333170.113827:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c54055 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x190:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968bf9 expref: 222 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.113838:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92ff8016ff00) 00010000:00010000:2.0:1763333170.113842:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54135 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x190:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.113849:0:6521:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54135 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x190:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.113856:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54135 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x190:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.113872:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333170.113891:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5413c lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333170.113899:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5413c lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.113906:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5413c lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.113917:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54143 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333170.113923:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54143 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.113928:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54143 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.114005:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5414a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333170.114013:0:6521:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54135 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x190:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.114020:0:6521:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5414a lrc: 4/0,1 mode: --/EX res: [0x240000404:0x190:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.114031:0:6521:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54135 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x190:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.114040:0:6521:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5414a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x190:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.121028:0:12741:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.204.28@tcp) returned -22 from blocking AST (req@00000000203c38cf x1848987627211776) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c540e8 lrc: 1/0,0 mode: --/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c23 expref: 221 pid: 8606 timeout: 1374 lvb_type: 0 00010000:00010000:3.0:1763333170.121053:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c540e8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c23 expref: 221 pid: 8606 timeout: 1374 lvb_type: 0 00000100:00100000:3.0:1763333170.121069:0:12741:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e00d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627211776:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333170.121104:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92ff8016ff00) 00010000:00010000:3.0:1763333170.121109:0:12741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5414a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x190:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.121117:0:12741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5414a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x190:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.121125:0:12741:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54135 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x190:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333170.121133:0:12741:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54135 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x190:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333170.121138:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54135 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x190:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 12741 initiator: MDT1 00000004:00200000:3.0:1763333170.121164:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x190:0x0]: returning size 5 00010000:00010000:3.0:1763333170.121301:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c5412e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x190:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c3f expref: 222 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.121325:0:12741:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54135 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x190:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c3f expref: 221 pid: 12741 timeout: 1374 lvb_type: 0 00010000:00010000:3.0:1763333170.121333:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54135 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x190:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c3f expref: 221 pid: 12741 timeout: 1374 lvb_type: 0 00010000:00010000:3.0:1763333170.121340:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea800, rc 0) 00000100:00100000:3.0:1763333170.121450:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50064700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56789:x1848987613544064:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 8104us (8315us total) trans 4294971935 rc 0/0 00000100:00100000:3.0:1763333170.121459:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8879 00000100:00100000:1.0:1763333170.127944:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.128042:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.128188:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613544576 00000100:00100000:2.0:1763333170.128199:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613544576 00010000:00010000:2.0:1763333170.128242:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54135 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x190:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c3f expref: 221 pid: 12741 timeout: 1374 lvb_type: 0 00000100:00100000:2.0:1763333170.128293:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2914 00000100:00100000:2.0:1763333170.128304:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff4627e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:2418:x1848987613544576:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333170.128321:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333170.128329:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54135 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x190:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c3f expref: 221 pid: 12741 timeout: 1374 lvb_type: 0 00010000:00010000:2.0:1763333170.128343:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54135 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x190:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c3f expref: 221 pid: 12741 timeout: 1374 lvb_type: 0 00010000:00010000:2.0:1763333170.128414:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54135 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x190:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c3f expref: 221 pid: 12741 timeout: 1374 lvb_type: 0 00010000:00010000:2.0:1763333170.128432:0:28428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92ff8016ff00) 00010000:00010000:2.0:1763333170.128437:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5414a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x190:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.128445:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5414a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x190:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.128452:0:28428:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5414a lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x190:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.128489:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333170.128516:0:6521:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5414a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x190:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.128527:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5414a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x190:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000100:00100000:2.0:1763333170.128539:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff4627e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+220:2418:x1848987613544576:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 236us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333170.128547:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2914 00000004:00080000:0.0:1763333170.128807:0:6521:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x190:0x0] is inserted into orphan list, open count = 1 00010000:00010000:0.0:1763333170.128892:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5414a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x190:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.128901:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5414a lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x190:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.128909:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5414a lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x190:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.128915:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333170.128920:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5414a lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x190:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.128928:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5414a lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x190:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.128937:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92ff8016ff00) 00010000:00010000:0.0:1763333170.128939:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1763333170.128943:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5414a lrc: 2/0,0 mode: --/EX res: [0x240000404:0x190:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.128950:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5414a lrc: 0/0,0 mode: --/EX res: [0x240000404:0x190:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.128970:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5413c lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.128975:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5413c lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.128980:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5413c lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.128986:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5413c lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.128991:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333170.128994:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5413c lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.129000:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5413c lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.129007:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff44d03800) 00010000:00010000:0.0:1763333170.129010:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333170.129012:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5413c lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.129018:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5413c lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000004:00010000:0.0:1763333170.129032:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005a349165 reply state 00000000f5df394f transno 4294971936 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54143 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.129043:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54143 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.129050:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff44d03200) 00010000:00010000:0.0:1763333170.129052:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333170.129055:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763333170.129115:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50066d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56790:x1848987613544320:12345-192.168.204.28@tcp:36:rm.0 Request processed in 15362us (15933us total) trans 4294971936 rc 0/0 00000100:00100000:0.0:1763333170.129123:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8880 00000100:00100000:0.0:1763333170.129143:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613544448 00000100:00100000:0.0:1763333170.129146:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613544448 00000100:00100000:0.0:1763333170.129190:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8881 00000100:00100000:0.0:1763333170.129199:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56789:x1848987613544448:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333170.129216:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333170.129235:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c54158 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968c46 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.129315:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c5415f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333170.129325:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c5415f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.129333:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c5415f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:0.0:1763333170.129386:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x190:0x0]: returning size 5 00000004:00200000:0.0:1763333170.129391:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763333170.129409:0:6521:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c5415f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.129431:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c54158 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c46 expref: 223 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.129445:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c5415f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c46 expref: 222 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.129453:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92fe4345b200) 00010000:00010000:0.0:1763333170.129455:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1763333170.129458:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe467be000, rc 0) 00000100:00100000:0.0:1763333170.129488:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:56789:x1848987613544448:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 289us (1555us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333170.129495:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8881 00000100:00100000:2.0:1763333170.141030:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.141140:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613544832 00000100:00100000:1.0:1763333170.141150:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613544832 00000100:00100000:1.0:1763333170.143723:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8882 00000100:00100000:1.0:1763333170.143739:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50065180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:56789:x1848987613544832:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333170.143762:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333170.143785:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54166 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968c4d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.143915:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5416d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333170.143930:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5416d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x190:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.143940:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5416d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x190:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:1.0:1763333170.143953:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x190:0x0]: returning size 5 00010000:00010000:1.0:1763333170.144063:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54166 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x190:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c4d expref: 225 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.144082:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5416d lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x190:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c4d expref: 224 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.144091:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92fe4345b200) 00010000:00010000:1.0:1763333170.144094:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763333170.144098:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7fc00, rc 0) 00000100:00100000:1.0:1763333170.144182:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50065180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56789:x1848987613544832:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 448us (3168us total) trans 4294971937 rc 0/0 00000100:00100000:1.0:1763333170.144191:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8882 00000100:00100000:1.0:1763333170.150779:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.150882:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.150997:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613544960 00000100:00100000:0.0:1763333170.151008:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613544960 00000100:00100000:0.0:1763333170.151074:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6180 00000100:00100000:0.0:1763333170.151085:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2420:x1848987613544960:12345-192.168.204.28@tcp:1:lfs.0 00010000:00010000:0.0:1763333170.151132:0:8406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c5417b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.151152:0:8406:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c540da lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c1c expref: 17 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.151161:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333170.151163:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333170.151167:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c5417b lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.151204:0:8406:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c540da lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c1c expref: 17 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.151218:0:8406:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c540da lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c1c expref: 17 pid: 8406 timeout: 1374 lvb_type: 0 00000100:00100000:0.0:1763333170.151233:0:8406:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46e2e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8406:1848987627211904:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333170.151325:0:8406:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4ce84780 going to sleep for 11 seconds 00000100:00100000:2.0:1763333170.151556:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613545088 00000100:00100000:2.0:1763333170.151562:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613545088 00000100:00100000:2.0:1763333170.151613:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8883 00000100:00100000:2.0:1763333170.151621:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56792:x1848987613545088:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333170.151640:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333170.151657:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54182 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968c54 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.151739:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54189 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333170.151751:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54189 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333170.151763:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54189 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333170.151775:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54190 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333170.151783:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54190 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333170.151788:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54190 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333170.151828:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54189 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333170.151835:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54189 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333170.151840:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54189 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333170.151847:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54189 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333170.151852:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333170.151858:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54189 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333170.151867:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54189 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333170.151878:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff44d03700) 00010000:00010000:2.0:1763333170.151881:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333170.151885:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54189 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333170.151890:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54189 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333170.151901:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54190 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333170.151907:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54190 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333170.151912:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54190 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333170.151917:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333170.151919:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54190 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333170.151924:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54190 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333170.151931:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff44d03200) 00010000:00010000:2.0:1763333170.151934:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333170.151936:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54190 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333170.151946:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54190 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333170.151974:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54182 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c54 expref: 225 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.151983:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff44d03700) 00010000:00010000:2.0:1763333170.151985:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333170.151988:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54182 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c54 expref: 225 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.152000:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5400, rc 0) 00000100:00100000:2.0:1763333170.152896:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56792:x1848987613545088:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1269us (2007us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333170.152906:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8883 00000100:00100000:1.0:1763333170.155486:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.155612:0:8406:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46e2e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8406:1848987627211904:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333170.155642:0:8406:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c5417b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333170.155714:0:28430:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613545216 00000100:00100000:3.0:1763333170.155723:0:28430:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613545216 00002000:00100000:3.0:1763333170.155780:0:28430:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x2c0000400:0x20d:0x0] (0->4) req@ffff92fe472f4700 x1848987613545216/t0(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:481/0 lens 496/0 e 0 to 0 dl 1763333181 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763333170.155790:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe472f4700 with x1848987613545216 ext(0->4) 00010000:00010000:3.0:1763333170.155799:0:28430:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c540da lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c1c expref: 18 pid: 8406 timeout: 1374 lvb_type: 0 00010000:00010000:3.0:1763333170.155813:0:28430:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c540da lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c1c expref: 18 pid: 8406 timeout: 1374 lvb_type: 0 00002000:00010000:3.0:1763333170.155821:0:28430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92fe472f4700 00000100:00100000:3.0:1763333170.155854:0:28430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 99 00000100:00100000:3.0:1763333170.155864:0:28430:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2420:x1848987613545216:12345-192.168.204.28@tcp:4:bash.0 00000100:00100000:3.0:1763333170.164245:0:28430:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2420:x1848987613545216:12345-192.168.204.28@tcp:4:bash.0 Request processed in 8367us (8752us total) trans 17179871429 rc 0/0 00000100:00100000:3.0:1763333170.164262:0:28430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 99 00002000:00100000:3.0:1763333170.164276:0:28430:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x2c0000400:0x20d:0x0] (0->4) req@ffff92fe472f4700 x1848987613545216/t17179871429(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:481/0 lens 496/448 e 0 to 0 dl 1763333181 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763333170.164287:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe472f4700 with x1848987613545216 ext(0->4) 00010000:00010000:3.0:1763333170.164297:0:28430:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c540da lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c1c expref: 20 pid: 8406 timeout: 1374 lvb_type: 0 00010000:00010000:3.0:1763333170.164322:0:28430:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c540da lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c1c expref: 20 pid: 8406 timeout: 1374 lvb_type: 0 00002000:00010000:3.0:1763333170.164331:0:28430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92fe472f4700 00000100:00100000:1.0:1763333170.164624:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333170.165332:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613545344 00000100:00100000:3.0:1763333170.165342:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613545344 00000100:00100000:3.0:1763333170.165420:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8884 00000100:00100000:3.0:1763333170.165429:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56792:x1848987613545344:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333170.165448:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333170.165471:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c54197 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968c5b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.165539:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5419e lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333170.165553:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5419e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.165576:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5419e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.165591:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c541a5 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333170.165599:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c541a5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.165604:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c541a5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.165642:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5419e lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.165648:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5419e lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.165654:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5419e lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.165660:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5419e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.165665:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333170.165668:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5419e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.165675:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5419e lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.165686:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff8016f400) 00010000:00010000:3.0:1763333170.165689:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333170.165694:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5419e lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.165699:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5419e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.165712:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c541a5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.165717:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c541a5 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.165721:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c541a5 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.165726:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333170.165728:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c541a5 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.165733:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c541a5 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.165738:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff44d03200) 00010000:00010000:3.0:1763333170.165740:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333170.165743:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c541a5 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.165749:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c541a5 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.165774:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c54197 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c5b expref: 225 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.165784:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff8016f400) 00010000:00010000:3.0:1763333170.165786:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333170.165790:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c54197 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c5b expref: 225 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.165807:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feb400, rc 0) 00000100:00100000:3.0:1763333170.165865:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56792:x1848987613545344:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 437us (1241us total) trans 0 rc 301/301 00000100:00100000:3.0:1763333170.165872:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8884 00000100:00100000:1.0:1763333170.168083:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.168187:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613545472 00000100:00100000:0.0:1763333170.168198:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613545472 00000100:00100000:0.0:1763333170.168252:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8885 00000100:00100000:0.0:1763333170.168260:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56792:x1848987613545472:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333170.168278:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333170.168299:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c541ac lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968c62 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.168372:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c541b3 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333170.168384:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c541b3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.168394:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c541b3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:0.0:1763333170.168434:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1763333170.168439:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763333170.168469:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c541ac lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c62 expref: 226 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.168485:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c541b3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c62 expref: 225 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.168493:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe4345b700) 00010000:00010000:0.0:1763333170.168497:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1763333170.168500:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdfe00, rc 0) 00000100:00100000:0.0:1763333170.168551:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56792:x1848987613545472:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 292us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333170.168558:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8885 00000100:00100000:1.0:1763333170.170639:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.170729:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613545600 00000100:00100000:2.0:1763333170.170738:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613545600 00010000:00010000:2.0:1763333170.170772:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c540da lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c1c expref: 20 pid: 8406 timeout: 1374 lvb_type: 0 00000100:00100000:2.0:1763333170.170806:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2915 00000100:00100000:2.0:1763333170.170814:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2418:x1848987613545600:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333170.170830:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1763333170.170846:0:28428:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x20d:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:2.0:1763333170.170849:0:28428:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x20d:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1763333170.170855:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c540da lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x20d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c1c expref: 20 pid: 8406 timeout: 1374 lvb_type: 0 00010000:00010000:2.0:1763333170.170874:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c540da lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c1c expref: 20 pid: 8406 timeout: 1374 lvb_type: 0 00010000:00010000:2.0:1763333170.170896:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c540da lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x20d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c1c expref: 20 pid: 8406 timeout: 1374 lvb_type: 0 00010000:00010000:2.0:1763333170.170912:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333170.170914:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333170.170919:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c5417b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.170929:0:28428:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c5417b lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.170966:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333170.171012:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2418:x1848987613545600:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 198us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333170.171019:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2915 00010000:00010000:1.0:1763333170.171661:0:8406:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c5417b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.171672:0:8406:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c5417b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.171693:0:8406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c5417b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.171701:0:8406:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c5417b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.171709:0:8406:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c5417b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.171717:0:8406:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe467bf200 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333170.171721:0:8406:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c5417b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.171731:0:8406:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c5417b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.171745:0:8406:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c5417b lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.171752:0:8406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c5417b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333170.171820:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2420:x1848987613544960:12345-192.168.204.28@tcp:1:lfs.0 Request processed in 20735us (21050us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333170.171831:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6180 00000100:00100000:1.0:1763333170.180753:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.180865:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.180956:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613545728 00000100:00100000:0.0:1763333170.180967:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613545728 00000100:00100000:0.0:1763333170.181020:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613545984 00000100:00100000:0.0:1763333170.181023:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613545984 00000100:00100000:0.0:1763333170.181052:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8886 00000100:00100000:0.0:1763333170.181061:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56792:x1848987613545728:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333170.181082:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333170.181104:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c541ba lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968c69 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333170.181130:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8887 00000100:00100000:3.0:1763333170.181143:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74039c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56789:x1848987613545984:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:3.0:1763333170.181173:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333170.181174:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c541c1 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333170.181189:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c541c1 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.181197:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c5415f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c46 expref: 227 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.181201:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c541c1 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.181219:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c541c8 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333170.181226:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c541c8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.181228:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92fe4345b200) 00010000:00010000:0.0:1763333170.181237:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c541c8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.181238:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333170.181265:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c541cf lrc: 3/0,1 mode: --/EX res: [0x240000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333170.181276:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c541cf lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333170.181278:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c541c1 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.181291:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c541cf lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333170.181291:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c541c1 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.181309:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c541c1 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.181320:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c541c1 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.181326:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdee00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333170.181330:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c541c1 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.181338:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c541c1 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.181369:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe4345b700) 00010000:00010000:0.0:1763333170.181372:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333170.181376:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c541c1 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.181382:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c541c1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.181393:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c541c8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.181399:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c541c8 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.181405:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c541c8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.181410:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333170.181414:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c541c8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.181420:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c541c8 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.181431:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff44d03200) 00010000:00010000:0.0:1763333170.181433:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333170.181436:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c541c8 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.181441:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c541c8 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.181465:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c541ba lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c69 expref: 226 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.181474:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe4345b700) 00010000:00010000:0.0:1763333170.181476:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333170.181480:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c541ba lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c69 expref: 226 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.181490:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdf600, rc 0) 00000040:00080000:3.0:1763333170.181534:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1298, 88 off110288 00000100:00100000:0.0:1763333170.181543:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56792:x1848987613545728:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 482us (801us total) trans 0 rc 301/301 00000004:00080000:3.0:1763333170.181544:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1274261193558ns, next at 1274741674609ns, rc = 0 00000100:00100000:0.0:1763333170.181555:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8886 00000040:00080000:3.0:1763333170.181605:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1299, 88 off110288 00000004:00080000:3.0:1763333170.181612:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1274261262876ns, next at 1274741703917ns, rc = 0 00000040:00080000:3.0:1763333170.181660:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1300, 88 off110376 00000004:00080000:3.0:1763333170.181665:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1274261316351ns, next at 1274741703917ns, rc = 0 00000040:00080000:3.0:1763333170.181700:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1299, 88 off110376 00000004:00080000:3.0:1763333170.181706:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1274261356393ns, next at 1274741674609ns, rc = 0 00000001:00080000:2.0:1763333170.184821:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294971938 is committed 00000004:00080000:2.0:1763333170.184834:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 850 committed 00000004:00080000:2.0:1763333170.184852:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 853 committed 00000004:00080000:2.0:1763333170.184866:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 852 committed 00000004:00080000:2.0:1763333170.184869:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 849 committed 00000100:00100000:3.0:1763333170.185025:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e00dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627212160:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333170.185026:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e00d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627212032:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333170.185130:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333170.185238:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627212032 00000100:00100000:1.0:1763333170.185246:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627212032 00000100:00100000:1.0:1763333170.185306:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6181 00000100:00100000:1.0:1763333170.185315:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50067800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+35:3654:x1848987627212032:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1763333170.185490:0:8406:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x20d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333170.185494:0:8406:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x20d:0x0] updating lvb mtime from disk: 1763333170 -> 1763333170 00002000:00010000:1.0:1763333170.185497:0:8406:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x20d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333170.185499:0:8406:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x20d:0x0] updating lvb ctime from disk: 1763333170 -> 1763333170 00002000:00010000:1.0:1763333170.185501:0:8406:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x20d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333170.185540:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50067800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+36:3654:x1848987627212032:12345-0@lo:2:osp-syn-0-1.0 Request processed in 225us (410us total) trans 21474838735 rc 0/0 00000100:00100000:1.0:1763333170.185552:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6181 00000004:00080000:2.0:1763333170.185667:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7e00d880/2, rc 0, transno 21474838735 00000100:00100000:2.0:1763333170.185674:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e00d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627212032:0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1763333170.185920:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54143 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00000100:00100000:3.0:1763333170.185922:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1763333170.185936:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54143 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.185947:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54143 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.185954:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333170.185961:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54143 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.185970:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54143 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00000100:00100000:3.0:1763333170.185972:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4399b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627212288:0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1763333170.185992:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff44d03200) 00010000:00010000:0.0:1763333170.185996:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333170.186003:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54143 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000100:00100000:3.0:1763333170.186012:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1763333170.186015:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54143 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000100:00100000:3.0:1763333170.186045:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763333170.186052:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe43998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627212416:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333170.186072:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333170.186095:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627212160 00000100:00100000:2.0:1763333170.186101:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627212160 00000100:00100000:2.0:1763333170.186130:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627212288 00000100:00100000:2.0:1763333170.186133:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627212288 00000004:00010000:3.0:1763333170.186139:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005675f843 reply state 000000001e5efdbc transno 4294971938 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c541cf lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000100:00100000:2.0:1763333170.186159:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627212416 00010000:00010000:3.0:1763333170.186160:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c541cf lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00000100:00100000:2.0:1763333170.186164:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627212416 00010000:00010000:3.0:1763333170.186173:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92fe4345b200) 00010000:00010000:3.0:1763333170.186176:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1763333170.186179:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763333170.186187:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6182 00000100:00100000:2.0:1763333170.186197:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+36:3655:x1848987627212160:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333170.186205:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6183 00000100:00100000:3.0:1763333170.186215:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+18:3652:x1848987627212288:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1763333170.186276:0:29013:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x20e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333170.186281:0:29013:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x20e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1763333170.186283:0:29013:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x20e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333170.186285:0:29013:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x20e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1763333170.186287:0:29013:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x20e:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333170.186321:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+19:3652:x1848987627212288:12345-0@lo:2:osp-syn-1-1.0 Request processed in 108us (312us total) trans 17179871430 rc 0/0 00000100:00100000:3.0:1763333170.186328:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6183 00000100:00100000:2.0:1763333170.186333:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+37:3655:x1848987627212160:12345-0@lo:2:osp-syn-0-1.0 Request processed in 136us (410us total) trans 21474838736 rc 0/0 00000100:00100000:2.0:1763333170.186341:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6182 00000100:00100000:3.0:1763333170.186366:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6184 00000100:00100000:3.0:1763333170.186374:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+18:3652:x1848987627212416:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1763333170.186417:0:8611:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x20e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333170.186420:0:8611:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x20e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763333170.186423:0:8611:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x20e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333170.186425:0:8611:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x20e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763333170.186427:0:8611:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x20e:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333170.186447:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+19:3652:x1848987627212416:12345-0@lo:2:osp-syn-1-1.0 Request processed in 75us (375us total) trans 17179871431 rc 0/0 00000100:00100000:3.0:1763333170.186453:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6184 00000004:00080000:3.0:1763333170.186480:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe43998000/2, rc 0, transno 17179871431 00000100:00100000:3.0:1763333170.186484:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe43998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627212416:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763333170.186491:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4399b800/2, rc 0, transno 17179871430 00000100:00100000:3.0:1763333170.186494:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4399b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627212288:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763333170.186506:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7e00dc00/2, rc 0, transno 21474838736 00000100:00100000:3.0:1763333170.186509:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e00dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627212160:0@lo:2:osp-syn-0-1.0 00010000:00080000:3.0:1763333170.186589:0:6519:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1763333170.186603:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74039c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+218:56789:x1848987613545984:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 5463us (5737us total) trans 4294971938 rc 0/0 00000100:00100000:3.0:1763333170.186610:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8887 00010000:00010000:3.0:1763333170.186629:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c541cf lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.186636:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c541cf lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.186642:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c541cf lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.186647:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feba00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333170.186649:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c541cf lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.186658:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c541cf lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.186666:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92fe4345b200) 00010000:00010000:3.0:1763333170.186669:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763333170.186672:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c541cf lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.186677:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c541cf lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000100:00100000:1.0:1763333170.191198:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333170.191292:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613546240 00000100:00100000:3.0:1763333170.191302:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613546240 00000100:00100000:1.0:1763333170.193671:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8888 00000100:00100000:1.0:1763333170.193696:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+217:56792:x1848987613546240:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333170.193722:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333170.193725:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763333170.193758:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c541b3 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c62 expref: 217 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.193781:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe4345b700) 00010000:00010000:1.0:1763333170.193794:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333170.193814:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c541d6 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968c70 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.193943:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c541dd lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333170.193959:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c541dd lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.193971:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c541dd lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.193986:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c541e4 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333170.193993:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c541e4 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.194000:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c541e4 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.196014:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c541eb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x191:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333170.196039:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c541eb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.196050:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c541eb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:1.0:1763333170.196064:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x191:0x0]: returning size 0 00010000:00010000:1.0:1763333170.196097:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c541dd lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.196104:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c541dd lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.196110:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c541dd lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.196117:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c541dd lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.196123:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333170.196127:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c541dd lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.196135:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c541dd lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.196149:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe4388e500) 00010000:00010000:1.0:1763333170.196152:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333170.196157:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c541dd lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.196168:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c541dd lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000004:00010000:1.0:1763333170.196182:0:8606:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000abd3c6fb reply state 000000002a79b7de transno 4294971939 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c541e4 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.196193:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c541e4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.196200:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe4388e400) 00010000:00010000:1.0:1763333170.196202:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333170.196205:0:8606:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763333170.196254:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c541d6 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c70 expref: 219 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.196274:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c541eb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c70 expref: 218 pid: 8606 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333170.196654:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333170.199027:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613546368 00000100:00100000:3.0:1763333170.199040:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613546368 00000100:00100000:3.0:1763333170.199106:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8889 00000100:00100000:3.0:1763333170.199115:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:56789:x1848987613546368:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333170.199140:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333170.199162:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c541f9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968c77 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.199215:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c541f9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c77 expref: 220 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.199228:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c541f9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c77 expref: 220 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.199255:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92fe4345b200) 00010000:00010000:3.0:1763333170.199258:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763333170.199261:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feb400, rc 0) 00000100:00100000:3.0:1763333170.199326:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+220:56789:x1848987613546368:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 212us (2674us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333170.199333:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8889 00010000:00010000:1.0:1763333170.199788:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x191:0x0].0x0 (ffff92fe4388e600) 00010000:00010000:1.0:1763333170.199790:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333170.199793:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f200, rc 0) 00000100:00100000:1.0:1763333170.200132:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+220:56792:x1848987613546240:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 6447us (8942us total) trans 4294971939 rc 0/0 00000100:00100000:1.0:1763333170.200140:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8888 00000100:00100000:0.0:1763333170.204640:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.208071:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613546496 00000100:00100000:2.0:1763333170.208090:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613546496 00000100:00100000:2.0:1763333170.208179:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8890 00000100:00100000:2.0:1763333170.208190:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+220:56789:x1848987613546496:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333170.208213:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333170.208246:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c54200 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968c7e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.208333:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54207 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333170.208369:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54207 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333170.208384:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54207 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:2.0:1763333170.208431:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x190:0x0]: returning size 5 00000004:00200000:2.0:1763333170.208436:0:6519:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763333170.208454:0:6519:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54207 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333170.208478:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c54200 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c7e expref: 222 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.208501:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54207 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c7e expref: 221 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.208511:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92fe4345b200) 00010000:00010000:2.0:1763333170.208513:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1763333170.208517:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4800, rc 0) 00000100:00100000:2.0:1763333170.208599:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56789:x1848987613546496:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 411us (3969us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333170.208608:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8890 00000100:00100000:3.0:1763333170.209573:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.209638:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613546752 00000100:00100000:1.0:1763333170.209645:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613546752 00000100:00100000:1.0:1763333170.209685:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8891 00000100:00100000:1.0:1763333170.209695:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56792:x1848987613546752:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333170.209714:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333170.209730:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5420e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x191:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968c85 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.209805:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54215 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x191:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333170.209818:0:8606:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c541eb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c70 expref: 222 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.209827:0:8606:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54215 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x191:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.209859:0:8606:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c541eb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c70 expref: 222 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.209873:0:8606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c541eb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c70 expref: 222 pid: 8606 timeout: 1374 lvb_type: 0 00000100:00100000:1.0:1763333170.209887:0:8606:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e120000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627212544:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333170.209961:0:8606:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe46e0e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763333170.213742:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.214249:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613546880 00000100:00100000:0.0:1763333170.214258:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613546880 00000100:00100000:0.0:1763333170.214318:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6185 00000100:00100000:0.0:1763333170.214328:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2421:x1848987613546880:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333170.214371:0:28600:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333170.214394:0:28600:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5421c lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968c8c expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763333170.214419:0:28600:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x20d:0x0] initial LVB size: 5, mtime: 0x691a5432, atime: 0x0, ctime: 0x691a5432, blocks: 0x8 00010000:00010000:0.0:1763333170.214438:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333170.214440:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333170.214450:0:28600:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5421c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c8c expref: 19 pid: 28600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333170.214466:0:28600:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5421c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c8c expref: 19 pid: 28600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333170.214480:0:28600:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdf200, rc 0) 00000100:00100000:0.0:1763333170.214537:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2421:x1848987613546880:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 210us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333170.214544:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6185 00000100:00100000:2.0:1763333170.218984:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.219079:0:8606:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e120000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627212544:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333170.219111:0:8606:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54215 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x191:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000100:00100000:0.0:1763333170.219197:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613547008 00000100:00100000:0.0:1763333170.219205:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613547008 00010000:00010000:0.0:1763333170.219245:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c541eb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c70 expref: 223 pid: 8606 timeout: 1374 lvb_type: 0 00000100:00100000:0.0:1763333170.219285:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2916 00000100:00100000:0.0:1763333170.219294:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50065c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:2420:x1848987613547008:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333170.219310:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333170.219317:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c541eb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c70 expref: 223 pid: 8606 timeout: 1374 lvb_type: 0 00010000:00010000:0.0:1763333170.219329:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c541eb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c70 expref: 223 pid: 8606 timeout: 1374 lvb_type: 0 00010000:00010000:0.0:1763333170.219377:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c541eb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c70 expref: 223 pid: 8606 timeout: 1374 lvb_type: 0 00010000:00010000:0.0:1763333170.219402:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x191:0x0].0x0 (ffff92fe4388e600) 00010000:00010000:0.0:1763333170.219407:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54215 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x191:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.219417:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54215 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x191:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.219426:0:6505:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54215 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x191:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.219455:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333170.219510:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50065c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:2420:x1848987613547008:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 217us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333170.219517:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2916 00010000:00010000:1.0:1763333170.219780:0:8606:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54215 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x191:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.219788:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54215 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x191:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:1.0:1763333170.219813:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x191:0x0]: returning size 0 00000004:00080000:1.0:1763333170.219969:0:8606:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x20f:0x0], index 0: 0 00000004:00080000:1.0:1763333170.219975:0:8606:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x20f:0x0], index 1: 0 00000004:00080000:1.0:1763333170.219980:0:8606:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x210:0x0], index 1: 0 00000004:00080000:1.0:1763333170.219984:0:8606:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x210:0x0], index 0: 0 00010000:00010000:1.0:1763333170.220095:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54215 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x191:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.220104:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54215 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x191:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.220110:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54215 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x191:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.220117:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333170.220121:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54215 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x191:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.220128:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54215 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x191:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.220138:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x191:0x0].0x0 (ffff92fe4388e600) 00010000:00010000:1.0:1763333170.220141:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763333170.220145:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54215 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x191:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.220150:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54215 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x191:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.220196:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5420e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x191:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c85 expref: 222 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.220205:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x191:0x0].0x0 (ffff92fe4388e600) 00010000:00010000:1.0:1763333170.220208:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763333170.220211:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5420e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x191:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c85 expref: 222 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.220225:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7ec00, rc 0) 00000100:00100000:1.0:1763333170.220443:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56792:x1848987613546752:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 10749us (10884us total) trans 4294971940 rc 301/301 00000100:00100000:1.0:1763333170.220451:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8891 00000100:00100000:2.0:1763333170.230553:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.230940:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613547264 00000100:00100000:0.0:1763333170.230954:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613547264 00000100:00100000:0.0:1763333170.231033:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3031 00000100:00100000:0.0:1763333170.231046:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50064380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56792:x1848987613547264:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333170.231908:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50064380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:56792:x1848987613547264:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 858us (1360us total) trans 4294971941 rc 0/0 00000100:00100000:0.0:1763333170.231919:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3031 00000100:00100000:3.0:1763333170.234428:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.235293:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613547520 00000100:00100000:1.0:1763333170.235306:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613547520 00000100:00100000:1.0:1763333170.235407:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3032 00000100:00100000:1.0:1763333170.235422:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:56792:x1848987613547520:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1763333170.235698:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56792:x1848987613547520:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 278us (1280us total) trans 4294971942 rc 0/0 00000100:00100000:1.0:1763333170.235707:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3032 00000100:00100000:2.0:1763333170.244936:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.245399:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613547776 00000100:00100000:1.0:1763333170.245413:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613547776 00000100:00100000:1.0:1763333170.245485:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8892 00000100:00100000:1.0:1763333170.245495:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:55917:x1848987613547776:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333170.245520:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333170.245545:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5422a lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968c93 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.245725:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54231 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333170.245742:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54231 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.245758:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54231 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.245772:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54238 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333170.245780:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54238 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.245786:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54238 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.245866:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5423f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x191:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333170.245874:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5423f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.245881:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5423f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:1.0:1763333170.245894:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x191:0x0]: returning size 0 00010000:00010000:1.0:1763333170.246006:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54231 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.246015:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54231 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.246022:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54231 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.246029:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54231 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.246035:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333170.246039:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54231 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.246051:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54231 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.246065:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe4388e600) 00010000:00010000:1.0:1763333170.246069:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333170.246074:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54231 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.246080:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54231 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.246093:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54238 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.246099:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54238 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.246104:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54238 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.246109:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7ea00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333170.246111:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54238 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.246116:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54238 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.246122:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe4388e400) 00010000:00010000:1.0:1763333170.246124:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333170.246126:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54238 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.246132:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54238 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.247557:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5422a lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c93 expref: 226 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.247601:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5423f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c93 expref: 225 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.247611:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x191:0x0].0x0 (ffff92fe4388e500) 00010000:00010000:1.0:1763333170.247614:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333170.247616:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f000, rc 0) 00000100:00100000:1.0:1763333170.247712:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:55917:x1848987613547776:12345-192.168.204.28@tcp:101:bash.0 Request processed in 2215us (2785us total) trans 4294971943 rc 0/0 00000100:00100000:1.0:1763333170.247722:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8892 00000100:00100000:1.0:1763333170.257789:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.259556:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613548032 00000100:00100000:0.0:1763333170.259576:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613548032 00000100:00100000:0.0:1763333170.259646:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6186 00000100:00100000:0.0:1763333170.259656:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2419:x1848987613548032:12345-192.168.204.28@tcp:23:lfs.0 00000100:00100000:1.0:1763333170.259676:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.259813:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2419:x1848987613548032:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 157us (2033us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333170.259822:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6186 00000100:00100000:0.0:1763333170.260405:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613547904 00000100:00100000:0.0:1763333170.260412:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613547904 00000100:00100000:0.0:1763333170.260449:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8893 00000100:00100000:0.0:1763333170.260455:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:55917:x1848987613547904:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333170.260471:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333170.260494:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5424d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x191:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968c9a expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.260530:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54254 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x191:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333170.260543:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54254 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x191:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.260555:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54254 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x191:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.260701:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5424d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x191:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c9a expref: 227 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.260721:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54254 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x191:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c9a expref: 226 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.260730:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x191:0x0].0x0 (ffff92fe4388e500) 00010000:00010000:0.0:1763333170.260733:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763333170.260738:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdf400, rc 0) 00000100:00100000:0.0:1763333170.260778:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:55917:x1848987613547904:12345-192.168.204.28@tcp:101:bash.0 Request processed in 322us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333170.260784:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8893 00000100:00100000:1.0:1763333170.263600:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.263650:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613548160 00000100:00100000:0.0:1763333170.263659:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613548160 00000100:00100000:1.0:1763333170.263831:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.263966:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6187 00000100:00100000:0.0:1763333170.263977:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2420:x1848987613548160:12345-192.168.204.28@tcp:23:lfs.0 00000100:00100000:0.0:1763333170.264102:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2420:x1848987613548160:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 127us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333170.264113:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6187 00000100:00100000:3.0:1763333170.264144:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613548416 00000100:00100000:3.0:1763333170.264149:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613548416 00000100:00100000:3.0:1763333170.264200:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8894 00000100:00100000:3.0:1763333170.264208:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:55917:x1848987613548416:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:3.0:1763333170.264248:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333170.264274:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5423f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c93 expref: 226 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.264291:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x191:0x0].0x0 (ffff92fe4388e500) 00010000:00010000:3.0:1763333170.264296:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333170.264581:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5425b lrc: 3/0,1 mode: --/PW res: [0x240000404:0x191:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333170.264596:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5425b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x191:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.264606:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5425b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x191:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000001:00080000:3.0:1763333170.264656:0:6519:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294971944 00000004:00010000:3.0:1763333170.264681:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000772be9fc reply state 000000004a7b163a transno 4294971945 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5425b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x191:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.264692:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5425b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x191:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.264698:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x191:0x0].0x0 (ffff92fe4388e500) 00010000:00010000:3.0:1763333170.264701:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763333170.264704:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763333170.264773:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:55917:x1848987613548416:12345-192.168.204.28@tcp:36:bash.0 Request processed in 566us (942us total) trans 4294971945 rc 0/0 00000100:00100000:3.0:1763333170.264780:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8894 00000020:00080000:3.0:1763333170.264784:0:6519:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763333170.266603:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333170.266672:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613548544 00000100:00100000:3.0:1763333170.266681:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613548544 00000100:00100000:3.0:1763333170.266735:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8895 00000100:00100000:3.0:1763333170.266745:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:55917:x1848987613548544:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333170.266770:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333170.266791:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c54262 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x191:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968ca1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.266853:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c54262 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x191:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ca1 expref: 229 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.266868:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c54262 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x191:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ca1 expref: 229 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.266946:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x191:0x0].0x0 (ffff92fe4388e500) 00010000:00010000:3.0:1763333170.266957:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763333170.266961:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea000, rc 0) 00000100:00100000:3.0:1763333170.267067:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:55917:x1848987613548544:12345-192.168.204.28@tcp:101:bash.0 Request processed in 322us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333170.267074:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8895 00000100:00100000:1.0:1763333170.268931:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333170.269013:0:28430:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613548672 00000100:00100000:3.0:1763333170.269022:0:28430:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613548672 00000100:00100000:3.0:1763333170.269099:0:28430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1544 00000100:00100000:3.0:1763333170.269108:0:28430:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2421:x1848987613548672:12345-192.168.204.28@tcp:3:lfs.0 00010000:00010000:3.0:1763333170.269150:0:28430:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54269 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.269166:0:28430:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333170.269168:0:28430:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333170.269174:0:28430:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54269 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.269330:0:28430:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54269 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333170.269416:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333170.269534:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613548928 00000100:00100000:3.0:1763333170.269538:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613548928 00010000:00010000:2.0:1763333170.269553:0:28430:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54269 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.269572:0:28430:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54269 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333170.269579:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8896 00000100:00100000:3.0:1763333170.269586:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:55917:x1848987613548928:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333170.269586:0:28430:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54269 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.269593:0:28430:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea800 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333170.269597:0:28430:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54269 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.269598:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333170.269601:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763333170.269605:0:28430:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54269 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.269619:0:28430:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54269 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.269620:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c54262 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x191:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ca1 expref: 229 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.269628:0:28430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54269 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.269636:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x191:0x0].0x0 (ffff92fe4388e500) 00010000:00010000:3.0:1763333170.269639:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333170.269647:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c54270 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x191:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968ca8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333170.269686:0:28430:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2421:x1848987613548672:12345-192.168.204.28@tcp:3:lfs.0 Request processed in 579us (761us total) trans 0 rc 4096/4096 00010000:00010000:3.0:1763333170.269690:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c54277 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x191:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00000100:00100000:2.0:1763333170.269694:0:28430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1544 00010000:00010000:3.0:1763333170.269700:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c54277 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x191:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.269708:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c54277 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x191:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000040:00080000:2.0:1763333170.270120:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1301, 88 off110464 00000004:00080000:2.0:1763333170.270128:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1274349778683ns, next at 1274741703917ns, rc = 0 00000040:00080000:2.0:1763333170.270172:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1300, 88 off110464 00000004:00080000:2.0:1763333170.270177:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1274349828147ns, next at 1274741674609ns, rc = 0 00000040:00080000:2.0:1763333170.270338:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1301, 88 off110552 00000004:00080000:2.0:1763333170.270344:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1274349994698ns, next at 1274741674609ns, rc = 0 00000040:00080000:2.0:1763333170.270497:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1302, 88 off110552 00000004:00080000:2.0:1763333170.270502:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1274350153496ns, next at 1274741703917ns, rc = 0 00000100:00100000:1.0:1763333170.272926:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.273246:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613549056 00000100:00100000:2.0:1763333170.273259:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613549056 00000001:00080000:0.0:1763333170.273275:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294971946 is committed 00000004:00080000:0.0:1763333170.273283:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 855 committed 00000004:00080000:0.0:1763333170.273299:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 852 committed 00000004:00080000:0.0:1763333170.273307:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 851 committed 00000004:00080000:0.0:1763333170.273310:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 854 committed 00000100:00100000:2.0:1763333170.273313:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8897 00000100:00100000:2.0:1763333170.273323:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56789:x1848987613549056:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333170.273344:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333170.273387:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5427e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968caf expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.273422:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c54285 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00000100:00100000:0.0:1763333170.273428:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46e2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627212672:0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1763333170.273437:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c54285 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.273447:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c54285 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000100:00100000:0.0:1763333170.273473:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333170.273505:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763333170.273510:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627212800:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333170.273528:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1763333170.273551:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5427e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x190:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968caf expref: 225 pid: 8606 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333170.273556:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627212672 00000100:00100000:0.0:1763333170.273570:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627212672 00010000:00010000:2.0:1763333170.273581:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5600/0xb32e3ef184c54285 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x190:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968caf expref: 224 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.273590:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92fe4345b200) 00010000:00010000:2.0:1763333170.273593:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:0.0:1763333170.273595:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627212800 00010000:00010000:2.0:1763333170.273597:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5600, rc 0) 00000100:00100000:0.0:1763333170.273597:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627212800 00000100:00100000:0.0:1763333170.273612:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6188 00000100:00100000:0.0:1763333170.273618:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+20:3654:x1848987627212672:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333170.273639:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56789:x1848987613549056:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 318us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333170.273645:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8897 00010000:00010000:2.0:1763333170.273696:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c54277 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x191:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ca8 expref: 224 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.273704:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x191:0x0].0x0 (ffff92fe4388e500) 00010000:00010000:2.0:1763333170.273706:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763333170.273715:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c54270 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x191:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ca8 expref: 224 pid: 6519 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1763333170.273726:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c54277 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x191:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ca8 expref: 223 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.273747:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x191:0x0].0x0 (ffff92fe4388e500) 00010000:00010000:2.0:1763333170.273750:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:0.0:1763333170.273751:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+21:3654:x1848987627212672:12345-0@lo:2:osp-syn-1-1.0 Request processed in 133us (276us total) trans 17179871432 rc 0/0 00010000:00010000:2.0:1763333170.273752:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feb200, rc 0) 00000100:00100000:0.0:1763333170.273757:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6188 00000100:00100000:0.0:1763333170.273770:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6189 00000100:00100000:2.0:1763333170.273775:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:55917:x1848987613548928:12345-192.168.204.28@tcp:101:bash.0 Request processed in 4190us (4360us total) trans 4294971946 rc 0/0 00000100:00100000:0.0:1763333170.273776:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+20:3654:x1848987627212800:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333170.273782:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8896 00000100:00100000:0.0:1763333170.273849:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+21:3654:x1848987627212800:12345-0@lo:2:osp-syn-1-1.0 Request processed in 73us (319us total) trans 17179871433 rc 0/0 00000100:00100000:0.0:1763333170.273857:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6189 00010000:00010000:3.0:1763333170.273897:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c541e4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00000004:00080000:0.0:1763333170.273900:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe46e2d500/2, rc 0, transno 17179871433 00000100:00100000:0.0:1763333170.273905:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627212800:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1763333170.273906:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c541e4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333170.273913:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c541e4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00000004:00080000:0.0:1763333170.273914:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe46e2ea00/2, rc 0, transno 17179871432 00000100:00100000:0.0:1763333170.273917:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46e2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627212672:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1763333170.273919:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333170.273923:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c541e4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333170.273932:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c541e4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333170.273942:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe4388e400) 00010000:00010000:3.0:1763333170.273945:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333170.273960:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c541e4 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333170.273967:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c541e4 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333170.273989:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5425b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x191:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.273994:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5425b lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x191:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.273999:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5425b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x191:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.274004:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feba00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333170.274007:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5425b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x191:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.274012:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5425b lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x191:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.274020:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x191:0x0].0x0 (ffff92fe4388e500) 00010000:00010000:3.0:1763333170.274022:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333170.274025:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5425b lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x191:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.274030:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5425b lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x191:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000100:00100000:3.0:1763333170.274049:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763333170.274058:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4684c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627212928:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333170.274084:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333170.274108:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe45183b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627213056:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333170.274126:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333170.274151:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627212928 00000100:00100000:3.0:1763333170.274155:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627212928 00000100:00100000:3.0:1763333170.274191:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627213056 00000100:00100000:3.0:1763333170.274195:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627213056 00000100:00100000:3.0:1763333170.274215:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6190 00000100:00100000:3.0:1763333170.274222:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+38:3653:x1848987627212928:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333170.274223:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6191 00000100:00100000:1.0:1763333170.274231:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+38:3653:x1848987627213056:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333170.274595:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+40:3653:x1848987627213056:12345-0@lo:2:osp-syn-0-1.0 Request processed in 364us (466us total) trans 21474838738 rc 0/0 00000100:00100000:1.0:1763333170.274602:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6191 00000004:00080000:3.0:1763333170.274625:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe45183b80/2, rc 0, transno 21474838738 00000100:00100000:3.0:1763333170.274631:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe45183b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627213056:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333170.274763:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+39:3653:x1848987627212928:12345-0@lo:2:osp-syn-0-1.0 Request processed in 537us (672us total) trans 21474838737 rc 0/0 00000100:00100000:2.0:1763333170.274769:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6190 00000004:00080000:3.0:1763333170.274838:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4684c700/2, rc 0, transno 21474838737 00000100:00100000:3.0:1763333170.274843:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4684c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627212928:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333170.277620:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.277620:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.277687:0:28430:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613549184 00000100:00100000:2.0:1763333170.277710:0:28430:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613549184 00000100:00100000:2.0:1763333170.277789:0:28430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1545 00000100:00100000:2.0:1763333170.277800:0:28430:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2421:x1848987613549184:12345-192.168.204.28@tcp:4:lfs.0 00010000:00010000:2.0:1763333170.277841:0:28430:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5428c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.277865:0:28430:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54039 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968beb expref: 22 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333170.277879:0:28430:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333170.277882:0:28430:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333170.277885:0:28430:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5428c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.277922:0:28430:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54039 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968beb expref: 22 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333170.277935:0:28430:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54039 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968beb expref: 22 pid: 8406 timeout: 1374 lvb_type: 1 00000100:00100000:2.0:1763333170.278072:0:28430:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe434c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0000_UUID:28430:1848987627213184:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333170.278252:0:28430:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff412edc00 going to sleep for 11 seconds 00000100:00100000:2.0:1763333170.278273:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613549312 00000100:00100000:2.0:1763333170.278277:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613549312 00000100:00100000:2.0:1763333170.278314:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6192 00000100:00100000:2.0:1763333170.278321:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:55917:x1848987613549312:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333170.278329:0:17605:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333170.278344:0:17605:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5000/0xb32e3ef184c54293 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968cb6 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763333170.278393:0:17605:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x20f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763333170.278407:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333170.278409:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333170.278417:0:17605:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5000/0xb32e3ef184c54293 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cb6 expref: 24 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.278435:0:17605:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5000/0xb32e3ef184c54293 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cb6 expref: 24 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.278446:0:17605:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5000, rc 0) 00000100:00100000:2.0:1763333170.278482:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:55917:x1848987613549312:12345-192.168.204.28@tcp:101:bash.0 Request processed in 161us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333170.278489:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6192 00000100:00100000:3.0:1763333170.280546:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.280584:0:28430:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe434c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0000_UUID:28430:1848987627213184:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333170.280611:0:28430:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5428c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333170.280731:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613549440 00000100:00100000:0.0:1763333170.280738:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613549440 00000100:00100000:0.0:1763333170.280794:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6193 00000100:00100000:0.0:1763333170.280804:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:55917:x1848987613549440:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333170.280820:0:28600:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333170.280840:0:28600:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5429a lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968cbd expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763333170.280863:0:28600:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x20f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333170.280882:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333170.280884:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333170.280893:0:28600:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5429a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cbd expref: 20 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.280908:0:28600:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5429a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cbd expref: 20 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.280919:0:28600:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdee00, rc 0) 00000100:00100000:1.0:1763333170.281106:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.281313:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613549568 00000100:00100000:2.0:1763333170.281318:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613549568 00010000:00010000:2.0:1763333170.281340:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54039 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968beb expref: 24 pid: 8406 timeout: 1374 lvb_type: 1 00000100:00100000:2.0:1763333170.281444:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2917 00000100:00100000:2.0:1763333170.281452:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45182680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:2421:x1848987613549568:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333170.281463:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333170.281478:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54039 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968beb expref: 24 pid: 8406 timeout: 1374 lvb_type: 1 00010000:00010000:2.0:1763333170.281491:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54039 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968beb expref: 24 pid: 8406 timeout: 1374 lvb_type: 1 00010000:00010000:2.0:1763333170.281517:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54039 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x20e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968beb expref: 24 pid: 8406 timeout: 1374 lvb_type: 1 00010000:00010000:2.0:1763333170.281530:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333170.281532:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333170.281536:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5428c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.281544:0:28428:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5428c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.281573:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333170.281603:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45182680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2421:x1848987613549568:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 152us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333170.281610:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2917 00010000:00010000:1.0:1763333170.281700:0:28430:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5428c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.281708:0:28430:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5428c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1763333170.284283:0:24714:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838739 is committed 00000001:00080000:3.0:1763333170.284299:0:24714:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838738 is committed 00000100:00100000:0.0:1763333170.284404:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:55917:x1848987613549440:12345-192.168.204.28@tcp:101:bash.0 Request processed in 3596us (3856us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333170.284415:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6193 00002000:00010000:1.0:1763333170.285849:0:28430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x20e:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:1.0:1763333170.285856:0:28430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x20e:0x0] updating lvb mtime from disk: 0 -> 1763333170 00002000:00010000:1.0:1763333170.285858:0:28430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x20e:0x0] updating lvb ctime from disk: 0 -> 1763333170 00002000:00010000:1.0:1763333170.285861:0:28430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x20e:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1763333170.285873:0:28430:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5428c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.285884:0:28430:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5428c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.285892:0:28430:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5428c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.285899:0:28430:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4a00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333170.285905:0:28430:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5428c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.285913:0:28430:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5428c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.285933:0:28430:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5428c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.285946:0:28430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5428c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333170.286037:0:28430:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+11:2421:x1848987613549184:12345-192.168.204.28@tcp:4:lfs.0 Request processed in 8236us (8422us total) trans 21474838739 rc 0/0 00000100:00100000:1.0:1763333170.286048:0:28430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1545 00000100:00100000:2.0:1763333170.286546:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.286666:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.286814:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613549696 00000100:00100000:0.0:1763333170.286825:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613549696 00002000:00010000:0.0:1763333170.286866:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/527 (0->18446744073709551615) 00002000:00100000:0.0:1763333170.286871:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe434c4e00 with x1848987613549696 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333170.286881:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe434c4e00. 00000100:00100000:0.0:1763333170.286909:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613549824 00000100:00100000:0.0:1763333170.286914:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613549824 00002000:00010000:0.0:1763333170.286929:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/527 (0->18446744073709551615) 00002000:00100000:0.0:1763333170.286932:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4920c380 with x1848987613549824 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333170.286938:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe4920c380. 00000100:00100000:0.0:1763333170.286961:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1546 00000100:00100000:0.0:1763333170.286970:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+11:2420:x1848987613549696:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:0.0:1763333170.287160:0:28427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x20f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333170.287164:0:28427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x20f:0x0] updating lvb mtime from disk: 0 -> 1763333170 00002000:00010000:0.0:1763333170.287166:0:28427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x20f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333170.287168:0:28427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x20f:0x0] updating lvb ctime from disk: 0 -> 1763333170 00002000:00010000:0.0:1763333170.287171:0:28427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x20f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333170.287207:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:2420:x1848987613549696:12345-192.168.204.28@tcp:10:bash.0 Request processed in 237us (661us total) trans 21474838740 rc 0/0 00000100:00100000:0.0:1763333170.287214:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1546 00002000:00010000:0.0:1763333170.287218:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/527 (0->18446744073709551615) 00002000:00100000:0.0:1763333170.287221:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe434c4e00 with x1848987613549696 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333170.287225:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe434c4e00. 00000100:00100000:0.0:1763333170.287239:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1547 00000100:00100000:0.0:1763333170.287246:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2420:x1848987613549824:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:0.0:1763333170.287330:0:28427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x20f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333170.287334:0:28427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x20f:0x0] updating lvb mtime from disk: 0 -> 1763333170 00002000:00010000:0.0:1763333170.287336:0:28427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x20f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333170.287338:0:28427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x20f:0x0] updating lvb ctime from disk: 0 -> 1763333170 00002000:00010000:0.0:1763333170.287340:0:28427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x20f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333170.287401:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2420:x1848987613549824:12345-192.168.204.28@tcp:10:bash.0 Request processed in 155us (734us total) trans 17179871434 rc 0/0 00000100:00100000:0.0:1763333170.287407:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1547 00002000:00010000:0.0:1763333170.287410:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/527 (0->18446744073709551615) 00002000:00100000:0.0:1763333170.287413:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4920c380 with x1848987613549824 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333170.287417:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe4920c380. 00000100:00100000:2.0:1763333170.295230:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.295481:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613550080 00000100:00100000:0.0:1763333170.295493:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613550080 00000100:00100000:1.0:1763333170.296501:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3033 00000100:00100000:1.0:1763333170.296518:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:55917:x1848987613550080:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:1.0:1763333170.296842:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:55917:x1848987613550080:12345-192.168.204.28@tcp:35:bash.0 Request processed in 329us (1620us total) trans 4294971947 rc 0/0 00000100:00100000:1.0:1763333170.296850:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3033 00000100:00100000:1.0:1763333170.313772:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.314534:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613550336 00000100:00100000:0.0:1763333170.314548:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613550336 00000100:00100000:0.0:1763333170.314620:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8898 00000100:00100000:0.0:1763333170.314630:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6b3cfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:56789:x1848987613550336:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:0.0:1763333170.314699:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333170.314734:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54207 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x190:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c7e expref: 222 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.314756:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92fe4345b200) 00010000:00010000:0.0:1763333170.314762:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333170.314841:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c542a1 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333170.314856:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c542a1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.314866:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c542a1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00010000:0.0:1763333170.315010:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001f441562 reply state 000000003e424dc6 transno 4294971948 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c542a1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.315023:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c542a1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.315028:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92fe4345b200) 00010000:00010000:0.0:1763333170.315031:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333170.315034:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763333170.315128:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6b3cfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56789:x1848987613550336:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 499us (1364us total) trans 4294971948 rc 0/0 00000100:00100000:0.0:1763333170.315135:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8898 00000100:00100000:2.0:1763333170.318254:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.318555:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613550464 00000100:00100000:0.0:1763333170.318575:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613550464 00000100:00100000:0.0:1763333170.318644:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8899 00000100:00100000:0.0:1763333170.318654:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56793:x1848987613550464:12345-192.168.204.28@tcp:101:rm.0 00010000:00010000:0.0:1763333170.318678:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333170.318703:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c542a8 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968ccb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.318770:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c542af lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333170.318783:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c542af lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333170.318793:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c542af lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333170.318804:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c542b6 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333170.318811:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c542b6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333170.318818:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c542b6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333170.318892:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c542bd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x191:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333170.318900:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c542bd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x191:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333170.318907:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c542bd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x191:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:0.0:1763333170.318959:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x191:0x0]: returning size 5 00000004:00200000:0.0:1763333170.318964:0:6519:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763333170.318986:0:6519:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c542bd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x191:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333170.318999:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c542bd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333170.319007:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c542af lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333170.319014:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c542af lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333170.319019:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c542af lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333170.319025:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c542af lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333170.319032:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333170.319035:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c542af lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333170.319042:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c542af lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333170.319053:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab5200) 00010000:00010000:0.0:1763333170.319056:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333170.319060:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c542af lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333170.319066:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c542af lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333170.319080:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c542b6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333170.319085:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c542b6 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333170.319091:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c542b6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333170.319096:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abde400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333170.319098:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c542b6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333170.319103:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c542b6 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333170.319110:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43ab5900) 00010000:00010000:0.0:1763333170.319112:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333170.319115:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c542b6 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333170.319120:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c542b6 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333170.319153:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c542a8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ccb expref: 225 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.319170:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c542bd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ccb expref: 224 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.319177:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x191:0x0].0x0 (ffff92fe4388e500) 00010000:00010000:0.0:1763333170.319179:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333170.319181:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abde200, rc 0) 00000100:00100000:0.0:1763333170.319258:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56793:x1848987613550464:12345-192.168.204.28@tcp:101:rm.0 Request processed in 605us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333170.319266:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8899 00000100:00100000:1.0:1763333170.321075:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.322207:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613550592 00000100:00100000:0.0:1763333170.322219:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613550592 00000100:00100000:2.0:1763333170.322851:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6194 00000100:00100000:2.0:1763333170.322869:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:56789:x1848987613550592:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333170.322893:0:17605:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333170.322924:0:17605:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c542c4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968cc4 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763333170.323099:0:17605:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x20e:0x0] initial LVB size: 4096, mtime: 0x691a5432, atime: 0x0, ctime: 0x691a5432, blocks: 0x8 00010000:00010000:2.0:1763333170.323135:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333170.323137:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333170.323147:0:17605:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c542c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cc4 expref: 13 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.323165:0:17605:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c542c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cc4 expref: 13 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.323178:0:17605:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4000, rc 0) 00000100:00100000:2.0:1763333170.323302:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:56789:x1848987613550592:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 438us (2233us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333170.323310:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6194 00000100:00100000:1.0:1763333170.325555:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.325627:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613550720 00000100:00100000:2.0:1763333170.325636:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613550720 00000100:00100000:2.0:1763333170.325685:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6195 00000100:00100000:2.0:1763333170.325694:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:56789:x1848987613550720:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333170.325710:0:17605:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333170.325729:0:17605:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c542cb lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968cd2 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.325756:0:17605:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c54040 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968bf2 expref: 22 pid: 29013 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333170.325763:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333170.325765:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333170.325770:0:17605:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c542cb lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cd2 expref: 22 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.325808:0:17605:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c54040 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968bf2 expref: 22 pid: 29013 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333170.325822:0:17605:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c54040 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968bf2 expref: 22 pid: 29013 timeout: 1374 lvb_type: 1 00000100:00100000:2.0:1763333170.325835:0:17605:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4920ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17605:1848987627213312:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333170.325917:0:17605:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff412edc00 going to sleep for 11 seconds 00000100:00100000:1.0:1763333170.329748:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.329829:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.330046:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613550976 00000100:00100000:0.0:1763333170.330056:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613550976 00000100:00100000:3.0:1763333170.330476:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613551104 00000100:00100000:3.0:1763333170.330482:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613551104 00010000:00010000:3.0:1763333170.330518:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c54040 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968bf2 expref: 23 pid: 29013 timeout: 1374 lvb_type: 1 00000100:00100000:3.0:1763333170.330554:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2918 00000100:00100000:3.0:1763333170.330577:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45182a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2421:x1848987613551104:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333170.330595:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333170.330621:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c54040 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x20e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968bf2 expref: 23 pid: 29013 timeout: 1374 lvb_type: 1 00010000:00010000:3.0:1763333170.330635:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c54040 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x20e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968bf2 expref: 23 pid: 29013 timeout: 1374 lvb_type: 1 00010000:00010000:3.0:1763333170.330668:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333170.330670:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333170.330677:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c542cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cd2 expref: 23 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.330687:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c542cb lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x20e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cd2 expref: 23 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.330727:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c542cb lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x20e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cd2 expref: 23 pid: 17605 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333170.330745:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7400d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6505:1848987627213440:192.168.204.28@tcp:105: 00000100:00100000:3.0:1763333170.330849:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff801bcc00 going to sleep for 11 seconds 00000100:00100000:0.0:1763333170.331068:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8900 00000100:00100000:0.0:1763333170.331080:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56793:x1848987613550976:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:0.0:1763333170.331130:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1763333170.331150:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c54277 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x191:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ca8 expref: 224 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.331172:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c542bd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ccb expref: 223 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.331187:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54254 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x191:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c9a expref: 222 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.331204:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x191:0x0].0x0 (ffff92fe4388e500) 00010000:00010000:0.0:1763333170.331216:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333170.331243:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c542d2 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333170.331255:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c542d2 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.331265:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c542d2 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.331278:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c542d9 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333170.331285:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c542d9 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.331290:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c542d9 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.331410:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c542e0 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x191:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333170.331418:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c542e0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x191:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.331425:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c542e0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x191:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000040:00080000:0.0:1763333170.331737:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1303, 64 off110616 00000040:00080000:0.0:1763333170.331763:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1302, 64 off110616 00000040:00080000:0.0:1763333170.331772:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1303, 64 off110680 00000040:00080000:0.0:1763333170.331780:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1304, 64 off110680 00010000:00010000:0.0:1763333170.331832:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c542e7 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x191:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333170.331842:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c542e7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x191:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.331850:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c542e7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x191:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.331857:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c542e7 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x191:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.331862:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c542e7 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x191:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.331868:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c542e7 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x191:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.331888:0:6521:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763333170.331905:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c542e0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x191:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.331910:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c542e0 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x191:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.331917:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c542e0 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x191:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.331922:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48191800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333170.331926:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c542e0 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x191:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.331933:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c542e0 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x191:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.331941:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x191:0x0].0x0 (ffff92fe43ab5c00) 00010000:00010000:0.0:1763333170.331945:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1763333170.331963:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c542e0 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x191:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.331970:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c542e0 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x191:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.332095:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c542d2 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.332102:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c542d2 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.332107:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c542d2 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.332112:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c542d2 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.332117:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48191600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333170.332120:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c542d2 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.332126:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c542d2 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.332135:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab5100) 00010000:00010000:0.0:1763333170.332137:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333170.332140:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c542d2 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.332146:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c542d2 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000004:00010000:0.0:1763333170.332160:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007099fc42 reply state 0000000091bf9cbd transno 4294971949 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c542d9 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.332171:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c542d9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.332177:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43ab5a00) 00010000:00010000:0.0:1763333170.332180:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333170.332182:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763333170.332254:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56793:x1848987613550976:12345-192.168.204.28@tcp:36:rm.0 Request processed in 1175us (2422us total) trans 4294971949 rc 0/0 00000100:00100000:0.0:1763333170.332263:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8900 00010000:00010000:2.0:1763333170.332540:0:17605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c54040 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x20e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968bf2 expref: 23 pid: 29013 timeout: 1374 lvb_type: 1 00000100:00100000:2.0:1763333170.332554:0:17605:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4920ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17605:1848987627213312:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333170.332594:0:17605:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c542cb lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cd2 expref: 22 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.332607:0:17605:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4c00, rc 0) 00000100:00100000:2.0:1763333170.332632:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:56789:x1848987613550720:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 6939us (7084us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333170.332639:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6195 00010000:00010000:3.0:1763333170.333056:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333170.333063:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c542e7 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x191:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.333070:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48191400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333170.333074:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c542e7 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x191:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.333081:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c542e7 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x191:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.333091:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x191:0x0].0x0 (ffff92fe43ab5c00) 00010000:00010000:3.0:1763333170.333093:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763333170.333097:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c542e7 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x191:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.333105:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c542e7 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x191:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.334371:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333170.334378:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333170.334380:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763333170.340222:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7400d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6505:1848987627213440:192.168.204.28@tcp:105: 00010000:00010000:1.0:1763333170.340247:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333170.340308:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45182a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2421:x1848987613551104:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 9733us (10568us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333170.340318:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2918 00000100:00100000:1.0:1763333170.345104:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.345147:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.345219:0:28429:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613551232 00000100:00100000:0.0:1763333170.345228:0:28429:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613551232 00002000:00010000:0.0:1763333170.345267:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/526 (5->18446744073709551615) 00002000:00100000:0.0:1763333170.345272:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45180380 with x1848987613551232 ext(5->18446744073709551615) 00002000:00010000:0.0:1763333170.345283:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe45180380. 00000100:00100000:0.0:1763333170.345307:0:28429:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613551360 00000100:00100000:0.0:1763333170.345310:0:28429:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613551360 00002000:00010000:0.0:1763333170.345319:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/526 (0->18446744073709551615) 00002000:00100000:0.0:1763333170.345321:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45181f80 with x1848987613551360 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333170.345326:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe45181f80. 00000100:00100000:0.0:1763333170.345363:0:28429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1548 00000100:00100000:0.0:1763333170.345372:0:28429:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45180380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2421:x1848987613551232:12345-192.168.204.28@tcp:10:lfs.0 00002000:00010000:0.0:1763333170.345682:0:28429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x20e:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:0.0:1763333170.345686:0:28429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x20e:0x0] updating lvb mtime from disk: 1763333170 -> 1763333170 00002000:00010000:0.0:1763333170.345688:0:28429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x20e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333170.345691:0:28429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x20e:0x0] updating lvb ctime from disk: 1763333170 -> 1763333170 00002000:00010000:0.0:1763333170.345693:0:28429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x20e:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1763333170.345748:0:28429:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45180380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2421:x1848987613551232:12345-192.168.204.28@tcp:10:lfs.0 Request processed in 377us (655us total) trans 21474838741 rc 0/0 00000100:00100000:0.0:1763333170.345757:0:28429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1548 00002000:00010000:0.0:1763333170.345761:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/526 (5->18446744073709551615) 00002000:00100000:0.0:1763333170.345763:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45180380 with x1848987613551232 ext(5->18446744073709551615) 00002000:00010000:0.0:1763333170.345767:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe45180380. 00000100:00100000:0.0:1763333170.345782:0:28429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1549 00000100:00100000:0.0:1763333170.345789:0:28429:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2421:x1848987613551360:12345-192.168.204.28@tcp:10:lfs.0 00002000:00010000:0.0:1763333170.345876:0:28429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x20e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333170.345879:0:28429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x20e:0x0] updating lvb mtime from disk: 0 -> 1763333170 00002000:00010000:0.0:1763333170.345881:0:28429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x20e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333170.345883:0:28429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x20e:0x0] updating lvb ctime from disk: 0 -> 1763333170 00002000:00010000:0.0:1763333170.345885:0:28429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x20e:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333170.345903:0:28429:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2421:x1848987613551360:12345-192.168.204.28@tcp:10:lfs.0 Request processed in 116us (756us total) trans 17179871435 rc 0/0 00000100:00100000:0.0:1763333170.345909:0:28429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1549 00002000:00010000:0.0:1763333170.345911:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/526 (0->18446744073709551615) 00002000:00100000:0.0:1763333170.345913:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45181f80 with x1848987613551360 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333170.345917:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe45181f80. 00000100:00100000:2.0:1763333170.357027:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.357236:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613551488 00000100:00100000:0.0:1763333170.357247:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613551488 00000100:00100000:0.0:1763333170.357319:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8901 00000100:00100000:0.0:1763333170.357330:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56794:x1848987613551488:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333170.357397:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333170.357434:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c542ee lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968cd9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.357524:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c542f5 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333170.357539:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c542f5 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.357549:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c542f5 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.357572:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c542fc lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333170.357579:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c542fc lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.357586:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c542fc lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.357635:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c542f5 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.357642:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c542f5 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.357649:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c542f5 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.357655:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c542f5 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.357662:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48191800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333170.357666:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c542f5 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.357677:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c542f5 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.357688:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab5100) 00010000:00010000:0.0:1763333170.357691:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333170.357697:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c542f5 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.357703:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c542f5 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.357716:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c542fc lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.357722:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c542fc lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.357728:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c542fc lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.357732:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48190200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333170.357735:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c542fc lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.357742:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c542fc lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.357748:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43ab5a00) 00010000:00010000:0.0:1763333170.357750:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333170.357753:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c542fc lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.357758:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c542fc lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.357785:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c542ee lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cd9 expref: 224 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.357796:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab5100) 00010000:00010000:0.0:1763333170.357798:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333170.357801:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c542ee lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cd9 expref: 224 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.357815:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48191600, rc 0) 00000100:00100000:0.0:1763333170.357889:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56794:x1848987613551488:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 561us (875us total) trans 0 rc 301/301 00000100:00100000:0.0:1763333170.357897:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8901 00000100:00100000:2.0:1763333170.360276:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.360381:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613551744 00000100:00100000:1.0:1763333170.360391:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613551744 00000100:00100000:1.0:1763333170.360446:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8902 00000100:00100000:1.0:1763333170.360456:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56789:x1848987613551744:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:1.0:1763333170.360539:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54303 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333170.360556:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54303 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.360579:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54303 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00010000:1.0:1763333170.360697:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000008b116759 reply state 000000000ef9c8fb transno 4294971950 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54303 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.360710:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54303 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.360718:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92fe4345b200) 00010000:00010000:1.0:1763333170.360720:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333170.360723:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763333170.362391:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56789:x1848987613551744:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 1925us (2113us total) trans 4294971950 rc 0/0 00000100:00100000:1.0:1763333170.362402:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8902 00000100:00100000:2.0:1763333170.365834:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.366186:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613551872 00000100:00100000:1.0:1763333170.366197:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613551872 00000100:00100000:0.0:1763333170.366667:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8903 00000100:00100000:0.0:1763333170.366684:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56794:x1848987613551872:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333170.366709:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333170.366735:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c5430a lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968ce0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.366812:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c54311 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333170.366827:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c54311 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.366838:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c54311 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.366848:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c54318 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333170.366856:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c54318 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.366863:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c54318 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.366905:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c54311 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.366913:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c54311 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.366918:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c54311 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.366924:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c54311 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.366929:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48190200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333170.366933:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c54311 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.366940:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c54311 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.366965:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab5100) 00010000:00010000:0.0:1763333170.366969:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333170.366974:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c54311 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.366981:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c54311 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.366995:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c54318 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.367001:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c54318 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.367007:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c54318 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.367011:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48191800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333170.367014:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c54318 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.367019:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c54318 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.367025:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43ab5a00) 00010000:00010000:0.0:1763333170.367028:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333170.367031:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c54318 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.367036:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c54318 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.367065:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c5430a lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ce0 expref: 226 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.367076:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab5100) 00010000:00010000:0.0:1763333170.367079:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333170.367083:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c5430a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ce0 expref: 226 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.367096:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48191600, rc 0) 00000100:00100000:0.0:1763333170.367179:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56794:x1848987613551872:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 500us (1357us total) trans 0 rc 301/301 00000100:00100000:0.0:1763333170.367187:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8903 00000100:00100000:2.0:1763333170.369315:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333170.369708:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613552000 00000100:00100000:3.0:1763333170.369722:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613552000 00000100:00100000:3.0:1763333170.369800:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6196 00000100:00100000:3.0:1763333170.369810:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2419:x1848987613552000:12345-192.168.204.28@tcp:2:lfs.0 00002000:00010000:3.0:1763333170.369985:0:17605:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x20d:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1763333170.369989:0:17605:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x20d:0x0] updating lvb mtime from disk: 1763333170 -> 1763333170 00002000:00010000:3.0:1763333170.369992:0:17605:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x20d:0x0] updating lvb atime from disk: 0 -> 1763333170 00002000:00010000:3.0:1763333170.369995:0:17605:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x20d:0x0] updating lvb ctime from disk: 1763333170 -> 1763333170 00002000:00010000:3.0:1763333170.369997:0:17605:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x20d:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763333170.370075:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2419:x1848987613552000:12345-192.168.204.28@tcp:2:lfs.0 Request processed in 266us (770us total) trans 17179871436 rc 0/0 00000100:00100000:3.0:1763333170.370083:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6196 00000100:00100000:2.0:1763333170.372742:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.372825:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613552128 00000100:00100000:1.0:1763333170.372834:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613552128 00000100:00100000:1.0:1763333170.373306:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8904 00000100:00100000:1.0:1763333170.373317:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56794:x1848987613552128:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333170.373340:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333170.373383:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c5431f lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968ce7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.373446:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54326 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333170.373459:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54326 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.373470:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54326 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:1.0:1763333170.373509:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1763333170.373513:0:6519:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1763333170.373543:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c5431f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ce7 expref: 227 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.373571:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54326 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ce7 expref: 226 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.373580:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe4388e600) 00010000:00010000:1.0:1763333170.373582:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1763333170.373586:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f000, rc 0) 00000100:00100000:1.0:1763333170.373658:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56794:x1848987613552128:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 342us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333170.373664:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8904 00000100:00100000:0.0:1763333170.377436:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.377535:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613552384 00000100:00100000:2.0:1763333170.377545:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613552384 00000100:00100000:2.0:1763333170.377638:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3034 00000100:00100000:2.0:1763333170.377648:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56789:x1848987613552384:12345-192.168.204.28@tcp:35:lfs.0 00000004:00010000:2.0:1763333170.377706:0:6523:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x240000404:0x190:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5416d lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x190:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c4d expref: 226 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.377754:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5432d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763333170.377767:0:6523:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c541f9 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c77 expref: 226 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.377777:0:6523:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5432d lrc: 4/0,1 mode: --/EX res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT1 00010000:00010000:2.0:1763333170.377811:0:6523:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c541f9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c77 expref: 226 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.377825:0:6523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c541f9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c77 expref: 226 pid: 12741 timeout: 1374 lvb_type: 0 00000100:00100000:2.0:1763333170.377839:0:6523:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4920ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6523:1848987627213568:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333170.377932:0:6523:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff412edc00 going to sleep for 11 seconds 00000100:00100000:2.0:1763333170.379011:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.379076:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613552512 00000100:00100000:0.0:1763333170.379082:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613552512 00000100:00100000:0.0:1763333170.379133:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8905 00000100:00100000:0.0:1763333170.379142:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56794:x1848987613552512:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333170.379158:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333170.379175:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c54334 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968cee expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.379233:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c5433b lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333170.379244:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c5433b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333170.379254:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c5433b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333170.379264:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c54342 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333170.379270:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c54342 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333170.379276:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c54342 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333170.379314:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c5433b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333170.379321:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c5433b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333170.379328:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c5433b lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333170.379333:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c5433b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333170.379339:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48190e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333170.379342:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c5433b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333170.379378:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c5433b lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333170.379389:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe4388e600) 00010000:00010000:0.0:1763333170.379391:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333170.379396:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c5433b lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333170.379401:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c5433b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333170.379414:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c54342 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333170.379419:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c54342 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333170.379424:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c54342 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333170.379429:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48191400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333170.379432:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c54342 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333170.379442:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c54342 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333170.379447:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43ab5a00) 00010000:00010000:0.0:1763333170.379449:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333170.379452:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c54342 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333170.379457:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c54342 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333170.379482:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c54334 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cee expref: 228 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.379490:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe4388e600) 00010000:00010000:0.0:1763333170.379492:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333170.379496:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c54334 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cee expref: 228 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.379504:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48190c00, rc 0) 00000100:00100000:0.0:1763333170.379552:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56794:x1848987613552512:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 411us (544us total) trans 0 rc 301/301 00000100:00100000:0.0:1763333170.379568:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8905 00000100:00100000:2.0:1763333170.383932:0:6523:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4920ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6523:1848987627213568:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333170.383980:0:6523:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5432d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT1 00000100:00100000:2.0:1763333170.384194:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.384282:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.384342:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613552640 00000100:00100000:1.0:1763333170.384377:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613552640 00010000:00010000:1.0:1763333170.384414:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c541f9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c77 expref: 227 pid: 12741 timeout: 1374 lvb_type: 0 00000100:00100000:1.0:1763333170.384449:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2919 00000100:00100000:1.0:1763333170.384459:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:2421:x1848987613552640:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333170.384476:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333170.384483:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c541f9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c77 expref: 227 pid: 12741 timeout: 1374 lvb_type: 0 00010000:00010000:1.0:1763333170.384495:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c541f9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c77 expref: 227 pid: 12741 timeout: 1374 lvb_type: 0 00010000:00010000:1.0:1763333170.384516:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c541f9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c77 expref: 227 pid: 12741 timeout: 1374 lvb_type: 0 00010000:00010000:1.0:1763333170.384531:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92fe4345b200) 00010000:00010000:1.0:1763333170.384535:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5432d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT1 00010000:00010000:1.0:1763333170.384545:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5432d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT1 00010000:00010000:1.0:1763333170.384552:0:6505:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5432d lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT1 00010000:00010000:1.0:1763333170.384588:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333170.384633:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:2421:x1848987613552640:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 175us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333170.384640:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2919 00000100:00100000:0.0:1763333170.384787:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613552896 00000100:00100000:0.0:1763333170.384793:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613552896 00000100:00100000:0.0:1763333170.384839:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8906 00000100:00100000:0.0:1763333170.384847:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56794:x1848987613552896:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333170.384864:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333170.384866:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763333170.384878:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54326 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ce7 expref: 226 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.384888:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe4388e600) 00010000:00010000:0.0:1763333170.384895:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333170.384909:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c54349 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968cf5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.385009:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c54350 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333170.385018:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c54350 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.385025:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c54350 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.385034:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c54357 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333170.385040:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c54357 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.385045:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c54357 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.385440:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c5435e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x193:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333170.385449:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c5435e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.385456:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c5435e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:0.0:1763333170.385465:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x193:0x0]: returning size 0 00010000:00010000:0.0:1763333170.385490:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c54350 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.385497:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c54350 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.385502:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c54350 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.385507:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c54350 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.385513:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48191800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333170.385516:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c54350 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.385523:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c54350 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.385531:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab5100) 00010000:00010000:0.0:1763333170.385533:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333170.385537:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c54350 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.385542:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c54350 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000004:00010000:0.0:1763333170.385553:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000931f28bb reply state 000000009c84f371 transno 4294971951 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c54357 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.385577:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c54357 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.385587:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43ab5a00) 00010000:00010000:0.0:1763333170.385590:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333170.385592:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763333170.385617:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c54349 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cf5 expref: 228 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.385633:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c5435e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cf5 expref: 227 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.385640:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x193:0x0].0x0 (ffff92fe43ab5200) 00010000:00010000:0.0:1763333170.385642:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333170.385644:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdf400, rc 0) 00000100:00100000:0.0:1763333170.385686:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56794:x1848987613552896:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 840us (1404us total) trans 4294971951 rc 0/0 00000100:00100000:0.0:1763333170.385693:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8906 00010000:00010000:3.0:1763333170.385856:0:6523:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5432d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT1 00010000:00010000:3.0:1763333170.385865:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5432d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT1 00000040:00080000:3.0:1763333170.386028:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1304, 88 off110768 00000004:00080000:3.0:1763333170.386037:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1274465687292ns, next at 1274741674609ns, rc = 0 00000040:00080000:3.0:1763333170.386076:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1305, 88 off110768 00000004:00080000:3.0:1763333170.386081:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1274465732171ns, next at 1274741703917ns, rc = 0 00000040:00080000:3.0:1763333170.386100:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1306, 88 off110856 00000004:00080000:3.0:1763333170.386105:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1274465755437ns, next at 1274741703917ns, rc = 0 00000040:00080000:3.0:1763333170.386115:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1305, 88 off110856 00000004:00080000:3.0:1763333170.386119:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1274465769892ns, next at 1274741674609ns, rc = 0 00000100:00100000:1.0:1763333170.393895:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.394252:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613553152 00000100:00100000:0.0:1763333170.394265:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613553152 00000100:00100000:2.0:1763333170.394422:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8907 00000100:00100000:2.0:1763333170.394433:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56794:x1848987613553152:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333170.394455:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333170.394479:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5436c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x193:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968cfc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.394604:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54373 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x193:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333170.394619:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c5435e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cf5 expref: 230 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.394628:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54373 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333170.394662:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c5435e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cf5 expref: 230 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.394676:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c5435e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cf5 expref: 230 pid: 6521 timeout: 1374 lvb_type: 0 00000100:00100000:2.0:1763333170.394690:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4920ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627213696:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333170.394770:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff412edc00 going to sleep for 11 seconds 00000001:00080000:0.0:1763333170.396518:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294971952 is committed 00000004:00080000:0.0:1763333170.396530:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 854 committed 00000004:00080000:0.0:1763333170.396540:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 857 committed 00000004:00080000:0.0:1763333170.396550:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 856 committed 00000004:00080000:0.0:1763333170.396552:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 853 committed 00010000:00010000:1.0:1763333170.396624:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c542a1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.396636:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c542a1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.396644:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c542a1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.396650:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdea00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333170.396654:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c542a1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.396662:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c542a1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.396679:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92fe4345b200) 00010000:00010000:1.0:1763333170.396682:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333170.396686:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c542a1 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.396692:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c542a1 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.396715:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c542d9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.396720:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c542d9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.396725:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c542d9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.396730:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48190400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333170.396732:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c542d9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.396738:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c542d9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.396745:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43ab5a00) 00010000:00010000:1.0:1763333170.396748:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333170.396750:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c542d9 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.396755:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c542d9 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.396764:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54303 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.396770:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54303 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.396775:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54303 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.396779:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333170.396782:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54303 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.396787:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54303 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.396794:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92fe4345b200) 00010000:00010000:1.0:1763333170.396797:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333170.396799:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54303 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.396804:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54303 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.396812:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c54357 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.396818:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c54357 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.396823:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c54357 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.396827:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48190200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333170.396829:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c54357 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.396834:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c54357 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.396839:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43ab5a00) 00010000:00010000:1.0:1763333170.396842:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333170.396844:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c54357 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.396848:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c54357 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000100:00100000:3.0:1763333170.397322:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7400f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627214080:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333170.397417:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333170.397454:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763333170.397460:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7400f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627214208:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333170.397479:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:3.0:1763333170.397535:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000aa0a92f1 reply state 00000000be02977f transno 4294971952 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5432d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT1 00010000:00010000:3.0:1763333170.397551:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5432d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT1 00010000:00010000:3.0:1763333170.397570:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92fe4345b200) 00010000:00010000:3.0:1763333170.397573:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1763333170.397577:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763333170.397582:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92fe4345b200) 00010000:00010000:3.0:1763333170.397584:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763333170.397589:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5416d lrc: 0/0,0 mode: --/PW res: [0x240000404:0x190:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c4d expref: 220 pid: 6519 timeout: 0 lvb_type: 0 00010000:00080000:3.0:1763333170.397681:0:6523:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1763333170.397693:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+220:56789:x1848987613552384:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 20045us (20266us total) trans 4294971952 rc 0/0 00000100:00100000:3.0:1763333170.397702:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3034 00010000:00010000:3.0:1763333170.397733:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5432d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT1 00010000:00010000:3.0:1763333170.397741:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5432d lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT1 00010000:00010000:3.0:1763333170.397747:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5432d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT1 00010000:00010000:3.0:1763333170.397753:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333170.397756:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5432d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT1 00010000:00010000:3.0:1763333170.397762:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5432d lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT1 00010000:00010000:3.0:1763333170.397771:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92fe4345b200) 00010000:00010000:3.0:1763333170.397773:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763333170.397776:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5432d lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT1 00010000:00010000:3.0:1763333170.397781:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5432d lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT1 00000100:00100000:3.0:1763333170.397803:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627214080 00000100:00100000:3.0:1763333170.397811:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627214080 00000100:00100000:3.0:1763333170.397843:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627214208 00000100:00100000:3.0:1763333170.397845:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627214208 00000100:00100000:3.0:1763333170.397864:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6197 00000100:00100000:3.0:1763333170.397872:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3652:x1848987627214080:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1763333170.398023:0:17605:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x20d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333170.398026:0:17605:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x20d:0x0] updating lvb mtime from disk: 1763333170 -> 1763333170 00002000:00010000:3.0:1763333170.398029:0:17605:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x20d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333170.398032:0:17605:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x20d:0x0] updating lvb ctime from disk: 1763333170 -> 1763333170 00002000:00010000:3.0:1763333170.398034:0:17605:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x20d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333170.398070:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+7:3652:x1848987627214080:12345-0@lo:2:osp-syn-0-1.0 Request processed in 198us (653us total) trans 21474838742 rc 0/0 00000100:00100000:3.0:1763333170.398077:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6197 00000100:00100000:3.0:1763333170.398093:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6198 00000100:00100000:3.0:1763333170.398100:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3652:x1848987627214208:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1763333170.398148:0:17605:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x20e:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1763333170.398151:0:17605:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x20e:0x0] updating lvb mtime from disk: 1763333170 -> 1763333170 00002000:00010000:3.0:1763333170.398154:0:17605:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x20e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333170.398156:0:17605:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x20e:0x0] updating lvb ctime from disk: 1763333170 -> 1763333170 00002000:00010000:3.0:1763333170.398158:0:17605:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x20e:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763333170.398181:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+7:3652:x1848987627214208:12345-0@lo:2:osp-syn-0-1.0 Request processed in 83us (701us total) trans 21474838743 rc 0/0 00000100:00100000:3.0:1763333170.398187:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6198 00000100:00100000:3.0:1763333170.398219:0:3652:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474838738 gen 2 00000004:00080000:3.0:1763333170.398224:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe438ab480, transno 21474838695 00000004:00080000:3.0:1763333170.398231:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe438aa300, transno 21474838696 00000004:00080000:3.0:1763333170.398234:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff6bc12d80, transno 21474838699 00000004:00080000:3.0:1763333170.398236:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe42efad80, transno 21474838700 00000004:00080000:3.0:1763333170.398239:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe42ef8380, transno 21474838701 00000004:00080000:3.0:1763333170.398241:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe42ef9c00, transno 21474838702 00000004:00080000:3.0:1763333170.398244:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe469a0a80, transno 21474838703 00000004:00080000:3.0:1763333170.398246:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe469a0380, transno 21474838704 00000004:00080000:3.0:1763333170.398249:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe469a1f80, transno 21474838705 00000004:00080000:3.0:1763333170.398251:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe469a2a00, transno 21474838706 00000004:00080000:3.0:1763333170.398253:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe434c7480, transno 21474838708 00000004:00080000:3.0:1763333170.398255:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe434c6d80, transno 21474838709 00000004:00080000:3.0:1763333170.398258:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe434c6680, transno 21474838710 00000004:00080000:3.0:1763333170.398260:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe434c4380, transno 21474838711 00000004:00080000:3.0:1763333170.398263:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe472f6a00, transno 21474838714 00000004:00080000:3.0:1763333170.398265:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe472f5f80, transno 21474838715 00000004:00080000:3.0:1763333170.398267:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe43999180, transno 21474838716 00000004:00080000:3.0:1763333170.398270:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe43998a80, transno 21474838717 00000004:00080000:3.0:1763333170.398273:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4684c000, transno 21474838721 00000004:00080000:3.0:1763333170.398275:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7e121500, transno 21474838722 00000004:00080000:3.0:1763333170.398277:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4399b480, transno 21474838723 00000004:00080000:3.0:1763333170.398279:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe43999500, transno 21474838724 00000004:00080000:3.0:1763333170.398282:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe469a1500, transno 21474838725 00000004:00080000:3.0:1763333170.398284:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe469a0000, transno 21474838726 00000004:00080000:3.0:1763333170.398286:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe469a0700, transno 21474838727 00000004:00080000:3.0:1763333170.398289:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff74039180, transno 21474838728 00000004:00080000:3.0:1763333170.398293:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7e00ca80, transno 21474838730 00000004:00080000:3.0:1763333170.398295:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7e00c000, transno 21474838731 00000004:00080000:3.0:1763333170.398297:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7e00c700, transno 21474838732 00000004:00080000:3.0:1763333170.398300:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7e00e680, transno 21474838733 00000004:00080000:3.0:1763333170.398303:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7e00d880, transno 21474838735 00000004:00080000:3.0:1763333170.398305:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7e00dc00, transno 21474838736 00000004:00080000:3.0:1763333170.398307:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4684c700, transno 21474838737 00000004:00080000:3.0:1763333170.398309:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe45183b80, transno 21474838738 00000100:00100000:3.0:1763333170.398316:0:3652:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff92ff7400f100 x1848987627214208/t21474838743(21474838743) o2->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763333186 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1763333170.398327:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7400f100/2, rc 0, transno 21474838743 00000100:00100000:3.0:1763333170.398330:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7400f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627214208:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1763333170.398340:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7400f480/2, rc 0, transno 21474838742 00000100:00100000:3.0:1763333170.398343:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7400f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627214080:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1763333170.398537:0:8604:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 4 in progress, 2 in flight, 34 done 00000100:00100000:2.0:1763333170.398835:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4920fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627214720:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333170.398871:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333170.398891:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1763333170.398897:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4920e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627214592:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333170.398916:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333170.398939:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627214720 00000100:00100000:2.0:1763333170.398943:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627214720 00000100:00100000:2.0:1763333170.398972:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627214592 00000100:00100000:2.0:1763333170.398975:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627214592 00000100:00100000:2.0:1763333170.398990:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6199 00000100:00100000:2.0:1763333170.398995:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+22:3653:x1848987627214720:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1763333170.399221:0:28650:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x20e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333170.399224:0:28650:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x20e:0x0] updating lvb mtime from disk: 1763333170 -> 1763333170 00002000:00010000:2.0:1763333170.399226:0:28650:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x20e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333170.399228:0:28650:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x20e:0x0] updating lvb ctime from disk: 1763333170 -> 1763333170 00002000:00010000:2.0:1763333170.399230:0:28650:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x20e:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333170.399263:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+23:3653:x1848987627214720:12345-0@lo:2:osp-syn-1-1.0 Request processed in 267us (391us total) trans 17179871437 rc 0/0 00000100:00100000:2.0:1763333170.399269:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6199 00000100:00100000:2.0:1763333170.399285:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6200 00000100:00100000:2.0:1763333170.399292:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+22:3653:x1848987627214592:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1763333170.399341:0:28650:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x20d:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1763333170.399344:0:28650:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x20d:0x0] updating lvb mtime from disk: 1763333170 -> 1763333170 00002000:00010000:2.0:1763333170.399383:0:28650:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x20d:0x0] updating lvb atime from disk: 1763333170 -> 1763333170 00002000:00010000:2.0:1763333170.399385:0:28650:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x20d:0x0] updating lvb ctime from disk: 1763333170 -> 1763333170 00002000:00010000:2.0:1763333170.399388:0:28650:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x20d:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1763333170.399413:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+23:3653:x1848987627214592:12345-0@lo:2:osp-syn-1-1.0 Request processed in 122us (495us total) trans 17179871438 rc 0/0 00000100:00100000:2.0:1763333170.399419:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6200 00000004:00080000:2.0:1763333170.399453:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4920e680/2, rc 0, transno 17179871438 00000100:00100000:2.0:1763333170.399458:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4920e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627214592:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1763333170.399466:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4920fb80/2, rc 0, transno 17179871437 00000100:00100000:2.0:1763333170.399469:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4920fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627214720:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333170.400315:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7400d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627213824:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763333170.400378:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333170.400404:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4920ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627214336:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763333170.400425:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333170.400444:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1763333170.400452:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7400ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627213952:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763333170.400472:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333170.400485:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4920f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627214464:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763333170.400502:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333170.401978:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627213824 00000100:00100000:2.0:1763333170.401990:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627213824 00000100:00100000:2.0:1763333170.402052:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627214336 00000100:00100000:2.0:1763333170.402055:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627214336 00000100:00100000:2.0:1763333170.402083:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627213952 00000100:00100000:2.0:1763333170.402087:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627213952 00000100:00100000:2.0:1763333170.402106:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627214464 00000100:00100000:2.0:1763333170.402109:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627214464 00000100:00100000:2.0:1763333170.402131:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6201 00000100:00100000:2.0:1763333170.402139:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+8:3654:x1848987627213824:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1763333170.402164:0:8611:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:527 count 1 00010000:00010000:2.0:1763333170.402189:0:8611:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5437a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.402207:0:8611:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5000/0xb32e3ef184c54293 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cb6 expref: 13 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.402214:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333170.402216:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333170.402219:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5437a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.402250:0:8611:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5000/0xb32e3ef184c54293 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cb6 expref: 13 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.402262:0:8611:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5000/0xb32e3ef184c54293 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cb6 expref: 13 pid: 17605 timeout: 1374 lvb_type: 0 00000100:00100000:2.0:1763333170.402274:0:8611:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46a6ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8611:1848987627214848:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333170.402383:0:8611:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff412ed3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763333170.402405:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6202 00000100:00100000:2.0:1763333170.402414:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+24:3654:x1848987627214336:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1763333170.402428:0:8404:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:527 count 1 00010000:00010000:2.0:1763333170.402443:0:8404:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54381 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x20f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.402454:0:8404:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5429a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x20f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cbd expref: 22 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.402461:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333170.402463:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333170.402465:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54381 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x20f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.402485:0:8404:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5429a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cbd expref: 22 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.402494:0:8404:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5429a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x20f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cbd expref: 22 pid: 28600 timeout: 1374 lvb_type: 0 00000100:00100000:2.0:1763333170.402504:0:8404:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46a6ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8404:1848987627214976:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333170.402526:0:8404:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff742b9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1763333170.402545:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6203 00000100:00100000:2.0:1763333170.402553:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+8:3654:x1848987627213952:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1763333170.402576:0:8407:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:528 count 1 00002000:00010000:2.0:1763333170.402598:0:8407:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x210:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763333170.402604:0:8407:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54388 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.402612:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333170.402614:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333170.402618:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54388 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.402629:0:8407:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54388 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.402638:0:8407:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54388 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.402645:0:8407:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54388 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.402664:0:8407:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763333170.402915:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+9:3654:x1848987627213952:12345-0@lo:6:osp-syn-0-1.0 Request processed in 364us (2442us total) trans 21474838744 rc 0/0 00000100:00100000:2.0:1763333170.402922:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6203 00000100:00100000:2.0:1763333170.402938:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6204 00000100:00100000:2.0:1763333170.402944:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+24:3654:x1848987627214464:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1763333170.402968:0:8407:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:528 count 1 00002000:00010000:2.0:1763333170.402985:0:8407:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x210:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763333170.402990:0:8407:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5438f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.402998:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333170.402999:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333170.403002:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5438f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.403013:0:8407:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5438f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.403020:0:8407:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5438f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.403027:0:8407:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5438f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.403043:0:8407:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1763333170.403160:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+25:3654:x1848987627214464:12345-0@lo:6:osp-syn-1-1.0 Request processed in 216us (2656us total) trans 17179871439 rc 0/0 00000100:00100000:2.0:1763333170.403167:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6204 00010000:00010000:2.0:1763333170.403187:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1763333170.403194:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54388 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.403202:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5c00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333170.403207:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54388 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.403216:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54388 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.403234:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54388 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.403241:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54388 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.403258:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333170.403261:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5438f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.403267:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333170.403270:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5438f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.403277:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5438f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.403286:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5438f lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.403293:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5438f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.403309:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333170.403311:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333170.403313:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333170.403320:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763333170.403382:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7400ce00/2, rc 0, transno 21474838744 00000100:00100000:2.0:1763333170.403389:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7400ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627213952:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1763333170.403404:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4920f800/2, rc 0, transno 17179871439 00000100:00100000:2.0:1763333170.403409:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4920f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627214464:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763333170.406433:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4920ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627213696:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333170.406467:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54373 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000100:00100000:1.0:1763333170.406553:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.407217:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613553280 00000100:00100000:0.0:1763333170.407227:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613553280 00000100:00100000:0.0:1763333170.407282:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8908 00000100:00100000:0.0:1763333170.407291:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:56789:x1848987613553280:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333170.407316:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333170.407336:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c54396 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968d03 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.407427:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c54396 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d03 expref: 220 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.407442:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde200/0xb32e3ef184c54396 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d03 expref: 220 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.407460:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92fe4345b200) 00010000:00010000:0.0:1763333170.407464:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333170.407468:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abde200, rc 0) 00000100:00100000:0.0:1763333170.407532:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+220:56789:x1848987613553280:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 241us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333170.407540:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8908 00000100:00100000:1.0:1763333170.408317:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.408400:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613553408 00000100:00100000:2.0:1763333170.408407:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613553408 00010000:00010000:2.0:1763333170.408440:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c5435e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cf5 expref: 220 pid: 6521 timeout: 1374 lvb_type: 0 00000100:00100000:2.0:1763333170.408475:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2920 00000100:00100000:2.0:1763333170.408484:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45182300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+220:2421:x1848987613553408:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333170.408495:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333170.408501:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c5435e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cf5 expref: 220 pid: 6521 timeout: 1374 lvb_type: 0 00010000:00010000:2.0:1763333170.408515:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c5435e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cf5 expref: 220 pid: 6521 timeout: 1374 lvb_type: 0 00010000:00010000:2.0:1763333170.408541:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c5435e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cf5 expref: 220 pid: 6521 timeout: 1374 lvb_type: 0 00010000:00010000:2.0:1763333170.408556:0:28428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x193:0x0].0x0 (ffff92fe43ab5200) 00010000:00010000:2.0:1763333170.408570:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54373 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333170.408578:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54373 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333170.408584:0:28428:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54373 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333170.408610:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333170.408655:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45182300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:2421:x1848987613553408:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 173us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333170.408662:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2920 00000100:00100000:2.0:1763333170.408702:0:8404:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46a6ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8404:1848987627214976:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333170.408720:0:8404:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54381 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x20f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.408741:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54373 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333170.408747:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54373 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:2.0:1763333170.408769:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x193:0x0]: returning size 0 00000100:00100000:2.0:1763333170.408923:0:8605:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46a6ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8605:1848987627215104:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1763333170.408963:0:8605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333170.408985:0:8605:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4869d480 going to sleep for 11 seconds 00000100:00100000:2.0:1763333170.409003:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627215104 00000100:00100000:2.0:1763333170.409006:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627215104 00000004:00080000:1.0:1763333170.409474:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x211:0x0], index 1: 0 00000004:00080000:1.0:1763333170.409482:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x211:0x0], index 0: 0 00000004:00080000:1.0:1763333170.409494:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x212:0x0], index 0: 0 00000004:00080000:1.0:1763333170.409498:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x212:0x0], index 1: 0 00010000:00010000:1.0:1763333170.409623:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54373 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.409633:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54373 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.409641:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54373 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.409647:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4a00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333170.409651:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54373 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.409658:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54373 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.409670:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x193:0x0].0x0 (ffff92fe43ab5200) 00010000:00010000:1.0:1763333170.409672:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763333170.409676:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54373 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.409682:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54373 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.409729:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5436c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x193:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cfc expref: 219 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.409739:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x193:0x0].0x0 (ffff92fe43ab5200) 00010000:00010000:1.0:1763333170.409742:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763333170.409746:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5436c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x193:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cfc expref: 219 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.409760:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4400, rc 0) 00000100:00100000:1.0:1763333170.409795:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+218:56794:x1848987613553152:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 15364us (15915us total) trans 4294971953 rc 301/301 00000100:00100000:1.0:1763333170.409803:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8907 00000100:00100000:0.0:1763333170.409963:0:8611:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46a6ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8611:1848987627214848:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333170.409981:0:8611:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5437a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333170.410306:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6205 00000100:00100000:2.0:1763333170.410317:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+9:8605:x1848987627215104:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1763333170.410371:0:28650:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 546 00000100:00100000:3.0:1763333170.410414:0:9837:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7400c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9837:1848987627215232:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1763333170.410460:0:9837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333170.410482:0:9837:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff801bc480 going to sleep for 11 seconds 00000100:00100000:3.0:1763333170.410524:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333170.410549:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.410614:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627215232 00000100:00100000:0.0:1763333170.410620:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627215232 00000100:00100000:0.0:1763333170.410659:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6206 00000100:00100000:0.0:1763333170.410667:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+25:9837:x1848987627215232:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1763333170.410691:0:29013:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 546 00000100:00100000:0.0:1763333170.412275:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+26:9837:x1848987627215232:12345-0@lo:5:osp-pre-1-1.0 Request processed in 1605us (1811us total) trans 17179871440 rc 0/0 00000100:00100000:0.0:1763333170.412286:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6206 00000100:00100000:0.0:1763333170.412344:0:9837:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7400c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9837:1848987627215232:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1763333170.412387:0:9837:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x212:0x0]-[0x2c0000400:0x241:0x0] 00000100:00100000:2.0:1763333170.413208:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+10:8605:x1848987627215104:12345-0@lo:5:osp-pre-0-1.0 Request processed in 2891us (4241us total) trans 21474838745 rc 0/0 00000100:00100000:2.0:1763333170.413217:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6205 00000100:00100000:2.0:1763333170.413255:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613553664 00000100:00100000:2.0:1763333170.413262:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613553664 00010000:00010000:2.0:1763333170.413294:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5429a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x20f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cbd expref: 23 pid: 28600 timeout: 1374 lvb_type: 0 00000100:00100000:2.0:1763333170.413330:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613553536 00000100:00100000:2.0:1763333170.413333:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613553536 00010000:00010000:2.0:1763333170.413367:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5000/0xb32e3ef184c54293 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cb6 expref: 14 pid: 17605 timeout: 1374 lvb_type: 0 00000100:00100000:2.0:1763333170.413395:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2921 00000100:00100000:2.0:1763333170.413406:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff4627c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2420:x1848987613553664:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333170.413421:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1763333170.413426:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2922 00010000:00010000:2.0:1763333170.413429:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5429a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x20f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cbd expref: 23 pid: 28600 timeout: 1374 lvb_type: 0 00000100:00100000:1.0:1763333170.413442:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2420:x1848987613553536:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333170.413448:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5429a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cbd expref: 23 pid: 28600 timeout: 1374 lvb_type: 0 00010000:00010000:1.0:1763333170.413455:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333170.413464:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5000/0xb32e3ef184c54293 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cb6 expref: 14 pid: 17605 timeout: 1374 lvb_type: 0 00010000:00010000:2.0:1763333170.413475:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5429a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x20f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cbd expref: 23 pid: 28600 timeout: 1374 lvb_type: 0 00010000:00010000:1.0:1763333170.413480:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5000/0xb32e3ef184c54293 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cb6 expref: 14 pid: 17605 timeout: 1374 lvb_type: 0 00010000:00010000:2.0:1763333170.413497:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333170.413502:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333170.413505:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5000/0xb32e3ef184c54293 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cb6 expref: 14 pid: 17605 timeout: 1374 lvb_type: 0 00010000:00010000:2.0:1763333170.413509:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54381 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x20f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.413522:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333170.413525:0:28428:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54381 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x20f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.413526:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333170.413532:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5437a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.413541:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5437a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.413553:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333170.413579:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333170.413607:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff4627c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2420:x1848987613553664:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 203us (3081us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333170.413609:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2420:x1848987613553536:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 171us (3057us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333170.413622:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2921 00010000:00010000:2.0:1763333170.413976:0:8404:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54381 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.413986:0:8404:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54381 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.413995:0:8404:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54381 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.414002:0:8404:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54381 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.414019:0:8404:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763333170.414186:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+26:3654:x1848987627214336:12345-0@lo:6:osp-syn-1-1.0 Request processed in 11772us (13758us total) trans 17179871441 rc 0/0 00000100:00100000:2.0:1763333170.414193:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6202 00010000:00010000:2.0:1763333170.414211:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333170.414218:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54381 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.414226:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4600 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333170.414230:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54381 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.414239:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54381 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.414252:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54381 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.414260:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54381 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.414278:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333170.414280:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333170.414282:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763333170.414314:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4920ea00/2, rc 0, transno 17179871441 00000100:00100000:2.0:1763333170.414320:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4920ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627214336:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763333170.415101:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2922 00010000:00010000:1.0:1763333170.415147:0:8611:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5437a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.415157:0:8611:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5437a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.415168:0:8611:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5437a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.415176:0:8611:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5437a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.415205:0:8611:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763333170.415410:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+10:3654:x1848987627213824:12345-0@lo:6:osp-syn-0-1.0 Request processed in 13269us (15029us total) trans 21474838746 rc 0/0 00000100:00100000:1.0:1763333170.415419:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6201 00000004:00080000:1.0:1763333170.415467:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7400d180/2, rc 0, transno 21474838746 00000100:00100000:1.0:1763333170.415473:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7400d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627213824:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1763333170.416532:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333170.416542:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5437a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.416553:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5e00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333170.416574:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5437a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.416585:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5437a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.416605:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5437a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.417111:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5437a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.417143:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333170.417147:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333170.417151:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763333170.417644:0:8605:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46a6ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8605:1848987627215104:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1763333170.417660:0:8605:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x212:0x0]-[0x280000400:0x241:0x0] 00000100:00100000:2.0:1763333170.417782:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.418955:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613553920 00000100:00100000:0.0:1763333170.418966:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613553920 00000100:00100000:0.0:1763333170.419032:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3035 00000100:00100000:0.0:1763333170.419042:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6b3eb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+218:56789:x1848987613553920:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333170.419251:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000004:00080000:0.0:1763333170.419292:0:6523:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x190:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:1.0:1763333170.419344:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613554176 00000100:00100000:1.0:1763333170.419370:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613554176 00000040:00080000:0.0:1763333170.419371:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1306, 64 off110920 00000040:00080000:0.0:1763333170.419396:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1307, 64 off110920 00000100:00100000:1.0:1763333170.419402:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3036 00000040:00080000:0.0:1763333170.419407:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1308, 64 off110984 00000100:00100000:1.0:1763333170.419409:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:56794:x1848987613554176:12345-192.168.204.28@tcp:35:lfs.0 00000040:00080000:0.0:1763333170.419416:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1307, 64 off110984 00010000:00010000:0.0:1763333170.419472:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c543a4 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763333170.419487:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c543a4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x190:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT1 00010000:00010000:0.0:1763333170.419498:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c543a4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x190:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT1 00010000:00010000:0.0:1763333170.419506:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c543a4 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x190:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT1 00010000:00010000:0.0:1763333170.419511:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c543a4 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x190:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT1 00010000:00010000:0.0:1763333170.419516:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c543a4 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x190:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT1 00010000:00010000:0.0:1763333170.419532:0:6523:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763333170.419694:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6b3eb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56789:x1848987613553920:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 652us (1912us total) trans 4294971954 rc 0/0 00000100:00100000:0.0:1763333170.419702:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3035 00010000:00010000:0.0:1763333170.419752:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333170.419758:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c543a4 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x190:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT1 00000100:00100000:1.0:1763333170.419764:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+220:56794:x1848987613554176:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 356us (513us total) trans 4294971955 rc 0/0 00010000:00010000:0.0:1763333170.419765:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdfe00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333170.419768:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c543a4 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x190:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT1 00000100:00100000:1.0:1763333170.419771:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3036 00010000:00010000:0.0:1763333170.419776:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c543a4 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x190:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT1 00010000:00010000:0.0:1763333170.419787:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x190:0x0].0x0 (ffff92fe4345b200) 00010000:00010000:0.0:1763333170.419791:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763333170.419796:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c543a4 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x190:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT1 00010000:00010000:0.0:1763333170.419801:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c543a4 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x190:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT1 00010000:00010000:0.0:1763333170.419810:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333170.419812:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333170.419814:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763333170.423383:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.423480:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.423643:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613554432 00000100:00100000:0.0:1763333170.423654:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613554432 00000100:00100000:0.0:1763333170.423721:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3037 00000100:00100000:0.0:1763333170.423732:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+220:56794:x1848987613554432:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333170.423951:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56794:x1848987613554432:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 220us (611us total) trans 4294971956 rc 0/0 00000100:00100000:0.0:1763333170.423959:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3037 00000100:00100000:3.0:1763333170.426155:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613554688 00000100:00100000:3.0:1763333170.426169:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613554688 00000100:00100000:3.0:1763333170.426238:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8909 00000100:00100000:3.0:1763333170.426250:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56789:x1848987613554688:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333170.426274:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333170.426301:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c543ab lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968d0a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.426406:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c543b2 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333170.426421:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c543b2 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.426433:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c543b2 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.426445:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c543b9 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333170.426451:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c543b9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.426457:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c543b9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.426594:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c543c0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x193:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333170.426602:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c543c0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.426609:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c543c0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:3.0:1763333170.426619:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x193:0x0]: returning size 0 00010000:00010000:3.0:1763333170.426712:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c543b2 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.426720:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c543b2 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.426730:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c543b2 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.426737:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c543b2 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.426743:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feba00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333170.426747:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c543b2 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.426755:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c543b2 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.426767:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055a000) 00010000:00010000:3.0:1763333170.426770:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333170.426775:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c543b2 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.426781:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c543b2 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.426793:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c543b9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.426799:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c543b9 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.426804:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c543b9 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.426809:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333170.426812:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c543b9 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.426821:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c543b9 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.426829:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6055ad00) 00010000:00010000:3.0:1763333170.426831:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333170.426834:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c543b9 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.426839:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c543b9 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.426879:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c543ab lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d0a expref: 224 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.426893:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c543c0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d0a expref: 223 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.426900:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x193:0x0].0x0 (ffff92ff6055a300) 00010000:00010000:3.0:1763333170.426902:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333170.426905:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feb400, rc 0) 00000100:00100000:3.0:1763333170.426984:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56789:x1848987613554688:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 735us (3501us total) trans 4294971957 rc 0/0 00000100:00100000:3.0:1763333170.426992:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8909 00000100:00100000:1.0:1763333170.432622:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.432665:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.432735:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613554816 00000100:00100000:0.0:1763333170.432742:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613554944 00000100:00100000:2.0:1763333170.432748:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613554816 00000100:00100000:0.0:1763333170.432749:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613554944 00000100:00100000:0.0:1763333170.432830:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6207 00000100:00100000:2.0:1763333170.432841:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6208 00000100:00100000:0.0:1763333170.432844:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2420:x1848987613554944:12345-192.168.204.28@tcp:101:lfs.0 00000100:00100000:2.0:1763333170.432855:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2421:x1848987613554816:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333170.432864:0:8611:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333170.432866:0:17605:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333170.432895:0:17605:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c543ce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968d11 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.432896:0:8611:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c543d5 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968d18 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763333170.432931:0:17605:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x212:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1763333170.432931:0:8611:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x212:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763333170.432954:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333170.432955:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333170.432959:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333170.432960:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333170.432970:0:17605:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c543ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d11 expref: 14 pid: 17605 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333170.432971:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c543d5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d18 expref: 23 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333170.433004:0:17605:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c543ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d11 expref: 14 pid: 17605 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333170.433004:0:8611:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c543d5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d18 expref: 23 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333170.433032:0:17605:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5c00, rc 0) 00010000:00010000:0.0:1763333170.433033:0:8611:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdfe00, rc 0) 00000100:00100000:0.0:1763333170.433099:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2420:x1848987613554944:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 259us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333170.433107:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6207 00000100:00100000:2.0:1763333170.433719:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2421:x1848987613554816:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 867us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333170.433727:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6208 00000100:00100000:2.0:1763333170.438154:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333170.438293:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613555200 00000100:00100000:3.0:1763333170.438304:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613555200 00000100:00100000:3.0:1763333170.438402:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8910 00000100:00100000:3.0:1763333170.438414:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:55917:x1848987613555200:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333170.438443:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333170.438447:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763333170.438476:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c543c0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d0a expref: 223 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.438494:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x193:0x0].0x0 (ffff92ff6055a300) 00010000:00010000:3.0:1763333170.438504:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333170.438519:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c543dc lrc: 2/0,0 mode: --/CW res: [0x240000404:0x193:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968d1f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.438633:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c543e3 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x193:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333170.438645:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c543e3 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x193:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.438655:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c543e3 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x193:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:3.0:1763333170.438667:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x193:0x0]: returning size 0 00010000:00010000:3.0:1763333170.438772:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c543dc lrc: 0/0,0 mode: --/CW res: [0x240000404:0x193:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d1f expref: 225 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.438785:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c543e3 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x193:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d1f expref: 224 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.438792:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x193:0x0].0x0 (ffff92ff6055a000) 00010000:00010000:3.0:1763333170.438794:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:3.0:1763333170.438796:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea000, rc 0) 00000100:00100000:3.0:1763333170.438866:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:55917:x1848987613555200:12345-192.168.204.28@tcp:101:bash.0 Request processed in 454us (722us total) trans 4294971958 rc 0/0 00000100:00100000:3.0:1763333170.438874:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8910 00000100:00100000:0.0:1763333170.445265:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.445326:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613555328 00000100:00100000:2.0:1763333170.445337:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613555328 00000100:00100000:2.0:1763333170.445428:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8911 00000100:00100000:2.0:1763333170.445439:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56789:x1848987613555328:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333170.445459:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333170.445482:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c543f1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x193:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968d26 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.445540:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c543f1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d26 expref: 225 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.445555:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c543f1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d26 expref: 225 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.445588:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x193:0x0].0x0 (ffff92ff6055a000) 00010000:00010000:2.0:1763333170.445591:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333170.445595:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5400, rc 0) 00000100:00100000:2.0:1763333170.445659:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56789:x1848987613555328:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 222us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333170.445666:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8911 00000100:00100000:2.0:1763333170.445763:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.445833:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613555456 00000100:00100000:2.0:1763333170.445837:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613555456 00000100:00100000:2.0:1763333170.445857:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8912 00000100:00100000:2.0:1763333170.445864:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:55917:x1848987613555456:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333170.445875:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333170.445884:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c543f8 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x193:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968d2d expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.445903:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c543ff lrc: 3/1,0 mode: --/PR res: [0x240000404:0x193:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333170.445912:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c543ff lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x193:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.445923:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c543ff lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x193:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.446031:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c543f8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x193:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d2d expref: 227 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.446047:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c543ff lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x193:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d2d expref: 226 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.446054:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x193:0x0].0x0 (ffff92ff6055a000) 00010000:00010000:2.0:1763333170.446057:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763333170.446060:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5000, rc 0) 00000100:00100000:2.0:1763333170.446085:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:55917:x1848987613555456:12345-192.168.204.28@tcp:101:bash.0 Request processed in 221us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333170.446091:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8912 00000100:00100000:3.0:1763333170.451196:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333170.451249:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.451324:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613555712 00000100:00100000:1.0:1763333170.451337:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613555712 00000100:00100000:1.0:1763333170.451419:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3038 00000100:00100000:1.0:1763333170.451428:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56789:x1848987613555712:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333170.451476:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613555968 00000100:00100000:0.0:1763333170.451482:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613555968 00000100:00100000:0.0:1763333170.451526:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8913 00000100:00100000:0.0:1763333170.451535:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:55917:x1848987613555968:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:0.0:1763333170.451579:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333170.451608:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c543e3 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x193:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d1f expref: 228 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.451627:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x193:0x0].0x0 (ffff92ff6055a000) 00010000:00010000:0.0:1763333170.451633:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333170.451679:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56789:x1848987613555712:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 251us (492us total) trans 4294971959 rc 0/0 00000100:00100000:1.0:1763333170.451689:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3038 00010000:00010000:0.0:1763333170.451793:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c54406 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x193:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333170.452921:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c54406 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x193:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333170.452941:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c54406 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x193:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000001:00080000:1.0:1763333170.453448:0:6519:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294971960 00000004:00010000:1.0:1763333170.453495:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d4eadac6 reply state 000000006d85755a transno 4294971961 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c54406 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x193:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.453511:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c54406 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x193:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.453519:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x193:0x0].0x0 (ffff92ff6055a000) 00010000:00010000:1.0:1763333170.453522:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333170.453525:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763333170.453654:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:55917:x1848987613555968:12345-192.168.204.28@tcp:36:bash.0 Request processed in 2117us (2400us total) trans 4294971961 rc 0/0 00000100:00100000:1.0:1763333170.453665:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8913 00000020:00080000:1.0:1763333170.453670:0:6519:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763333170.455255:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.455437:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613556224 00000100:00100000:1.0:1763333170.455448:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613556224 00000100:00100000:1.0:1763333170.455510:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8914 00000100:00100000:1.0:1763333170.455522:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56789:x1848987613556224:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333170.455549:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333170.455584:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c5440d lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968d34 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.455666:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c54414 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333170.455679:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c54414 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.455690:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c54414 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.455702:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5441b lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333170.455708:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5441b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.455714:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5441b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.455824:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54422 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x193:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333170.455832:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54422 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.455838:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54422 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:1.0:1763333170.455847:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x193:0x0]: returning size 0 00010000:00010000:1.0:1763333170.455920:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c54414 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.455927:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c54414 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.455934:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c54414 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.455939:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c54414 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.455944:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fc00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333170.455949:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c54414 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.455956:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c54414 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.455966:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe4388ee00) 00010000:00010000:1.0:1763333170.455969:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333170.455973:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c54414 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.455979:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c54414 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.455991:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5441b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.455996:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5441b lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.456001:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5441b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.456004:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333170.456007:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5441b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.456012:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5441b lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.456018:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe4388ed00) 00010000:00010000:1.0:1763333170.456021:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333170.456023:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5441b lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.456032:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5441b lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.456069:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c5440d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d34 expref: 232 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.456084:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54422 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d34 expref: 231 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.456091:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x193:0x0].0x0 (ffff92ff6055a000) 00010000:00010000:1.0:1763333170.456093:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333170.456096:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f800, rc 0) 00000100:00100000:1.0:1763333170.460584:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56789:x1848987613556224:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 5040us (5313us total) trans 4294971962 rc 0/0 00000100:00100000:1.0:1763333170.460599:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8914 00000100:00100000:2.0:1763333170.460933:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.460987:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613556480 00000100:00100000:1.0:1763333170.460995:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613556480 00000100:00100000:1.0:1763333170.461051:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8915 00000100:00100000:1.0:1763333170.461061:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:55917:x1848987613556480:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333170.461086:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333170.461090:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763333170.461116:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c543f1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d26 expref: 231 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.461134:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x193:0x0].0x0 (ffff92ff6055a000) 00010000:00010000:1.0:1763333170.461139:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333170.461153:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54430 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x193:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968d3b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.461196:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54437 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x193:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333170.461208:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54422 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d34 expref: 231 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.461216:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54437 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x193:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.461245:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54422 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d34 expref: 231 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.461259:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54422 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d34 expref: 231 pid: 6519 timeout: 1374 lvb_type: 0 00000100:00100000:1.0:1763333170.461274:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe45182680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627215360:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333170.461395:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe46e0eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1763333170.466855:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.466952:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe45182680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627215360:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333170.466979:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54437 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x193:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000100:00100000:0.0:1763333170.467049:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613556736 00000100:00100000:0.0:1763333170.467059:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613556736 00000100:00100000:0.0:1763333170.467121:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3039 00000100:00100000:0.0:1763333170.467131:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56789:x1848987613556736:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333170.467376:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56789:x1848987613556736:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 220us (504us total) trans 4294971963 rc 0/0 00000100:00100000:0.0:1763333170.467384:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3039 00000100:00100000:3.0:1763333170.470759:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333170.473111:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.473261:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613556864 00000100:00100000:1.0:1763333170.473272:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613556864 00000100:00100000:1.0:1763333170.473317:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3040 00000100:00100000:1.0:1763333170.473325:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56789:x1848987613556864:12345-192.168.204.28@tcp:33:lfs.0 00000100:00100000:1.0:1763333170.473497:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56789:x1848987613556864:12345-192.168.204.28@tcp:33:lfs.0 Request processed in 172us (2747us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333170.473508:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3040 00000100:00100000:2.0:1763333170.473656:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613556992 00000100:00100000:2.0:1763333170.473661:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613556992 00010000:00010000:2.0:1763333170.473686:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54422 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d34 expref: 233 pid: 6519 timeout: 1374 lvb_type: 0 00000100:00100000:2.0:1763333170.473723:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2923 00000100:00100000:2.0:1763333170.473730:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:2420:x1848987613556992:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333170.473741:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333170.473747:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54422 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d34 expref: 233 pid: 6519 timeout: 1374 lvb_type: 0 00010000:00010000:2.0:1763333170.473759:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54422 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d34 expref: 233 pid: 6519 timeout: 1374 lvb_type: 0 00010000:00010000:2.0:1763333170.473779:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54422 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d34 expref: 233 pid: 6519 timeout: 1374 lvb_type: 0 00010000:00010000:2.0:1763333170.473794:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x193:0x0].0x0 (ffff92ff6055a000) 00010000:00010000:2.0:1763333170.473799:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54437 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x193:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333170.473810:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54437 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x193:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333170.473818:0:6505:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54437 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x193:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333170.473841:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333170.473864:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:2420:x1848987613556992:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 135us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333170.473869:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2923 00010000:00010000:1.0:1763333170.474972:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54437 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x193:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.474985:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54437 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x193:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000040:00080000:1.0:1763333170.475236:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1308, 88 off111072 00000004:00080000:1.0:1763333170.475244:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1274554895061ns, next at 1274741674609ns, rc = 0 00000040:00080000:1.0:1763333170.475274:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1309, 88 off111072 00000004:00080000:1.0:1763333170.475278:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1274554929115ns, next at 1274741703917ns, rc = 0 00000040:00080000:1.0:1763333170.475298:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1310, 88 off111160 00000004:00080000:1.0:1763333170.475302:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1274554952675ns, next at 1274741703917ns, rc = 0 00000040:00080000:1.0:1763333170.475309:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1309, 88 off111160 00000004:00080000:1.0:1763333170.475312:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1274554962988ns, next at 1274741674609ns, rc = 0 00000001:00080000:1.0:1763333170.484003:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294971964 is committed 00000004:00080000:1.0:1763333170.484019:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 856 committed 00000004:00080000:1.0:1763333170.484041:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 859 committed 00000004:00080000:1.0:1763333170.484061:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 858 committed 00000004:00080000:1.0:1763333170.484065:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 855 committed 00010000:00010000:1.0:1763333170.484179:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54437 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x193:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d3b expref: 221 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.484196:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x193:0x0].0x0 (ffff92ff6055a000) 00010000:00010000:1.0:1763333170.484200:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:2.0:1763333170.484205:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46a6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627215488:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1763333170.484219:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54430 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d3b expref: 221 pid: 6519 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763333170.484239:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54437 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x193:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d3b expref: 220 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.484274:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x193:0x0].0x0 (ffff92ff6055a000) 00010000:00010000:1.0:1763333170.484277:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763333170.484279:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7ec00, rc 0) 00000100:00100000:2.0:1763333170.484281:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333170.484332:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+220:55917:x1848987613556480:12345-192.168.204.28@tcp:101:bash.0 Request processed in 23272us (23399us total) trans 4294971964 rc 0/0 00000100:00100000:1.0:1763333170.484341:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8915 00000100:00100000:2.0:1763333170.484605:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627216000:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763333170.484630:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333170.484658:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1763333170.484664:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46a6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627215616:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763333170.484690:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333170.484711:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46e2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627216128:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763333170.484732:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333170.484764:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46a6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627215744:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333170.484786:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333170.484802:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46e2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627216256:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333170.484822:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333170.484836:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1763333170.484841:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46a6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627215872:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333170.484857:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333170.484869:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46e2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627216384:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333170.484882:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333170.484907:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627215488 00000100:00100000:2.0:1763333170.484913:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627215488 00000100:00100000:2.0:1763333170.484945:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627216000 00000100:00100000:2.0:1763333170.484957:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627216000 00000100:00100000:2.0:1763333170.484972:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627215616 00000100:00100000:2.0:1763333170.484974:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627215616 00000100:00100000:2.0:1763333170.484981:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627216128 00000100:00100000:2.0:1763333170.484983:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627216128 00000100:00100000:2.0:1763333170.484990:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627215744 00000100:00100000:2.0:1763333170.484992:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627215744 00000100:00100000:2.0:1763333170.484999:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627216256 00000100:00100000:2.0:1763333170.485001:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627216256 00000100:00100000:2.0:1763333170.485007:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627215872 00000100:00100000:2.0:1763333170.485009:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627215872 00000100:00100000:2.0:1763333170.485016:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627216384 00000100:00100000:2.0:1763333170.485017:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627216384 00000100:00100000:2.0:1763333170.485027:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6209 00000100:00100000:2.0:1763333170.485034:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+29:3654:x1848987627215488:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1763333170.485054:0:8406:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:525 count 1 00010000:00010000:2.0:1763333170.485076:0:8406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5443e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.485092:0:8406:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5421c lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c8c expref: 22 pid: 28600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333170.485106:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333170.485108:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333170.485112:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5443e lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.485139:0:8406:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5421c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c8c expref: 22 pid: 28600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333170.485152:0:8406:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5421c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c8c expref: 22 pid: 28600 timeout: 1374 lvb_type: 1 00000100:00100000:2.0:1763333170.485164:0:8406:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff73166d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8406:1848987627216512:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333170.485205:0:8406:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff742b9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1763333170.485219:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6210 00000100:00100000:2.0:1763333170.485225:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+13:3654:x1848987627216000:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1763333170.485236:0:28650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:525 count 1 00010000:00010000:2.0:1763333170.485250:0:28650:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54445 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.485261:0:28650:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c540ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c2a expref: 13 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.485267:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333170.485269:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333170.485271:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54445 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.485292:0:28650:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c540ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c2a expref: 13 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.485300:0:28650:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c540ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c2a expref: 13 pid: 29013 timeout: 1374 lvb_type: 0 00000100:00100000:2.0:1763333170.485310:0:28650:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff73167480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28650:1848987627216640:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333170.485328:0:28650:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff742b9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1763333170.485342:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6211 00000100:00100000:2.0:1763333170.485379:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff49773c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+29:3654:x1848987627215616:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1763333170.485389:0:28600:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:526 count 1 00010000:00010000:2.0:1763333170.485399:0:28600:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5444c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.485409:0:28600:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c542cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cd2 expref: 22 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.485414:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333170.485415:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333170.485418:0:28600:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5444c lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.485434:0:28600:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c542cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cd2 expref: 22 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.485443:0:28600:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c542cb lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cd2 expref: 22 pid: 17605 timeout: 1374 lvb_type: 0 00000100:00100000:2.0:1763333170.485452:0:28600:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff73167100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28600:1848987627216768:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333170.485476:0:28600:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff471d7a80 going to sleep for 11 seconds 00000100:00100000:2.0:1763333170.485490:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6212 00000100:00100000:2.0:1763333170.485496:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+13:3654:x1848987627216128:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1763333170.485506:0:8407:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:526 count 1 00010000:00010000:2.0:1763333170.485516:0:8407:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54453 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.485525:0:8407:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c542c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cc4 expref: 13 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.485531:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333170.485532:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333170.485535:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54453 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.485549:0:8407:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c542c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cc4 expref: 13 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.485565:0:8407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c542c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cc4 expref: 13 pid: 17605 timeout: 1374 lvb_type: 0 00000100:00100000:2.0:1763333170.485574:0:8407:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff73167b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8407:1848987627216896:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333170.485592:0:8407:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff51d95000 going to sleep for 11 seconds 00000100:00100000:2.0:1763333170.485607:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6213 00000100:00100000:2.0:1763333170.485613:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+29:3652:x1848987627215744:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333170.485751:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+30:3652:x1848987627215744:12345-0@lo:2:osp-syn-1-1.0 Request processed in 138us (963us total) trans 17179871442 rc 0/0 00000100:00100000:2.0:1763333170.485758:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6213 00000100:00100000:2.0:1763333170.485771:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6214 00000100:00100000:2.0:1763333170.485777:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+13:3652:x1848987627216256:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333170.485841:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+14:3652:x1848987627216256:12345-0@lo:2:osp-syn-0-1.0 Request processed in 64us (1018us total) trans 21474838747 rc 0/0 00000100:00100000:2.0:1763333170.485846:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6214 00000100:00100000:2.0:1763333170.485856:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6215 00000100:00100000:2.0:1763333170.485861:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73164700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+29:3652:x1848987627215872:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1763333170.485900:0:28651:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x212:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333170.485903:0:28651:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x212:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1763333170.485905:0:28651:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x212:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333170.485907:0:28651:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x212:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1763333170.485909:0:28651:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x212:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333170.485926:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73164700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+30:3652:x1848987627215872:12345-0@lo:2:osp-syn-1-1.0 Request processed in 65us (1068us total) trans 17179871443 rc 0/0 00000100:00100000:2.0:1763333170.485931:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6215 00000100:00100000:2.0:1763333170.485941:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6216 00000100:00100000:2.0:1763333170.485947:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73165880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+13:3652:x1848987627216384:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:2.0:1763333170.485981:0:28651:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x212:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333170.485983:0:28651:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x212:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1763333170.485985:0:28651:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x212:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333170.485987:0:28651:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x212:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1763333170.485989:0:28651:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x212:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333170.486007:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73165880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+14:3652:x1848987627216384:12345-0@lo:2:osp-syn-0-1.0 Request processed in 61us (1124us total) trans 21474838748 rc 0/0 00000100:00100000:2.0:1763333170.486012:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6216 00000004:00080000:2.0:1763333170.486052:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe46a6f480/2, rc 0, transno 17179871443 00000100:00100000:2.0:1763333170.486057:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46a6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627215872:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1763333170.486066:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe46e2c700/2, rc 0, transno 21474838748 00000100:00100000:2.0:1763333170.486069:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46e2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627216384:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1763333170.486075:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe46a6c380/2, rc 0, transno 17179871442 00000100:00100000:2.0:1763333170.486078:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46a6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627215744:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1763333170.486084:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe46e2e300/2, rc 0, transno 21474838747 00000100:00100000:2.0:1763333170.486087:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46e2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627216256:0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1763333170.486597:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c54406 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x193:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.486608:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c54406 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x193:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.486615:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c54406 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x193:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.486620:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdee00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333170.486625:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c54406 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x193:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.486631:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c54406 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x193:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.486646:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x193:0x0].0x0 (ffff92ff6055a000) 00010000:00010000:3.0:1763333170.486649:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333170.486654:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c54406 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x193:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.486661:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c54406 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x193:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000100:00100000:3.0:1763333170.490971:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333170.491005:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333170.491032:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333170.491063:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333170.491102:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613557248 00000100:00100000:3.0:1763333170.491111:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613557248 00010000:00010000:3.0:1763333170.491150:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c540ef lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c2a expref: 14 pid: 29013 timeout: 1374 lvb_type: 0 00000100:00100000:3.0:1763333170.491179:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613557120 00000100:00100000:3.0:1763333170.491182:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613557120 00010000:00010000:3.0:1763333170.491194:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5421c lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c8c expref: 23 pid: 28600 timeout: 1374 lvb_type: 1 00000100:00100000:3.0:1763333170.491207:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2924 00000100:00100000:3.0:1763333170.491216:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2418:x1848987613557248:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333170.491231:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333170.491236:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c540ef lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c2a expref: 14 pid: 29013 timeout: 1374 lvb_type: 0 00010000:00010000:3.0:1763333170.491248:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c540ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c2a expref: 14 pid: 29013 timeout: 1374 lvb_type: 0 00010000:00010000:3.0:1763333170.491272:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333170.491275:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333170.491279:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54445 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.491289:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54445 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.491310:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333170.491382:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2418:x1848987613557248:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 166us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333170.491390:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2924 00000100:00100000:3.0:1763333170.491407:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613557376 00000100:00100000:3.0:1763333170.491410:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613557376 00010000:00010000:3.0:1763333170.491422:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c542cb lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cd2 expref: 24 pid: 17605 timeout: 1374 lvb_type: 0 00000100:00100000:3.0:1763333170.491433:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613557504 00000100:00100000:3.0:1763333170.491435:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613557504 00010000:00010000:3.0:1763333170.491445:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c542c4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cc4 expref: 14 pid: 17605 timeout: 1374 lvb_type: 0 00000100:00100000:3.0:1763333170.491457:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2925 00000100:00100000:3.0:1763333170.491463:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:2418:x1848987613557120:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333170.491471:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333170.491475:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5421c lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x20d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c8c expref: 24 pid: 28600 timeout: 1374 lvb_type: 1 00010000:00010000:3.0:1763333170.491486:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5421c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x20d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c8c expref: 24 pid: 28600 timeout: 1374 lvb_type: 1 00010000:00010000:3.0:1763333170.491500:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333170.491502:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333170.491506:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5443e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x20d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.491514:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5443e lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x20d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.491531:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333170.491551:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:2418:x1848987613557120:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 88us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333170.491569:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2925 00000100:00100000:3.0:1763333170.491584:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2926 00000100:00100000:3.0:1763333170.491591:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2418:x1848987613557376:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333170.491599:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333170.491604:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c542cb lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x20e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cd2 expref: 23 pid: 17605 timeout: 1374 lvb_type: 0 00010000:00010000:3.0:1763333170.491614:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c542cb lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x20e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cd2 expref: 23 pid: 17605 timeout: 1374 lvb_type: 0 00010000:00010000:3.0:1763333170.491626:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333170.491627:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333170.491630:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5444c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x20e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.491638:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5444c lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x20e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.491650:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333170.491669:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2418:x1848987613557376:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 78us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333170.491676:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2926 00000100:00100000:3.0:1763333170.491689:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2927 00000100:00100000:3.0:1763333170.491696:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2418:x1848987613557504:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333170.491704:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333170.491709:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c542c4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cc4 expref: 14 pid: 17605 timeout: 1374 lvb_type: 0 00010000:00010000:3.0:1763333170.491717:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c542c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cc4 expref: 14 pid: 17605 timeout: 1374 lvb_type: 0 00010000:00010000:3.0:1763333170.491728:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333170.491730:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333170.491733:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54453 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.491740:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54453 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.491749:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333170.491766:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2418:x1848987613557504:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 71us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333170.491772:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2927 00010000:00010000:0.0:1763333170.491999:0:28650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c540ef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c2a expref: 13 pid: 29013 timeout: 1374 lvb_type: 0 00000100:00100000:0.0:1763333170.492014:0:28650:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff73167480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28650:1848987627216640:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333170.492035:0:28650:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54445 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.492046:0:28650:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54445 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.492052:0:28650:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54445 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.492060:0:28650:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54445 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.492067:0:28650:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54445 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.492091:0:28650:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763333170.492317:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+14:3654:x1848987627216000:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7090us (7684us total) trans 21474838749 rc 0/0 00000100:00100000:0.0:1763333170.492326:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6210 00010000:00010000:0.0:1763333170.492370:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333170.492376:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54445 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.492384:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5e00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333170.492387:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54445 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.492396:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54445 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.492409:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54445 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.492416:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54445 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.492432:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333170.492434:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333170.492436:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763333170.492465:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe46e2e680/2, rc 0, transno 21474838749 00000100:00100000:0.0:1763333170.492471:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627216000:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1763333170.493455:0:8407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c542c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cc4 expref: 12 pid: 17605 timeout: 1374 lvb_type: 0 00000100:00100000:2.0:1763333170.493470:0:8407:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff73167b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8407:1848987627216896:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333170.493481:0:8406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5421c lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968c8c expref: 22 pid: 28600 timeout: 1374 lvb_type: 1 00010000:00010000:2.0:1763333170.493487:0:8407:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54453 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333170.493491:0:8406:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff73166d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8406:1848987627216512:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333170.493496:0:8407:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54453 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.493502:0:8407:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54453 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.493504:0:8406:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5443e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.493518:0:8406:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5443e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.493519:0:8407:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54453 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.493525:0:8406:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5443e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.493527:0:8407:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54453 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.493533:0:8406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5443e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.493539:0:8406:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5443e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.493551:0:8407:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1763333170.493630:0:8406:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1763333170.493868:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1763333170.493876:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54453 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.493884:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4a00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333170.493887:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54453 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.493895:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54453 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.493910:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54453 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.493916:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54453 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.493932:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333170.493936:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5443e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.493947:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4800 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333170.493962:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5443e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.493968:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5443e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.493977:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5443e lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.493983:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5443e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.493995:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333170.493997:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333170.493998:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333170.495688:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763333170.495995:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+14:3654:x1848987627216128:12345-0@lo:6:osp-syn-0-1.0 Request processed in 10493us (11256us total) trans 21474838750 rc 0/0 00000100:00100000:2.0:1763333170.496009:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6212 00010000:00010000:2.0:1763333170.496082:0:28600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c542cb lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968cd2 expref: 21 pid: 17605 timeout: 1374 lvb_type: 0 00000100:00100000:2.0:1763333170.496098:0:28600:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff73167100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28600:1848987627216768:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333170.496120:0:28600:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5444c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.496130:0:28600:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5444c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.496137:0:28600:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5444c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.496146:0:28600:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5444c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.496158:0:28600:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5444c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.496191:0:28600:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763333170.496437:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff49773c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+31:3654:x1848987627215616:12345-0@lo:6:osp-syn-1-1.0 Request processed in 11088us (11746us total) trans 17179871445 rc 0/0 00000100:00100000:2.0:1763333170.496444:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6211 00000004:00080000:0.0:1763333170.496580:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe46a6dc00/2, rc 0, transno 17179871445 00000100:00100000:0.0:1763333170.496587:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46a6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627215616:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1763333170.496599:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe46e2d180/2, rc 0, transno 21474838750 00000100:00100000:0.0:1763333170.496602:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46e2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627216128:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1763333170.496664:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333170.496672:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5444c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.496681:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333170.496684:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5444c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.496693:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5444c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.496716:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5444c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.496722:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5444c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.496739:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333170.496741:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333170.496743:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763333170.499494:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+30:3654:x1848987627215488:12345-0@lo:6:osp-syn-1-1.0 Request processed in 14308us (15060us total) trans 17179871444 rc 0/0 00000100:00100000:3.0:1763333170.499508:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6209 00000100:00100000:1.0:1763333170.499541:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.499584:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.499615:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613557888 00000100:00100000:1.0:1763333170.499625:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613557888 00000100:00100000:1.0:1763333170.499673:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8916 00000100:00100000:1.0:1763333170.499682:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:56795:x1848987613557888:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333170.499707:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333170.499734:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5445a lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968d49 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.499816:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54461 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333170.499830:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54461 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.499842:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54461 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.499856:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54468 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333170.499864:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54468 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.499870:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54468 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00080000:2.0:1763333170.500095:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe46a6c700/2, rc 0, transno 17179871444 00000100:00100000:2.0:1763333170.500103:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46a6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627215488:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763333170.500126:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613557632 00000100:00100000:2.0:1763333170.500130:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613557632 00010000:00010000:1.0:1763333170.500799:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5446f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x193:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333170.500813:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5446f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.500823:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5446f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:1.0:1763333170.500836:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x193:0x0]: returning size 2 00010000:00010000:1.0:1763333170.500942:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54461 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.500962:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54461 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.500990:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54461 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.500997:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54461 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.501003:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333170.501007:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54461 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.501014:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54461 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.501029:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355800) 00010000:00010000:1.0:1763333170.501032:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333170.501037:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54461 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.501042:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54461 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.501054:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54468 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.501059:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54468 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.501064:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54468 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.501069:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333170.501071:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54468 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.501076:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54468 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.501082:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355600) 00010000:00010000:1.0:1763333170.501085:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333170.501088:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54468 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.501093:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54468 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.501142:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5445a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d49 expref: 222 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.501157:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5446f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d49 expref: 221 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.501165:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x193:0x0].0x0 (ffff92ff6055a000) 00010000:00010000:1.0:1763333170.501167:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333170.501170:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7fc00, rc 0) 00000100:00100000:1.0:1763333170.501239:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56795:x1848987613557888:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1557us (1652us total) trans 4294971965 rc 0/0 00000100:00100000:1.0:1763333170.501246:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8916 00000100:00100000:3.0:1763333170.501421:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6217 00000100:00100000:3.0:1763333170.501434:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:55917:x1848987613557632:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333170.501450:0:8407:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333170.501471:0:8407:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5447d lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968d42 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333170.501661:0:8407:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x211:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333170.501680:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333170.501684:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333170.501694:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5447d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d42 expref: 22 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.501707:0:8407:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5447d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d42 expref: 22 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.501718:0:8407:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea200, rc 0) 00000100:00100000:3.0:1763333170.501754:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:55917:x1848987613557632:12345-192.168.204.28@tcp:101:bash.0 Request processed in 325us (2216us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333170.501760:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6217 00000100:00100000:3.0:1763333170.504469:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.504783:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613558016 00000100:00100000:2.0:1763333170.504797:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613558016 00000100:00100000:2.0:1763333170.504867:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6218 00000100:00100000:2.0:1763333170.504881:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2420:x1848987613558016:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333170.504912:0:8407:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333170.504938:0:8407:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54484 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968d50 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333170.505010:0:8407:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff73167100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8407:1848987627217024:192.168.204.28@tcp:106: 00000100:00100000:2.0:1763333170.505096:0:8407:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff51d95000 going to sleep for 11 seconds 00000100:00100000:3.0:1763333170.507678:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00002000:00010000:2.0:1763333170.507766:0:8407:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000400:0x211:0x0] updating lvb mtime: 0 -> 1763333170 00002000:00010000:2.0:1763333170.507771:0:8407:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000400:0x211:0x0] updating lvb atime: 0 -> 1763333170 00002000:00010000:2.0:1763333170.507773:0:8407:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000400:0x211:0x0] updating lvb ctime: 0 -> 1763333170 00000100:00100000:2.0:1763333170.507792:0:8407:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff73167100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8407:1848987627217024:192.168.204.28@tcp:106: 00010000:00010000:2.0:1763333170.507829:0:8407:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54484 lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d50 expref: 23 pid: 8407 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333170.507851:0:8407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54484 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d50 expref: 23 pid: 8407 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333170.507863:0:8407:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4000, rc 0) 00000100:00100000:2.0:1763333170.507925:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2420:x1848987613558016:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 3046us (3466us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333170.507934:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6218 00000100:00100000:2.0:1763333170.507965:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613558144 00000100:00100000:2.0:1763333170.507971:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613558144 00000100:00100000:2.0:1763333170.508019:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6219 00000100:00100000:2.0:1763333170.508027:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:55917:x1848987613558144:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333170.508041:0:8407:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333170.508059:0:8407:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5448b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968d57 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763333170.508076:0:8407:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x211:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763333170.508915:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333170.508922:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333170.508936:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5448b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d57 expref: 13 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.508956:0:8407:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5448b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d57 expref: 13 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.508973:0:8407:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4600, rc 0) 00000100:00100000:2.0:1763333170.509169:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:55917:x1848987613558144:12345-192.168.204.28@tcp:101:bash.0 Request processed in 1142us (1498us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333170.509177:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6219 00000100:00100000:3.0:1763333170.512695:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333170.513687:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.513708:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613558272 00000100:00100000:1.0:1763333170.513717:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613558272 00002000:00010000:1.0:1763333170.513757:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/529 (0->18446744073709551615) 00002000:00100000:1.0:1763333170.513762:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe42f0c000 with x1848987613558272 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333170.513773:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe42f0c000. 00000100:00100000:3.0:1763333170.514747:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333170.514771:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613558656 00000100:00100000:3.0:1763333170.514776:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613558656 00000100:00100000:3.0:1763333170.514813:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3041 00000100:00100000:3.0:1763333170.514821:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6b3e8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56795:x1848987613558656:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333170.515052:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6b3e8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:56795:x1848987613558656:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 231us (308us total) trans 4294971966 rc 0/0 00000100:00100000:3.0:1763333170.515059:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3041 00000100:00100000:1.0:1763333170.515245:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613558400 00000100:00100000:1.0:1763333170.515251:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613558400 00002000:00010000:1.0:1763333170.515268:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/529 (0->18446744073709551615) 00002000:00100000:1.0:1763333170.515272:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe42f0f800 with x1848987613558400 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333170.515281:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe42f0f800. 00000100:00100000:1.0:1763333170.515310:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1550 00000100:00100000:1.0:1763333170.515318:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2421:x1848987613558272:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:1.0:1763333170.515479:0:28427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x211:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333170.515483:0:28427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x211:0x0] updating lvb mtime from disk: 1763333170 -> 1763333170 00002000:00010000:1.0:1763333170.515486:0:28427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x211:0x0] updating lvb atime from disk: 1763333170 -> 0 00002000:00010000:1.0:1763333170.515488:0:28427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x211:0x0] updating lvb ctime from disk: 1763333170 -> 1763333170 00002000:00010000:1.0:1763333170.515491:0:28427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x211:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333170.515520:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2421:x1848987613558272:12345-192.168.204.28@tcp:10:bash.0 Request processed in 203us (2835us total) trans 17179871446 rc 0/0 00000100:00100000:1.0:1763333170.515527:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1550 00002000:00010000:1.0:1763333170.515530:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/529 (0->18446744073709551615) 00002000:00100000:1.0:1763333170.515533:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe42f0c000 with x1848987613558272 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333170.515538:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe42f0c000. 00000100:00100000:1.0:1763333170.515552:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1551 00000100:00100000:1.0:1763333170.515568:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2420:x1848987613558400:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:1.0:1763333170.515653:0:28427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x211:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333170.515656:0:28427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x211:0x0] updating lvb mtime from disk: 0 -> 1763333170 00002000:00010000:1.0:1763333170.515658:0:28427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x211:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333170.515660:0:28427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x211:0x0] updating lvb ctime from disk: 0 -> 1763333170 00002000:00010000:1.0:1763333170.515662:0:28427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x211:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333170.515683:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2420:x1848987613558400:12345-192.168.204.28@tcp:10:bash.0 Request processed in 125us (2000us total) trans 21474838751 rc 0/0 00000100:00100000:1.0:1763333170.515689:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1551 00002000:00010000:1.0:1763333170.515692:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/529 (0->18446744073709551615) 00002000:00100000:1.0:1763333170.515694:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe42f0f800 with x1848987613558400 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333170.515697:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe42f0f800. 00000100:00100000:1.0:1763333170.521881:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.521938:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613558912 00000100:00100000:0.0:1763333170.521959:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613558912 00000100:00100000:1.0:1763333170.521996:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.522021:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613559168 00000100:00100000:0.0:1763333170.522024:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3042 00000100:00100000:1.0:1763333170.522025:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613559168 00000100:00100000:0.0:1763333170.522033:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:55917:x1848987613558912:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:1.0:1763333170.522052:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8917 00000100:00100000:1.0:1763333170.522059:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56795:x1848987613559168:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333170.522068:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1763333170.522374:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:55917:x1848987613558912:12345-192.168.204.28@tcp:35:bash.0 Request processed in 312us (477us total) trans 4294971967 rc 0/0 00000100:00100000:0.0:1763333170.522383:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3042 00010000:00010000:1.0:1763333170.522759:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54492 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x193:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968d5e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.522844:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54499 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x193:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333170.522859:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5446f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d49 expref: 224 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.522867:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54499 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x193:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.522901:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5446f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d49 expref: 224 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.522915:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5446f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d49 expref: 224 pid: 6519 timeout: 1374 lvb_type: 0 00000100:00100000:1.0:1763333170.522929:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe45181880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627217152:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333170.522993:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe46e0e540 going to sleep for 11 seconds 00000100:00100000:2.0:1763333170.533641:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe45181880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627217152:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333170.533641:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:2.0:1763333170.533675:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54499 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x193:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000100:00100000:0.0:1763333170.533762:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333170.533835:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613559552 00000100:00100000:3.0:1763333170.533843:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613559552 00000100:00100000:1.0:1763333170.533853:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613559424 00000100:00100000:1.0:1763333170.533858:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613559424 00010000:00010000:3.0:1763333170.533893:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5446f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d49 expref: 226 pid: 6519 timeout: 1374 lvb_type: 0 00000100:00100000:3.0:1763333170.533926:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2928 00000100:00100000:3.0:1763333170.533938:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff4627cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:2420:x1848987613559552:12345-192.168.204.28@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1763333170.533971:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8918 00000100:00100000:1.0:1763333170.533980:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56796:x1848987613559424:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:1.0:1763333170.534056:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1763333170.534096:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54437 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x193:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d3b expref: 226 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.534124:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c543ff lrc: 0/0,0 mode: --/PR res: [0x240000404:0x193:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d2d expref: 225 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.534137:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x193:0x0].0x0 (ffff92ff6055a000) 00010000:00010000:1.0:1763333170.534142:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54499 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x193:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.534153:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54499 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x193:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.534160:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333170.534203:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c544a0 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333170.534218:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c544a0 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.534229:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c544a0 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.534243:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c544a7 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333170.534250:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c544a7 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.534256:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c544a7 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.534275:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333170.534281:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5446f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d49 expref: 224 pid: 6519 timeout: 1374 lvb_type: 0 00010000:00010000:3.0:1763333170.534292:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5446f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d49 expref: 224 pid: 6519 timeout: 1374 lvb_type: 0 00010000:00010000:3.0:1763333170.534304:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5446f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x193:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d49 expref: 224 pid: 6519 timeout: 1374 lvb_type: 0 00010000:00010000:3.0:1763333170.534315:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x193:0x0].0x0 (ffff92ff6055a000) 00010000:00010000:3.0:1763333170.534318:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54499 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x193:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.534325:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54499 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x193:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333170.534331:0:6505:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54499 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x193:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.534344:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c544ae lrc: 3/0,1 mode: --/EX res: [0x240000404:0x193:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333170.534388:0:6521:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54499 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x193:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.535197:0:6521:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c544ae lrc: 4/0,1 mode: --/EX res: [0x240000404:0x193:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.535214:0:6521:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54499 lrc: 5/0,1 mode: CW/CW res: [0x240000404:0x193:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333170.535223:0:6521:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c544ae lrc: 3/0,1 mode: --/EX res: [0x240000404:0x193:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.535575:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54499 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x193:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333170.535584:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54499 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x193:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6519 initiator: MDT1 00000004:00200000:0.0:1763333170.535605:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x193:0x0]: returning size 5 00010000:00010000:0.0:1763333170.535746:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54492 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x193:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d5e expref: 225 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.535769:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54499 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x193:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d5e expref: 224 pid: 6519 timeout: 1374 lvb_type: 0 00010000:00010000:0.0:1763333170.535778:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54499 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x193:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d5e expref: 224 pid: 6519 timeout: 1374 lvb_type: 0 00010000:00010000:0.0:1763333170.535786:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f200, rc 0) 00000100:00100000:0.0:1763333170.535860:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56795:x1848987613559168:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 13800us (13862us total) trans 4294971968 rc 0/0 00000100:00100000:0.0:1763333170.535869:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8917 00010000:00010000:3.0:1763333170.536138:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333170.536257:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff4627cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:2420:x1848987613559552:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 2317us (2491us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333170.536266:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2928 00000100:00100000:0.0:1763333170.539606:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.540180:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613559680 00000100:00100000:2.0:1763333170.540192:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613559680 00010000:00010000:2.0:1763333170.540235:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54499 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x193:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d5e expref: 223 pid: 6519 timeout: 1374 lvb_type: 0 00000100:00100000:2.0:1763333170.540287:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2929 00000100:00100000:2.0:1763333170.540299:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:2421:x1848987613559680:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333170.540317:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333170.540324:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54499 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x193:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d5e expref: 223 pid: 6519 timeout: 1374 lvb_type: 0 00010000:00010000:2.0:1763333170.540336:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54499 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x193:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d5e expref: 223 pid: 6519 timeout: 1374 lvb_type: 0 00010000:00010000:2.0:1763333170.540382:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54499 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x193:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d5e expref: 223 pid: 6519 timeout: 1374 lvb_type: 0 00010000:00010000:2.0:1763333170.540398:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x193:0x0].0x0 (ffff92ff6055a000) 00010000:00010000:2.0:1763333170.540403:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c544ae lrc: 3/0,1 mode: --/EX res: [0x240000404:0x193:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.540412:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c544ae lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x193:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.540419:0:6505:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c544ae lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x193:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.540462:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333170.540642:0:6521:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c544ae lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x193:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.540651:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c544ae lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x193:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00080000:1.0:1763333170.540917:0:6521:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x193:0x0] is inserted into orphan list, open count = 1 00010000:00010000:1.0:1763333170.541016:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c544ae lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x193:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.541024:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c544ae lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x193:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.541030:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c544ae lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x193:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.541035:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333170.541039:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c544ae lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x193:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.541046:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c544ae lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x193:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.541055:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x193:0x0].0x0 (ffff92ff6055a000) 00010000:00010000:1.0:1763333170.541058:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763333170.541062:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c544ae lrc: 2/0,0 mode: --/EX res: [0x240000404:0x193:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.541068:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c544ae lrc: 0/0,0 mode: --/EX res: [0x240000404:0x193:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.541088:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c544a0 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.541095:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c544a0 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.541100:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c544a0 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.541105:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c544a0 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.541110:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333170.541113:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c544a0 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.541118:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c544a0 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.541125:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355800) 00010000:00010000:1.0:1763333170.541127:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333170.541130:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c544a0 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.541136:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c544a0 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000004:00010000:1.0:1763333170.541148:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ae8d1b63 reply state 00000000657736bc transno 4294971969 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c544a7 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.541158:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c544a7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.541164:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355600) 00010000:00010000:1.0:1763333170.541166:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333170.541169:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763333170.542274:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:2421:x1848987613559680:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 1970us (2671us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333170.542287:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2929 00000100:00100000:0.0:1763333170.542508:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.543029:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56796:x1848987613559424:12345-192.168.204.28@tcp:36:rm.0 Request processed in 9047us (9396us total) trans 4294971969 rc 0/0 00000100:00100000:1.0:1763333170.543039:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8918 00000100:00100000:1.0:1763333170.543063:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613559808 00000100:00100000:1.0:1763333170.543072:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613559808 00000100:00100000:2.0:1763333170.543887:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8919 00000100:00100000:2.0:1763333170.543901:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56795:x1848987613559808:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333170.543928:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333170.543960:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c544bc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x193:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968d65 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.544037:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c544c3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x193:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333170.544051:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c544c3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x193:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333170.544062:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c544c3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x193:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:2.0:1763333170.544114:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x193:0x0]: returning size 5 00000004:00200000:2.0:1763333170.544119:0:6519:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763333170.544137:0:6519:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c544c3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x193:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333170.544165:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c544bc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x193:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d65 expref: 225 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.544180:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c544c3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x193:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d65 expref: 224 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.544189:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x193:0x0].0x0 (ffff92ff44d03400) 00010000:00010000:2.0:1763333170.544192:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1763333170.544195:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5000, rc 0) 00000100:00100000:2.0:1763333170.544243:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56795:x1848987613559808:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 346us (1734us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333170.544250:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8919 00000100:00100000:0.0:1763333170.549663:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.549739:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613560064 00000100:00100000:2.0:1763333170.549750:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613560064 00000100:00100000:2.0:1763333170.549824:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8920 00000100:00100000:2.0:1763333170.549836:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56795:x1848987613560064:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333170.549863:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333170.549889:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c544ca lrc: 2/0,0 mode: --/CR res: [0x240000404:0x193:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968d6c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.550018:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c544d1 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x193:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333170.550034:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c544d1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x193:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333170.550048:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c544d1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x193:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:2.0:1763333170.550061:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x193:0x0]: returning size 5 00010000:00010000:2.0:1763333170.550194:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c544ca lrc: 0/0,0 mode: --/CR res: [0x240000404:0x193:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d6c expref: 227 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.550218:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c544d1 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x193:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d6c expref: 226 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.550227:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x193:0x0].0x0 (ffff92ff44d03400) 00010000:00010000:2.0:1763333170.550230:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763333170.550234:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5400, rc 0) 00000100:00100000:2.0:1763333170.550312:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56795:x1848987613560064:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 477us (660us total) trans 4294971970 rc 0/0 00000100:00100000:2.0:1763333170.550320:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8920 00000100:00100000:2.0:1763333170.556298:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333170.556459:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613560192 00000100:00100000:3.0:1763333170.556469:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613560192 00000100:00100000:3.0:1763333170.556529:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6220 00000100:00100000:3.0:1763333170.556548:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73167100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2421:x1848987613560192:12345-192.168.204.28@tcp:1:lfs.0 00010000:00010000:3.0:1763333170.556600:0:8407:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c544df lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.556618:0:8407:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5447d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d42 expref: 23 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.556627:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333170.556629:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333170.556633:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c544df lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.556665:0:8407:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5447d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d42 expref: 23 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.556678:0:8407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5447d lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d42 expref: 23 pid: 8407 timeout: 1374 lvb_type: 0 00000100:00100000:3.0:1763333170.556692:0:8407:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42f0dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8407:1848987627217280:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333170.556772:0:8407:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff801bc240 going to sleep for 11 seconds 00000100:00100000:3.0:1763333170.558858:0:8407:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42f0dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8407:1848987627217280:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333170.558885:0:8407:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c544df lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333170.560504:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333170.560928:0:28429:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613560320 00000100:00100000:3.0:1763333170.560940:0:28429:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613560320 00002000:00100000:3.0:1763333170.561009:0:28429:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x2c0000400:0x211:0x0] (0->4) req@ffff92ff73167b80 x1848987613560320/t0(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:481/0 lens 496/0 e 0 to 0 dl 1763333181 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763333170.561021:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff73167b80 with x1848987613560320 ext(0->4) 00010000:00010000:3.0:1763333170.561030:0:28429:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5447d lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d42 expref: 24 pid: 8407 timeout: 1374 lvb_type: 0 00010000:00010000:3.0:1763333170.561050:0:28429:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5447d lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d42 expref: 24 pid: 8407 timeout: 1374 lvb_type: 0 00002000:00010000:3.0:1763333170.561058:0:28429:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92ff73167b80 00000100:00100000:3.0:1763333170.561092:0:28429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 100 00000100:00100000:3.0:1763333170.561101:0:28429:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73167b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:2421:x1848987613560320:12345-192.168.204.28@tcp:4:bash.0 00000100:00100000:3.0:1763333170.565260:0:28429:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73167b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+26:2421:x1848987613560320:12345-192.168.204.28@tcp:4:bash.0 Request processed in 4142us (4743us total) trans 17179871447 rc 0/0 00000100:00100000:3.0:1763333170.565278:0:28429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 100 00002000:00100000:3.0:1763333170.565298:0:28429:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x2c0000400:0x211:0x0] (0->4) req@ffff92ff73167b80 x1848987613560320/t17179871447(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:481/0 lens 496/448 e 0 to 0 dl 1763333181 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763333170.565309:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff73167b80 with x1848987613560320 ext(0->4) 00010000:00010000:3.0:1763333170.565321:0:28429:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5447d lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d42 expref: 26 pid: 8407 timeout: 1374 lvb_type: 0 00010000:00010000:3.0:1763333170.565339:0:28429:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5447d lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d42 expref: 26 pid: 8407 timeout: 1374 lvb_type: 0 00002000:00010000:3.0:1763333170.567074:0:28429:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92ff73167b80 00000100:00100000:2.0:1763333170.567306:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333170.567416:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613560448 00000100:00100000:3.0:1763333170.567425:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613560448 00010000:00010000:3.0:1763333170.567457:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5447d lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d42 expref: 26 pid: 8407 timeout: 1374 lvb_type: 0 00000100:00100000:3.0:1763333170.567498:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2930 00000100:00100000:3.0:1763333170.567508:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73167800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+26:2420:x1848987613560448:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333170.567524:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1763333170.567539:0:6505:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x211:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:3.0:1763333170.567543:0:6505:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x211:0x0] updating lvb atime from disk: 0 -> 1763333170 00002000:00010000:3.0:1763333170.567546:0:6505:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x211:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1763333170.567552:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5447d lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d42 expref: 26 pid: 8407 timeout: 1374 lvb_type: 0 00010000:00010000:3.0:1763333170.567576:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5447d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d42 expref: 26 pid: 8407 timeout: 1374 lvb_type: 0 00010000:00010000:3.0:1763333170.567601:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5447d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d42 expref: 26 pid: 8407 timeout: 1374 lvb_type: 0 00010000:00010000:3.0:1763333170.567616:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333170.567617:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333170.567623:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c544df lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.567633:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c544df lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.567673:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333170.567721:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73167800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:2420:x1848987613560448:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 214us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333170.567729:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2930 00010000:00010000:1.0:1763333170.567859:0:8407:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c544df lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.567870:0:8407:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c544df lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.567890:0:8407:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c544df lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.567900:0:8407:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c544df lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.567908:0:8407:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c544df lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.567915:0:8407:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feba00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333170.567919:0:8407:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c544df lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.567928:0:8407:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c544df lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.567941:0:8407:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c544df lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.567949:0:8407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c544df lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333170.567995:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73167100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:2421:x1848987613560192:12345-192.168.204.28@tcp:1:lfs.0 Request processed in 11458us (11710us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333170.568004:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6220 00000100:00100000:0.0:1763333170.571869:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.572330:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613560576 00000100:00100000:1.0:1763333170.572343:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613560576 00000100:00100000:1.0:1763333170.572412:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8921 00000100:00100000:1.0:1763333170.572422:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56797:x1848987613560576:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333170.572446:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333170.572468:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c544e6 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968d73 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.572535:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c544ed lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333170.572549:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c544ed lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.572572:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c544ed lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.572589:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c544f4 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333170.572596:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c544f4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.572602:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c544f4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000100:00100000:0.0:1763333170.572630:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:1.0:1763333170.572641:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c544ed lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.572648:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c544ed lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.572653:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c544ed lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.572660:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c544ed lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.572665:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333170.572668:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c544ed lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.572675:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c544ed lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.572687:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355800) 00010000:00010000:1.0:1763333170.572690:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333170.572694:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c544ed lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.572701:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c544ed lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.572712:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c544f4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.572718:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c544f4 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.572723:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c544f4 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.572728:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7ec00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333170.572730:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c544f4 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.572735:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c544f4 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.572741:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355600) 00010000:00010000:1.0:1763333170.572744:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333170.572746:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c544f4 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.572752:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c544f4 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.572777:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c544e6 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d73 expref: 227 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.572788:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355800) 00010000:00010000:1.0:1763333170.572790:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333170.572793:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c544e6 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d73 expref: 227 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.572810:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e600, rc 0) 00000100:00100000:1.0:1763333170.572879:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56797:x1848987613560576:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 458us (1021us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333170.572886:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8921 00000100:00100000:1.0:1763333170.572903:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613560832 00000100:00100000:1.0:1763333170.572907:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613560832 00000100:00100000:1.0:1763333170.572929:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8922 00000100:00100000:1.0:1763333170.572935:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56795:x1848987613560832:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:1.0:1763333170.572959:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333170.572973:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c544c3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x193:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d65 expref: 226 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.572985:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x193:0x0].0x0 (ffff92ff44d03400) 00010000:00010000:1.0:1763333170.572988:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333170.573004:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c544fb lrc: 3/0,1 mode: --/EX res: [0x240000404:0x193:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333170.573012:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c544fb lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.573019:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c544fb lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000040:00080000:1.0:1763333170.573612:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1310, 88 off111248 00000004:00080000:1.0:1763333170.573622:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1274653272970ns, next at 1274741674609ns, rc = 0 00000040:00080000:1.0:1763333170.575690:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1311, 88 off111248 00000004:00080000:1.0:1763333170.575706:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1274655356820ns, next at 1274741703917ns, rc = 0 00000040:00080000:1.0:1763333170.576480:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1312, 88 off111336 00000004:00080000:1.0:1763333170.576489:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1274656139465ns, next at 1274741703917ns, rc = 0 00000040:00080000:1.0:1763333170.576506:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1311, 88 off111336 00000004:00080000:1.0:1763333170.576510:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1274656160945ns, next at 1274741674609ns, rc = 0 00000100:00100000:0.0:1763333170.579213:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333170.580134:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613560960 00000100:00100000:3.0:1763333170.580145:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613560960 00000100:00100000:2.0:1763333170.580460:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8923 00000100:00100000:2.0:1763333170.580474:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56797:x1848987613560960:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333170.580495:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333170.580516:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54502 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968d7a expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.580595:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54509 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333170.580609:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54509 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.580626:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54509 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.580640:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54510 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333170.580648:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54510 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.580654:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54510 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.580693:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54509 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.580700:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54509 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.580706:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54509 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.580713:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54509 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.580719:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333170.580723:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54509 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.580731:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54509 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.580743:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff44d03c00) 00010000:00010000:2.0:1763333170.580746:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333170.580751:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54509 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.580756:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54509 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.580769:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54510 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.580775:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54510 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.580781:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54510 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.580786:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4a00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333170.580789:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54510 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.580794:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54510 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.580801:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355600) 00010000:00010000:2.0:1763333170.580803:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333170.580807:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54510 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.580813:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54510 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.580840:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54502 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d7a expref: 228 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.580851:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff44d03c00) 00010000:00010000:2.0:1763333170.580854:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333170.580858:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54502 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d7a expref: 228 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.580871:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4000, rc 0) 00000100:00100000:2.0:1763333170.580945:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56797:x1848987613560960:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 476us (1741us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333170.580961:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8923 00000001:00080000:2.0:1763333170.584433:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294971971 is committed 00000004:00080000:2.0:1763333170.584446:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 858 committed 00000004:00080000:2.0:1763333170.584713:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 861 committed 00000004:00080000:2.0:1763333170.584728:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 860 committed 00000004:00080000:2.0:1763333170.584731:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 857 committed 00000100:00100000:0.0:1763333170.584819:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46e2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627217536:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333170.584840:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42f0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627217792:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333170.584877:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333170.584879:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627217664:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333170.584901:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333170.584928:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333170.584942:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42f0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627217408:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333170.584949:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627217792 00000100:00100000:0.0:1763333170.584955:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627217792 00000100:00100000:3.0:1763333170.584976:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333170.584995:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627217664 00000100:00100000:0.0:1763333170.584998:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627217664 00000100:00100000:3.0:1763333170.585002:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627217536 00000100:00100000:3.0:1763333170.585005:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627217536 00010000:00010000:1.0:1763333170.585378:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c544a7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.585390:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c544a7 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.585398:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c544a7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.585405:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333170.585411:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c544a7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.585419:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c544a7 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.585434:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355600) 00010000:00010000:1.0:1763333170.585437:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333170.585442:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c544a7 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.585447:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c544a7 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000100:00100000:0.0:1763333170.585720:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6221 00000100:00100000:0.0:1763333170.585732:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+30:3652:x1848987627217792:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333170.585871:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627217408 00000100:00100000:3.0:1763333170.585877:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627217408 00002000:00010000:0.0:1763333170.585887:0:29013:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x212:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333170.585890:0:29013:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x212:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763333170.585892:0:29013:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x212:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333170.585894:0:29013:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x212:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763333170.585896:0:29013:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x212:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333170.585908:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6222 00000100:00100000:2.0:1763333170.585917:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+15:3655:x1848987627217664:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333170.585940:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+32:3652:x1848987627217792:12345-0@lo:2:osp-syn-1-1.0 Request processed in 212us (1062us total) trans 17179871448 rc 0/0 00000100:00100000:0.0:1763333170.585948:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6221 00000100:00100000:0.0:1763333170.585964:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6223 00000100:00100000:0.0:1763333170.585971:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+15:3654:x1848987627217536:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:2.0:1763333170.586003:0:28600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x212:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333170.586006:0:28600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x212:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1763333170.586008:0:28600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x212:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333170.586010:0:28600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x212:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1763333170.586012:0:28600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x212:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1763333170.586016:0:29013:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x211:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333170.586018:0:29013:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x211:0x0] updating lvb mtime from disk: 1763333170 -> 1763333170 00002000:00010000:0.0:1763333170.586021:0:29013:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x211:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333170.586023:0:29013:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x211:0x0] updating lvb ctime from disk: 1763333170 -> 1763333170 00002000:00010000:0.0:1763333170.586025:0:29013:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x211:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333170.586044:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+17:3655:x1848987627217664:12345-0@lo:2:osp-syn-0-1.0 Request processed in 128us (1140us total) trans 21474838752 rc 0/0 00000100:00100000:0.0:1763333170.586047:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+17:3654:x1848987627217536:12345-0@lo:2:osp-syn-0-1.0 Request processed in 78us (1119us total) trans 21474838753 rc 0/0 00000100:00100000:2.0:1763333170.586051:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6222 00000100:00100000:0.0:1763333170.586053:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6223 00000004:00010000:1.0:1763333170.586165:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ffacb188 reply state 000000005040f74c transno 4294971971 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c544fb lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.586181:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c544fb lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.586188:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x193:0x0].0x0 (ffff92ff44d03400) 00010000:00010000:1.0:1763333170.586191:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1763333170.586194:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1763333170.586280:0:6521:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1763333170.586295:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:56795:x1848987613560832:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 13359us (13664us total) trans 4294971971 rc 0/0 00000100:00100000:1.0:1763333170.586302:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8922 00010000:00010000:1.0:1763333170.586322:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c544fb lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.586329:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c544fb lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.586334:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c544fb lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.586339:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fa00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333170.586343:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c544fb lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00000004:00080000:0.0:1763333170.586375:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe46e2c380/2, rc 0, transno 21474838752 00010000:00010000:1.0:1763333170.586380:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c544fb lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00000100:00100000:0.0:1763333170.586381:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627217664:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1763333170.586389:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x193:0x0].0x0 (ffff92ff44d03400) 00010000:00010000:1.0:1763333170.586392:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763333170.586396:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c544fb lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.586401:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c544fb lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000100:00100000:0.0:1763333170.586438:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333170.586489:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6224 00000100:00100000:3.0:1763333170.586497:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+31:3654:x1848987627217408:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333170.586585:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+32:3654:x1848987627217408:12345-0@lo:2:osp-syn-1-1.0 Request processed in 89us (1607us total) trans 17179871449 rc 0/0 00000100:00100000:3.0:1763333170.586592:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6224 00000004:00080000:3.0:1763333170.586624:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe42f0ed80/2, rc 0, transno 17179871448 00000100:00100000:3.0:1763333170.586629:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42f0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627217792:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763333170.586649:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe46e2d880/2, rc 0, transno 21474838753 00000100:00100000:3.0:1763333170.586653:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46e2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627217536:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1763333170.586660:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe42f0dc00/2, rc 0, transno 17179871449 00000100:00100000:3.0:1763333170.586663:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42f0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627217408:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333170.586894:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613561088 00000100:00100000:1.0:1763333170.586898:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613561088 00000100:00100000:1.0:1763333170.586931:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8924 00000100:00100000:1.0:1763333170.586937:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+218:56797:x1848987613561088:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333170.586948:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333170.586965:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54517 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968d81 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.587287:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5451e lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333170.587299:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5451e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.587309:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5451e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:1.0:1763333170.587341:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1763333170.587390:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1763333170.587426:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54517 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d81 expref: 220 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.587440:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5451e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d81 expref: 219 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.587447:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355b00) 00010000:00010000:1.0:1763333170.587450:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1763333170.587452:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f600, rc 0) 00000100:00100000:1.0:1763333170.587489:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:56797:x1848987613561088:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 551us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333170.587496:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8924 00000100:00100000:0.0:1763333170.592393:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.592454:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.592589:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613561216 00000100:00100000:1.0:1763333170.592600:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613561216 00000100:00100000:1.0:1763333170.592655:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613561344 00000100:00100000:1.0:1763333170.592659:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613561344 00000100:00100000:1.0:1763333170.592686:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8925 00000100:00100000:1.0:1763333170.592694:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+220:56795:x1848987613561216:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333170.592718:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333170.592739:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c54525 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x193:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968d88 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.592796:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c54525 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d88 expref: 221 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.592810:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c54525 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d88 expref: 221 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.592828:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x193:0x0].0x0 (ffff92ff44d03400) 00010000:00010000:1.0:1763333170.592832:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1763333170.592980:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8926 00000100:00100000:2.0:1763333170.592991:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56797:x1848987613561344:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333170.593000:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333170.593009:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5452c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968d8f expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.593064:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54533 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333170.593073:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54533 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.593562:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54533 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.593583:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5453a lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333170.593590:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5453a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.593598:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5453a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.593639:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54533 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.593646:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54533 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.593651:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54533 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.593656:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54533 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.593661:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4a00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333170.593665:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54533 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.593675:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54533 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.593685:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355b00) 00010000:00010000:2.0:1763333170.593687:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333170.593691:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54533 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.593698:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54533 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.593712:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5453a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.593717:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5453a lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.593723:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5453a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.593727:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333170.593730:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5453a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.593735:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5453a lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.593741:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff44d03c00) 00010000:00010000:2.0:1763333170.593744:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333170.593747:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5453a lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.593751:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5453a lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.593782:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5452c lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d8f expref: 222 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.593791:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355b00) 00010000:00010000:2.0:1763333170.593793:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333170.593796:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5452c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d8f expref: 222 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.593804:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4000, rc 0) 00000100:00100000:2.0:1763333170.593869:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56797:x1848987613561344:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 880us (1413us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333170.593876:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8926 00010000:00010000:1.0:1763333170.594520:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7fa00, rc 0) 00000100:00100000:1.0:1763333170.594566:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+220:56795:x1848987613561216:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1863us (2207us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333170.594573:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8925 00000100:00100000:0.0:1763333170.596808:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.596865:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.596960:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613561728 00000100:00100000:1.0:1763333170.596969:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613561728 00000100:00100000:1.0:1763333170.597020:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613561600 00000100:00100000:1.0:1763333170.597024:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613561600 00000100:00100000:1.0:1763333170.597056:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8927 00000100:00100000:1.0:1763333170.597065:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56795:x1848987613561728:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333170.597146:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333170.597171:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54541 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x193:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968d9d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.597255:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54548 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x193:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333170.597271:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54548 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x193:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.597282:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54548 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x193:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:1.0:1763333170.597326:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x193:0x0]: returning size 5 00000004:00200000:1.0:1763333170.597331:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763333170.597378:0:6521:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54548 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x193:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.597406:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54541 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x193:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d9d expref: 223 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.597421:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54548 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x193:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d9d expref: 222 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.597430:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x193:0x0].0x0 (ffff92ff44d03400) 00010000:00010000:1.0:1763333170.597433:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1763333170.597437:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f400, rc 0) 00000100:00100000:1.0:1763333170.597489:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:56795:x1848987613561728:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 425us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333170.597497:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8927 00000100:00100000:1.0:1763333170.597516:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8928 00000100:00100000:1.0:1763333170.597523:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56797:x1848987613561600:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333170.597531:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333170.597533:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763333170.597549:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5451e lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d81 expref: 221 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.597571:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355b00) 00010000:00010000:1.0:1763333170.597578:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333170.597588:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c5454f lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968d96 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.597661:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54556 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333170.597669:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54556 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.597676:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54556 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.597689:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5455d lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333170.597696:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5455d lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.597702:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5455d lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.598551:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54564 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333170.598574:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54564 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.598582:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54564 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:1.0:1763333170.598594:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x194:0x0]: returning size 0 00010000:00010000:1.0:1763333170.598624:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54556 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.598632:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54556 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.598638:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54556 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.598645:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54556 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.598650:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7ec00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333170.598654:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54556 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.598661:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54556 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.598670:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355600) 00010000:00010000:1.0:1763333170.598673:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333170.598678:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54556 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.598683:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54556 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000004:00010000:1.0:1763333170.598696:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000057661b2a reply state 00000000174ea696 transno 4294971972 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5455d lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.598707:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5455d lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.598717:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355800) 00010000:00010000:1.0:1763333170.598719:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333170.598722:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763333170.598752:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c5454f lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d96 expref: 223 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.598770:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54564 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d96 expref: 222 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.598778:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x194:0x0].0x0 (ffff92fe48355700) 00010000:00010000:1.0:1763333170.598780:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333170.598782:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e000, rc 0) 00000100:00100000:1.0:1763333170.599600:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56797:x1848987613561600:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 2073us (2730us total) trans 4294971972 rc 0/0 00000100:00100000:1.0:1763333170.599610:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8928 00000100:00100000:0.0:1763333170.603809:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.603853:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.603924:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613562112 00000100:00100000:2.0:1763333170.603934:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613562112 00000100:00100000:2.0:1763333170.603994:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8929 00000100:00100000:2.0:1763333170.604005:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56797:x1848987613562112:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333170.604030:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333170.604050:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54572 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968dab expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333170.604159:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613561856 00000100:00100000:3.0:1763333170.604165:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613561856 00000100:00100000:3.0:1763333170.604197:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6225 00000100:00100000:3.0:1763333170.604204:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:2420:x1848987613561856:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333170.604212:0:8611:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333170.604226:0:8611:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c54579 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968da4 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333170.604248:0:8611:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x211:0x0] initial LVB size: 5, mtime: 0x691a5432, atime: 0x691a5432, ctime: 0x691a5432, blocks: 0x8 00010000:00010000:3.0:1763333170.604264:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333170.604266:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333170.604277:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c54579 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968da4 expref: 25 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333170.604292:0:8611:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c54579 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968da4 expref: 25 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333170.604304:0:8611:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feb400, rc 0) 00000100:00100000:3.0:1763333170.604390:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:2420:x1848987613561856:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 186us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333170.604396:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6225 00010000:00010000:2.0:1763333170.604712:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54580 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333170.604727:0:6521:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54564 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d96 expref: 224 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.604733:0:6521:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54580 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.604762:0:6521:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54564 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d96 expref: 224 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.604773:0:6521:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54564 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d96 expref: 224 pid: 6521 timeout: 1374 lvb_type: 0 00000100:00100000:2.0:1763333170.604785:0:6521:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff73166300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6521:1848987627217920:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333170.604850:0:6521:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff471d7a80 going to sleep for 11 seconds 00000100:00100000:2.0:1763333170.614316:0:6521:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff73166300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6521:1848987627217920:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333170.614381:0:6521:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54580 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000100:00100000:1.0:1763333170.615920:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.618726:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613562240 00000100:00100000:2.0:1763333170.618742:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613562240 00010000:00010000:2.0:1763333170.618791:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54564 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d96 expref: 225 pid: 6521 timeout: 1374 lvb_type: 0 00000100:00100000:2.0:1763333170.618838:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2931 00000100:00100000:2.0:1763333170.618848:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45181500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:2420:x1848987613562240:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333170.618866:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333170.618872:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54564 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d96 expref: 225 pid: 6521 timeout: 1374 lvb_type: 0 00010000:00010000:2.0:1763333170.618886:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54564 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d96 expref: 225 pid: 6521 timeout: 1374 lvb_type: 0 00010000:00010000:2.0:1763333170.618907:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54564 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d96 expref: 225 pid: 6521 timeout: 1374 lvb_type: 0 00010000:00010000:2.0:1763333170.618925:0:28428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x194:0x0].0x0 (ffff92fe48355700) 00010000:00010000:2.0:1763333170.618932:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54580 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.618941:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54580 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.618948:0:28428:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54580 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.618986:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333170.619042:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45181500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:2420:x1848987613562240:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 194us (3128us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333170.619049:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2931 00010000:00010000:0.0:1763333170.619375:0:6521:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54580 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.619384:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54580 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:0.0:1763333170.619411:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x194:0x0]: returning size 0 00000004:00080000:0.0:1763333170.619665:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x213:0x0], index 0: 0 00000004:00080000:0.0:1763333170.619674:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x213:0x0], index 1: 0 00000004:00080000:0.0:1763333170.619679:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x214:0x0], index 1: 0 00000004:00080000:0.0:1763333170.619683:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x214:0x0], index 0: 0 00010000:00010000:0.0:1763333170.619800:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54580 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.619808:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54580 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.619815:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54580 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.619821:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333170.619825:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54580 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.619832:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54580 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.619842:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x194:0x0].0x0 (ffff92fe48355700) 00010000:00010000:0.0:1763333170.619845:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333170.619850:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54580 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.619856:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54580 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.619909:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54572 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x194:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968dab expref: 224 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.619920:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x194:0x0].0x0 (ffff92fe48355700) 00010000:00010000:0.0:1763333170.619923:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763333170.619928:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54572 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x194:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968dab expref: 224 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.619943:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5e00, rc 0) 00000100:00100000:0.0:1763333170.619991:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56797:x1848987613562112:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 15987us (16135us total) trans 4294971973 rc 301/301 00000100:00100000:0.0:1763333170.620001:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8929 00000100:00100000:1.0:1763333170.636609:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.636736:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613562496 00000100:00100000:2.0:1763333170.636748:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613562496 00000100:00100000:2.0:1763333170.636814:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3043 00000100:00100000:2.0:1763333170.636824:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56797:x1848987613562496:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333170.637174:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56797:x1848987613562496:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 350us (579us total) trans 4294971974 rc 0/0 00000100:00100000:2.0:1763333170.637181:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3043 00000100:00100000:3.0:1763333170.639695:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.639937:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613562752 00000100:00100000:0.0:1763333170.639947:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613562752 00000100:00100000:0.0:1763333170.640018:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3044 00000100:00100000:0.0:1763333170.640030:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56797:x1848987613562752:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333170.640258:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56797:x1848987613562752:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 230us (572us total) trans 4294971975 rc 0/0 00000100:00100000:0.0:1763333170.640266:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3044 00000100:00100000:1.0:1763333170.649614:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.649738:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613563008 00000100:00100000:0.0:1763333170.649752:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613563008 00000100:00100000:0.0:1763333170.649833:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8930 00000100:00100000:0.0:1763333170.649845:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:55917:x1848987613563008:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333170.649871:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333170.649895:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c5458e lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968db2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.650146:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c54595 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333170.650161:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c54595 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.650173:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c54595 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.650184:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5459c lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333170.650191:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5459c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.650197:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5459c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.650259:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c545a3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333170.650268:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c545a3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.650274:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c545a3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:0.0:1763333170.650285:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x194:0x0]: returning size 0 00010000:00010000:0.0:1763333170.653368:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c54595 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.653390:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c54595 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.653399:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c54595 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.653407:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c54595 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.653413:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdea00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333170.653418:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c54595 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.653431:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c54595 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.653453:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab5b00) 00010000:00010000:0.0:1763333170.653457:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333170.653463:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c54595 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.653469:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c54595 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.653488:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5459c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.653494:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5459c lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.653499:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5459c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.653504:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333170.653507:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5459c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.653512:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5459c lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.653519:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355800) 00010000:00010000:0.0:1763333170.653522:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333170.653524:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5459c lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.653529:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5459c lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.653603:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c5458e lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968db2 expref: 228 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.653627:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c545a3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968db2 expref: 227 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.653635:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x194:0x0].0x0 (ffff92fe43ab5200) 00010000:00010000:0.0:1763333170.653637:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333170.653640:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdf400, rc 0) 00000100:00100000:0.0:1763333170.653738:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:55917:x1848987613563008:12345-192.168.204.28@tcp:101:bash.0 Request processed in 3895us (4135us total) trans 4294971976 rc 0/0 00000100:00100000:0.0:1763333170.653748:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8930 00000100:00100000:1.0:1763333170.668263:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333170.669875:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613563136 00000100:00100000:3.0:1763333170.669889:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613563136 00000100:00100000:1.0:1763333170.673769:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8931 00000100:00100000:1.0:1763333170.673789:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:55917:x1848987613563136:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333170.673823:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333170.673852:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c545b1 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968db9 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.673897:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c545b8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333170.673917:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c545b8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x194:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333170.673930:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c545b8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x194:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333170.674064:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c545b1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x194:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968db9 expref: 229 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.674088:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c545b8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x194:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968db9 expref: 228 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.674098:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x194:0x0].0x0 (ffff92fe43ab5200) 00010000:00010000:1.0:1763333170.674102:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763333170.674106:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f000, rc 0) 00000100:00100000:1.0:1763333170.674209:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:55917:x1848987613563136:12345-192.168.204.28@tcp:101:bash.0 Request processed in 424us (5961us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333170.674217:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8931 00000100:00100000:2.0:1763333170.681015:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.681537:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613563392 00000100:00100000:0.0:1763333170.681551:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613563392 00000100:00100000:0.0:1763333170.682417:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8932 00000100:00100000:0.0:1763333170.682433:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73166300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:55917:x1848987613563392:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:0.0:1763333170.682487:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333170.682516:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c545a3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968db2 expref: 228 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.682536:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x194:0x0].0x0 (ffff92fe43ab5200) 00010000:00010000:0.0:1763333170.682541:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333170.682731:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c545bf lrc: 3/0,1 mode: --/PW res: [0x240000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333170.682745:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c545bf lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.682759:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c545bf lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000001:00080000:0.0:1763333170.682803:0:6521:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294971977 00000004:00010000:0.0:1763333170.682823:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000aeab73a0 reply state 000000002e2197d4 transno 4294971978 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c545bf lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.682834:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c545bf lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.682841:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x194:0x0].0x0 (ffff92fe43ab5200) 00010000:00010000:0.0:1763333170.682843:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333170.682846:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763333170.682960:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73166300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:55917:x1848987613563392:12345-192.168.204.28@tcp:36:bash.0 Request processed in 533us (1963us total) trans 4294971978 rc 0/0 00000100:00100000:0.0:1763333170.682968:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8932 00000020:00080000:0.0:1763333170.682973:0:6521:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763333170.690037:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.690132:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333170.690181:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613563648 00000100:00100000:0.0:1763333170.690185:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613563520 00000100:00100000:3.0:1763333170.690192:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613563648 00000100:00100000:0.0:1763333170.690192:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613563520 00000100:00100000:3.0:1763333170.690242:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6226 00000100:00100000:0.0:1763333170.690242:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8933 00000100:00100000:3.0:1763333170.690251:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:2418:x1848987613563648:12345-192.168.204.28@tcp:23:lfs.0 00000100:00100000:0.0:1763333170.690252:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73165c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:55917:x1848987613563520:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333170.690271:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333170.690293:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c545c6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968dc0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.690343:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c545c6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968dc0 expref: 231 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.690383:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c545c6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968dc0 expref: 231 pid: 6521 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333170.690389:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:2418:x1848987613563648:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 138us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333170.690397:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6226 00010000:00010000:0.0:1763333170.690405:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x194:0x0].0x0 (ffff92fe43ab5200) 00010000:00010000:0.0:1763333170.690409:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333170.690413:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdf200, rc 0) 00000100:00100000:0.0:1763333170.690435:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73165c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:55917:x1848987613563520:12345-192.168.204.28@tcp:101:bash.0 Request processed in 185us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333170.690440:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8933 00000100:00100000:3.0:1763333170.695681:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.695902:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613563904 00000100:00100000:1.0:1763333170.695913:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613563904 00000100:00100000:1.0:1763333170.695982:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8934 00000100:00100000:1.0:1763333170.695992:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:55917:x1848987613563904:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333170.696019:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333170.696022:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763333170.696053:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c545c6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968dc0 expref: 231 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.696074:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x194:0x0].0x0 (ffff92fe43ab5200) 00010000:00010000:1.0:1763333170.696080:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333170.696096:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c545cd lrc: 2/0,0 mode: --/EX res: [0x240000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968dc7 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.696160:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c545d4 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333170.696172:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c545d4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x194:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333170.696181:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c545d4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x194:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000040:00080000:1.0:1763333170.696485:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1313, 88 off111424 00000004:00080000:1.0:1763333170.696494:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1274776145121ns, next at 1274741703917ns, rc = 0 00000040:00080000:1.0:1763333170.696535:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1312, 88 off111424 00000004:00080000:1.0:1763333170.696540:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1274776191293ns, next at 1274741674609ns, rc = 0 00000040:00080000:1.0:1763333170.696568:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1313, 88 off111512 00000004:00080000:1.0:1763333170.696573:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1274776223811ns, next at 1274741674609ns, rc = 0 00000040:00080000:1.0:1763333170.696582:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1314, 88 off111512 00000004:00080000:1.0:1763333170.696586:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1274776237240ns, next at 1274741703917ns, rc = 0 00000001:00080000:1.0:1763333170.699773:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294971979 is committed 00000004:00080000:1.0:1763333170.699789:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 863 committed 00010000:00010000:3.0:1763333170.701387:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5455d lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.701408:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5455d lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.701415:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5455d lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.701420:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333170.701425:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5455d lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.701432:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5455d lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.701449:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355800) 00010000:00010000:3.0:1763333170.701452:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333170.701458:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5455d lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.701463:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5455d lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.701495:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c545bf lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.701502:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c545bf lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.701507:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c545bf lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.701511:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abde400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333170.701514:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c545bf lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.701520:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c545bf lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.701527:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x194:0x0].0x0 (ffff92fe43ab5200) 00010000:00010000:3.0:1763333170.701530:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333170.701532:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c545bf lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.701537:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c545bf lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000100:00100000:0.0:1763333170.701921:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1763333170.701942:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4399b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627218176:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333170.702021:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333170.702198:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe43998a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627218048:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333170.702228:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333170.704167:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000004:00080000:1.0:1763333170.704821:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 860 committed 00000004:00080000:1.0:1763333170.704846:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 859 committed 00000004:00080000:1.0:1763333170.704849:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 862 committed 00000100:00100000:2.0:1763333170.705118:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1763333170.705139:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff73165500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627218304:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333170.705196:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff73166a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627218432:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1763333170.705524:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c545d4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x194:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968dc7 expref: 223 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.705538:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x194:0x0].0x0 (ffff92fe43ab5200) 00010000:00010000:3.0:1763333170.705541:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763333170.705572:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c545cd lrc: 0/0,0 mode: --/EX res: [0x240000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968dc7 expref: 223 pid: 12741 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1763333170.705590:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c545d4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x194:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968dc7 expref: 222 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.705622:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x194:0x0].0x0 (ffff92fe43ab5200) 00010000:00010000:3.0:1763333170.705625:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763333170.705628:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7fe00, rc 0) 00000100:00100000:3.0:1763333170.705685:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:55917:x1848987613563904:12345-192.168.204.28@tcp:101:bash.0 Request processed in 9693us (10016us total) trans 4294971979 rc 0/0 00000100:00100000:3.0:1763333170.705695:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8934 00000100:00100000:0.0:1763333170.706110:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627218176 00000100:00100000:0.0:1763333170.706122:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627218176 00000100:00100000:0.0:1763333170.706169:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627218048 00000100:00100000:0.0:1763333170.706172:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627218048 00000100:00100000:0.0:1763333170.706188:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613564032 00000100:00100000:0.0:1763333170.706190:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613564032 00000100:00100000:0.0:1763333170.706212:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6227 00000100:00100000:0.0:1763333170.706223:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+17:3655:x1848987627218176:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333170.706468:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+18:3655:x1848987627218176:12345-0@lo:2:osp-syn-0-1.0 Request processed in 246us (4446us total) trans 21474838754 rc 0/0 00000100:00100000:0.0:1763333170.706476:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6227 00000100:00100000:0.0:1763333170.706492:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6228 00000100:00100000:0.0:1763333170.706499:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+17:3653:x1848987627218048:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333170.706592:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+18:3653:x1848987627218048:12345-0@lo:2:osp-syn-0-1.0 Request processed in 93us (4361us total) trans 21474838755 rc 0/0 00000100:00100000:0.0:1763333170.706598:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6228 00000100:00100000:0.0:1763333170.706613:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6229 00000100:00100000:0.0:1763333170.706620:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:2421:x1848987613564032:12345-192.168.204.28@tcp:23:lfs.0 00000100:00100000:0.0:1763333170.706686:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:2421:x1848987613564032:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 66us (2528us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333170.706694:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6229 00000100:00100000:2.0:1763333170.706883:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333170.706940:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333170.707045:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627218304 00000100:00100000:2.0:1763333170.707050:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627218304 00000100:00100000:2.0:1763333170.707074:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627218432 00000100:00100000:2.0:1763333170.707077:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627218432 00000100:00100000:2.0:1763333170.707093:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6230 00000100:00100000:2.0:1763333170.707099:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73165f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+33:3654:x1848987627218304:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333170.707198:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73165f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+34:3654:x1848987627218304:12345-0@lo:2:osp-syn-1-1.0 Request processed in 98us (315us total) trans 17179871450 rc 0/0 00000100:00100000:2.0:1763333170.707206:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6230 00000100:00100000:2.0:1763333170.707220:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6231 00000100:00100000:2.0:1763333170.707226:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73164e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+33:3652:x1848987627218432:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333170.707297:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73164e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+34:3652:x1848987627218432:12345-0@lo:2:osp-syn-1-1.0 Request processed in 71us (356us total) trans 17179871451 rc 0/0 00000100:00100000:2.0:1763333170.707304:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6231 00000004:00080000:2.0:1763333170.707369:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff73165500/2, rc 0, transno 17179871450 00000100:00100000:2.0:1763333170.707375:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff73165500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627218304:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1763333170.707396:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff73166a00/2, rc 0, transno 17179871451 00000100:00100000:2.0:1763333170.707400:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff73166a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627218432:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1763333170.707421:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe43998a80/2, rc 0, transno 21474838755 00000100:00100000:2.0:1763333170.707425:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe43998a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627218048:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1763333170.707442:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4399b480/2, rc 0, transno 21474838754 00000100:00100000:2.0:1763333170.707446:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4399b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627218176:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333170.714788:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.714898:0:28429:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613564160 00000100:00100000:0.0:1763333170.714910:0:28429:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613564160 00000100:00100000:0.0:1763333170.714979:0:28429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1552 00000100:00100000:0.0:1763333170.714988:0:28429:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:2419:x1848987613564160:12345-192.168.204.28@tcp:3:lfs.0 00010000:00010000:0.0:1763333170.715022:0:28429:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c545db lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.715035:0:28429:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333170.715037:0:28429:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333170.715042:0:28429:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c545db lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.715054:0:28429:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c545db lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.715152:0:28429:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c545db lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.715161:0:28429:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c545db lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.715168:0:28429:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c545db lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.715180:0:28429:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333170.715185:0:28429:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c545db lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.715193:0:28429:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c545db lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.715210:0:28429:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c545db lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.715218:0:28429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c545db lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333170.715299:0:28429:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:2419:x1848987613564160:12345-192.168.204.28@tcp:3:lfs.0 Request processed in 311us (528us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1763333170.715307:0:28429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1552 00000100:00100000:2.0:1763333170.720507:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.720566:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613564288 00000100:00100000:2.0:1763333170.720571:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.720577:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613564288 00000100:00100000:3.0:1763333170.720616:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613564416 00000100:00100000:3.0:1763333170.720620:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613564416 00000100:00100000:3.0:1763333170.720685:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8935 00000100:00100000:3.0:1763333170.720696:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73164000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:56795:x1848987613564416:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333170.720721:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333170.720741:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c545e2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x193:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968dd5 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.720777:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c545e9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x193:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333170.720792:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c545e9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x193:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333170.720803:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c545e9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x193:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333170.720960:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c545e2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x193:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968dd5 expref: 224 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.720979:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb200/0xb32e3ef184c545e9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x193:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968dd5 expref: 223 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.720988:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x193:0x0].0x0 (ffff92ff44d03400) 00010000:00010000:3.0:1763333170.720990:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763333170.720994:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feb200, rc 0) 00000100:00100000:3.0:1763333170.721057:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73164000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56795:x1848987613564416:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 363us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333170.721065:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8935 00000100:00100000:1.0:1763333170.727400:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6232 00000100:00100000:1.0:1763333170.727424:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73165180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:55917:x1848987613564288:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333170.727446:0:28650:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333170.727474:0:28650:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c545f0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968dce expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333170.727501:0:28650:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x213:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333170.727525:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333170.727528:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333170.727539:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c545f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968dce expref: 15 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.727565:0:28650:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c545f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968dce expref: 15 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.727578:0:28650:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7ea00, rc 0) 00000100:00100000:1.0:1763333170.727647:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73165180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:55917:x1848987613564288:12345-192.168.204.28@tcp:101:bash.0 Request processed in 232us (7151us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333170.727654:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6232 00000100:00100000:3.0:1763333170.728641:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.728716:0:28430:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613564544 00000100:00100000:0.0:1763333170.728727:0:28430:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613564544 00000100:00100000:0.0:1763333170.728792:0:28430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1553 00000100:00100000:0.0:1763333170.728803:0:28430:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2419:x1848987613564544:12345-192.168.204.28@tcp:4:lfs.0 00010000:00010000:0.0:1763333170.728835:0:28430:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c545f7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.728852:0:28430:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c543ce lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d11 expref: 15 pid: 17605 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333170.728865:0:28430:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333170.728867:0:28430:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333170.728870:0:28430:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c545f7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.728905:0:28430:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c543ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d11 expref: 15 pid: 17605 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333170.728920:0:28430:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c543ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d11 expref: 15 pid: 17605 timeout: 1374 lvb_type: 1 00000100:00100000:0.0:1763333170.728935:0:28430:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe43998e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0000_UUID:28430:1848987627218560:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333170.728995:0:28430:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff742b9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1763333170.732635:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.732727:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613564672 00000100:00100000:0.0:1763333170.732739:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613564672 00000100:00100000:1.0:1763333170.732809:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6233 00000100:00100000:1.0:1763333170.732827:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:55917:x1848987613564672:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333170.732848:0:28650:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333170.732871:0:28650:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c545fe lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968ddc expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333170.732900:0:28650:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x213:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333170.732925:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333170.732927:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333170.732939:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c545fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ddc expref: 26 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.732960:0:28650:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c545fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ddc expref: 26 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.732973:0:28650:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f800, rc 0) 00000100:00100000:1.0:1763333170.733031:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+26:55917:x1848987613564672:12345-192.168.204.28@tcp:101:bash.0 Request processed in 211us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333170.733038:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6233 00000100:00100000:0.0:1763333170.733784:0:28430:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe43998e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0000_UUID:28430:1848987627218560:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333170.733812:0:28430:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c545f7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333170.733905:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333170.734006:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613564800 00000100:00100000:3.0:1763333170.734012:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613564800 00010000:00010000:3.0:1763333170.734040:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c543ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d11 expref: 16 pid: 17605 timeout: 1374 lvb_type: 1 00000100:00100000:3.0:1763333170.735760:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2932 00000100:00100000:3.0:1763333170.735776:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2420:x1848987613564800:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333170.735796:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333170.735821:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c543ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x212:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d11 expref: 16 pid: 17605 timeout: 1374 lvb_type: 1 00010000:00010000:3.0:1763333170.735837:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c543ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x212:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d11 expref: 16 pid: 17605 timeout: 1374 lvb_type: 1 00010000:00010000:3.0:1763333170.735860:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c543ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x212:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d11 expref: 16 pid: 17605 timeout: 1374 lvb_type: 1 00010000:00010000:3.0:1763333170.735875:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333170.735877:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333170.735881:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c545f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.735890:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c545f7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.735935:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333170.735978:0:28430:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c545f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.735987:0:28430:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c545f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333170.736001:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2420:x1848987613564800:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 230us (2096us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333170.736008:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2932 00000100:00100000:0.0:1763333170.736107:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.736238:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.736521:0:28429:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613564928 00000100:00100000:1.0:1763333170.736529:0:28429:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613564928 00002000:00010000:1.0:1763333170.736568:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/531 (0->18446744073709551615) 00002000:00100000:1.0:1763333170.736573:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe43998e00 with x1848987613564928 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333170.736583:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe43998e00. 00000100:00100000:1.0:1763333170.736601:0:28429:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613565056 00000100:00100000:1.0:1763333170.736604:0:28429:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613565056 00002000:00010000:1.0:1763333170.736622:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/531 (0->18446744073709551615) 00002000:00100000:1.0:1763333170.736624:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4399ad80 with x1848987613565056 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333170.736631:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe4399ad80. 00000100:00100000:1.0:1763333170.736647:0:28429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1554 00000100:00100000:1.0:1763333170.736654:0:28429:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2420:x1848987613564928:12345-192.168.204.28@tcp:10:bash.0 00000100:00100000:2.0:1763333170.736667:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1555 00000100:00100000:2.0:1763333170.736681:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4399ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+26:2420:x1848987613565056:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:1.0:1763333170.736753:0:28429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x213:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333170.736757:0:28429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x213:0x0] updating lvb mtime from disk: 0 -> 1763333170 00002000:00010000:1.0:1763333170.736760:0:28429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x213:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333170.736763:0:28429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x213:0x0] updating lvb ctime from disk: 0 -> 1763333170 00002000:00010000:1.0:1763333170.736765:0:28429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x213:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:2.0:1763333170.736794:0:24027:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x213:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1763333170.736806:0:28429:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2420:x1848987613564928:12345-192.168.204.28@tcp:10:bash.0 Request processed in 151us (698us total) trans 21474838757 rc 0/0 00002000:00010000:2.0:1763333170.736810:0:24027:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x213:0x0] updating lvb mtime from disk: 0 -> 1763333170 00002000:00010000:2.0:1763333170.736815:0:24027:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x213:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:1.0:1763333170.736819:0:28429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1554 00002000:00010000:2.0:1763333170.736820:0:24027:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x213:0x0] updating lvb ctime from disk: 0 -> 1763333170 00002000:00010000:1.0:1763333170.736824:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/531 (0->18446744073709551615) 00002000:00010000:2.0:1763333170.736825:0:24027:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x213:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00100000:1.0:1763333170.736833:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe43998e00 with x1848987613564928 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333170.736838:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe43998e00. 00000100:00100000:2.0:1763333170.736858:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4399ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+27:2420:x1848987613565056:12345-192.168.204.28@tcp:10:bash.0 Request processed in 180us (618us total) trans 17179871452 rc 0/0 00000100:00100000:2.0:1763333170.736868:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1555 00002000:00010000:2.0:1763333170.736871:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/531 (0->18446744073709551615) 00002000:00100000:2.0:1763333170.736874:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4399ad80 with x1848987613565056 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333170.736880:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe4399ad80. 00000001:00080000:1.0:1763333170.741699:0:24714:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838757 is committed 00000001:00080000:1.0:1763333170.741721:0:24714:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838755 is committed 00002000:00010000:0.0:1763333170.741882:0:28430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x212:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:0.0:1763333170.741887:0:28430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x212:0x0] updating lvb mtime from disk: 0 -> 1763333171 00002000:00010000:0.0:1763333170.741889:0:28430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x212:0x0] updating lvb ctime from disk: 0 -> 1763333171 00002000:00010000:0.0:1763333170.741891:0:28430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x212:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1763333170.741905:0:28430:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c545f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.741917:0:28430:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c545f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.741926:0:28430:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c545f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.741932:0:28430:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdea00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333170.741936:0:28430:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c545f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.741945:0:28430:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c545f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.741964:0:28430:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c545f7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.741972:0:28430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c545f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333170.742223:0:28430:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+11:2419:x1848987613564544:12345-192.168.204.28@tcp:4:lfs.0 Request processed in 13415us (13577us total) trans 21474838756 rc 0/0 00000100:00100000:0.0:1763333170.742232:0:28430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1553 00000100:00100000:1.0:1763333170.742495:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.742606:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613565312 00000100:00100000:2.0:1763333170.742616:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613565312 00000100:00100000:2.0:1763333170.742667:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3045 00000100:00100000:2.0:1763333170.742678:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:55917:x1848987613565312:12345-192.168.204.28@tcp:35:bash.0 00000001:00080000:2.0:1763333170.742917:0:6522:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294971980 00000100:00100000:2.0:1763333170.743004:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:55917:x1848987613565312:12345-192.168.204.28@tcp:35:bash.0 Request processed in 328us (508us total) trans 4294971981 rc 0/0 00000100:00100000:2.0:1763333170.743011:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3045 00000020:00080000:2.0:1763333170.743015:0:6522:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763333170.758164:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333170.758656:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613565440 00000100:00100000:3.0:1763333170.758669:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613565440 00000100:00100000:3.0:1763333170.758739:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8936 00000100:00100000:3.0:1763333170.758749:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73166d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56798:x1848987613565440:12345-192.168.204.28@tcp:101:rm.0 00010000:00010000:3.0:1763333170.758780:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333170.758809:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c54605 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968de3 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.758894:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5460c lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333170.758910:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5460c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333170.758924:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5460c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333170.758938:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54613 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333170.758946:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54613 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333170.758951:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54613 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333170.759042:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5461a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333170.759051:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5461a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x194:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333170.759058:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5461a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x194:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:3.0:1763333170.759099:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x194:0x0]: returning size 5 00000004:00200000:3.0:1763333170.759104:0:12741:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763333170.759124:0:12741:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5461a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x194:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333170.759135:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5461a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333170.759144:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5460c lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333170.759150:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5460c lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333170.759156:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5460c lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333170.759163:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5460c lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333170.759168:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333170.759172:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5460c lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333170.759179:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5460c lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333170.759192:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff80045900) 00010000:00010000:3.0:1763333170.759195:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333170.759200:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5460c lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333170.759207:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5460c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333170.759223:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54613 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333170.759229:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54613 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333170.759235:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54613 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333170.759241:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333170.759244:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54613 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333170.759249:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54613 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333170.759256:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045800) 00010000:00010000:3.0:1763333170.759258:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333170.759260:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54613 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333170.759266:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54613 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333170.759296:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c54605 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968de3 expref: 227 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.759313:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5461a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968de3 expref: 226 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.759319:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x194:0x0].0x0 (ffff92fe43ab5200) 00010000:00010000:3.0:1763333170.759322:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333170.759325:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feba00, rc 0) 00000100:00100000:3.0:1763333170.759450:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73166d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56798:x1848987613565440:12345-192.168.204.28@tcp:101:rm.0 Request processed in 702us (1296us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333170.759457:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8936 00000100:00100000:1.0:1763333170.763583:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333170.764625:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613565696 00000100:00100000:3.0:1763333170.764637:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613565696 00000100:00100000:3.0:1763333170.764695:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8937 00000100:00100000:3.0:1763333170.764704:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56798:x1848987613565696:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:3.0:1763333170.764770:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1763333170.764804:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c545d4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x194:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968dc7 expref: 226 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.764828:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5461a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968de3 expref: 225 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.764841:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c545b8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x194:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968db9 expref: 224 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.764851:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x194:0x0].0x0 (ffff92fe43ab5200) 00010000:00010000:3.0:1763333170.764865:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333170.764900:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c54621 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333170.764914:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c54621 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333170.764924:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c54621 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333170.764935:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54628 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333170.764942:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54628 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333170.764947:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54628 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.765148:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c5462f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333170.765162:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c5462f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x194:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.765170:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c5462f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x194:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000040:00080000:2.0:1763333170.765460:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1315, 64 off111576 00000004:00080000:2.0:1763333170.765470:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1274845120356ns, next at 1275845117682ns, rc = 0 00000040:00080000:2.0:1763333170.765493:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1314, 64 off111576 00000004:00080000:2.0:1763333170.765497:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1274845148329ns, next at 1275845147255ns, rc = 0 00000040:00080000:2.0:1763333170.765506:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1315, 64 off111640 00000040:00080000:2.0:1763333170.765515:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1316, 64 off111640 00010000:00010000:2.0:1763333170.765582:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54636 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333170.765592:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54636 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x194:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.765599:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54636 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x194:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.765605:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54636 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x194:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.765610:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54636 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x194:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.765617:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54636 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x194:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.766114:0:12741:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763333170.766138:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c5462f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x194:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.766145:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c5462f lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x194:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.766151:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c5462f lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x194:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.766156:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333170.766160:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c5462f lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x194:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.766167:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c5462f lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x194:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.766177:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x194:0x0].0x0 (ffff92fe43ab2c00) 00010000:00010000:2.0:1763333170.766179:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763333170.766184:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c5462f lrc: 2/0,0 mode: --/EX res: [0x240000404:0x194:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.766192:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c5462f lrc: 0/0,0 mode: --/EX res: [0x240000404:0x194:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.766318:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c54621 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.766325:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c54621 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.766331:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c54621 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.766337:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c54621 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.766341:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feaa00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333170.766345:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c54621 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.766383:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c54621 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.766391:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff80045900) 00010000:00010000:2.0:1763333170.766394:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333170.766397:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c54621 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.766402:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c54621 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000004:00010000:2.0:1763333170.766419:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009cb16739 reply state 00000000f62c06e0 transno 4294971982 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54628 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.766430:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54628 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.766436:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045800) 00010000:00010000:2.0:1763333170.766438:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333170.766442:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763333170.766545:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56798:x1848987613565696:12345-192.168.204.28@tcp:36:rm.0 Request processed in 1839us (2972us total) trans 4294971982 rc 0/0 00000100:00100000:2.0:1763333170.766562:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8937 00010000:00010000:0.0:1763333170.766660:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333170.766667:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54636 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x194:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333170.766673:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5c00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333170.766676:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54636 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x194:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333170.766681:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54636 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x194:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333170.766690:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x194:0x0].0x0 (ffff92fe43ab2c00) 00010000:00010000:0.0:1763333170.766692:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763333170.766695:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54636 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x194:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333170.766700:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54636 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x194:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333170.766714:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333170.766716:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333170.766718:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763333170.768151:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:1.0:1763333170.768471:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763333170.768667:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613565952 00000100:00100000:2.0:1763333170.768679:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613565952 00000100:00100000:2.0:1763333170.769337:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8938 00000100:00100000:2.0:1763333170.769403:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56795:x1848987613565952:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:2.0:1763333170.769458:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333170.769483:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54548 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x193:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d9d expref: 225 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.769500:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x193:0x0].0x0 (ffff92ff44d03400) 00010000:00010000:2.0:1763333170.769504:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333170.769595:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c5463d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x193:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333170.769611:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c5463d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x193:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.769622:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c5463d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x193:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00010000:2.0:1763333170.769775:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d923446d reply state 0000000067a9dcae transno 4294971983 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c5463d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x193:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.769789:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c5463d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x193:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.769795:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x193:0x0].0x0 (ffff92ff44d03400) 00010000:00010000:2.0:1763333170.769798:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333170.769801:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763333170.771751:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56795:x1848987613565952:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 2392us (3601us total) trans 4294971983 rc 0/0 00000100:00100000:2.0:1763333170.771763:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8938 00000100:00100000:0.0:1763333170.779575:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.779765:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613566080 00000100:00100000:1.0:1763333170.779778:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613566080 00000100:00100000:2.0:1763333170.780948:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6234 00000100:00100000:2.0:1763333170.780970:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43999c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+11:56795:x1848987613566080:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333170.780997:0:8406:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333170.781031:0:8406:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54644 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968dea expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763333170.781063:0:8406:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x212:0x0] initial LVB size: 4096, mtime: 0x691a5433, atime: 0x0, ctime: 0x691a5433, blocks: 0x8 00010000:00010000:2.0:1763333170.781087:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333170.781090:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333170.781098:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54644 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968dea expref: 12 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.781113:0:8406:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54644 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968dea expref: 12 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.781126:0:8406:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4c00, rc 0) 00000100:00100000:2.0:1763333170.782325:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43999c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:56795:x1848987613566080:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1356us (2760us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333170.782340:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6234 00000100:00100000:1.0:1763333170.785405:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.785607:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613566208 00000100:00100000:2.0:1763333170.785620:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613566208 00000100:00100000:2.0:1763333170.785694:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6235 00000100:00100000:2.0:1763333170.785705:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+27:56795:x1848987613566208:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333170.785728:0:8406:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333170.785752:0:8406:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5464b lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968df1 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.785792:0:8406:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c543d5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d18 expref: 28 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333170.785800:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333170.785803:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333170.785807:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5464b lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968df1 expref: 28 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.785846:0:8406:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c543d5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d18 expref: 28 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333170.785860:0:8406:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c543d5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d18 expref: 28 pid: 8611 timeout: 1374 lvb_type: 1 00000100:00100000:2.0:1763333170.785874:0:8406:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff73167480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8406:1848987627218688:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333170.785974:0:8406:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff471d7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1763333170.786925:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.787033:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613566336 00000100:00100000:2.0:1763333170.787039:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613566336 00000100:00100000:2.0:1763333170.787119:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8939 00000100:00100000:2.0:1763333170.787128:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56799:x1848987613566336:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333170.787145:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333170.787164:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54652 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968df8 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.787229:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54659 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333170.787242:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54659 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.787254:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54659 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.787266:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54660 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333170.787275:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54660 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.787281:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54660 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.787326:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54659 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.787333:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54659 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.787339:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54659 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.787345:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54659 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.787476:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333170.787480:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54659 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.787488:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54659 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.787507:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab2900) 00010000:00010000:2.0:1763333170.787511:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333170.787518:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54659 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.787525:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54659 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.787541:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54660 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.787548:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54660 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.787563:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54660 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.787568:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4a00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333170.787571:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54660 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.787577:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54660 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.787584:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045800) 00010000:00010000:2.0:1763333170.787587:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333170.787589:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54660 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.787595:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54660 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.787623:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54652 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968df8 expref: 227 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.787633:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab2900) 00010000:00010000:2.0:1763333170.787635:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333170.787639:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54652 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968df8 expref: 227 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.787654:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5e00, rc 0) 00000100:00100000:2.0:1763333170.787714:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56799:x1848987613566336:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 587us (792us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333170.787723:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8939 00000100:00100000:0.0:1763333170.788637:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.788765:0:8406:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff73167480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8406:1848987627218688:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333170.788801:0:8406:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5464b lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968df1 expref: 28 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.788819:0:8406:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4000, rc 0) 00000100:00100000:2.0:1763333170.788870:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+28:56795:x1848987613566208:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 3166us (3477us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333170.788878:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6235 00000100:00100000:3.0:1763333170.789079:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613566464 00000100:00100000:3.0:1763333170.789095:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613566464 00010000:00010000:3.0:1763333170.789134:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c543d5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d18 expref: 28 pid: 8611 timeout: 1374 lvb_type: 1 00000100:00100000:3.0:1763333170.789170:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2933 00000100:00100000:3.0:1763333170.789179:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4399a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+28:2420:x1848987613566464:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333170.789194:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333170.789213:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c543d5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x212:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d18 expref: 28 pid: 8611 timeout: 1374 lvb_type: 1 00010000:00010000:3.0:1763333170.789226:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c543d5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x212:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d18 expref: 28 pid: 8611 timeout: 1374 lvb_type: 1 00010000:00010000:3.0:1763333170.789250:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c543d5 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x212:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d18 expref: 28 pid: 8611 timeout: 1374 lvb_type: 1 00010000:00010000:3.0:1763333170.789262:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333170.789264:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333170.789270:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5464b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968df1 expref: 27 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.789280:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5464b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968df1 expref: 27 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.789314:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5464b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968df1 expref: 27 pid: 8406 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333170.789328:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7400d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6505:1848987627218816:192.168.204.28@tcp:105: 00000100:00100000:3.0:1763333170.789414:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff801bc240 going to sleep for 11 seconds 00000100:00100000:1.0:1763333170.790816:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.791143:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613566592 00000100:00100000:2.0:1763333170.791151:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613566592 00000100:00100000:2.0:1763333170.791202:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8940 00000100:00100000:2.0:1763333170.791212:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56799:x1848987613566592:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333170.791229:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333170.791251:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c54667 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968dff expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.791313:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5466e lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333170.791327:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5466e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.791337:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5466e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.791375:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c54675 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333170.791386:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c54675 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.791392:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c54675 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.791429:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5466e lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.791435:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5466e lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.791441:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5466e lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.791446:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5466e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.791451:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333170.791455:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5466e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.791461:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5466e lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.791470:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab2600) 00010000:00010000:2.0:1763333170.791472:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333170.791476:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5466e lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.791482:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5466e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.791494:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c54675 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.791500:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c54675 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.791505:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c54675 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.791509:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe44d75a00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333170.791511:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c54675 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.791516:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c54675 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.791521:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045800) 00010000:00010000:2.0:1763333170.791523:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333170.791525:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c54675 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.791530:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c54675 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333170.791563:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c54667 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968dff expref: 227 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.791571:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab2600) 00010000:00010000:2.0:1763333170.791573:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333170.791576:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c54667 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968dff expref: 227 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.791588:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4400, rc 0) 00000100:00100000:2.0:1763333170.791648:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56799:x1848987613566592:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 438us (838us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333170.791656:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8940 00000100:00100000:3.0:1763333170.794695:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7400d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6505:1848987627218816:192.168.204.28@tcp:105: 00010000:00010000:3.0:1763333170.794733:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333170.795529:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4399a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+27:2420:x1848987613566464:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 6346us (6890us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333170.795544:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2933 00000100:00100000:1.0:1763333170.795663:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.795757:0:28430:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613566720 00000100:00100000:0.0:1763333170.795767:0:28430:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613566720 00002000:00010000:0.0:1763333170.795810:0:28430:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/530 (5->18446744073709551615) 00002000:00100000:0.0:1763333170.795815:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe44de2d80 with x1848987613566720 ext(5->18446744073709551615) 00002000:00010000:0.0:1763333170.795826:0:28430:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe44de2d80. 00000100:00100000:0.0:1763333170.795859:0:28430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1556 00000100:00100000:0.0:1763333170.795868:0:28430:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:2421:x1848987613566720:12345-192.168.204.28@tcp:10:lfs.0 00002000:00010000:0.0:1763333170.796267:0:28430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x212:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:0.0:1763333170.796271:0:28430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x212:0x0] updating lvb mtime from disk: 1763333171 -> 1763333171 00002000:00010000:0.0:1763333170.796275:0:28430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x212:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333170.796277:0:28430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x212:0x0] updating lvb ctime from disk: 1763333171 -> 1763333171 00002000:00010000:0.0:1763333170.796279:0:28430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x212:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1763333170.796325:0:28430:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2421:x1848987613566720:12345-192.168.204.28@tcp:10:lfs.0 Request processed in 458us (663us total) trans 21474838758 rc 0/0 00000100:00100000:0.0:1763333170.796333:0:28430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1556 00002000:00010000:0.0:1763333170.796336:0:28430:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/530 (5->18446744073709551615) 00002000:00100000:0.0:1763333170.796339:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe44de2d80 with x1848987613566720 ext(5->18446744073709551615) 00002000:00010000:0.0:1763333170.796343:0:28430:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe44de2d80. 00000100:00100000:2.0:1763333170.796580:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.796619:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333170.796851:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613566848 00000100:00100000:3.0:1763333170.797215:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613566848 00002000:00010000:3.0:1763333170.797245:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/530 (0->18446744073709551615) 00002000:00100000:3.0:1763333170.797250:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff73167480 with x1848987613566848 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333170.797263:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff73167480. 00000100:00100000:3.0:1763333170.797294:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1557 00000100:00100000:3.0:1763333170.797303:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73167480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+27:2420:x1848987613566848:12345-192.168.204.28@tcp:10:lfs.0 00000100:00100000:0.0:1763333170.797389:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613566976 00000100:00100000:0.0:1763333170.797395:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613566976 00000100:00100000:0.0:1763333170.797504:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8941 00000100:00100000:0.0:1763333170.797512:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5922a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56799:x1848987613566976:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333170.797525:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333170.797548:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c5467c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968e06 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.797620:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54683 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333170.797637:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54683 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.797648:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54683 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:0.0:1763333170.797695:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1763333170.797700:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763333170.797737:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c5467c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e06 expref: 228 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.797766:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54683 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e06 expref: 227 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.797774:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12f00) 00010000:00010000:0.0:1763333170.797778:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1763333170.797781:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdf600, rc 0) 00000100:00100000:0.0:1763333170.797836:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5922a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56799:x1848987613566976:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 325us (1216us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333170.797843:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8941 00002000:00010000:3.0:1763333170.798082:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x212:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333170.798086:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x212:0x0] updating lvb mtime from disk: 0 -> 1763333171 00002000:00010000:3.0:1763333170.798088:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x212:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333170.798090:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x212:0x0] updating lvb ctime from disk: 0 -> 1763333171 00002000:00010000:3.0:1763333170.798093:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x212:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333170.798132:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73167480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+28:2420:x1848987613566848:12345-192.168.204.28@tcp:10:lfs.0 Request processed in 829us (1552us total) trans 17179871453 rc 0/0 00000100:00100000:3.0:1763333170.798139:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1557 00002000:00010000:3.0:1763333170.798143:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/530 (0->18446744073709551615) 00002000:00100000:3.0:1763333170.798146:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff73167480 with x1848987613566848 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333170.798152:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff73167480. 00000100:00100000:2.0:1763333170.803989:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.805303:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.805336:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613567232 00000100:00100000:0.0:1763333170.805362:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613567232 00000100:00100000:0.0:1763333170.805429:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613567360 00000100:00100000:0.0:1763333170.805433:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613567360 00000100:00100000:0.0:1763333170.806626:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8942 00000100:00100000:0.0:1763333170.806639:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5922b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56795:x1848987613567232:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:0.0:1763333170.806721:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5468a lrc: 3/0,1 mode: --/PW res: [0x240000404:0x193:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333170.806739:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5468a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x193:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.806750:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5468a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x193:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00010000:0.0:1763333170.806861:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000520900a3 reply state 00000000c88d3892 transno 4294971984 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5468a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x193:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.806873:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5468a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x193:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.806882:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x193:0x0].0x0 (ffff92ff44d03400) 00010000:00010000:0.0:1763333170.806886:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333170.806890:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763333170.806992:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5922b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56795:x1848987613567232:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 356us (3015us total) trans 4294971984 rc 0/0 00000100:00100000:0.0:1763333170.807000:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8942 00000100:00100000:0.0:1763333170.807019:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8943 00000100:00100000:0.0:1763333170.807027:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5922b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56799:x1848987613567360:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333170.807036:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333170.807046:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c54691 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968e0d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.807085:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54698 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333170.807092:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54698 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.807099:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54698 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.807109:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c5469f lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333170.807116:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c5469f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.807122:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c5469f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.807150:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54698 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.807157:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54698 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.807163:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54698 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.807170:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54698 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.807174:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333170.807178:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54698 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.807185:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54698 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.807196:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12f00) 00010000:00010000:0.0:1763333170.807198:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333170.807202:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54698 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.807207:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54698 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.807220:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c5469f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.807226:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c5469f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.807231:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c5469f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.807235:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abde400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333170.807238:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c5469f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.807244:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c5469f lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.807250:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045800) 00010000:00010000:0.0:1763333170.807253:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333170.807256:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c5469f lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.807261:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c5469f lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.807290:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c54691 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e0d expref: 230 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.807301:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12f00) 00010000:00010000:0.0:1763333170.807304:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333170.807307:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c54691 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e0d expref: 230 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.807316:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdea00, rc 0) 00000100:00100000:0.0:1763333170.807336:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5922b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56799:x1848987613567360:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 312us (2040us total) trans 0 rc 301/301 00000100:00100000:0.0:1763333170.807342:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8943 00000100:00100000:1.0:1763333170.812974:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.813466:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613567488 00000100:00100000:2.0:1763333170.813479:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613567488 00000100:00100000:1.0:1763333170.813587:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333170.813759:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613567744 00000100:00100000:3.0:1763333170.813763:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613567744 00000100:00100000:3.0:1763333170.813802:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8944 00000100:00100000:3.0:1763333170.813811:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56799:x1848987613567744:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333170.813835:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333170.813838:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763333170.813867:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54683 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e06 expref: 229 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.813888:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12f00) 00010000:00010000:3.0:1763333170.813899:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333170.813914:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c546a6 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968e1b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.814186:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c546ad lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333170.814201:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c546ad lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.814211:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c546ad lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.814223:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c546b4 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333170.814231:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c546b4 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.814238:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c546b4 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000100:00100000:2.0:1763333170.814365:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6236 00000100:00100000:2.0:1763333170.814378:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+28:56795:x1848987613567488:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333170.814389:0:8406:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333170.814402:0:8406:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c546bb lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968e14 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.814424:0:8406:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c54579 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968da4 expref: 29 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333170.814431:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333170.814433:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333170.814437:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c546bb lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e14 expref: 29 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.814470:0:8406:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c54579 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968da4 expref: 29 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333170.814483:0:8406:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c54579 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968da4 expref: 29 pid: 8611 timeout: 1374 lvb_type: 1 00000100:00100000:2.0:1763333170.814504:0:8406:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff5922a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8406:1848987627218944:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333170.814713:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c546c2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x196:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333170.814721:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c546c2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.814728:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c546c2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:3.0:1763333170.814739:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x196:0x0]: returning size 0 00010000:00010000:3.0:1763333170.814765:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c546ad lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.814771:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c546ad lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00000100:00100000:2.0:1763333170.814775:0:8406:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff471d7a80 going to sleep for 11 seconds 00010000:00010000:3.0:1763333170.814777:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c546ad lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.814783:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c546ad lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.814789:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333170.814793:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c546ad lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.814801:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c546ad lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.814810:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff80045f00) 00010000:00010000:3.0:1763333170.814814:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333170.814817:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c546ad lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.814822:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c546ad lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000004:00010000:3.0:1763333170.814833:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000cfd5ec8d reply state 00000000992f1440 transno 4294971985 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c546b4 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.814843:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c546b4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.814848:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045800) 00010000:00010000:3.0:1763333170.814850:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763333170.814853:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763333170.814879:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c546a6 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e1b expref: 231 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.814893:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c546c2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e1b expref: 230 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.814899:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x196:0x0].0x0 (ffff92ff80045e00) 00010000:00010000:3.0:1763333170.814902:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333170.814905:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feaa00, rc 0) 00000100:00100000:3.0:1763333170.814951:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56799:x1848987613567744:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1140us (1363us total) trans 4294971985 rc 0/0 00000100:00100000:3.0:1763333170.814960:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8944 00000100:00100000:2.0:1763333170.817831:0:8406:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff5922a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8406:1848987627218944:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333170.817865:0:8406:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c546bb lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e14 expref: 29 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.817884:0:8406:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe44d75a00, rc 0) 00000100:00100000:2.0:1763333170.817944:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:56795:x1848987613567488:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 3569us (4978us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333170.817952:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6236 00000100:00100000:1.0:1763333170.818080:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.818433:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613567872 00000100:00100000:0.0:1763333170.818441:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613567872 00010000:00010000:0.0:1763333170.818473:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c54579 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968da4 expref: 29 pid: 8611 timeout: 1374 lvb_type: 1 00000100:00100000:0.0:1763333170.818513:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2934 00000100:00100000:0.0:1763333170.818522:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:2420:x1848987613567872:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333170.818536:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333170.818566:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c54579 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x211:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968da4 expref: 29 pid: 8611 timeout: 1374 lvb_type: 1 00010000:00010000:0.0:1763333170.818577:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c54579 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x211:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968da4 expref: 29 pid: 8611 timeout: 1374 lvb_type: 1 00010000:00010000:0.0:1763333170.818600:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c54579 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x211:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968da4 expref: 29 pid: 8611 timeout: 1374 lvb_type: 1 00010000:00010000:0.0:1763333170.818615:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333170.818618:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333170.818626:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c546bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e14 expref: 28 pid: 8406 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333170.818630:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:0.0:1763333170.818636:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c546bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e14 expref: 28 pid: 8406 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333170.818651:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613568128 00000100:00100000:3.0:1763333170.818655:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613568128 00010000:00010000:0.0:1763333170.818671:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c546bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e14 expref: 28 pid: 8406 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333170.818682:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8945 00000100:00100000:0.0:1763333170.818684:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4399b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6505:1848987627219072:192.168.204.28@tcp:105: 00000100:00100000:3.0:1763333170.818688:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56799:x1848987613568128:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333170.818708:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333170.818728:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c546d0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x196:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968e22 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333170.818742:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff742b93c0 going to sleep for 11 seconds 00010000:00010000:3.0:1763333170.818833:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c546d7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x196:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333170.818847:0:6521:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c546c2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e1b expref: 232 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.818854:0:6521:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c546d7 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x196:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.818878:0:6521:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c546c2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e1b expref: 232 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.818890:0:6521:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c546c2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e1b expref: 232 pid: 6521 timeout: 1374 lvb_type: 0 00000100:00100000:3.0:1763333170.818900:0:6521:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7400dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6521:1848987627219200:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333170.818938:0:6521:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff50ece000 going to sleep for 11 seconds 00000100:00100000:3.0:1763333170.821689:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333170.821765:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.821845:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613568384 00000100:00100000:2.0:1763333170.821855:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613568384 00010000:00010000:2.0:1763333170.821893:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c546c2 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e1b expref: 233 pid: 6521 timeout: 1374 lvb_type: 0 00000100:00100000:2.0:1763333170.821935:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2935 00000100:00100000:2.0:1763333170.821944:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff61b15450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:2421:x1848987613568384:12345-192.168.204.28@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1763333170.821946:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4399b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6505:1848987627219072:192.168.204.28@tcp:105: 00010000:00010000:0.0:1763333170.821967:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333170.821970:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333170.821977:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c546c2 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e1b expref: 233 pid: 6521 timeout: 1374 lvb_type: 0 00010000:00010000:2.0:1763333170.821988:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c546c2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e1b expref: 233 pid: 6521 timeout: 1374 lvb_type: 0 00010000:00010000:2.0:1763333170.822009:0:28428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x196:0x0].0x0 (ffff92ff80045e00) 00010000:00010000:2.0:1763333170.822015:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c546d7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x196:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00000100:00100000:0.0:1763333170.822021:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+28:2420:x1848987613567872:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 3501us (3942us total) trans 0 rc 0/0 00010000:00010000:2.0:1763333170.822025:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c546d7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x196:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT1 00000100:00100000:0.0:1763333170.822028:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2934 00010000:00010000:2.0:1763333170.822032:0:28428:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c546d7 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x196:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.822047:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333170.822065:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff61b15450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:2421:x1848987613568384:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 124us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333170.822072:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2935 00000100:00100000:2.0:1763333170.822120:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613568256 00000100:00100000:2.0:1763333170.822124:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613568256 00000100:00100000:2.0:1763333170.822156:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6237 00000100:00100000:2.0:1763333170.822163:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+28:2420:x1848987613568256:12345-192.168.204.28@tcp:2:lfs.0 00002000:00010000:2.0:1763333170.822314:0:8406:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x211:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1763333170.822317:0:8406:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x211:0x0] updating lvb mtime from disk: 1763333170 -> 1763333170 00002000:00010000:2.0:1763333170.822320:0:8406:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x211:0x0] updating lvb atime from disk: 1763333170 -> 1763333170 00002000:00010000:2.0:1763333170.822322:0:8406:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x211:0x0] updating lvb ctime from disk: 1763333170 -> 1763333171 00002000:00010000:2.0:1763333170.822325:0:8406:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x211:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1763333170.822386:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:2420:x1848987613568256:12345-192.168.204.28@tcp:2:lfs.0 Request processed in 221us (705us total) trans 17179871454 rc 0/0 00000100:00100000:2.0:1763333170.822393:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6237 00010000:00010000:1.0:1763333170.822977:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c546c2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e1b expref: 232 pid: 6521 timeout: 1374 lvb_type: 0 00000100:00100000:1.0:1763333170.823001:0:6521:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7400dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6521:1848987627219200:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333170.823020:0:6521:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c546d7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x196:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.823029:0:6521:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c546d7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x196:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.823034:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c546d7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x196:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:1.0:1763333170.823057:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x196:0x0]: returning size 0 00000004:00080000:1.0:1763333170.823234:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x215:0x0], index 1: 0 00000004:00080000:1.0:1763333170.823240:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x215:0x0], index 0: 0 00000004:00080000:1.0:1763333170.823244:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x216:0x0], index 0: 0 00000004:00080000:1.0:1763333170.823247:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x216:0x0], index 1: 0 00010000:00010000:1.0:1763333170.823386:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c546d7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x196:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.823394:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c546d7 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x196:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.823400:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c546d7 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x196:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.823406:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333170.823410:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c546d7 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x196:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.823418:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c546d7 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x196:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.823434:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x196:0x0].0x0 (ffff92ff80045e00) 00010000:00010000:1.0:1763333170.823437:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763333170.823442:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c546d7 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x196:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.823448:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c546d7 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x196:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.823494:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c546d0 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x196:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e22 expref: 232 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.823503:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x196:0x0].0x0 (ffff92ff80045e00) 00010000:00010000:1.0:1763333170.823506:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763333170.823510:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c546d0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x196:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e22 expref: 232 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.823523:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a97000, rc 0) 00000100:00100000:1.0:1763333170.823569:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56799:x1848987613568128:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 4880us (4938us total) trans 4294971986 rc 301/301 00000100:00100000:1.0:1763333170.823576:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8945 00000100:00100000:0.0:1763333170.828434:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333170.828493:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613568640 00000100:00100000:3.0:1763333170.828507:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613568640 00000100:00100000:3.0:1763333170.828588:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3046 00000100:00100000:3.0:1763333170.828600:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6b3eb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56795:x1848987613568640:12345-192.168.204.28@tcp:35:lfs.0 00000004:00010000:3.0:1763333170.828674:0:6523:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x240000404:0x193:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c544d1 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x193:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d6c expref: 231 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.828728:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c546e5 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x193:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763333170.828741:0:6523:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c54525 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d88 expref: 231 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.828750:0:6523:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c546e5 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT1 00010000:00010000:3.0:1763333170.828792:0:6523:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c54525 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d88 expref: 231 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.828806:0:6523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c54525 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d88 expref: 231 pid: 6521 timeout: 1374 lvb_type: 0 00000100:00100000:3.0:1763333170.828822:0:6523:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7400e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6523:1848987627219328:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333170.828921:0:6523:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff50ece000 going to sleep for 11 seconds 00000100:00100000:3.0:1763333170.830306:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.830667:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613568896 00000100:00100000:2.0:1763333170.830678:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613568896 00000100:00100000:2.0:1763333170.830742:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3047 00000100:00100000:2.0:1763333170.830751:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56799:x1848987613568896:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333170.832890:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56799:x1848987613568896:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 2118us (2574us total) trans 4294971987 rc 0/0 00000100:00100000:2.0:1763333170.832908:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3047 00000100:00100000:3.0:1763333170.834560:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.834672:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613569024 00000100:00100000:2.0:1763333170.834683:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613569024 00010000:00010000:2.0:1763333170.834722:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c54525 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d88 expref: 233 pid: 6521 timeout: 1374 lvb_type: 0 00000100:00100000:2.0:1763333170.834761:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2936 00000100:00100000:2.0:1763333170.834771:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:2420:x1848987613569024:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333170.834785:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333170.834792:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c54525 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d88 expref: 233 pid: 6521 timeout: 1374 lvb_type: 0 00010000:00010000:2.0:1763333170.834805:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c54525 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d88 expref: 233 pid: 6521 timeout: 1374 lvb_type: 0 00010000:00010000:2.0:1763333170.834827:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x193:0x0].0x0 (ffff92ff44d03400) 00010000:00010000:2.0:1763333170.834831:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c546e5 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT1 00010000:00010000:2.0:1763333170.834842:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c546e5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT1 00010000:00010000:2.0:1763333170.834849:0:6506:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c546e5 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT1 00010000:00010000:2.0:1763333170.834872:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333170.834930:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:2420:x1848987613569024:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 160us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333170.834937:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2936 00010000:00010000:0.0:1763333170.835032:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c54525 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d88 expref: 232 pid: 6521 timeout: 1374 lvb_type: 0 00000100:00100000:0.0:1763333170.835048:0:6523:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7400e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6523:1848987627219328:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333170.835068:0:6523:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c546e5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT1 00010000:00010000:0.0:1763333170.835076:0:6523:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c546e5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT1 00010000:00010000:0.0:1763333170.835081:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c546e5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT1 00000040:00080000:0.0:1763333170.835313:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1316, 88 off111728 00000004:00080000:0.0:1763333170.835321:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1274914972035ns, next at 1275845147255ns, rc = 0 00000040:00080000:0.0:1763333170.835378:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1317, 88 off111728 00000004:00080000:0.0:1763333170.835384:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1274915034970ns, next at 1275845117682ns, rc = 0 00000040:00080000:0.0:1763333170.835407:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1318, 88 off111816 00000004:00080000:0.0:1763333170.835412:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1274915062808ns, next at 1275845117682ns, rc = 0 00000040:00080000:0.0:1763333170.835423:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1317, 88 off111816 00000004:00080000:0.0:1763333170.835427:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1274915077969ns, next at 1275845147255ns, rc = 0 00000001:00080000:1.0:1763333170.838429:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294971988 is committed 00000004:00080000:1.0:1763333170.838443:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 863 committed 00000004:00080000:1.0:1763333170.838450:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 866 committed 00010000:00010000:0.0:1763333170.838452:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54628 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00000004:00080000:1.0:1763333170.838462:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 865 committed 00000004:00080000:1.0:1763333170.838464:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 862 committed 00010000:00010000:0.0:1763333170.838465:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54628 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333170.838473:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54628 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333170.838478:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea800 already unused, calling callback (ffffffffc17b3550) 00000004:00080000:1.0:1763333170.838481:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 861 committed 00010000:00010000:0.0:1763333170.838483:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54628 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00000004:00080000:1.0:1763333170.838484:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 864 committed 00010000:00010000:0.0:1763333170.838491:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54628 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333170.838507:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045800) 00010000:00010000:0.0:1763333170.838511:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333170.838517:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54628 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333170.838523:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54628 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333170.838546:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c5463d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x193:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333170.838561:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c5463d lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x193:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333170.838566:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c5463d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x193:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333170.838570:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333170.838573:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c5463d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x193:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333170.838578:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c5463d lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x193:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333170.838586:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x193:0x0].0x0 (ffff92ff44d03400) 00010000:00010000:0.0:1763333170.838589:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333170.838592:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c5463d lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x193:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333170.838597:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c5463d lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x193:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333170.838607:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5468a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x193:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.838613:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5468a lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x193:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.838618:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5468a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x193:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.838623:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdee00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333170.838626:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5468a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x193:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.838632:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5468a lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x193:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.838639:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x193:0x0].0x0 (ffff92ff44d03400) 00010000:00010000:0.0:1763333170.838641:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333170.838643:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5468a lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x193:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.838648:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5468a lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x193:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000100:00100000:2.0:1763333170.838651:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff59229f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627219840:0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1763333170.838658:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c546b4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.838663:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c546b4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.838668:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c546b4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.838672:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333170.838675:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c546b4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.838680:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c546b4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.838686:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045800) 00010000:00010000:0.0:1763333170.838688:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333170.838690:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c546b4 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333170.838695:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c546b4 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000100:00100000:2.0:1763333170.838712:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:0.0:1763333170.838744:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007903f772 reply state 0000000080ee0886 transno 4294971988 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c546e5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT1 00000100:00100000:2.0:1763333170.838748:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1763333170.838754:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff5922a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627219456:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1763333170.838757:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c546e5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT1 00010000:00010000:0.0:1763333170.838764:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x193:0x0].0x0 (ffff92ff44d03400) 00010000:00010000:0.0:1763333170.838767:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1763333170.838770:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763333170.838772:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1763333170.838776:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x193:0x0].0x0 (ffff92ff44d03400) 00010000:00010000:0.0:1763333170.838778:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763333170.838784:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c544d1 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x193:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d6c expref: 219 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333170.838795:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff5922bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627219584:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763333170.838815:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333170.838833:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1763333170.838838:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff59228700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627219712:0@lo:2:osp-syn-1-1.0 00010000:00080000:0.0:1763333170.838881:0:6523:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1763333170.838895:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6b3eb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:56795:x1848987613568640:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 10298us (10473us total) trans 4294971988 rc 0/0 00000100:00100000:0.0:1763333170.838905:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3046 00000100:00100000:1.0:1763333170.838969:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7400df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627219968:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1763333170.838984:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c546e5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT1 00010000:00010000:0.0:1763333170.838992:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c546e5 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT1 00010000:00010000:0.0:1763333170.838997:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c546e5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT1 00010000:00010000:0.0:1763333170.839002:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333170.839005:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c546e5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT1 00010000:00010000:0.0:1763333170.839011:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c546e5 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT1 00010000:00010000:0.0:1763333170.839019:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x193:0x0].0x0 (ffff92ff44d03400) 00010000:00010000:0.0:1763333170.839022:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333170.839024:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c546e5 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT1 00010000:00010000:0.0:1763333170.839030:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c546e5 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT1 00000100:00100000:0.0:1763333170.839055:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627219840 00000100:00100000:0.0:1763333170.839062:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627219840 00000100:00100000:0.0:1763333170.839106:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627219456 00000100:00100000:0.0:1763333170.839109:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627219456 00000100:00100000:3.0:1763333170.839128:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627219584 00000100:00100000:3.0:1763333170.839133:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627219584 00000100:00100000:0.0:1763333170.839134:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6238 00000100:00100000:0.0:1763333170.839141:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff59228a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+36:3652:x1848987627219840:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333170.839154:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6239 00000100:00100000:3.0:1763333170.839159:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5922b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+36:3652:x1848987627219456:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763333170.839171:0:8404:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:531 count 1 00010000:00010000:3.0:1763333170.839193:0:8404:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c546ec lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x213:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.839209:0:8404:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c545fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ddc expref: 28 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.839216:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333170.839219:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333170.839222:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c546ec lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.839248:0:8404:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c545fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ddc expref: 28 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.839260:0:8404:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c545fe lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ddc expref: 28 pid: 28650 timeout: 1374 lvb_type: 0 00000100:00100000:3.0:1763333170.839270:0:8404:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46a6ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8404:1848987627220480:192.168.204.28@tcp:104: 00002000:00010000:0.0:1763333170.839276:0:8611:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x212:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333170.839279:0:8611:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x212:0x0] updating lvb mtime from disk: 1763333171 -> 1763333171 00002000:00010000:0.0:1763333170.839282:0:8611:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x212:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333170.839284:0:8611:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x212:0x0] updating lvb ctime from disk: 1763333171 -> 1763333171 00002000:00010000:0.0:1763333170.839286:0:8611:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x212:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333170.839447:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333170.839470:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7400d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627220096:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763333170.839491:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333170.839507:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1763333170.839512:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7400e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627220224:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333170.839534:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333170.839575:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627219712 00000100:00100000:2.0:1763333170.839581:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627219712 00000100:00100000:2.0:1763333170.839603:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627220096 00000100:00100000:2.0:1763333170.839606:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627220096 00000100:00100000:2.0:1763333170.839616:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627220224 00000100:00100000:2.0:1763333170.839619:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627220224 00000100:00100000:2.0:1763333170.839629:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6240 00000100:00100000:2.0:1763333170.839634:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff59229180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+38:3654:x1848987627219584:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1763333170.839647:0:8407:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:532 count 1 00002000:00010000:2.0:1763333170.839667:0:8407:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x214:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763333170.839673:0:8407:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c546f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.839682:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333170.839684:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333170.839688:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c546f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.839698:0:8407:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c546f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.839706:0:8407:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c546f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.839712:0:8407:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c546f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.839729:0:8407:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763333170.839887:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff59229180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+39:3654:x1848987627219584:12345-0@lo:6:osp-syn-1-1.0 Request processed in 251us (1070us total) trans 17179871456 rc 0/0 00000100:00100000:2.0:1763333170.839894:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6240 00000100:00100000:2.0:1763333170.839909:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6241 00000100:00100000:2.0:1763333170.839915:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff59228000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+38:3654:x1848987627219712:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333170.840291:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333170.840310:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1763333170.840320:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7400dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627220352:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333170.840366:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333170.840448:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff59228a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+38:3652:x1848987627219840:12345-0@lo:2:osp-syn-1-1.0 Request processed in 1306us (1734us total) trans 17179871455 rc 0/0 00000100:00100000:3.0:1763333170.840452:0:8404:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff50ece000 going to sleep for 11 seconds 00000100:00100000:0.0:1763333170.840455:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6238 00000100:00100000:0.0:1763333170.840469:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627219968 00000100:00100000:0.0:1763333170.840473:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627219968 00000100:00100000:0.0:1763333170.840488:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627220352 00000100:00100000:0.0:1763333170.840491:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627220352 00000100:00100000:0.0:1763333170.840502:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6242 00000100:00100000:0.0:1763333170.840508:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5922aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+8:3654:x1848987627220096:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1763333170.840522:0:8611:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:532 count 1 00002000:00010000:0.0:1763333170.840547:0:8611:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x214:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333170.840562:0:8611:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c546fa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.840571:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333170.840573:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333170.840577:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c546fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333170.840583:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6243 00010000:00010000:0.0:1763333170.840588:0:8611:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c546fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333170.840591:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff59228380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+8:3654:x1848987627220224:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1763333170.840596:0:8611:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c546fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.840603:0:8611:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c546fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333170.840682:0:29013:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x211:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333170.840685:0:29013:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x211:0x0] updating lvb mtime from disk: 1763333170 -> 1763333170 00002000:00010000:3.0:1763333170.840688:0:29013:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x211:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333170.840690:0:29013:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x211:0x0] updating lvb ctime from disk: 1763333170 -> 1763333170 00002000:00010000:3.0:1763333170.840692:0:29013:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x211:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333170.840718:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff59228380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+9:3654:x1848987627220224:12345-0@lo:2:osp-syn-0-1.0 Request processed in 128us (1183us total) trans 21474838759 rc 0/0 00000100:00100000:3.0:1763333170.840723:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6243 00000100:00100000:3.0:1763333170.840736:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6244 00000100:00100000:3.0:1763333170.840741:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+8:3653:x1848987627219968:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763333170.840751:0:29013:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:531 count 1 00010000:00010000:3.0:1763333170.840759:0:29013:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c54701 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x213:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.840772:0:29013:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c545f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968dce expref: 12 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.840778:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00002000:00010000:2.0:1763333170.841124:0:8407:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x211:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1763333170.841128:0:8407:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x211:0x0] updating lvb mtime from disk: 1763333170 -> 1763333170 00002000:00010000:2.0:1763333170.841130:0:8407:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x211:0x0] updating lvb atime from disk: 1763333170 -> 1763333170 00002000:00010000:2.0:1763333170.841133:0:8407:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x211:0x0] updating lvb ctime from disk: 1763333171 -> 1763333171 00002000:00010000:2.0:1763333170.841134:0:8407:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x211:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1763333170.841168:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff59228000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+38:3654:x1848987627219712:12345-0@lo:2:osp-syn-1-1.0 Request processed in 1253us (1720us total) trans 17179871457 rc 0/0 00000100:00100000:2.0:1763333170.841175:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6241 00000100:00100000:2.0:1763333170.841190:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6245 00000100:00100000:2.0:1763333170.841197:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+8:3653:x1848987627220352:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:2.0:1763333170.841252:0:8407:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x212:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1763333170.841255:0:8407:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x212:0x0] updating lvb mtime from disk: 1763333171 -> 1763333171 00002000:00010000:2.0:1763333170.841258:0:8407:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x212:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333170.841260:0:8407:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x212:0x0] updating lvb ctime from disk: 1763333171 -> 1763333171 00002000:00010000:2.0:1763333170.841262:0:8407:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x212:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1763333170.841293:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+9:3653:x1848987627220352:12345-0@lo:2:osp-syn-0-1.0 Request processed in 96us (944us total) trans 21474838760 rc 0/0 00000100:00100000:2.0:1763333170.841299:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6245 00010000:00010000:3.0:1763333170.841476:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333170.841480:0:29013:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c54701 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.841514:0:29013:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c545f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968dce expref: 12 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.841527:0:29013:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c545f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968dce expref: 12 pid: 28650 timeout: 1374 lvb_type: 0 00000100:00100000:3.0:1763333170.841540:0:29013:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46a6e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29013:1848987627220608:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333170.841580:0:29013:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7dfd8b40 going to sleep for 11 seconds 00000004:00080000:3.0:1763333170.841620:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff59229f80/2, rc 0, transno 17179871455 00000100:00100000:3.0:1763333170.841626:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff59229f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627219840:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333170.841671:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:0.0:1763333170.842129:0:8611:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1763333170.842438:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1763333170.842447:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c546f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.842455:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333170.842456:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe44d75400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333170.842461:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c546f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.842461:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c546fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.842469:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdfe00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333170.842472:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c546fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.842473:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c546f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.842480:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c546fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.842495:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c546f3 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.842495:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c546fa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.842503:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c546fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.842509:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c546f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.842521:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333170.842522:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333170.842523:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333170.842524:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333170.842525:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333170.842526:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763333170.842561:0:3653:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474838755 gen 2 00000004:00080000:2.0:1763333170.842566:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7400f480, transno 21474838742 00000004:00080000:2.0:1763333170.842583:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7400f100, transno 21474838743 00000004:00080000:2.0:1763333170.842586:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7400ce00, transno 21474838744 00000004:00080000:2.0:1763333170.842604:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7400d180, transno 21474838746 00000004:00080000:2.0:1763333170.842607:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46e2e300, transno 21474838747 00000004:00080000:2.0:1763333170.842610:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46e2c700, transno 21474838748 00000004:00080000:2.0:1763333170.842613:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46e2e680, transno 21474838749 00000004:00080000:2.0:1763333170.842616:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46e2d180, transno 21474838750 00000004:00080000:2.0:1763333170.842620:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46e2c380, transno 21474838752 00000004:00080000:2.0:1763333170.842622:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46e2d880, transno 21474838753 00000004:00080000:2.0:1763333170.842624:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4399b480, transno 21474838754 00000004:00080000:2.0:1763333170.842627:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe43998a80, transno 21474838755 00000100:00100000:2.0:1763333170.842636:0:3653:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff92ff7400dc00 x1848987627220352/t21474838760(21474838760) o2->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763333186 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1763333170.842647:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7400dc00/2, rc 0, transno 21474838760 00000100:00100000:2.0:1763333170.842652:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7400dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627220352:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1763333170.842682:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7400e300/2, rc 0, transno 21474838759 00000100:00100000:2.0:1763333170.842686:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7400e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627220224:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1763333170.842694:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7400d880/2, rc 0, transno 21474838761 00000100:00100000:2.0:1763333170.842698:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7400d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627220096:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1763333170.842707:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff59228700/2, rc 0, transno 17179871457 00000100:00100000:2.0:1763333170.842711:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff59228700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627219712:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1763333170.842721:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff5922bb80/2, rc 0, transno 17179871456 00000100:00100000:2.0:1763333170.842725:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff5922bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627219584:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763333170.843548:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5922aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+9:3654:x1848987627220096:12345-0@lo:6:osp-syn-0-1.0 Request processed in 3032us (4048us total) trans 21474838761 rc 0/0 00000100:00100000:0.0:1763333170.843569:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6242 00000100:00100000:0.0:1763333170.843636:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613569280 00000100:00100000:0.0:1763333170.843645:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613569280 00000100:00100000:0.0:1763333170.843696:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3048 00000100:00100000:0.0:1763333170.843704:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+218:56799:x1848987613569280:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333170.843948:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:56799:x1848987613569280:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 245us (2275us total) trans 4294971989 rc 0/0 00000100:00100000:0.0:1763333170.843956:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3048 00000004:00080000:1.0:1763333170.844265:0:8604:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 4 in progress, 1 in flight, 12 done 00000100:00100000:0.0:1763333170.846960:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.847001:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.847014:0:29013:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46a6e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29013:1848987627220608:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333170.847051:0:29013:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c54701 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333170.847085:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613569408 00000100:00100000:0.0:1763333170.847088:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.847091:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613569408 00010000:00010000:2.0:1763333170.847126:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c545fe lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ddc expref: 29 pid: 28650 timeout: 1374 lvb_type: 0 00000100:00100000:1.0:1763333170.847139:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613569536 00000100:00100000:1.0:1763333170.847143:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613569536 00000100:00100000:2.0:1763333170.847173:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2937 00010000:00010000:1.0:1763333170.847176:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c545f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968dce expref: 13 pid: 28650 timeout: 1374 lvb_type: 0 00000100:00100000:2.0:1763333170.847182:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4399b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:2418:x1848987613569408:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333170.847198:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333170.847203:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c545fe lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x213:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ddc expref: 29 pid: 28650 timeout: 1374 lvb_type: 0 00000100:00100000:1.0:1763333170.847205:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2938 00000100:00100000:1.0:1763333170.847211:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4399bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2418:x1848987613569536:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333170.847215:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c545fe lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x213:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ddc expref: 29 pid: 28650 timeout: 1374 lvb_type: 0 00010000:00010000:1.0:1763333170.847219:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333170.847223:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c545f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968dce expref: 13 pid: 28650 timeout: 1374 lvb_type: 0 00010000:00010000:1.0:1763333170.847230:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c545f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968dce expref: 13 pid: 28650 timeout: 1374 lvb_type: 0 00010000:00010000:2.0:1763333170.847242:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333170.847244:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c545f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x213:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968dce expref: 13 pid: 28650 timeout: 1374 lvb_type: 0 00010000:00010000:2.0:1763333170.847245:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333170.847250:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c546ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x213:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.847256:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333170.847258:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333170.847260:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c54701 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.847262:0:6506:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c546ec lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x213:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.847268:0:28428:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c54701 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.847283:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333170.847284:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333170.848165:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4399b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:2418:x1848987613569408:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 978us (1212us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333170.848175:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2937 00010000:00010000:2.0:1763333170.848215:0:29013:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c54701 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.848224:0:29013:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c54701 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.848234:0:29013:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c54701 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.848242:0:29013:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c54701 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.848260:0:29013:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763333170.848274:0:8404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c545fe lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ddc expref: 28 pid: 28650 timeout: 1374 lvb_type: 0 00000100:00100000:3.0:1763333170.848285:0:8404:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46a6ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8404:1848987627220480:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333170.848300:0:8404:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c546ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.848307:0:8404:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c546ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.848312:0:8404:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c546ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.848319:0:8404:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c546ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.848325:0:8404:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c546ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.848338:0:8404:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1763333170.848678:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4399bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:2418:x1848987613569536:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 1465us (1673us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333170.848686:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2938 00010000:00010000:1.0:1763333170.848707:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1763333170.848712:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c54701 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.848721:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97800 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333170.848725:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c54701 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.848733:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c54701 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.848749:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c54701 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.848756:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c54701 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.848773:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333170.848776:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c546ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.848782:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96e00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333170.848784:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c546ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.848790:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c546ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.848798:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c546ec lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.848809:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c546ec lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.848820:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333170.848821:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333170.848823:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763333170.848834:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613569664 00000100:00100000:1.0:1763333170.848839:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613569664 00000100:00100000:1.0:1763333170.848872:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8946 00000100:00100000:1.0:1763333170.848878:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+219:56795:x1848987613569664:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333170.848900:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333170.848918:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c54708 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x193:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968e29 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.848971:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c54708 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e29 expref: 220 pid: 6521 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333170.849435:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5922b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+38:3652:x1848987627219456:12345-0@lo:6:osp-syn-1-1.0 Request processed in 10273us (10659us total) trans 17179871458 rc 0/0 00000100:00100000:3.0:1763333170.849446:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6239 00000004:00080000:3.0:1763333170.849504:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff5922a680/2, rc 0, transno 17179871458 00000100:00100000:3.0:1763333170.849512:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff5922a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627219456:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763333170.850656:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+9:3653:x1848987627219968:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9903us (10354us total) trans 21474838762 rc 0/0 00000100:00100000:2.0:1763333170.850670:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6244 00010000:00010000:2.0:1763333170.850716:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763333170.850767:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7400df80/2, rc 0, transno 21474838762 00010000:00010000:1.0:1763333170.850771:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fa00/0xb32e3ef184c54708 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x193:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e29 expref: 220 pid: 6521 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333170.850777:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7400df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627219968:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1763333170.850824:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x193:0x0].0x0 (ffff92ff44d03400) 00010000:00010000:1.0:1763333170.850829:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763333170.850834:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7fa00, rc 0) 00000100:00100000:1.0:1763333170.850914:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+220:56795:x1848987613569664:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 2034us (3825us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333170.850922:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8946 00000100:00100000:0.0:1763333170.853922:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.854002:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613569920 00000100:00100000:1.0:1763333170.854013:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613569920 00000100:00100000:1.0:1763333170.854073:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8947 00000100:00100000:1.0:1763333170.854084:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+220:55917:x1848987613569920:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333170.854109:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333170.854135:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5470f lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968e30 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.854292:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54716 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333170.854306:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54716 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333170.854317:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54716 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333170.854330:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5471d lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333170.854337:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5471d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333170.854343:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5471d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333170.854558:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c54724 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x196:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333170.854568:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c54724 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333170.854575:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c54724 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:1.0:1763333170.854591:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x196:0x0]: returning size 0 00010000:00010000:1.0:1763333170.854677:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54716 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333170.854685:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54716 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333170.854692:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54716 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333170.854698:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54716 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333170.854704:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333170.854708:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54716 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333170.854716:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54716 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333170.854729:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355300) 00010000:00010000:1.0:1763333170.854733:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333170.854738:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54716 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333170.854744:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54716 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333170.854755:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5471d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333170.854761:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5471d lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333170.854769:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5471d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333170.854773:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7ec00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333170.854776:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5471d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333170.854782:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5471d lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333170.854788:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355b00) 00010000:00010000:1.0:1763333170.854790:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333170.854793:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5471d lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333170.854798:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5471d lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333170.854838:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5470f lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e30 expref: 223 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.854852:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c54724 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e30 expref: 222 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.854859:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x196:0x0].0x0 (ffff92fe48355c00) 00010000:00010000:1.0:1763333170.854861:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333170.854863:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7fe00, rc 0) 00000100:00100000:1.0:1763333170.854922:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:55917:x1848987613569920:12345-192.168.204.28@tcp:101:bash.0 Request processed in 840us (1009us total) trans 4294971990 rc 0/0 00000100:00100000:1.0:1763333170.854931:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8947 00000100:00100000:3.0:1763333170.857596:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.857655:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613570176 00000100:00100000:2.0:1763333170.857670:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613570176 00000100:00100000:2.0:1763333170.857744:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3049 00000100:00100000:2.0:1763333170.857757:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:56795:x1848987613570176:12345-192.168.204.28@tcp:35:lfs.0 00000004:00080000:2.0:1763333170.858099:0:6522:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x193:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1763333170.858162:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1318, 64 off111880 00000040:00080000:2.0:1763333170.858187:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1319, 64 off111880 00000040:00080000:2.0:1763333170.858197:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1320, 64 off111944 00000040:00080000:2.0:1763333170.858206:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1319, 64 off111944 00010000:00010000:2.0:1763333170.858274:0:6522:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c54732 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x193:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 00010000:00010000:2.0:1763333170.858294:0:6522:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c54732 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x193:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT1 00010000:00010000:2.0:1763333170.858307:0:6522:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c54732 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x193:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT1 00010000:00010000:2.0:1763333170.858315:0:6522:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c54732 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x193:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT1 00010000:00010000:2.0:1763333170.858321:0:6522:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c54732 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x193:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT1 00010000:00010000:2.0:1763333170.858327:0:6522:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c54732 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x193:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT1 00010000:00010000:2.0:1763333170.858391:0:6522:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763333170.858392:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333170.858399:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c54732 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x193:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT1 00010000:00010000:1.0:1763333170.858406:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe44d75400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333170.858409:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c54732 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x193:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT1 00010000:00010000:1.0:1763333170.858417:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c54732 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x193:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT1 00010000:00010000:1.0:1763333170.858429:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x193:0x0].0x0 (ffff92ff44d03400) 00010000:00010000:1.0:1763333170.858432:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1763333170.858437:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c54732 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x193:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT1 00010000:00010000:1.0:1763333170.858442:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c54732 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x193:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT1 00010000:00010000:1.0:1763333170.858456:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333170.858458:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333170.858460:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763333170.858614:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56795:x1848987613570176:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 857us (1027us total) trans 4294971991 rc 0/0 00000100:00100000:2.0:1763333170.858622:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3049 00000100:00100000:0.0:1763333170.860455:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.860543:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613570304 00000100:00100000:1.0:1763333170.860561:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613570304 00000100:00100000:1.0:1763333170.860619:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8948 00000100:00100000:1.0:1763333170.860629:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4399aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:55917:x1848987613570304:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333170.860655:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333170.860676:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54739 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x196:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968e37 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.860711:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54740 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x196:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333170.860727:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54740 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x196:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333170.860738:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54740 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x196:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333170.860851:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54739 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x196:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e37 expref: 225 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.860870:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54740 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x196:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e37 expref: 224 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.860879:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x196:0x0].0x0 (ffff92fe48355c00) 00010000:00010000:1.0:1763333170.860882:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763333170.860886:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f000, rc 0) 00000100:00100000:1.0:1763333170.860933:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4399aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:55917:x1848987613570304:12345-192.168.204.28@tcp:101:bash.0 Request processed in 306us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333170.860940:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8948 00000100:00100000:0.0:1763333170.864531:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.864762:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613570560 00000100:00100000:2.0:1763333170.864774:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613570560 00000100:00100000:2.0:1763333170.864976:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8949 00000100:00100000:2.0:1763333170.864989:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56795:x1848987613570560:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333170.865018:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333170.865042:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c54747 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x196:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968e3e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.865165:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5474e lrc: 3/1,0 mode: --/CR res: [0x240000404:0x196:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333170.865179:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5474e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x196:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.865191:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5474e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x196:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:2.0:1763333170.865203:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x196:0x0]: returning size 0 00010000:00010000:2.0:1763333170.865331:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c54747 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x196:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e3e expref: 227 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.865375:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5474e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x196:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e3e expref: 226 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.865385:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x196:0x0].0x0 (ffff92fe48355c00) 00010000:00010000:2.0:1763333170.865388:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1763333170.865391:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5400, rc 0) 00000100:00100000:2.0:1763333170.865448:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56795:x1848987613570560:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 462us (927us total) trans 4294971992 rc 0/0 00000100:00100000:2.0:1763333170.865456:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8949 00000100:00100000:0.0:1763333170.865631:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.865683:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613570816 00000100:00100000:1.0:1763333170.865689:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613570816 00000100:00100000:1.0:1763333170.865717:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8950 00000100:00100000:1.0:1763333170.865725:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4399a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:55917:x1848987613570816:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:1.0:1763333170.865750:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333170.865765:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c54724 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e30 expref: 226 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.865775:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x196:0x0].0x0 (ffff92fe48355c00) 00010000:00010000:1.0:1763333170.865778:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333170.865897:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5475c lrc: 3/0,1 mode: --/PW res: [0x240000404:0x196:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333170.865913:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5475c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x196:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.865921:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5475c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x196:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000001:00080000:1.0:1763333170.865979:0:6521:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294971993 00000004:00010000:1.0:1763333170.866003:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a959f910 reply state 00000000da878de8 transno 4294971994 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5475c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x196:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.866015:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5475c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x196:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.866021:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x196:0x0].0x0 (ffff92fe48355c00) 00010000:00010000:1.0:1763333170.866024:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333170.866027:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763333170.866086:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4399a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:55917:x1848987613570816:12345-192.168.204.28@tcp:36:bash.0 Request processed in 362us (456us total) trans 4294971994 rc 0/0 00000100:00100000:1.0:1763333170.866093:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8950 00000020:00080000:1.0:1763333170.866097:0:6521:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763333170.867784:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.868566:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613570944 00000100:00100000:1.0:1763333170.868575:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613570944 00000100:00100000:1.0:1763333170.868774:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8951 00000100:00100000:1.0:1763333170.868784:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4399b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56795:x1848987613570944:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333170.868807:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333170.868824:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54763 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x196:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968e45 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.868906:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5476a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x196:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333170.868919:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5476a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.868929:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5476a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:1.0:1763333170.868951:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x196:0x0]: returning size 0 00000004:00200000:1.0:1763333170.868955:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763333170.868971:0:6521:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5476a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.868995:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54763 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x196:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e45 expref: 230 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.869011:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5476a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e45 expref: 229 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.869019:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x196:0x0].0x0 (ffff92fe48355c00) 00010000:00010000:1.0:1763333170.869022:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333170.869026:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f600, rc 0) 00000100:00100000:1.0:1763333170.869082:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4399b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56795:x1848987613570944:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 299us (1305us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333170.869088:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8951 00000100:00100000:0.0:1763333170.870668:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.870802:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613571200 00000100:00100000:1.0:1763333170.870811:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613571200 00000100:00100000:1.0:1763333170.870852:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8952 00000100:00100000:1.0:1763333170.870859:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:55917:x1848987613571200:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333170.870880:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333170.870882:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763333170.870909:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5474e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x196:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e3e expref: 229 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.870927:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x196:0x0].0x0 (ffff92fe48355c00) 00010000:00010000:1.0:1763333170.870931:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333170.870944:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54771 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x196:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968e4c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.870990:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54778 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x196:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333170.871004:0:6521:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5476a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e45 expref: 229 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.871012:0:6521:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54778 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x196:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.871044:0:6521:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5476a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e45 expref: 229 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.871056:0:6521:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5476a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e45 expref: 229 pid: 6521 timeout: 1374 lvb_type: 0 00000100:00100000:1.0:1763333170.871069:0:6521:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44de3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6521:1848987627220736:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333170.871164:0:6521:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe46e0ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1763333170.873029:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.873071:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.873142:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613571328 00000100:00100000:0.0:1763333170.873150:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613571328 00000100:00100000:0.0:1763333170.873193:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613571456 00000100:00100000:0.0:1763333170.873196:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613571456 00000100:00100000:0.0:1763333170.873220:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6246 00000100:00100000:0.0:1763333170.873230:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff59228e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:2420:x1848987613571328:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333170.873246:0:29013:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333170.873269:0:29013:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5477f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968e53 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333170.873275:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6247 00000100:00100000:3.0:1763333170.873285:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff59229500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+28:2420:x1848987613571456:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333170.873293:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:0.0:1763333170.873294:0:29013:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x216:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333170.873305:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c54786 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968e5a expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.873315:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333170.873318:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00002000:00010000:3.0:1763333170.873321:0:8404:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x216:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333170.873327:0:29013:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5477f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e53 expref: 13 pid: 29013 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333170.873328:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333170.873330:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333170.873334:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c54786 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e5a expref: 29 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333170.873343:0:29013:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5477f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e53 expref: 13 pid: 29013 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333170.873344:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c54786 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e5a expref: 29 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333170.873380:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a97200, rc 0) 00010000:00010000:0.0:1763333170.873380:0:29013:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdf200, rc 0) 00000100:00100000:1.0:1763333170.873486:0:6521:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44de3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6521:1848987627220736:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333170.873509:0:6521:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54778 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x196:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000100:00100000:3.0:1763333170.873807:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff59229500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:2420:x1848987613571456:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 523us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333170.873815:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6247 00000100:00100000:2.0:1763333170.873921:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.873922:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff59228e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2420:x1848987613571328:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 693us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333170.873929:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6246 00000100:00100000:3.0:1763333170.874178:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613571584 00000100:00100000:3.0:1763333170.874184:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613571584 00010000:00010000:3.0:1763333170.874210:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5476a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e45 expref: 230 pid: 6521 timeout: 1374 lvb_type: 0 00000100:00100000:3.0:1763333170.874243:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2939 00000100:00100000:3.0:1763333170.874253:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5922ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:2420:x1848987613571584:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333170.874265:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333170.874271:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5476a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e45 expref: 230 pid: 6521 timeout: 1374 lvb_type: 0 00010000:00010000:3.0:1763333170.874282:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5476a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e45 expref: 230 pid: 6521 timeout: 1374 lvb_type: 0 00010000:00010000:3.0:1763333170.874302:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5476a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e45 expref: 230 pid: 6521 timeout: 1374 lvb_type: 0 00010000:00010000:3.0:1763333170.874317:0:8423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x196:0x0].0x0 (ffff92fe48355c00) 00010000:00010000:3.0:1763333170.874322:0:8423:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54778 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x196:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.874332:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54778 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x196:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.874339:0:8423:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54778 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x196:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.874402:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333170.874435:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5922ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:2420:x1848987613571584:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 183us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333170.874442:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2939 00010000:00010000:1.0:1763333170.874453:0:6521:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54778 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x196:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333170.874462:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54778 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x196:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000040:00080000:1.0:1763333170.874715:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1320, 88 off112032 00000004:00080000:1.0:1763333170.874723:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1274954373917ns, next at 1275845147255ns, rc = 0 00000040:00080000:1.0:1763333170.874759:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1321, 88 off112032 00000004:00080000:1.0:1763333170.874765:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1274954415889ns, next at 1275845117682ns, rc = 0 00000040:00080000:1.0:1763333170.874792:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1322, 88 off112120 00000004:00080000:1.0:1763333170.874796:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1274954447234ns, next at 1275845117682ns, rc = 0 00000040:00080000:1.0:1763333170.874806:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1321, 88 off112120 00000004:00080000:1.0:1763333170.874809:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1274954460145ns, next at 1275845147255ns, rc = 0 00000100:00100000:2.0:1763333170.876786:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333170.876917:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613571712 00000100:00100000:3.0:1763333170.876926:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613571712 00000100:00100000:3.0:1763333170.876981:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8953 00000100:00100000:3.0:1763333170.876991:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff59229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56795:x1848987613571712:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333170.877014:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333170.877034:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c5478d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x196:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968e61 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.877081:0:12741:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54778 lrc: 2/0,1 mode: EX/EX res: [0x240000404:0x196:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.877091:0:12741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c5478d lrc: 4/0,0 mode: --/CR res: [0x240000404:0x196:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e61 expref: 231 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.877108:0:12741:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54778 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x196:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.877119:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c5478d lrc: 3/0,0 mode: --/CR res: [0x240000404:0x196:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e61 expref: 231 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.877131:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x196:0x0].0x0 (ffff92fe48355c00) 00010000:00010000:3.0:1763333170.877134:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763333170.877137:0:12741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c5478d lrc: 3/0,0 mode: --/CR res: [0x240000404:0x196:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e61 expref: 231 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.877144:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96400, rc 0) 00000100:00100000:3.0:1763333170.877213:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff59229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56795:x1848987613571712:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 223us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333170.877220:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8953 00000001:00080000:0.0:1763333170.878760:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294971995 is committed 00000004:00080000:0.0:1763333170.878771:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 865 committed 00000004:00080000:0.0:1763333170.878788:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 868 committed 00000004:00080000:0.0:1763333170.878799:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 867 committed 00000004:00080000:0.0:1763333170.878801:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 864 committed 00000100:00100000:2.0:1763333170.878969:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4399a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627220864:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763333170.879032:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333170.879074:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1763333170.879080:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe438ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627221248:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333170.879104:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333170.879134:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42f0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627220992:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763333170.879167:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333170.879188:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1763333170.879192:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe438ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627221120:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333170.879209:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333170.879236:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627220864 00000100:00100000:2.0:1763333170.879241:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627220864 00000100:00100000:2.0:1763333170.879273:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627221248 00000100:00100000:2.0:1763333170.879276:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627221248 00000100:00100000:2.0:1763333170.879292:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627220992 00000100:00100000:2.0:1763333170.879294:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627220992 00000100:00100000:2.0:1763333170.879308:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627221120 00000100:00100000:2.0:1763333170.879311:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627221120 00000100:00100000:2.0:1763333170.879329:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6248 00000100:00100000:2.0:1763333170.879336:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff49772450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+12:3653:x1848987627220864:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1763333170.879394:0:8404:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:529 count 1 00010000:00010000:2.0:1763333170.879424:0:8404:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54794 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.879444:0:8404:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5448b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d57 expref: 12 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.879453:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333170.879456:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333170.879459:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54794 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.879485:0:8404:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5448b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d57 expref: 12 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.879498:0:8404:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5448b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d57 expref: 12 pid: 8407 timeout: 1374 lvb_type: 0 00000100:00100000:2.0:1763333170.879509:0:8404:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46e2e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8404:1848987627221376:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333170.879571:0:8404:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7dcc7600 going to sleep for 11 seconds 00000100:00100000:2.0:1763333170.879590:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6249 00000100:00100000:2.0:1763333170.879599:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff59229880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+12:3653:x1848987627221248:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1763333170.879741:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5475c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x196:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00002000:00010000:2.0:1763333170.879744:0:28600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x216:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333170.879747:0:28600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x216:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1763333170.879750:0:28600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x216:0x0] updating lvb atime from disk: 0 -> 0 00010000:00010000:3.0:1763333170.879751:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5475c lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x196:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00002000:00010000:2.0:1763333170.879753:0:28600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x216:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1763333170.879755:0:28600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x216:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:3.0:1763333170.879762:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5475c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x196:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.879767:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333170.879771:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5475c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x196:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.879779:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5475c lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x196:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00000100:00100000:2.0:1763333170.879793:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff59229880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+13:3653:x1848987627221248:12345-0@lo:2:osp-syn-0-1.0 Request processed in 197us (688us total) trans 21474838763 rc 0/0 00010000:00010000:3.0:1763333170.879794:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x196:0x0].0x0 (ffff92fe48355c00) 00010000:00010000:3.0:1763333170.879797:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333170.879801:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6249 00010000:00010000:3.0:1763333170.879802:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5475c lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x196:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333170.879807:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5475c lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x196:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000100:00100000:2.0:1763333170.879817:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6250 00000100:00100000:2.0:1763333170.879823:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+12:3654:x1848987627220992:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763333170.879835:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6251 00002000:00080000:2.0:1763333170.879835:0:28600:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:530 count 1 00000100:00100000:3.0:1763333170.879843:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+12:3654:x1848987627221120:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1763333170.879845:0:28600:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5479b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.879855:0:28600:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54644 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968dea expref: 12 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.879861:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333170.879863:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333170.879866:0:28600:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5479b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.879883:0:28600:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54644 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968dea expref: 12 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.879893:0:28600:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54644 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968dea expref: 12 pid: 8406 timeout: 1374 lvb_type: 0 00000100:00100000:2.0:1763333170.879902:0:28600:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46e2d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28600:1848987627221504:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333170.879924:0:28600:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7dcc7900 going to sleep for 11 seconds 00000100:00100000:3.0:1763333170.879926:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+13:3654:x1848987627221120:12345-0@lo:2:osp-syn-0-1.0 Request processed in 84us (715us total) trans 21474838764 rc 0/0 00000100:00100000:3.0:1763333170.879933:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6251 00000004:00080000:2.0:1763333170.879960:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe438ab480/2, rc 0, transno 21474838763 00000004:00080000:3.0:1763333170.879965:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe438ab100/2, rc 0, transno 21474838764 00000100:00100000:2.0:1763333170.879966:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe438ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627221248:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333170.879968:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe438ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627221120:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333170.880134:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44de2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627221888:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333170.880163:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333170.880183:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1763333170.880189:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44de1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627221760:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763333170.880208:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333170.880233:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627221888 00000100:00100000:1.0:1763333170.880243:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627221888 00000100:00100000:1.0:1763333170.880266:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627221760 00000100:00100000:1.0:1763333170.880269:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627221760 00000100:00100000:0.0:1763333170.880279:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6252 00000100:00100000:1.0:1763333170.880284:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6253 00000100:00100000:0.0:1763333170.880288:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+39:3655:x1848987627221888:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333170.880289:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+39:3655:x1848987627221760:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763333170.880301:0:8611:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:530 count 1 00010000:00010000:1.0:1763333170.880314:0:8611:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c547a2 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.880326:0:8611:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5464b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968df1 expref: 28 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.880333:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333170.880335:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333170.880337:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c547a2 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.880380:0:8611:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5464b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968df1 expref: 28 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.880390:0:8611:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5464b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968df1 expref: 28 pid: 8406 timeout: 1374 lvb_type: 0 00000100:00100000:1.0:1763333170.880400:0:8611:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44de0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8611:1848987627222144:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333170.880411:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+40:3655:x1848987627221888:12345-0@lo:2:osp-syn-1-1.0 Request processed in 125us (247us total) trans 17179871459 rc 0/0 00000100:00100000:0.0:1763333170.880417:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6252 00000100:00100000:1.0:1763333170.880429:0:8611:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe46e0e9c0 going to sleep for 11 seconds 00000004:00080000:0.0:1763333170.880442:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44de2a00/2, rc 0, transno 17179871459 00000100:00100000:0.0:1763333170.880446:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44de2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627221888:0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1763333170.880475:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54778 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x196:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e4c expref: 223 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.880483:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x196:0x0].0x0 (ffff92fe48355c00) 00010000:00010000:1.0:1763333170.880486:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763333170.880490:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c5478d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x196:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e61 expref: 223 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.880499:0:6521:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c5478d lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x196:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e61 expref: 223 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.880506:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c5478d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x196:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e61 expref: 223 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.880530:0:6521:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c5478d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x196:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e61 expref: 223 pid: 12741 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333170.880539:0:6521:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44de2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6521:1848987627222272:192.168.204.28@tcp:105: 00000100:00100000:1.0:1763333170.880572:0:6521:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe46e0e900 going to sleep for 11 seconds 00000100:00100000:2.0:1763333170.880653:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44de3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627221632:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763333170.880678:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333170.880703:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1763333170.880712:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44de1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627222016:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333170.880734:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333170.880751:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627221632 00000100:00100000:3.0:1763333170.880755:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627221632 00000100:00100000:3.0:1763333170.880773:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627222016 00000100:00100000:3.0:1763333170.880775:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627222016 00000100:00100000:3.0:1763333170.880803:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6254 00000100:00100000:0.0:1763333170.880814:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6255 00000100:00100000:0.0:1763333170.880822:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+41:3653:x1848987627222016:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1763333170.880876:0:28650:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x216:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333170.880878:0:28650:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x216:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763333170.880881:0:28650:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x216:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333170.880882:0:28650:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x216:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763333170.880884:0:28650:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x216:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333170.880912:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+42:3653:x1848987627222016:12345-0@lo:2:osp-syn-1-1.0 Request processed in 91us (176us total) trans 17179871460 rc 0/0 00000100:00100000:0.0:1763333170.880918:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6255 00000100:00100000:3.0:1763333170.881205:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+41:3653:x1848987627221632:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763333170.881220:0:8406:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:529 count 1 00010000:00010000:3.0:1763333170.881234:0:8406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c547a9 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.881258:0:8406:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c546bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e14 expref: 28 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.881265:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333170.881267:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333170.881269:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c547a9 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.881289:0:8406:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c546bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e14 expref: 28 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.881298:0:8406:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c546bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e14 expref: 28 pid: 8406 timeout: 1374 lvb_type: 0 00000100:00100000:3.0:1763333170.881307:0:8406:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46a6ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8406:1848987627222400:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333170.881345:0:8406:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7dfd8f00 going to sleep for 11 seconds 00000004:00080000:2.0:1763333170.881437:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44de1500/2, rc 0, transno 17179871460 00000100:00100000:2.0:1763333170.881441:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44de1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627222016:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333170.885742:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.885770:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613571840 00000100:00100000:1.0:1763333170.885779:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613571840 00010000:00010000:1.0:1763333170.885818:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5448b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d57 expref: 13 pid: 8407 timeout: 1374 lvb_type: 0 00000100:00100000:1.0:1763333170.885854:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2940 00000100:00100000:1.0:1763333170.885864:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2418:x1848987613571840:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333170.885879:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333170.885884:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5448b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x211:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d57 expref: 13 pid: 8407 timeout: 1374 lvb_type: 0 00010000:00010000:1.0:1763333170.885898:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5448b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x211:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d57 expref: 13 pid: 8407 timeout: 1374 lvb_type: 0 00010000:00010000:1.0:1763333170.885922:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333170.885925:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333170.885930:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54794 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x211:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.885939:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54794 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x211:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.885958:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333170.885999:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2418:x1848987613571840:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 137us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333170.886006:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2940 00000100:00100000:1.0:1763333170.886041:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.886055:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613572096 00000100:00100000:1.0:1763333170.886058:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613572096 00010000:00010000:1.0:1763333170.886071:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5464b lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968df1 expref: 29 pid: 8406 timeout: 1374 lvb_type: 0 00000100:00100000:1.0:1763333170.886087:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2941 00000100:00100000:1.0:1763333170.886092:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:2418:x1848987613572096:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333170.886099:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333170.886102:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5464b lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x212:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968df1 expref: 29 pid: 8406 timeout: 1374 lvb_type: 0 00010000:00010000:1.0:1763333170.886111:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5464b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x212:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968df1 expref: 29 pid: 8406 timeout: 1374 lvb_type: 0 00010000:00010000:1.0:1763333170.886123:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333170.886125:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333170.886128:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c547a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x212:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.886135:0:28428:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c547a2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x212:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.886151:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333170.886168:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:2418:x1848987613572096:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 75us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333170.886174:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2941 00010000:00010000:0.0:1763333170.886212:0:8611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5464b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968df1 expref: 28 pid: 8406 timeout: 1374 lvb_type: 0 00000100:00100000:0.0:1763333170.886227:0:8611:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44de0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8611:1848987627222144:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333170.886230:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.886242:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613571968 00000100:00100000:1.0:1763333170.886245:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613571968 00010000:00010000:0.0:1763333170.886247:0:8611:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c547a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.886258:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54644 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968dea expref: 13 pid: 8406 timeout: 1374 lvb_type: 0 00010000:00010000:0.0:1763333170.886258:0:8611:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c547a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333170.886275:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2942 00000100:00100000:1.0:1763333170.886281:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff61b15050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2418:x1848987613571968:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333170.886290:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333170.886295:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54644 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968dea expref: 13 pid: 8406 timeout: 1374 lvb_type: 0 00010000:00010000:1.0:1763333170.886303:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54644 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968dea expref: 13 pid: 8406 timeout: 1374 lvb_type: 0 00010000:00010000:1.0:1763333170.886315:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333170.886317:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333170.886320:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5479b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.886328:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5479b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.886344:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333170.886389:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff61b15050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2418:x1848987613571968:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 108us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333170.886396:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2942 00010000:00010000:2.0:1763333170.886575:0:8404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5448b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968d57 expref: 12 pid: 8407 timeout: 1374 lvb_type: 0 00000100:00100000:2.0:1763333170.886586:0:8404:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46e2e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8404:1848987627221376:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333170.886600:0:8404:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54794 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.886608:0:8404:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54794 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.886614:0:8404:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54794 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.886623:0:8404:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54794 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.886631:0:8404:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54794 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.886659:0:8404:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763333170.886885:0:8611:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c547a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.886893:0:8611:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c547a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.886899:0:8611:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c547a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.886912:0:8611:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1763333170.886926:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff49772450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+13:3653:x1848987627220864:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7589us (7893us total) trans 21474838765 rc 0/0 00000100:00100000:2.0:1763333170.886932:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6248 00000100:00100000:0.0:1763333170.887038:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+42:3655:x1848987627221760:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6747us (6828us total) trans 17179871461 rc 0/0 00000100:00100000:0.0:1763333170.887044:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6253 00000004:00080000:0.0:1763333170.887080:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44de1f80/2, rc 0, transno 17179871461 00000100:00100000:0.0:1763333170.887085:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44de1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627221760:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1763333170.887816:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4399a300/2, rc 0, transno 21474838765 00000100:00100000:2.0:1763333170.887824:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4399a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627220864:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1763333170.889572:0:28600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54644 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968dea expref: 11 pid: 8406 timeout: 1374 lvb_type: 0 00000100:00100000:3.0:1763333170.889592:0:28600:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46e2d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28600:1848987627221504:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333170.889614:0:28600:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5479b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.889623:0:28600:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5479b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.889630:0:28600:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5479b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.889640:0:28600:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5479b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.889647:0:28600:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5479b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333170.889663:0:28600:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1763333170.889669:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333170.890000:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+13:3654:x1848987627220992:12345-0@lo:6:osp-syn-0-1.0 Request processed in 10174us (10830us total) trans 21474838766 rc 0/0 00000100:00100000:3.0:1763333170.890011:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6250 00000100:00100000:3.0:1763333170.890062:0:8406:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46a6ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8406:1848987627222400:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333170.890076:0:8406:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c547a9 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.890420:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1763333170.890428:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54794 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.890436:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5c00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333170.890440:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54794 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.890450:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54794 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.890469:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54794 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.890476:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54794 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.890496:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1763333170.890500:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c547a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.890507:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fe00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333170.890510:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c547a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.890516:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c547a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.890526:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c547a2 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.890533:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c547a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.890545:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333170.890557:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5479b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.890563:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5e00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333170.890566:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5479b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.890573:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5479b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.890581:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5479b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.890588:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5479b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.890600:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333170.890601:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333170.890603:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763333170.890617:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613572224 00000100:00100000:2.0:1763333170.890624:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613572224 00000100:00100000:2.0:1763333170.890668:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3050 00000100:00100000:2.0:1763333170.890676:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56795:x1848987613572224:12345-192.168.204.28@tcp:49:lfs.0 00000100:00100000:2.0:1763333170.890781:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56795:x1848987613572224:12345-192.168.204.28@tcp:49:lfs.0 Request processed in 105us (1112us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333170.890787:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3050 00000100:00100000:2.0:1763333170.890827:0:6521:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44de2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6521:1848987627222272:192.168.204.28@tcp:105: 00010000:00010000:2.0:1763333170.890849:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54771 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x196:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e4c expref: 223 pid: 6521 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1763333170.890863:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54778 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x196:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e4c expref: 222 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.890880:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e600, rc 0) 00000100:00100000:2.0:1763333170.890898:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:55917:x1848987613571200:12345-192.168.204.28@tcp:101:bash.0 Request processed in 20040us (20238us total) trans 4294971995 rc 0/0 00000100:00100000:2.0:1763333170.890905:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8952 00010000:00010000:1.0:1763333170.891128:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333170.891134:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763333170.893919:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe42f0df80/2, rc 0, transno 21474838766 00000100:00100000:0.0:1763333170.893933:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42f0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627220992:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763333170.901896:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.902854:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.903567:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613572352 00000100:00100000:1.0:1763333170.903579:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613572352 00010000:00010000:1.0:1763333170.903625:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c546bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e14 expref: 28 pid: 8406 timeout: 1374 lvb_type: 0 00000100:00100000:0.0:1763333170.904258:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.904285:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613572480 00000100:00100000:0.0:1763333170.904291:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613572480 00000100:00100000:0.0:1763333170.904323:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613572608 00000100:00100000:0.0:1763333170.904326:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613572608 00000100:00100000:0.0:1763333170.904343:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6256 00000100:00100000:0.0:1763333170.904365:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:2420:x1848987613572480:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333170.904379:0:8611:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333170.904398:0:8611:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c547b0 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968e68 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763333170.904420:0:8611:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x215:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333170.904439:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333170.904442:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333170.904452:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c547b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e68 expref: 31 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333170.904469:0:8611:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c547b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e68 expref: 31 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333170.904487:0:8611:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdfe00, rc 0) 00000100:00100000:0.0:1763333170.904539:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+31:2420:x1848987613572480:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 189us (1688us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333170.904546:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6256 00000100:00100000:0.0:1763333170.904591:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6257 00000100:00100000:0.0:1763333170.904597:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:55917:x1848987613572608:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333170.904603:0:8611:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333170.904610:0:8611:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c547b7 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968e6f expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.904630:0:8611:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c547b0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e68 expref: 31 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333170.904637:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333170.904638:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333170.904642:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c547b7 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e6f expref: 31 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333170.904668:0:8611:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c547b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e68 expref: 31 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333170.904678:0:8611:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c547b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e68 expref: 31 pid: 8611 timeout: 1374 lvb_type: 1 00000100:00100000:0.0:1763333170.904690:0:8611:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe438a9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8611:1848987627222528:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333170.904736:0:8611:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff742b93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763333170.904849:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2943 00000100:00100000:1.0:1763333170.904856:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+31:2421:x1848987613572352:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333170.904867:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333170.904872:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c546bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e14 expref: 31 pid: 8406 timeout: 1374 lvb_type: 0 00010000:00010000:1.0:1763333170.904882:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c546bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e14 expref: 31 pid: 8406 timeout: 1374 lvb_type: 0 00010000:00010000:1.0:1763333170.904899:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c546bb lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e14 expref: 31 pid: 8406 timeout: 1374 lvb_type: 0 00010000:00010000:1.0:1763333170.904911:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333170.904912:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333170.904915:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c547a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.904924:0:28428:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c547a9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.904942:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333170.904959:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:2421:x1848987613572352:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 105us (3076us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333170.904965:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2943 00010000:00010000:1.0:1763333170.905104:0:8406:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c547a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.905113:0:8406:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c547a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.905122:0:8406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c547a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.905129:0:8406:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c547a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.905618:0:8406:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763333170.905910:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+42:3653:x1848987627221632:12345-0@lo:6:osp-syn-1-1.0 Request processed in 25100us (25230us total) trans 17179871462 rc 0/0 00000100:00100000:1.0:1763333170.905918:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6254 00000004:00080000:1.0:1763333170.905960:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44de3100/2, rc 0, transno 17179871462 00000100:00100000:1.0:1763333170.905965:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44de3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627221632:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1763333170.906032:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333170.906040:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c547a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.906048:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96e00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333170.906051:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c547a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.906060:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c547a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.906079:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c547a9 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.906085:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c547a9 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.906101:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333170.906102:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333170.906103:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763333170.909199:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333170.909315:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613572864 00000100:00100000:3.0:1763333170.909326:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613572864 00000100:00100000:3.0:1763333170.909397:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3051 00000100:00100000:3.0:1763333170.909407:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:56795:x1848987613572864:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333170.910039:0:8611:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe438a9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8611:1848987627222528:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333170.910072:0:8611:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c547b7 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e6f expref: 29 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.910090:0:8611:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdf400, rc 0) 00000100:00100000:2.0:1763333170.910135:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:55917:x1848987613572608:12345-192.168.204.28@tcp:101:bash.0 Request processed in 5538us (5879us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333170.910143:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6257 00000100:00100000:1.0:1763333170.910264:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.910296:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613572992 00000100:00100000:1.0:1763333170.910302:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613572992 00010000:00010000:1.0:1763333170.910325:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c547b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e68 expref: 30 pid: 8611 timeout: 1374 lvb_type: 1 00000100:00100000:1.0:1763333170.910371:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2944 00000100:00100000:1.0:1763333170.910379:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:2420:x1848987613572992:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333170.910390:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333170.910396:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c547b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x215:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e68 expref: 30 pid: 8611 timeout: 1374 lvb_type: 1 00010000:00010000:1.0:1763333170.910411:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c547b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x215:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e68 expref: 30 pid: 8611 timeout: 1374 lvb_type: 1 00010000:00010000:1.0:1763333170.910437:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c547b0 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x215:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e68 expref: 30 pid: 8611 timeout: 1374 lvb_type: 1 00010000:00010000:1.0:1763333170.910451:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333170.910453:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333170.910460:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c547b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e6f expref: 29 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.910470:0:28428:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c547b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e6f expref: 29 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.910502:0:28428:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c547b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e6f expref: 29 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333170.910522:0:28428:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7400f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:28428:1848987627222656:192.168.204.28@tcp:105: 00000100:00100000:1.0:1763333170.910586:0:28428:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe46e0e540 going to sleep for 11 seconds 00000100:00100000:3.0:1763333170.911134:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56795:x1848987613572864:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 1727us (1943us total) trans 4294971996 rc 0/0 00000100:00100000:3.0:1763333170.911144:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3051 00000100:00100000:1.0:1763333170.920461:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.920519:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613573248 00000100:00100000:2.0:1763333170.920531:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613573248 00000100:00100000:1.0:1763333170.920561:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.920597:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613573376 00000100:00100000:2.0:1763333170.920601:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613573376 00000100:00100000:2.0:1763333170.920630:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6258 00000100:00100000:2.0:1763333170.920638:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+11:55917:x1848987613573376:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333170.920658:0:8611:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333170.920680:0:8611:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c547be lrc: 2/0,0 mode: --/PW res: [0x280000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968e7d expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333170.920705:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8954 00002000:00010000:2.0:1763333170.920712:0:8611:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x215:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1763333170.920713:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56795:x1848987613573248:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333170.920727:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333170.920736:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333170.920739:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333170.920744:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c547c5 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968e76 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.920747:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c547be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e7d expref: 12 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.920762:0:8611:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c547be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e7d expref: 12 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.920774:0:8611:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5e00, rc 0) 00010000:00010000:1.0:1763333170.920813:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c547cc lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333170.920825:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c547cc lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00000100:00100000:2.0:1763333170.920828:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:55917:x1848987613573376:12345-192.168.204.28@tcp:101:bash.0 Request processed in 191us (267us total) trans 0 rc 0/0 00010000:00010000:1.0:1763333170.920835:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c547cc lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000100:00100000:2.0:1763333170.920836:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6258 00010000:00010000:1.0:1763333170.920846:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c547d3 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333170.920852:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c547d3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.920859:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c547d3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.920990:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c547da lrc: 3/1,0 mode: --/PR res: [0x240000404:0x196:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333170.921001:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c547da lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.921007:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c547da lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:1.0:1763333170.921016:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x196:0x0]: returning size 2 00010000:00010000:1.0:1763333170.921092:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c547cc lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.921099:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c547cc lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.921104:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c547cc lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.921110:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c547cc lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.921115:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fc00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333170.921119:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c547cc lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.921125:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c547cc lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.921135:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355300) 00010000:00010000:1.0:1763333170.921137:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333170.921141:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c547cc lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.921146:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c547cc lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.921177:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c547d3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.921183:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c547d3 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.921188:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c547d3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.921193:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333170.921196:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c547d3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.921201:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c547d3 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.921207:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355b00) 00010000:00010000:1.0:1763333170.921210:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333170.921214:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c547d3 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.921218:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c547d3 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333170.921258:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c547c5 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e76 expref: 226 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.921271:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c547da lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e76 expref: 225 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333170.921278:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x196:0x0].0x0 (ffff92fe48355c00) 00010000:00010000:1.0:1763333170.921281:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333170.921283:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7fe00, rc 0) 00000100:00100000:1.0:1763333170.921325:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56795:x1848987613573248:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 613us (874us total) trans 4294971997 rc 0/0 00000100:00100000:1.0:1763333170.921332:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8954 00000100:00100000:3.0:1763333170.921512:0:28428:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7400f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:28428:1848987627222656:192.168.204.28@tcp:105: 00010000:00010000:3.0:1763333170.921535:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333170.921578:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+28:2420:x1848987613572992:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 11199us (11313us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333170.921586:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2944 00000100:00100000:2.0:1763333170.926983:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.927261:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.927304:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333170.927384:0:28430:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613573760 00000100:00100000:3.0:1763333170.927390:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613573632 00000100:00100000:1.0:1763333170.927395:0:28430:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613573760 00000100:00100000:3.0:1763333170.927397:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613573632 00002000:00010000:1.0:1763333170.927454:0:28430:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/533 (0->18446744073709551615) 00002000:00100000:1.0:1763333170.927461:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe46e2f800 with x1848987613573760 ext(0->18446744073709551615) 00000100:00100000:3.0:1763333170.927473:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3052 00002000:00010000:1.0:1763333170.927477:0:28430:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe46e2f800. 00000100:00100000:3.0:1763333170.927486:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6b3eb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56795:x1848987613573632:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1763333170.927502:0:28430:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613573888 00000100:00100000:1.0:1763333170.927506:0:28430:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613573888 00002000:00010000:1.0:1763333170.927521:0:28430:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/533 (0->18446744073709551615) 00002000:00100000:1.0:1763333170.927525:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe46e2e680 with x1848987613573888 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333170.927533:0:28430:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe46e2e680. 00000100:00100000:1.0:1763333170.927566:0:28430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1558 00000100:00100000:1.0:1763333170.927576:0:28430:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+28:2421:x1848987613573760:12345-192.168.204.28@tcp:10:bash.0 00000100:00100000:3.0:1763333170.927755:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6b3eb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56795:x1848987613573632:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 272us (783us total) trans 4294971998 rc 0/0 00000100:00100000:3.0:1763333170.927763:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3052 00002000:00010000:1.0:1763333170.927776:0:28430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x215:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333170.927781:0:28430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x215:0x0] updating lvb mtime from disk: 0 -> 1763333171 00002000:00010000:1.0:1763333170.927784:0:28430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x215:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333170.927786:0:28430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x215:0x0] updating lvb ctime from disk: 0 -> 1763333171 00002000:00010000:1.0:1763333170.927788:0:28430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x215:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333170.927823:0:28430:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:2421:x1848987613573760:12345-192.168.204.28@tcp:10:bash.0 Request processed in 248us (559us total) trans 17179871463 rc 0/0 00000100:00100000:1.0:1763333170.927830:0:28430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1558 00002000:00010000:1.0:1763333170.927833:0:28430:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/533 (0->18446744073709551615) 00002000:00100000:1.0:1763333170.927835:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe46e2f800 with x1848987613573760 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333170.927840:0:28430:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe46e2f800. 00000100:00100000:1.0:1763333170.927853:0:28430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1559 00000100:00100000:1.0:1763333170.927861:0:28430:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:2421:x1848987613573888:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:1.0:1763333170.927955:0:28430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x215:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333170.927958:0:28430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x215:0x0] updating lvb mtime from disk: 0 -> 1763333171 00002000:00010000:1.0:1763333170.927960:0:28430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x215:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333170.927961:0:28430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x215:0x0] updating lvb ctime from disk: 0 -> 1763333171 00002000:00010000:1.0:1763333170.927963:0:28430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x215:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333170.927985:0:28430:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2421:x1848987613573888:12345-192.168.204.28@tcp:10:bash.0 Request processed in 125us (680us total) trans 21474838767 rc 0/0 00000100:00100000:1.0:1763333170.927992:0:28430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1559 00002000:00010000:1.0:1763333170.927996:0:28430:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/533 (0->18446744073709551615) 00002000:00100000:1.0:1763333170.927999:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe46e2e680 with x1848987613573888 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333170.928004:0:28430:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe46e2e680. 00000100:00100000:0.0:1763333170.930988:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.931590:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613574016 00000100:00100000:2.0:1763333170.931602:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613574016 00000100:00100000:2.0:1763333170.931662:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3053 00000100:00100000:2.0:1763333170.931672:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56795:x1848987613574016:12345-192.168.204.28@tcp:33:lfs.0 00000100:00100000:2.0:1763333170.931842:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56795:x1848987613574016:12345-192.168.204.28@tcp:33:lfs.0 Request processed in 171us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333170.931849:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3053 00000100:00100000:1.0:1763333170.935092:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333170.935177:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613574272 00000100:00100000:3.0:1763333170.935189:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613574272 00000100:00100000:3.0:1763333170.935266:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3054 00000100:00100000:3.0:1763333170.935277:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56795:x1848987613574272:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333170.937087:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56795:x1848987613574272:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 1802us (1995us total) trans 4294971999 rc 0/0 00000100:00100000:3.0:1763333170.937100:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3054 00000100:00100000:1.0:1763333170.942558:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.942708:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613574528 00000100:00100000:2.0:1763333170.942719:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613574528 00000100:00100000:2.0:1763333170.942785:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8955 00000100:00100000:2.0:1763333170.942796:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56800:x1848987613574528:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:2.0:1763333170.942862:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1763333170.942895:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54778 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x196:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e4c expref: 227 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.942918:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c5478d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x196:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e61 expref: 226 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.942932:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c547da lrc: 0/0,0 mode: --/PR res: [0x240000404:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e76 expref: 225 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.942944:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54740 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x196:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e37 expref: 224 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.942970:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x196:0x0].0x0 (ffff92fe48355c00) 00010000:00010000:2.0:1763333170.942985:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333170.943019:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c547e8 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333170.943033:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c547e8 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.943043:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c547e8 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.943056:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c547ef lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333170.943062:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c547ef lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.943071:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c547ef lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.943164:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c547f6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x196:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333170.943172:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c547f6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x196:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.943179:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c547f6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x196:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000040:00080000:2.0:1763333170.943718:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1322, 64 off112184 00000040:00080000:2.0:1763333170.943745:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1323, 64 off112184 00000040:00080000:2.0:1763333170.943756:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1324, 64 off112248 00000040:00080000:2.0:1763333170.943764:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1323, 64 off112248 00010000:00010000:2.0:1763333170.943826:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c547fd lrc: 3/0,1 mode: --/PW res: [0x240000404:0x196:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333170.943837:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c547fd lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x196:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.943845:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c547fd lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x196:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.943852:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c547fd lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x196:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.943859:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c547fd lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x196:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.943864:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c547fd lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x196:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.943900:0:8606:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763333170.943923:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c547f6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x196:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.943929:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c547f6 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x196:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.943935:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c547f6 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x196:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.943940:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333170.943941:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333170.943952:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c547fd lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x196:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.943961:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5c00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333170.943965:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c547fd lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x196:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.943974:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c547fd lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x196:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.943991:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x196:0x0].0x0 (ffff92fe43ab2000) 00010000:00010000:0.0:1763333170.943995:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763333170.944000:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c547fd lrc: 1/0,0 mode: --/PW res: [0x240000404:0x196:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.944006:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c547fd lrc: 0/0,0 mode: --/PW res: [0x240000404:0x196:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.944012:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c547f6 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x196:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.944021:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333170.944024:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c547f6 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x196:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333170.944025:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333170.944030:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333170.944039:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x196:0x0].0x0 (ffff92fe43ab2000) 00010000:00010000:2.0:1763333170.944042:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763333170.944045:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c547f6 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x196:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.944051:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c547f6 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x196:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.944234:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c547e8 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.944241:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c547e8 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.944247:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c547e8 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.944256:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c547e8 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.944261:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333170.944263:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c547e8 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.944268:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c547e8 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.944274:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab2600) 00010000:00010000:2.0:1763333170.944276:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333170.944279:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c547e8 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.944283:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c547e8 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000004:00010000:2.0:1763333170.944294:0:8606:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000bbc1ec80 reply state 00000000029fbfab transno 4294972000 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c547ef lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.944303:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c547ef lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.944308:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43ab2900) 00010000:00010000:2.0:1763333170.944310:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333170.944313:0:8606:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763333170.945127:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56800:x1848987613574528:12345-192.168.204.28@tcp:36:rm.0 Request processed in 2327us (2584us total) trans 4294972000 rc 0/0 00000100:00100000:2.0:1763333170.945137:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8955 00000100:00100000:0.0:1763333170.955698:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.955764:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613574784 00000100:00100000:2.0:1763333170.955775:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613574784 00000100:00100000:2.0:1763333170.955836:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8956 00000100:00100000:2.0:1763333170.955845:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56801:x1848987613574784:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333170.955872:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333170.955895:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54804 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968e84 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.955984:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5480b lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333170.955997:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5480b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.956007:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5480b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.956018:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54812 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333170.956024:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54812 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.956030:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54812 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.956073:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5480b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.956079:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5480b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.956089:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5480b lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.956099:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5480b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.956104:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333170.956108:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5480b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.956115:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5480b lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.956126:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab2600) 00010000:00010000:2.0:1763333170.956129:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333170.956134:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5480b lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.956140:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5480b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.956152:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54812 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.956157:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54812 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.956162:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54812 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.956166:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333170.956168:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54812 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.956174:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54812 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.956184:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43ab2900) 00010000:00010000:2.0:1763333170.956187:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333170.956189:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54812 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.956194:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54812 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333170.956220:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54804 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e84 expref: 226 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.956229:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab2600) 00010000:00010000:2.0:1763333170.956231:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763333170.956234:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54804 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e84 expref: 226 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.956244:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4600, rc 0) 00000100:00100000:2.0:1763333170.956322:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56801:x1848987613574784:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 477us (633us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333170.956329:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8956 00000100:00100000:1.0:1763333170.965232:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.965300:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613574912 00000100:00100000:2.0:1763333170.965312:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613574912 00000100:00100000:2.0:1763333170.965413:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8957 00000100:00100000:2.0:1763333170.965424:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56802:x1848987613574912:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333170.965445:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333170.965468:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54819 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968e8b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.965542:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54820 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333170.965567:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54820 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.965578:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54820 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.965590:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54827 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333170.965597:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54827 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.965604:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54827 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.965640:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54820 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.965647:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54820 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.965653:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54820 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.965660:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54820 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.965666:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333170.965670:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54820 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.965681:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54820 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.965692:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab2600) 00010000:00010000:2.0:1763333170.965695:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333170.965699:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54820 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.965706:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54820 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.965718:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54827 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.965725:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54827 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.965730:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54827 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.965735:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333170.965738:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54827 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.965744:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54827 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.965750:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43ab2900) 00010000:00010000:2.0:1763333170.965753:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333170.965756:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54827 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.965772:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54827 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.965800:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54819 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e8b expref: 226 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.965809:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab2600) 00010000:00010000:2.0:1763333170.965812:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333170.965816:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54819 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e8b expref: 226 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.965829:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4600, rc 0) 00000100:00100000:2.0:1763333170.965880:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56802:x1848987613574912:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 459us (657us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333170.965887:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8957 00000100:00100000:3.0:1763333170.969719:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.969808:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613575040 00000100:00100000:2.0:1763333170.969819:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613575040 00000100:00100000:2.0:1763333170.969883:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8958 00000100:00100000:2.0:1763333170.969894:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56802:x1848987613575040:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333170.969917:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333170.969944:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5482e lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968e92 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.970017:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54835 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333170.970031:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54835 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.970042:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54835 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.970058:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5483c lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333170.970065:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5483c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.970070:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5483c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.970109:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54835 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.970116:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54835 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.970122:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54835 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.970128:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54835 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.970134:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333170.970137:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54835 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.970145:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54835 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.970156:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab2000) 00010000:00010000:2.0:1763333170.970159:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333170.970163:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54835 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.970169:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54835 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.970183:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5483c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.970189:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5483c lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.970195:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5483c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.970199:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333170.970202:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5483c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.970206:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5483c lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.970212:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43ab2900) 00010000:00010000:2.0:1763333170.970214:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333170.970216:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5483c lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.970222:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5483c lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.970247:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5482e lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e92 expref: 226 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.970256:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab2000) 00010000:00010000:2.0:1763333170.970258:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333170.970261:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5482e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e92 expref: 226 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.970278:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4000, rc 0) 00000100:00100000:2.0:1763333170.970334:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56802:x1848987613575040:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 441us (624us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333170.970342:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8958 00000100:00100000:0.0:1763333170.975529:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333170.975584:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.976193:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613575168 00000100:00100000:2.0:1763333170.976206:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613575168 00000100:00100000:1.0:1763333170.976225:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613575296 00000100:00100000:1.0:1763333170.976230:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613575296 00000100:00100000:2.0:1763333170.976271:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8959 00000100:00100000:2.0:1763333170.976282:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56801:x1848987613575168:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333170.976303:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333170.976326:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54843 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968e99 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.976425:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5484a lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333170.976440:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5484a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.976450:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5484a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.976462:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54851 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333170.976469:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54851 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.976474:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54851 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.976514:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5484a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.976521:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5484a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.976527:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5484a lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.976533:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5484a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.976538:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333170.976542:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5484a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.976559:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5484a lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.976570:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab2600) 00010000:00010000:2.0:1763333170.976573:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333170.976578:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5484a lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.976584:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5484a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.976599:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54851 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.976605:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54851 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.976610:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54851 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.976616:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333170.976619:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54851 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.976624:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54851 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.976631:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43ab2900) 00010000:00010000:2.0:1763333170.976634:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333170.976636:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54851 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.976642:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54851 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.976717:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54843 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e99 expref: 227 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.976728:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab2600) 00010000:00010000:2.0:1763333170.976730:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333170.976733:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54843 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e99 expref: 227 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.976747:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4600, rc 0) 00000100:00100000:2.0:1763333170.976874:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56801:x1848987613575168:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 593us (1354us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333170.976882:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8959 00000100:00100000:2.0:1763333170.976901:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8960 00000100:00100000:2.0:1763333170.976909:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56802:x1848987613575296:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333170.976917:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333170.976927:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c54858 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968ea0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.977253:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5485f lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333170.977263:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5485f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.977271:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5485f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:2.0:1763333170.977312:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1763333170.977317:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1763333170.977343:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c54858 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ea0 expref: 227 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.977385:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5485f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ea0 expref: 226 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.977391:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab2300) 00010000:00010000:2.0:1763333170.977394:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1763333170.977396:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5c00, rc 0) 00000100:00100000:2.0:1763333170.977420:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56802:x1848987613575296:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 513us (1836us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333170.977427:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8960 00000100:00100000:1.0:1763333170.990300:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333170.991680:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613575424 00000100:00100000:2.0:1763333170.991692:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613575424 00000100:00100000:2.0:1763333170.991758:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8961 00000100:00100000:2.0:1763333170.991769:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56802:x1848987613575424:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333170.991790:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333170.991812:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c54866 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968ea7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.991885:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5486d lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333170.991899:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5486d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.991910:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5486d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.991920:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54874 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333170.991926:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54874 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.991932:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54874 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.991974:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5486d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.991981:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5486d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.991986:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5486d lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.991992:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5486d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.992001:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333170.992005:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5486d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.992013:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5486d lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.992025:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab2300) 00010000:00010000:2.0:1763333170.992028:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333170.992031:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5486d lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.992038:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5486d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.992051:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54874 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.992056:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54874 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.992061:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54874 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.992065:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333170.992068:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54874 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.992073:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54874 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.992079:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43ab2900) 00010000:00010000:2.0:1763333170.992081:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333170.992084:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54874 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.992089:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54874 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333170.992114:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c54866 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ea7 expref: 227 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.992123:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab2300) 00010000:00010000:2.0:1763333170.992125:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333170.992128:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c54866 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ea7 expref: 227 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333170.992136:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5000, rc 0) 00000100:00100000:2.0:1763333170.992208:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56802:x1848987613575424:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 440us (1919us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333170.992215:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8961 00000100:00100000:1.0:1763333171.000256:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333171.001069:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613575680 00000100:00100000:3.0:1763333171.001081:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613575680 00000100:00100000:2.0:1763333171.001214:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8962 00000100:00100000:2.0:1763333171.001223:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56802:x1848987613575680:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333171.001246:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333171.001249:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763333171.001277:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5485f lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ea0 expref: 226 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.001297:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab2300) 00010000:00010000:2.0:1763333171.001308:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333171.001323:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c5487b lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968eae expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.001468:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54882 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333171.001482:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54882 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.001491:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54882 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.001501:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54889 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333171.001508:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54889 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.001515:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54889 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.001900:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54890 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x198:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333171.001909:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54890 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.001916:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54890 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:2.0:1763333171.001926:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x198:0x0]: returning size 0 00010000:00010000:2.0:1763333171.001965:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54882 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.001972:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54882 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.001982:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54882 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.001988:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54882 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.001995:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333171.001999:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54882 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.002006:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54882 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.002015:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab2600) 00010000:00010000:2.0:1763333171.002018:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333171.002022:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54882 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.002028:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54882 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000004:00010000:2.0:1763333171.002039:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b0cf5161 reply state 000000007b48f770 transno 4294972001 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54889 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.002049:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54889 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.002055:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43ab2900) 00010000:00010000:2.0:1763333171.002058:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333171.002061:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763333171.002089:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c5487b lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968eae expref: 228 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.002110:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54890 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968eae expref: 227 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.002118:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x198:0x0].0x0 (ffff92fe43ab2000) 00010000:00010000:2.0:1763333171.002120:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333171.002122:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4800, rc 0) 00000100:00100000:2.0:1763333171.002207:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56802:x1848987613575680:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 984us (1960us total) trans 4294972001 rc 0/0 00000100:00100000:2.0:1763333171.002215:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8962 00000100:00100000:0.0:1763333171.010613:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333171.010690:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.010792:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613575936 00000100:00100000:1.0:1763333171.010804:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613575936 00000100:00100000:1.0:1763333171.010861:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613576192 00000100:00100000:1.0:1763333171.010864:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613576192 00000100:00100000:1.0:1763333171.010904:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8963 00000100:00100000:1.0:1763333171.010915:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56802:x1848987613575936:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333171.010946:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333171.010968:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c5489e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x198:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968eb5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.011094:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c548a5 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x198:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333171.011110:0:6521:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54890 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968eae expref: 230 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.011119:0:6521:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c548a5 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x198:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.011156:0:6521:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54890 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968eae expref: 230 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.011169:0:6521:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54890 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968eae expref: 230 pid: 12741 timeout: 1375 lvb_type: 0 00000100:00100000:1.0:1763333171.011183:0:6521:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe43999c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6521:1848987627222784:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333171.011266:0:6521:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe46e0e180 going to sleep for 11 seconds 00000100:00100000:0.0:1763333171.011484:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8964 00000100:00100000:0.0:1763333171.011496:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56804:x1848987613576192:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333171.011505:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333171.011516:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c548ac lrc: 2/0,0 mode: --/CR res: [0x240000404:0x198:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968ebc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.011578:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c548b3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x198:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333171.011589:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c548b3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x198:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.011602:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c548b3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x198:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:0.0:1763333171.011617:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x198:0x0]: returning size 0 00010000:00010000:0.0:1763333171.011708:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c548b3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x198:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.011716:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c548b3 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x198:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.011723:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c548b3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x198:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.011729:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abde400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333171.011733:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c548b3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x198:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.011740:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c548b3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x198:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.011752:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x198:0x0].0x0 (ffff92fe43ab2000) 00010000:00010000:0.0:1763333171.011755:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1763333171.011761:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c548b3 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x198:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.011767:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c548b3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x198:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.011805:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c548ac lrc: 1/0,0 mode: --/CR res: [0x240000404:0x198:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ebc expref: 232 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.011815:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x198:0x0].0x0 (ffff92fe43ab2000) 00010000:00010000:0.0:1763333171.011818:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763333171.011822:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c548ac lrc: 0/0,0 mode: --/CR res: [0x240000404:0x198:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ebc expref: 232 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.011838:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdf600, rc 0) 00000100:00100000:0.0:1763333171.011888:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56804:x1848987613576192:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 395us (1197us total) trans 4294972002 rc 301/301 00000100:00100000:0.0:1763333171.011896:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8964 00000100:00100000:0.0:1763333171.013662:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.013762:0:6521:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe43999c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6521:1848987627222784:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333171.013788:0:6521:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c548a5 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x198:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000100:00100000:3.0:1763333171.014052:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613576320 00000100:00100000:3.0:1763333171.014059:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613576320 00010000:00010000:3.0:1763333171.014096:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54890 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968eae expref: 231 pid: 12741 timeout: 1375 lvb_type: 0 00000100:00100000:3.0:1763333171.014135:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2945 00000100:00100000:3.0:1763333171.014144:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:2421:x1848987613576320:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333171.014158:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333171.014164:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54890 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968eae expref: 231 pid: 12741 timeout: 1375 lvb_type: 0 00010000:00010000:3.0:1763333171.014176:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54890 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968eae expref: 231 pid: 12741 timeout: 1375 lvb_type: 0 00010000:00010000:3.0:1763333171.014196:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54890 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968eae expref: 231 pid: 12741 timeout: 1375 lvb_type: 0 00010000:00010000:3.0:1763333171.014209:0:28428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x198:0x0].0x0 (ffff92fe43ab2000) 00010000:00010000:3.0:1763333171.014213:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c548a5 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x198:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333171.014222:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c548a5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x198:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333171.014228:0:28428:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c548a5 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x198:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333171.014259:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333171.014299:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:2421:x1848987613576320:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 156us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333171.014307:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2945 00010000:00010000:0.0:1763333171.014925:0:6521:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c548a5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x198:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.014933:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c548a5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x198:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:0.0:1763333171.014965:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x198:0x0]: returning size 0 00000004:00080000:0.0:1763333171.015144:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x217:0x0], index 0: 0 00000004:00080000:0.0:1763333171.015151:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x217:0x0], index 1: 0 00000004:00080000:0.0:1763333171.015156:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x218:0x0], index 1: 0 00000004:00080000:0.0:1763333171.015160:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x218:0x0], index 0: 0 00010000:00010000:0.0:1763333171.015260:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c548a5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x198:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.015268:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c548a5 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x198:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.015275:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c548a5 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x198:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.015280:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333171.015284:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c548a5 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x198:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.015290:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c548a5 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x198:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.015302:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x198:0x0].0x0 (ffff92fe43ab2000) 00010000:00010000:0.0:1763333171.015305:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333171.015309:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c548a5 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x198:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.015315:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c548a5 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x198:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.015385:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c5489e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x198:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968eb5 expref: 230 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.015396:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x198:0x0].0x0 (ffff92fe43ab2000) 00010000:00010000:0.0:1763333171.015398:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763333171.015401:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c5489e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x198:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968eb5 expref: 230 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.015416:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7ea00, rc 0) 00000100:00100000:0.0:1763333171.015473:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56802:x1848987613575936:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 4559us (4869us total) trans 4294972003 rc 301/301 00000100:00100000:0.0:1763333171.015481:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8963 00000100:00100000:1.0:1763333171.018915:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.020403:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613576576 00000100:00100000:2.0:1763333171.020417:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613576576 00000100:00100000:2.0:1763333171.020484:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3055 00000100:00100000:2.0:1763333171.020495:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4399b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56804:x1848987613576576:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1763333171.020732:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333171.020789:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613576832 00000100:00100000:0.0:1763333171.020795:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613576832 00000100:00100000:0.0:1763333171.020836:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3056 00000100:00100000:0.0:1763333171.020845:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4399bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56802:x1848987613576832:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333171.021914:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4399b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56804:x1848987613576576:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 1417us (3005us total) trans 4294972004 rc 0/0 00000100:00100000:2.0:1763333171.021924:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3055 00000100:00100000:0.0:1763333171.022976:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4399bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56802:x1848987613576832:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 2128us (2241us total) trans 4294972005 rc 0/0 00000100:00100000:0.0:1763333171.022985:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3056 00000100:00100000:1.0:1763333171.028879:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333171.029743:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613577088 00000100:00100000:0.0:1763333171.029756:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613577088 00000100:00100000:0.0:1763333171.029825:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8965 00000100:00100000:0.0:1763333171.029835:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56804:x1848987613577088:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333171.029860:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333171.029884:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c548c8 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968ec3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.029958:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c548cf lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333171.029972:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c548cf lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.029983:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c548cf lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.029994:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c548d6 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333171.030001:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c548d6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.030008:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c548d6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.030123:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c548dd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x198:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333171.030131:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c548dd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.030138:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c548dd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:0.0:1763333171.030156:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x198:0x0]: returning size 0 00010000:00010000:0.0:1763333171.030236:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c548cf lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.030242:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c548cf lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.030248:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c548cf lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.030254:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c548cf lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.030259:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abde400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333171.030262:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c548cf lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.030269:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c548cf lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.030279:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44700) 00010000:00010000:0.0:1763333171.030282:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333171.030286:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c548cf lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.030292:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c548cf lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.030304:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c548d6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.030309:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c548d6 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.030317:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c548d6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.030322:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdee00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333171.030324:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c548d6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.030328:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c548d6 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.030333:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43ab2900) 00010000:00010000:0.0:1763333171.030335:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333171.030337:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c548d6 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.030342:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c548d6 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.030412:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c548c8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ec3 expref: 234 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.030430:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c548dd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ec3 expref: 233 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.030437:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x198:0x0].0x0 (ffff92fe43b44300) 00010000:00010000:0.0:1763333171.030439:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333171.030442:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdea00, rc 0) 00000100:00100000:0.0:1763333171.030504:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56804:x1848987613577088:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 671us (1638us total) trans 4294972006 rc 0/0 00000100:00100000:0.0:1763333171.030511:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8965 00000100:00100000:2.0:1763333171.030585:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333171.030837:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613577344 00000100:00100000:0.0:1763333171.030843:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613577344 00000100:00100000:0.0:1763333171.030884:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3057 00000100:00100000:0.0:1763333171.030891:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56802:x1848987613577344:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333171.031026:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:56802:x1848987613577344:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 134us (441us total) trans 4294972007 rc 0/0 00000100:00100000:0.0:1763333171.031032:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3057 00000100:00100000:1.0:1763333171.037383:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.037425:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333171.037500:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613577728 00000100:00100000:0.0:1763333171.037513:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613577728 00000100:00100000:0.0:1763333171.037647:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8966 00000100:00100000:0.0:1763333171.037659:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff59229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:55917:x1848987613577728:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333171.037686:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333171.037690:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763333171.037718:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c548dd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ec3 expref: 234 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.037742:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x198:0x0].0x0 (ffff92fe43b44300) 00010000:00010000:0.0:1763333171.037754:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333171.037769:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c548eb lrc: 2/0,0 mode: --/CW res: [0x240000404:0x198:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968ed1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.037880:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c548f2 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x198:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333171.037893:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c548f2 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x198:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.037903:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c548f2 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x198:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:0.0:1763333171.037920:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x198:0x0]: returning size 0 00010000:00010000:0.0:1763333171.038023:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c548eb lrc: 0/0,0 mode: --/CW res: [0x240000404:0x198:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ed1 expref: 236 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.038037:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c548f2 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x198:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ed1 expref: 235 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.038043:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x198:0x0].0x0 (ffff92fe43b44900) 00010000:00010000:0.0:1763333171.038046:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:0.0:1763333171.038048:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea000, rc 0) 00000100:00100000:0.0:1763333171.038104:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff59229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:55917:x1848987613577728:12345-192.168.204.28@tcp:101:bash.0 Request processed in 449us (753us total) trans 4294972008 rc 0/0 00000100:00100000:0.0:1763333171.038110:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8966 00000100:00100000:3.0:1763333171.038631:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613577472 00000100:00100000:3.0:1763333171.038640:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613577472 00000100:00100000:2.0:1763333171.038844:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6259 00000100:00100000:2.0:1763333171.038856:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff59228a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2420:x1848987613577472:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333171.038869:0:8611:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333171.038887:0:8611:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c54900 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968eca expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763333171.038910:0:8611:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x217:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763333171.038924:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333171.038927:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333171.038937:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c54900 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968eca expref: 14 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333171.038951:0:8611:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c54900 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968eca expref: 14 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333171.038961:0:8611:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4400, rc 0) 00000100:00100000:2.0:1763333171.040054:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff59228a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2420:x1848987613577472:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1192us (2619us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333171.040065:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6259 00000100:00100000:2.0:1763333171.041437:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333171.041559:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613577856 00000100:00100000:3.0:1763333171.041567:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613577856 00000100:00100000:3.0:1763333171.041626:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8967 00000100:00100000:3.0:1763333171.041638:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:55917:x1848987613577856:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333171.041663:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333171.041685:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c54907 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x198:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968ed8 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.041723:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c5490e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x198:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333171.041738:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c5490e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x198:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333171.041750:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c5490e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x198:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333171.041869:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c54907 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x198:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ed8 expref: 237 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.041889:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c5490e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x198:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ed8 expref: 236 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.041898:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x198:0x0].0x0 (ffff92fe43b44900) 00010000:00010000:3.0:1763333171.041901:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763333171.041905:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96000, rc 0) 00000100:00100000:3.0:1763333171.041978:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:55917:x1848987613577856:12345-192.168.204.28@tcp:101:bash.0 Request processed in 343us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333171.041986:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8967 00000100:00100000:1.0:1763333171.044589:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.045223:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613578112 00000100:00100000:2.0:1763333171.045234:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613578112 00000100:00100000:2.0:1763333171.045303:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3058 00000100:00100000:2.0:1763333171.045315:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6b3ea450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56804:x1848987613578112:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333171.045593:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6b3ea450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56804:x1848987613578112:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 280us (1011us total) trans 4294972009 rc 0/0 00000100:00100000:2.0:1763333171.045601:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3058 00000100:00100000:1.0:1763333171.046700:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333171.046981:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613578368 00000100:00100000:3.0:1763333171.046988:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613578368 00000100:00100000:3.0:1763333171.047037:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8968 00000100:00100000:3.0:1763333171.047046:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff59228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:55917:x1848987613578368:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:3.0:1763333171.047091:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333171.047118:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c548f2 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x198:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ed1 expref: 237 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.047138:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x198:0x0].0x0 (ffff92fe43b44900) 00010000:00010000:3.0:1763333171.047144:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333171.047309:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c54915 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x198:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333171.047322:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c54915 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x198:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333171.047332:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c54915 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x198:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000001:00080000:3.0:1763333171.047405:0:8606:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294972010 00000004:00010000:3.0:1763333171.047426:0:8606:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004dcd071c reply state 00000000b8bb825e transno 4294972011 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c54915 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x198:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333171.047438:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c54915 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x198:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333171.047444:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x198:0x0].0x0 (ffff92fe43b44900) 00010000:00010000:3.0:1763333171.047447:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763333171.047449:0:8606:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763333171.047515:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff59228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:55917:x1848987613578368:12345-192.168.204.28@tcp:36:bash.0 Request processed in 470us (819us total) trans 4294972011 rc 0/0 00000100:00100000:3.0:1763333171.047522:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8968 00000020:00080000:3.0:1763333171.047527:0:8606:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763333171.052722:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333171.053384:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.053463:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613578624 00000100:00100000:2.0:1763333171.053474:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613578624 00000100:00100000:2.0:1763333171.053533:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613578752 00000100:00100000:2.0:1763333171.053537:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613578752 00000100:00100000:2.0:1763333171.053577:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8969 00000100:00100000:2.0:1763333171.053587:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff59228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:56804:x1848987613578624:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333171.053615:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1763333171.053634:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8970 00010000:00010000:2.0:1763333171.053642:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5491c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968edf expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333171.053654:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:55917:x1848987613578752:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333171.053707:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333171.053721:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54923 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x198:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968ee6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.053728:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5492a lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333171.053743:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5492a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.053754:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5492a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333171.053761:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54923 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x198:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ee6 expref: 242 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.053765:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54931 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333171.053776:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54931 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333171.053778:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54923 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x198:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ee6 expref: 242 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.053786:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54931 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333171.053802:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x198:0x0].0x0 (ffff92fe43b44900) 00010000:00010000:0.0:1763333171.053807:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333171.053811:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea800, rc 0) 00000100:00100000:0.0:1763333171.053866:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:55917:x1848987613578752:12345-192.168.204.28@tcp:101:bash.0 Request processed in 218us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333171.053874:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8970 00010000:00010000:2.0:1763333171.053890:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c54938 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x198:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333171.053900:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c54938 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.053906:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c54938 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:2.0:1763333171.053916:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x198:0x0]: returning size 0 00010000:00010000:2.0:1763333171.054012:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5492a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.054019:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5492a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.054025:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5492a lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.054030:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5492a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.054035:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333171.054039:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5492a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.054045:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5492a lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.054055:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43ab2200) 00010000:00010000:2.0:1763333171.054058:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333171.054062:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5492a lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.054067:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5492a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.054081:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54931 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.054085:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54931 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.054090:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54931 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.054098:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333171.054101:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54931 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.054105:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54931 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.054111:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43ab2900) 00010000:00010000:2.0:1763333171.054113:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333171.054115:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54931 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.054120:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54931 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.054150:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5491c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968edf expref: 243 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.054165:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c54938 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968edf expref: 242 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.054171:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x198:0x0].0x0 (ffff92fe43b44900) 00010000:00010000:2.0:1763333171.054174:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333171.054176:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5000, rc 0) 00000100:00100000:2.0:1763333171.054215:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff59228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:56804:x1848987613578624:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 631us (1504us total) trans 4294972012 rc 0/0 00000100:00100000:2.0:1763333171.054222:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8969 00000100:00100000:3.0:1763333171.059061:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333171.059160:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333171.059519:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613579008 00000100:00100000:0.0:1763333171.059529:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613579008 00000100:00100000:2.0:1763333171.059876:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613579264 00000100:00100000:2.0:1763333171.059885:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613579264 00000100:00100000:2.0:1763333171.059933:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3059 00000100:00100000:2.0:1763333171.059943:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:56804:x1848987613579264:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333171.060080:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8971 00000100:00100000:0.0:1763333171.060089:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:55917:x1848987613579008:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333171.060100:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333171.060103:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763333171.060127:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54923 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x198:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ee6 expref: 244 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.060144:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x198:0x0].0x0 (ffff92fe43b44900) 00010000:00010000:0.0:1763333171.060148:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333171.060160:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c54946 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x198:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968eed expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333171.060174:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56804:x1848987613579264:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 233us (1013us total) trans 4294972013 rc 0/0 00000100:00100000:2.0:1763333171.060181:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3059 00010000:00010000:0.0:1763333171.060196:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5494d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x198:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333171.060209:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c54938 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968edf expref: 243 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.060219:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5494d lrc: 4/0,1 mode: --/EX res: [0x240000404:0x198:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.060250:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c54938 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968edf expref: 243 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.060268:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c54938 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968edf expref: 243 pid: 8606 timeout: 1375 lvb_type: 0 00000100:00100000:0.0:1763333171.060281:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe438aa680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627222912:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333171.060333:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4ce84840 going to sleep for 11 seconds 00000100:00100000:3.0:1763333171.063412:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe438aa680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627222912:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333171.063450:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5494d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x198:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000100:00100000:3.0:1763333171.064194:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333171.064271:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613579392 00000100:00100000:3.0:1763333171.064272:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333171.064279:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613579392 00000100:00100000:0.0:1763333171.064341:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3060 00000100:00100000:0.0:1763333171.064370:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56804:x1848987613579392:12345-192.168.204.28@tcp:33:lfs.0 00000100:00100000:2.0:1763333171.064483:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613579520 00000100:00100000:2.0:1763333171.064488:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613579520 00010000:00010000:2.0:1763333171.064512:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c54938 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968edf expref: 245 pid: 8606 timeout: 1375 lvb_type: 0 00000100:00100000:2.0:1763333171.064556:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2946 00000100:00100000:0.0:1763333171.064557:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56804:x1848987613579392:12345-192.168.204.28@tcp:33:lfs.0 Request processed in 197us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333171.064565:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:2419:x1848987613579520:12345-192.168.204.28@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1763333171.064565:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3060 00010000:00010000:2.0:1763333171.064575:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333171.064582:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c54938 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968edf expref: 244 pid: 8606 timeout: 1375 lvb_type: 0 00010000:00010000:2.0:1763333171.064593:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c54938 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968edf expref: 244 pid: 8606 timeout: 1375 lvb_type: 0 00010000:00010000:2.0:1763333171.064619:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c54938 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968edf expref: 244 pid: 8606 timeout: 1375 lvb_type: 0 00010000:00010000:2.0:1763333171.064634:0:8423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x198:0x0].0x0 (ffff92fe43b44900) 00010000:00010000:2.0:1763333171.064641:0:8423:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5494d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x198:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.064651:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5494d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x198:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.064662:0:8423:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5494d lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x198:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.064689:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333171.064709:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:2419:x1848987613579520:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 146us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333171.064715:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2946 00010000:00010000:2.0:1763333171.064738:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5494d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x198:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.064745:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5494d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x198:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000040:00080000:2.0:1763333171.065013:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1325, 88 off112336 00000004:00080000:2.0:1763333171.065024:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1275144674329ns, next at 1275845117682ns, rc = 0 00000040:00080000:2.0:1763333171.065055:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1324, 88 off112336 00000004:00080000:2.0:1763333171.065061:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1275144711881ns, next at 1275845147255ns, rc = 0 00000040:00080000:2.0:1763333171.065077:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1325, 88 off112424 00000004:00080000:2.0:1763333171.065081:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1275144732229ns, next at 1275845147255ns, rc = 0 00000040:00080000:2.0:1763333171.065090:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1326, 88 off112424 00000004:00080000:2.0:1763333171.065094:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1275144744956ns, next at 1275845117682ns, rc = 0 00000001:00080000:2.0:1763333171.071091:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972014 is committed 00000004:00080000:2.0:1763333171.071107:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 870 committed 00000004:00080000:2.0:1763333171.071127:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 867 committed 00000004:00080000:2.0:1763333171.071139:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 866 committed 00000004:00080000:2.0:1763333171.071141:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 869 committed 00010000:00010000:2.0:1763333171.071241:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5494d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x198:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968eed expref: 225 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.071260:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x198:0x0].0x0 (ffff92fe43b44900) 00010000:00010000:2.0:1763333171.071263:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763333171.071280:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c54946 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x198:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968eed expref: 225 pid: 6519 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1763333171.071297:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5494d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x198:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968eed expref: 224 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.071329:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x198:0x0].0x0 (ffff92fe43b44900) 00010000:00010000:2.0:1763333171.071331:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763333171.071334:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feba00, rc 0) 00000100:00100000:2.0:1763333171.071438:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:55917:x1848987613579008:12345-192.168.204.28@tcp:101:bash.0 Request processed in 11348us (12385us total) trans 4294972014 rc 0/0 00000100:00100000:2.0:1763333171.071447:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8971 00010000:00010000:0.0:1763333171.071495:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c547ef lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333171.071505:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c547ef lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333171.071511:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c547ef lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333171.071517:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4a00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333171.071522:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c547ef lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333171.071529:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c547ef lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333171.071542:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43ab2900) 00010000:00010000:0.0:1763333171.071553:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333171.071558:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c547ef lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333171.071563:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c547ef lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333171.071576:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54889 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.071582:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54889 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.071588:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54889 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.071593:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333171.071595:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54889 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.071601:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54889 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.071609:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43ab2900) 00010000:00010000:0.0:1763333171.071612:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333171.071614:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54889 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.071620:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54889 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.071636:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c54915 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x198:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00000100:00100000:1.0:1763333171.071641:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff59228e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627223424:0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1763333171.071643:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c54915 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x198:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333171.071648:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c54915 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x198:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333171.071652:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333171.071655:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c54915 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x198:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333171.071660:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c54915 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x198:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00000100:00100000:1.0:1763333171.071693:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1763333171.071731:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x198:0x0].0x0 (ffff92fe43b44900) 00000100:00100000:1.0:1763333171.071732:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1763333171.071735:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333171.071738:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff5922aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627223040:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1763333171.071738:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c54915 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x198:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333171.071744:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c54915 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x198:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000100:00100000:1.0:1763333171.071760:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333171.071783:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff5922b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627223168:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763333171.071803:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333171.071818:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1763333171.071823:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff59229500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627223296:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333171.071839:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333171.071867:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627223424 00000100:00100000:1.0:1763333171.071873:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627223424 00000100:00100000:1.0:1763333171.071906:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627223040 00000100:00100000:1.0:1763333171.071909:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627223040 00000100:00100000:1.0:1763333171.071932:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627223168 00000100:00100000:1.0:1763333171.071935:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627223168 00000100:00100000:0.0:1763333171.073561:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627223296 00000100:00100000:0.0:1763333171.073571:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627223296 00000100:00100000:0.0:1763333171.073616:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6260 00000100:00100000:0.0:1763333171.073626:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5922ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+45:3652:x1848987627223424:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333171.074587:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5922ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+46:3652:x1848987627223424:12345-0@lo:2:osp-syn-1-1.0 Request processed in 960us (2891us total) trans 17179871464 rc 0/0 00000100:00100000:0.0:1763333171.074595:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6260 00000100:00100000:0.0:1763333171.074614:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6261 00000100:00100000:0.0:1763333171.074621:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+45:3652:x1848987627223040:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1763333171.074639:0:28651:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:533 count 1 00010000:00010000:0.0:1763333171.074657:0:28651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c54954 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333171.075627:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6262 00000100:00100000:1.0:1763333171.075642:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+45:3654:x1848987627223168:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763333171.075661:0:8406:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:534 count 1 00010000:00010000:1.0:1763333171.075679:0:8406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5495b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.075698:0:8406:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c54786 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e5a expref: 28 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333171.075706:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333171.075708:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333171.075712:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5495b lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.075748:0:8406:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c54786 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e5a expref: 28 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333171.075763:0:8406:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c54786 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e5a expref: 28 pid: 8404 timeout: 1375 lvb_type: 1 00000100:00100000:1.0:1763333171.075776:0:8406:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e05f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8406:1848987627223552:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333171.075862:0:8406:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe46e0eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1763333171.075894:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6263 00000100:00100000:1.0:1763333171.075902:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+45:3654:x1848987627223296:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333171.076048:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+46:3654:x1848987627223296:12345-0@lo:2:osp-syn-1-1.0 Request processed in 146us (4206us total) trans 17179871465 rc 0/0 00000100:00100000:1.0:1763333171.076055:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6263 00000004:00080000:1.0:1763333171.076106:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff59229500/2, rc 0, transno 17179871465 00000100:00100000:1.0:1763333171.076112:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff59229500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627223296:0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1763333171.076128:0:28651:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c547b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e6f expref: 28 pid: 8611 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1763333171.076134:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff59228e00/2, rc 0, transno 17179871464 00010000:00010000:0.0:1763333171.076136:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1763333171.076137:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff59228e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627223424:0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1763333171.076137:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333171.076140:0:28651:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c54954 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.076161:0:28651:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c547b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e6f expref: 28 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.076170:0:28651:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c547b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e6f expref: 28 pid: 8611 timeout: 1375 lvb_type: 0 00000100:00100000:0.0:1763333171.076180:0:28651:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe438aa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28651:1848987627223680:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333171.076283:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627224064:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333171.076311:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333171.076332:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1763333171.076338:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627223936:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763333171.076378:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333171.076401:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627224064 00000100:00100000:1.0:1763333171.076407:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627224064 00000100:00100000:1.0:1763333171.076436:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627223936 00000100:00100000:1.0:1763333171.076439:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627223936 00000100:00100000:1.0:1763333171.076455:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6264 00000100:00100000:1.0:1763333171.076461:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+14:3655:x1848987627224064:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1763333171.076531:0:28650:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x217:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333171.076535:0:28650:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x217:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763333171.076537:0:28650:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x217:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333171.076539:0:28650:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x217:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763333171.076541:0:28650:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x217:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333171.076583:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+15:3655:x1848987627224064:12345-0@lo:2:osp-syn-0-1.0 Request processed in 121us (270us total) trans 21474838768 rc 0/0 00000100:00100000:1.0:1763333171.076589:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6264 00000100:00100000:1.0:1763333171.076603:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6265 00000100:00100000:1.0:1763333171.076610:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+14:3655:x1848987627223936:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1763333171.076620:0:28650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:534 count 1 00010000:00010000:1.0:1763333171.076632:0:28650:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54962 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.076643:0:28650:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5477f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e53 expref: 13 pid: 29013 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333171.076649:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333171.076650:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333171.076653:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54962 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.076671:0:28650:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5477f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e53 expref: 13 pid: 29013 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333171.076681:0:28650:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5477f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e53 expref: 13 pid: 29013 timeout: 1375 lvb_type: 1 00000100:00100000:1.0:1763333171.076691:0:28650:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e04380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28650:1848987627224320:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333171.076719:0:28650:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe46e0e180 going to sleep for 11 seconds 00000004:00080000:1.0:1763333171.076745:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44e05180/2, rc 0, transno 21474838768 00000100:00100000:1.0:1763333171.076750:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627224064:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333171.076777:0:28651:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4ce84840 going to sleep for 11 seconds 00000100:00100000:0.0:1763333171.077109:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627224192:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333171.077137:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333171.077157:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1763333171.077162:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627223808:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763333171.077183:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333171.077206:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627224192 00000100:00100000:0.0:1763333171.077210:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627224192 00000100:00100000:0.0:1763333171.077233:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627223808 00000100:00100000:0.0:1763333171.077236:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627223808 00000100:00100000:0.0:1763333171.077252:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6266 00000100:00100000:0.0:1763333171.077258:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+16:3652:x1848987627224192:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333171.077368:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+17:3652:x1848987627224192:12345-0@lo:2:osp-syn-0-1.0 Request processed in 109us (229us total) trans 21474838769 rc 0/0 00000100:00100000:0.0:1763333171.077375:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6266 00000100:00100000:0.0:1763333171.077389:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6267 00000100:00100000:0.0:1763333171.077396:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+16:3652:x1848987627223808:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1763333171.077406:0:8611:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:533 count 1 00010000:00010000:0.0:1763333171.077418:0:8611:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c54969 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.077429:0:8611:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c547be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e7d expref: 13 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.077435:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333171.077437:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333171.077440:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c54969 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.077459:0:8611:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c547be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e7d expref: 13 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.077468:0:8611:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c547be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e7d expref: 13 pid: 8611 timeout: 1375 lvb_type: 0 00000100:00100000:0.0:1763333171.077478:0:8611:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44de2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8611:1848987627224448:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333171.077504:0:8611:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4ce84780 going to sleep for 11 seconds 00000004:00080000:0.0:1763333171.077532:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44e04700/2, rc 0, transno 21474838769 00000100:00100000:0.0:1763333171.077536:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627224192:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333171.083452:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333171.083538:0:28650:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e04380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28650:1848987627224320:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333171.083577:0:28650:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54962 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333171.083713:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613579776 00000100:00100000:2.0:1763333171.083722:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613579776 00000100:00100000:2.0:1763333171.083785:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8972 00000100:00100000:2.0:1763333171.083795:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56805:x1848987613579776:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333171.083826:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333171.083849:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c54970 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968ef4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333171.083913:0:8406:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e05f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8406:1848987627223552:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333171.083929:0:8406:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5495b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.083944:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54977 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333171.083969:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54977 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.083985:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54977 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.083998:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5497e lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333171.084005:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5497e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.084011:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5497e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.084132:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54985 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x198:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333171.084141:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54985 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.084148:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54985 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:2.0:1763333171.084157:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x198:0x0]: returning size 2 00010000:00010000:2.0:1763333171.084274:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54977 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.084281:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54977 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.084286:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54977 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.084291:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54977 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.084297:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333171.084301:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54977 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.084307:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54977 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.084319:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff44d03200) 00010000:00010000:2.0:1763333171.084322:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333171.084326:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54977 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.084332:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54977 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.084344:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5497e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.084381:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5497e lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.084386:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5497e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.084391:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333171.084394:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5497e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.084398:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5497e lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.084405:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff44d03a00) 00010000:00010000:2.0:1763333171.084408:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333171.084410:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5497e lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.084419:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5497e lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.084461:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c54970 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ef4 expref: 224 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.084477:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54985 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ef4 expref: 223 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.084484:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x198:0x0].0x0 (ffff92fe43b44900) 00010000:00010000:2.0:1763333171.084487:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333171.084489:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4000, rc 0) 00000100:00100000:2.0:1763333171.084559:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56805:x1848987613579776:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 765us (1117us total) trans 4294972015 rc 0/0 00000100:00100000:2.0:1763333171.084566:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8972 00000100:00100000:3.0:1763333171.086590:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333171.086633:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333171.086657:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333171.086685:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613580160 00000100:00100000:3.0:1763333171.086693:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613580160 00010000:00010000:3.0:1763333171.086732:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c547b7 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e6f expref: 29 pid: 8611 timeout: 1375 lvb_type: 0 00000100:00100000:3.0:1763333171.086760:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613580288 00000100:00100000:3.0:1763333171.086763:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613580288 00010000:00010000:3.0:1763333171.086778:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c547be lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e7d expref: 14 pid: 8611 timeout: 1375 lvb_type: 0 00000100:00100000:3.0:1763333171.086795:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613579904 00000100:00100000:3.0:1763333171.086798:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613579904 00010000:00010000:3.0:1763333171.086809:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c54786 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e5a expref: 30 pid: 8404 timeout: 1375 lvb_type: 1 00000100:00100000:3.0:1763333171.086822:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2947 00000100:00100000:3.0:1763333171.086831:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:2418:x1848987613580160:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333171.086845:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333171.086851:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c547b7 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x215:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e6f expref: 30 pid: 8611 timeout: 1375 lvb_type: 0 00010000:00010000:3.0:1763333171.086861:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c547b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x215:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e6f expref: 30 pid: 8611 timeout: 1375 lvb_type: 0 00010000:00010000:3.0:1763333171.086889:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333171.086891:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333171.086896:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c54954 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x215:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.086908:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c54954 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x215:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.086927:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333171.086979:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:2418:x1848987613580160:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 149us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333171.086986:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2947 00000100:00100000:3.0:1763333171.087007:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2948 00000100:00100000:3.0:1763333171.087013:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2418:x1848987613580288:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333171.087025:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333171.087030:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c547be lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x215:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e7d expref: 14 pid: 8611 timeout: 1375 lvb_type: 0 00010000:00010000:3.0:1763333171.087040:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c547be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x215:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e7d expref: 14 pid: 8611 timeout: 1375 lvb_type: 0 00010000:00010000:3.0:1763333171.087056:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333171.087058:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333171.087061:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c54969 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x215:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.087068:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c54969 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x215:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.087080:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333171.087098:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2418:x1848987613580288:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 85us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333171.087104:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2948 00000100:00100000:3.0:1763333171.087117:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2949 00000100:00100000:3.0:1763333171.087123:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff61b16050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:2421:x1848987613579904:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333171.087131:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333171.087135:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c54786 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x216:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e5a expref: 29 pid: 8404 timeout: 1375 lvb_type: 1 00010000:00010000:3.0:1763333171.087145:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c54786 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x216:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e5a expref: 29 pid: 8404 timeout: 1375 lvb_type: 1 00010000:00010000:3.0:1763333171.087164:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c54786 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x216:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e5a expref: 29 pid: 8404 timeout: 1375 lvb_type: 1 00010000:00010000:3.0:1763333171.087177:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333171.087179:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333171.087183:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5495b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.087190:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5495b lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.087205:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333171.087223:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff61b16050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+28:2421:x1848987613579904:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 100us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333171.087229:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2949 00000100:00100000:3.0:1763333171.087293:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333171.087313:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613580032 00000100:00100000:3.0:1763333171.087317:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613580032 00010000:00010000:3.0:1763333171.087333:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5477f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e53 expref: 14 pid: 29013 timeout: 1375 lvb_type: 1 00000100:00100000:3.0:1763333171.087385:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2950 00000100:00100000:3.0:1763333171.087391:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2421:x1848987613580032:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333171.087399:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333171.087403:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5477f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x216:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e53 expref: 14 pid: 29013 timeout: 1375 lvb_type: 1 00010000:00010000:3.0:1763333171.087419:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5477f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x216:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e53 expref: 14 pid: 29013 timeout: 1375 lvb_type: 1 00010000:00010000:3.0:1763333171.087432:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5477f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x216:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e53 expref: 14 pid: 29013 timeout: 1375 lvb_type: 1 00010000:00010000:3.0:1763333171.087443:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333171.087445:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333171.087448:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54962 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.087455:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54962 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.087472:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333171.087491:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2421:x1848987613580032:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 100us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333171.087497:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2950 00010000:00010000:3.0:1763333171.087518:0:28650:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54962 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.087526:0:28650:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54962 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.087535:0:28650:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54962 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.087554:0:28650:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54962 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.087570:0:28650:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763333171.087787:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+17:3655:x1848987627223936:12345-0@lo:6:osp-syn-0-1.0 Request processed in 11178us (11408us total) trans 21474838770 rc 0/0 00000100:00100000:3.0:1763333171.087796:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6265 00010000:00010000:3.0:1763333171.087817:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333171.087824:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54962 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.087831:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333171.087835:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54962 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.087844:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54962 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.087855:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54962 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.087862:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54962 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.087881:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333171.087883:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333171.087885:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763333171.087926:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44e06680/2, rc 0, transno 21474838770 00000100:00100000:3.0:1763333171.087933:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627223936:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1763333171.088739:0:8611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c547be lrc: 0/0,0 mode: --/PW res: [0x280000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e7d expref: 12 pid: 8611 timeout: 1375 lvb_type: 0 00000100:00100000:0.0:1763333171.088754:0:8611:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44de2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8611:1848987627224448:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333171.088773:0:8611:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c54969 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.088782:0:8611:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c54969 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.088789:0:8611:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c54969 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.088797:0:8611:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c54969 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.088804:0:8611:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c54969 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.088830:0:8611:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763333171.088973:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+17:3652:x1848987627223808:12345-0@lo:6:osp-syn-0-1.0 Request processed in 11577us (11787us total) trans 21474838771 rc 0/0 00000100:00100000:0.0:1763333171.088980:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6267 00000004:00080000:0.0:1763333171.089015:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44e04e00/2, rc 0, transno 21474838771 00000100:00100000:3.0:1763333171.089016:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333171.089019:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627223808:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763333171.089035:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613580416 00000100:00100000:3.0:1763333171.089040:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613580416 00010000:00010000:2.0:1763333171.089065:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333171.089072:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c54969 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.089084:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333171.089087:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c54969 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.089095:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c54969 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.089108:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c54969 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.089118:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c54969 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.089134:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333171.089136:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333171.089137:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763333171.089148:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6268 00000100:00100000:3.0:1763333171.089157:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:55917:x1848987613580416:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333171.089170:0:8611:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333171.089248:0:8611:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c54993 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x217:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968efb expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.089274:0:8611:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c54900 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968eca expref: 13 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333171.089282:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333171.089283:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333171.089287:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c54993 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x217:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968efb expref: 13 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.089313:0:8611:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c54900 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968eca expref: 13 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333171.089326:0:8611:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c54900 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968eca expref: 13 pid: 8611 timeout: 1375 lvb_type: 1 00000100:00100000:3.0:1763333171.089340:0:8611:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46a6e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8611:1848987627224576:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333171.089399:0:8406:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5495b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.089407:0:8406:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5495b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.089414:0:8406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5495b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.089420:0:8406:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5495b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.089435:0:8406:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763333171.089579:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+46:3654:x1848987627223168:12345-0@lo:6:osp-syn-1-1.0 Request processed in 13942us (17775us total) trans 17179871466 rc 0/0 00010000:00010000:2.0:1763333171.089580:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333171.089585:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5495b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333171.089586:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6262 00010000:00010000:2.0:1763333171.089592:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7ec00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333171.089595:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5495b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.089602:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5495b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.089613:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5495b lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.089620:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5495b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.089643:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333171.089645:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333171.089647:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763333171.089746:0:8611:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7df5de40 going to sleep for 11 seconds 00000100:00100000:3.0:1763333171.089799:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.090398:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613580672 00000100:00100000:2.0:1763333171.090406:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613580672 00000100:00100000:2.0:1763333171.090456:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3061 00000100:00100000:2.0:1763333171.090465:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56805:x1848987613580672:12345-192.168.204.28@tcp:35:lfs.0 00010000:00010000:1.0:1763333171.091306:0:28651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c547b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968e6f expref: 27 pid: 8611 timeout: 1375 lvb_type: 0 00000100:00100000:1.0:1763333171.091322:0:28651:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe438aa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28651:1848987627223680:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333171.091344:0:28651:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c54954 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.091367:0:28651:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c54954 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.091373:0:28651:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c54954 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.091387:0:28651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c54954 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.091395:0:28651:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c54954 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.091422:0:28651:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763333171.091656:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+46:3652:x1848987627223040:12345-0@lo:6:osp-syn-1-1.0 Request processed in 17034us (19892us total) trans 17179871467 rc 0/0 00000100:00100000:1.0:1763333171.091664:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6261 00010000:00010000:1.0:1763333171.091700:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333171.091706:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c54954 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.091714:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea200 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333171.091717:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c54954 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.091726:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c54954 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.091742:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c54954 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.091749:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c54954 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.091770:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333171.091772:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333171.091773:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763333171.091802:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff5922b480/2, rc 0, transno 17179871466 00000100:00100000:1.0:1763333171.091807:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff5922b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627223168:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1763333171.091829:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff5922aa00/2, rc 0, transno 17179871467 00000100:00100000:1.0:1763333171.091833:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff5922aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627223040:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763333171.092395:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56805:x1848987613580672:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 1930us (2594us total) trans 4294972016 rc 0/0 00000100:00100000:1.0:1763333171.092403:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3061 00000100:00100000:3.0:1763333171.094905:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333171.095057:0:8611:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46a6e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8611:1848987627224576:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333171.095093:0:8611:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c54993 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x217:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968efb expref: 13 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.095110:0:8611:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a97800, rc 0) 00000100:00100000:2.0:1763333171.095229:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613580800 00000100:00100000:2.0:1763333171.095236:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613580800 00010000:00010000:2.0:1763333171.095267:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c54900 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968eca expref: 14 pid: 8611 timeout: 1375 lvb_type: 1 00000100:00100000:2.0:1763333171.095308:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2951 00000100:00100000:2.0:1763333171.095317:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2421:x1848987613580800:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333171.095330:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333171.095345:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c54900 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x217:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968eca expref: 14 pid: 8611 timeout: 1375 lvb_type: 1 00010000:00010000:2.0:1763333171.095392:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c54900 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x217:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968eca expref: 14 pid: 8611 timeout: 1375 lvb_type: 1 00010000:00010000:2.0:1763333171.095415:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c54900 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x217:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968eca expref: 14 pid: 8611 timeout: 1375 lvb_type: 1 00010000:00010000:2.0:1763333171.095426:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333171.095427:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333171.095434:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c54993 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968efb expref: 13 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.095443:0:28428:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c54993 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968efb expref: 13 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.095481:0:28428:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c54993 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968efb expref: 13 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333171.095495:0:28428:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46e2f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:28428:1848987627224704:192.168.204.28@tcp:105: 00000100:00100000:0.0:1763333171.095581:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:55917:x1848987613580416:12345-192.168.204.28@tcp:101:bash.0 Request processed in 6425us (6564us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333171.095590:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6268 00000100:00100000:2.0:1763333171.096393:0:28428:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7dcc7540 going to sleep for 11 seconds 00000100:00100000:0.0:1763333171.098226:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333171.098304:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613580928 00000100:00100000:3.0:1763333171.098315:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613580928 00000100:00100000:3.0:1763333171.098740:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6269 00000100:00100000:3.0:1763333171.098752:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2419:x1848987613580928:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333171.098770:0:8611:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333171.098789:0:8611:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5499a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x217:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968f02 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333171.098850:0:8611:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe438a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8611:1848987627224832:192.168.204.28@tcp:106: 00000100:00100000:3.0:1763333171.098934:0:8611:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7df5de40 going to sleep for 11 seconds 00000100:00100000:1.0:1763333171.100179:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.100319:0:28428:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46e2f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:28428:1848987627224704:192.168.204.28@tcp:105: 00010000:00010000:2.0:1763333171.100343:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333171.100414:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2421:x1848987613580800:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 5097us (5515us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333171.100423:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2951 00000100:00100000:3.0:1763333171.100881:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613581056 00000100:00100000:3.0:1763333171.100889:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613581056 00000100:00100000:3.0:1763333171.100938:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6270 00000100:00100000:3.0:1763333171.100947:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+27:55917:x1848987613581056:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333171.100962:0:28651:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333171.100982:0:28651:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c549a1 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968f09 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333171.101005:0:28651:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x217:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333171.101023:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333171.101025:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333171.101035:0:28651:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c549a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f09 expref: 28 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.101052:0:28651:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c549a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f09 expref: 28 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.101069:0:28651:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a97000, rc 0) 00000100:00100000:3.0:1763333171.101097:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+28:55917:x1848987613581056:12345-192.168.204.28@tcp:101:bash.0 Request processed in 152us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333171.101103:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6270 00002000:00010000:3.0:1763333171.102151:0:8611:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x217:0x0] updating lvb mtime: 0 -> 1763333171 00002000:00010000:3.0:1763333171.102156:0:8611:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x217:0x0] updating lvb atime: 0 -> 1763333171 00002000:00010000:3.0:1763333171.102158:0:8611:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x217:0x0] updating lvb ctime: 0 -> 1763333171 00000100:00100000:3.0:1763333171.102173:0:8611:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe438a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8611:1848987627224832:192.168.204.28@tcp:106: 00010000:00010000:3.0:1763333171.102201:0:8611:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5499a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x217:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f02 expref: 13 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333171.102217:0:8611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5499a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x217:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f02 expref: 13 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333171.102228:0:8611:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96c00, rc 0) 00000100:00100000:3.0:1763333171.102760:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:2419:x1848987613580928:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 4010us (4543us total) trans 0 rc 301/301 00000100:00100000:3.0:1763333171.102768:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6269 00000100:00100000:1.0:1763333171.104757:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.104799:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.104967:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613581184 00000100:00100000:2.0:1763333171.104978:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613581184 00002000:00010000:2.0:1763333171.105019:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/535 (0->18446744073709551615) 00002000:00100000:2.0:1763333171.105024:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe44e07b80 with x1848987613581184 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333171.105036:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe44e07b80. 00000100:00100000:2.0:1763333171.105064:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613581312 00000100:00100000:2.0:1763333171.105068:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613581312 00002000:00010000:2.0:1763333171.105082:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/535 (0->18446744073709551615) 00002000:00100000:2.0:1763333171.105084:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe44e05c00 with x1848987613581312 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333171.105091:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe44e05c00. 00000100:00100000:2.0:1763333171.105118:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1560 00000100:00100000:2.0:1763333171.105127:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:2420:x1848987613581184:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:2.0:1763333171.105323:0:28427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x217:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333171.105327:0:28427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x217:0x0] updating lvb mtime from disk: 1763333171 -> 1763333171 00002000:00010000:2.0:1763333171.105331:0:28427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x217:0x0] updating lvb atime from disk: 1763333171 -> 0 00002000:00010000:2.0:1763333171.105334:0:28427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x217:0x0] updating lvb ctime from disk: 1763333171 -> 1763333171 00002000:00010000:2.0:1763333171.105336:0:28427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x217:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333171.105421:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2420:x1848987613581184:12345-192.168.204.28@tcp:10:bash.0 Request processed in 294us (670us total) trans 21474838772 rc 0/0 00000100:00100000:2.0:1763333171.105428:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1560 00002000:00010000:2.0:1763333171.105432:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/535 (0->18446744073709551615) 00002000:00100000:2.0:1763333171.105434:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe44e07b80 with x1848987613581184 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333171.105438:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe44e07b80. 00000100:00100000:2.0:1763333171.105458:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1561 00000100:00100000:2.0:1763333171.105465:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+28:2420:x1848987613581312:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:2.0:1763333171.105571:0:28427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x217:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333171.105574:0:28427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x217:0x0] updating lvb mtime from disk: 0 -> 1763333171 00002000:00010000:2.0:1763333171.105577:0:28427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x217:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333171.105579:0:28427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x217:0x0] updating lvb ctime from disk: 0 -> 1763333171 00002000:00010000:2.0:1763333171.105581:0:28427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x217:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333171.105602:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:2420:x1848987613581312:12345-192.168.204.28@tcp:10:bash.0 Request processed in 137us (802us total) trans 17179871468 rc 0/0 00000100:00100000:2.0:1763333171.105609:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1561 00002000:00010000:2.0:1763333171.105612:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/535 (0->18446744073709551615) 00002000:00100000:2.0:1763333171.105615:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe44e05c00 with x1848987613581312 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333171.105619:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe44e05c00. 00000100:00100000:0.0:1763333171.111108:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333171.111200:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613581568 00000100:00100000:3.0:1763333171.111210:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613581568 00000100:00100000:3.0:1763333171.111268:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3062 00000100:00100000:3.0:1763333171.111279:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:55917:x1848987613581568:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:3.0:1763333171.111641:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:55917:x1848987613581568:12345-192.168.204.28@tcp:35:bash.0 Request processed in 363us (543us total) trans 4294972017 rc 0/0 00000100:00100000:3.0:1763333171.111653:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3062 00000100:00100000:2.0:1763333171.118689:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333171.118789:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613581824 00000100:00100000:0.0:1763333171.118802:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613581824 00000100:00100000:1.0:1763333171.118940:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8973 00000100:00100000:1.0:1763333171.119137:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56807:x1848987613581824:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:1.0:1763333171.119199:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1763333171.119226:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5494d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x198:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968eed expref: 225 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.119247:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54985 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ef4 expref: 224 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.119260:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c5490e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x198:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ed8 expref: 223 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.119275:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x198:0x0].0x0 (ffff92fe43b44900) 00010000:00010000:1.0:1763333171.119285:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333171.119317:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c549a8 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333171.119332:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c549a8 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.119342:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c549a8 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.119464:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c549af lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333171.119472:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c549af lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.119479:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c549af lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.119567:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c549b6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x198:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333171.119576:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c549b6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x198:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.119582:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c549b6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x198:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000040:00080000:1.0:1763333171.119872:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1327, 64 off112488 00000040:00080000:1.0:1763333171.119904:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1326, 64 off112488 00000040:00080000:1.0:1763333171.119914:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1327, 64 off112552 00000040:00080000:1.0:1763333171.119922:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1328, 64 off112552 00010000:00010000:1.0:1763333171.120041:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c549bd lrc: 3/0,1 mode: --/PW res: [0x240000404:0x198:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333171.120051:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c549bd lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x198:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.120058:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c549bd lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x198:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.120065:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c549bd lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x198:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.120071:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c549bd lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x198:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.120077:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c549bd lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x198:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.120152:0:12741:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763333171.120173:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c549b6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x198:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.120178:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c549b6 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x198:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.120184:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c549b6 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x198:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.120189:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333171.120193:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c549b6 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x198:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.120201:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c549b6 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x198:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.120210:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x198:0x0].0x0 (ffff92fe48355900) 00010000:00010000:1.0:1763333171.120213:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763333171.120218:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c549b6 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x198:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.120223:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c549b6 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x198:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.120389:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c549a8 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.120397:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c549a8 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.120402:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c549a8 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.120408:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c549a8 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.120413:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333171.120416:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c549a8 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.120420:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c549a8 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.120427:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355300) 00010000:00010000:1.0:1763333171.120430:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333171.120433:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c549a8 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.120438:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c549a8 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000004:00010000:1.0:1763333171.120450:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a2d0efe1 reply state 00000000bfaf4dfb transno 4294972018 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c549af lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.120461:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c549af lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.120467:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355b00) 00010000:00010000:1.0:1763333171.120469:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333171.120472:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763333171.120576:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56807:x1848987613581824:12345-192.168.204.28@tcp:36:rm.0 Request processed in 1624us (1952us total) trans 4294972018 rc 0/0 00000100:00100000:1.0:1763333171.120585:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8973 00010000:00010000:3.0:1763333171.120655:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333171.120662:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c549bd lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x198:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333171.120668:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f800 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333171.120671:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c549bd lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x198:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333171.120676:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c549bd lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x198:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333171.120686:0:8422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x198:0x0].0x0 (ffff92fe48355900) 00010000:00010000:3.0:1763333171.120688:0:8422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763333171.120691:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c549bd lrc: 1/0,0 mode: --/PW res: [0x240000404:0x198:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333171.120695:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c549bd lrc: 0/0,0 mode: --/PW res: [0x240000404:0x198:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333171.120707:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333171.120709:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333171.120710:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763333171.124946:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.125741:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613582080 00000100:00100000:1.0:1763333171.125755:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613582080 00000100:00100000:1.0:1763333171.125817:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8974 00000100:00100000:1.0:1763333171.125826:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56806:x1848987613582080:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333171.125850:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333171.125876:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c549c4 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968f10 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.125977:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c549cb lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333171.125991:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c549cb lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.126004:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c549cb lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.126015:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c549d2 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333171.126022:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c549d2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.126029:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c549d2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.126074:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c549cb lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.126081:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c549cb lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.126086:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c549cb lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.126093:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c549cb lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.126098:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333171.126103:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c549cb lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.126109:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c549cb lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.126120:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355600) 00010000:00010000:1.0:1763333171.126122:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333171.126127:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c549cb lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.126133:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c549cb lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.126147:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c549d2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.126152:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c549d2 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.126158:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c549d2 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.126163:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333171.126165:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c549d2 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.126170:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c549d2 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.126176:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355b00) 00010000:00010000:1.0:1763333171.126179:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333171.126181:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c549d2 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.126187:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c549d2 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.126219:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c549c4 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f10 expref: 225 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.126231:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355600) 00010000:00010000:1.0:1763333171.126234:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763333171.126238:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c549c4 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f10 expref: 225 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.126254:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7ea00, rc 0) 00000100:00100000:1.0:1763333171.126331:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56806:x1848987613582080:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 506us (1400us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333171.126339:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8974 00000100:00100000:0.0:1763333171.131674:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.132136:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613582208 00000100:00100000:2.0:1763333171.132148:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613582208 00000100:00100000:2.0:1763333171.132215:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8975 00000100:00100000:2.0:1763333171.132226:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56806:x1848987613582208:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333171.132247:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333171.132274:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c549d9 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968f17 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.132365:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c549e0 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333171.132379:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c549e0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.132390:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c549e0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.132402:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c549e7 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333171.132409:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c549e7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.132415:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c549e7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.132462:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c549e0 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.132470:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c549e0 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.132476:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c549e0 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.132488:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c549e0 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.132494:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333171.132497:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c549e0 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.132504:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c549e0 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.132516:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff44d03200) 00010000:00010000:2.0:1763333171.132519:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333171.132524:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c549e0 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.132530:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c549e0 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.132541:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c549e7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.132558:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c549e7 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.132564:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c549e7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.132569:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333171.132572:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c549e7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.132578:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c549e7 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.132589:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355b00) 00010000:00010000:2.0:1763333171.132592:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333171.132595:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c549e7 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.132600:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c549e7 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.132632:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c549d9 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f17 expref: 225 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.132641:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff44d03200) 00010000:00010000:2.0:1763333171.132643:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333171.132646:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c549d9 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f17 expref: 225 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.132660:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5400, rc 0) 00000100:00100000:2.0:1763333171.132740:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56806:x1848987613582208:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 515us (1074us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333171.132748:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8975 00000100:00100000:2.0:1763333171.137376:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333171.137456:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613582336 00000100:00100000:3.0:1763333171.137467:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613582336 00000100:00100000:3.0:1763333171.137534:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8976 00000100:00100000:3.0:1763333171.137554:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56808:x1848987613582336:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333171.137578:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333171.137604:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c549ee lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968f1e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.137680:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c549f5 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333171.137694:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c549f5 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333171.137705:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c549f5 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333171.137714:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c549fc lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333171.137722:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c549fc lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333171.137728:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c549fc lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333171.137778:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c549f5 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333171.137785:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c549f5 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333171.137791:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c549f5 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333171.137797:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c549f5 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333171.137802:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333171.137806:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c549f5 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333171.137817:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c549f5 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333171.137828:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6231e400) 00010000:00010000:3.0:1763333171.137830:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333171.137836:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c549f5 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333171.137842:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c549f5 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333171.137855:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c549fc lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333171.137861:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c549fc lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333171.137866:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c549fc lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333171.137871:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333171.137874:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c549fc lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333171.137879:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c549fc lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333171.137885:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355b00) 00010000:00010000:3.0:1763333171.137887:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333171.137889:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c549fc lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333171.137895:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c549fc lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333171.137922:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c549ee lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f1e expref: 225 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.137931:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6231e400) 00010000:00010000:3.0:1763333171.137934:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333171.137938:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c549ee lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f1e expref: 225 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.137960:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96c00, rc 0) 00000100:00100000:3.0:1763333171.138024:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56808:x1848987613582336:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 481us (679us total) trans 0 rc 301/301 00000100:00100000:3.0:1763333171.138032:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8976 00000100:00100000:1.0:1763333171.145777:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333171.145850:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613582464 00000100:00100000:0.0:1763333171.145863:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613582464 00000100:00100000:0.0:1763333171.145925:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8977 00000100:00100000:0.0:1763333171.145934:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56808:x1848987613582464:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333171.145963:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333171.145988:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c54a03 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968f25 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.146070:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c54a0a lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333171.146085:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c54a0a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.146095:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c54a0a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.146105:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54a11 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333171.146112:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54a11 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.146117:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54a11 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.146162:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c54a0a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.146169:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c54a0a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.146275:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c54a0a lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.146284:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c54a0a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.146290:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feaa00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333171.146293:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c54a0a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.146300:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c54a0a lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.146313:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44300) 00010000:00010000:0.0:1763333171.146315:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333171.146320:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c54a0a lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.146325:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c54a0a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.146338:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54a11 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.146345:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54a11 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.147555:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54a11 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.147561:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333171.147565:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54a11 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.147577:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54a11 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.147589:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355b00) 00010000:00010000:0.0:1763333171.147591:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333171.147595:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54a11 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.147601:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54a11 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.147647:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c54a03 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f25 expref: 225 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.147657:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44300) 00010000:00010000:0.0:1763333171.147659:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333171.147663:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c54a03 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f25 expref: 225 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.147675:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea000, rc 0) 00000100:00100000:0.0:1763333171.149535:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56808:x1848987613582464:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 3590us (3756us total) trans 0 rc 301/301 00000100:00100000:0.0:1763333171.149560:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8977 00000100:00100000:3.0:1763333171.159189:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.159272:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613582848 00000100:00100000:1.0:1763333171.159284:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613582848 00000100:00100000:2.0:1763333171.166598:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.166629:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613582592 00000100:00100000:2.0:1763333171.166639:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613582592 00000100:00100000:1.0:1763333171.166746:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8978 00000100:00100000:1.0:1763333171.166758:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56809:x1848987613582848:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333171.166783:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1763333171.166810:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8979 00010000:00010000:1.0:1763333171.166810:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54a18 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968f33 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333171.166817:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4399b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56808:x1848987613582592:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333171.166824:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333171.166832:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54a1f lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968f2c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.166874:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54a26 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333171.166879:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54a2d lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333171.166888:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54a26 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.166907:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54a26 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333171.166907:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54a2d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.166914:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54a2d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.166924:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54a34 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333171.166929:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54a34 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.166934:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54a34 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:2.0:1763333171.166964:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1763333171.166969:0:6519:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1763333171.167001:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54a1f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f2c expref: 228 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.167019:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54a26 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f2c expref: 227 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.167026:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54a2d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.167027:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355600) 00010000:00010000:2.0:1763333171.167030:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1763333171.167034:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4c00, rc 0) 00010000:00010000:1.0:1763333171.167034:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54a2d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.167039:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54a2d lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.167046:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54a2d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.167052:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333171.167055:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54a2d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.167062:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54a2d lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.167071:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355600) 00010000:00010000:1.0:1763333171.167074:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333171.167078:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54a2d lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.167083:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54a2d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.167091:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54a34 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.167097:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54a34 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00000100:00100000:2.0:1763333171.167101:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4399b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56808:x1848987613582592:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 285us (515us total) trans 0 rc 0/0 00010000:00010000:1.0:1763333171.167103:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54a34 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.167108:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f400 already unused, calling callback (ffffffffc17b3550) 00000100:00100000:2.0:1763333171.167109:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8979 00010000:00010000:1.0:1763333171.167111:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54a34 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.167116:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54a34 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.167126:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355b00) 00010000:00010000:1.0:1763333171.167129:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333171.167131:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54a34 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.167136:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54a34 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.167157:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54a18 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f33 expref: 226 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.167165:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355600) 00010000:00010000:1.0:1763333171.167168:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763333171.167171:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54a18 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f33 expref: 226 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.167178:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7ea00, rc 0) 00000100:00100000:1.0:1763333171.167200:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56809:x1848987613582848:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 445us (8024us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333171.167206:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8978 00000100:00100000:3.0:1763333171.182069:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.184603:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613583104 00000100:00100000:2.0:1763333171.184619:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613583104 00000100:00100000:0.0:1763333171.185179:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8980 00000100:00100000:0.0:1763333171.185191:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56808:x1848987613583104:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333171.185212:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333171.185216:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763333171.185243:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54a26 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f2c expref: 225 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.185266:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355600) 00010000:00010000:0.0:1763333171.185278:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333171.185296:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c54a3b lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968f3a expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.185455:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54a42 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333171.185468:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54a42 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333171.185479:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54a42 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333171.185490:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c54a49 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333171.185498:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c54a49 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333171.185504:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c54a49 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333171.185900:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c54a50 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333171.185909:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c54a50 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333171.185915:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c54a50 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:0.0:1763333171.185924:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x199:0x0]: returning size 0 00010000:00010000:0.0:1763333171.185949:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54a42 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333171.185956:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54a42 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333171.185962:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54a42 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333171.185967:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54a42 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333171.185972:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333171.185976:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54a42 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333171.185982:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54a42 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333171.185989:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44300) 00010000:00010000:0.0:1763333171.185992:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333171.185995:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54a42 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333171.186000:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54a42 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000004:00010000:0.0:1763333171.186010:0:8606:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000054c89441 reply state 000000003d0fd144 transno 4294972019 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c54a49 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333171.186020:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c54a49 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333171.186026:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355b00) 00010000:00010000:0.0:1763333171.186028:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333171.186031:0:8606:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763333171.186055:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c54a3b lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f3a expref: 227 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.186069:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c54a50 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f3a expref: 226 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.186075:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x199:0x0].0x0 (ffff92fe43b44700) 00010000:00010000:0.0:1763333171.186077:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333171.186079:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea200, rc 0) 00000100:00100000:0.0:1763333171.186146:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56808:x1848987613583104:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 958us (4085us total) trans 4294972019 rc 0/0 00000100:00100000:0.0:1763333171.186153:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8980 00000100:00100000:2.0:1763333171.191254:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.191452:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613583360 00000100:00100000:1.0:1763333171.191463:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613583360 00000100:00100000:1.0:1763333171.191525:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8981 00000100:00100000:1.0:1763333171.191535:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4399bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56808:x1848987613583360:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333171.191569:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333171.191590:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54a5e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968f41 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.191697:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54a65 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333171.191712:0:12741:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c54a50 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f3a expref: 228 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.191721:0:12741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54a65 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x199:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.191752:0:12741:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c54a50 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f3a expref: 228 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.191764:0:12741:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c54a50 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f3a expref: 228 pid: 8606 timeout: 1375 lvb_type: 0 00000100:00100000:1.0:1763333171.191777:0:12741:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e07100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627224960:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333171.191845:0:12741:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe46e0eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1763333171.194124:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333171.194464:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613583616 00000100:00100000:0.0:1763333171.194474:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613583616 00000100:00100000:1.0:1763333171.195365:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8982 00000100:00100000:1.0:1763333171.195377:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56810:x1848987613583616:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333171.195399:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333171.195421:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54a6c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x199:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968f48 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.195536:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54a73 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x199:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333171.195560:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54a73 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.195577:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54a73 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:1.0:1763333171.195589:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x199:0x0]: returning size 0 00010000:00010000:1.0:1763333171.195837:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54a73 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.195845:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54a73 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.195850:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54a73 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.195855:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333171.195859:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54a73 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.195866:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54a73 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.195875:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x199:0x0].0x0 (ffff92fe43b44700) 00010000:00010000:1.0:1763333171.195878:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1763333171.195882:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54a73 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x199:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.195887:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54a73 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x199:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.195923:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54a6c lrc: 1/0,0 mode: --/CR res: [0x240000404:0x199:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f48 expref: 231 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.195932:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x199:0x0].0x0 (ffff92fe43b44700) 00010000:00010000:1.0:1763333171.195934:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763333171.195937:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54a6c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x199:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f48 expref: 231 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.195945:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f000, rc 0) 00000100:00100000:3.0:1763333171.196110:0:12741:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e07100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627224960:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333171.196132:0:12741:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54a65 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x199:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000100:00100000:1.0:1763333171.196256:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56810:x1848987613583616:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 880us (2138us total) trans 4294972020 rc 301/301 00000100:00100000:1.0:1763333171.196263:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8982 00000100:00100000:0.0:1763333171.196326:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.196551:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613583744 00000100:00100000:2.0:1763333171.196558:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613583744 00010000:00010000:1.0:1763333171.196611:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c54a50 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f3a expref: 230 pid: 8606 timeout: 1375 lvb_type: 0 00000100:00100000:1.0:1763333171.196639:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2952 00000100:00100000:1.0:1763333171.196647:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:2420:x1848987613583744:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333171.196658:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333171.196665:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c54a50 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f3a expref: 230 pid: 8606 timeout: 1375 lvb_type: 0 00010000:00010000:1.0:1763333171.196675:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c54a50 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f3a expref: 230 pid: 8606 timeout: 1375 lvb_type: 0 00010000:00010000:1.0:1763333171.196694:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c54a50 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f3a expref: 230 pid: 8606 timeout: 1375 lvb_type: 0 00010000:00010000:1.0:1763333171.196706:0:28428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x199:0x0].0x0 (ffff92fe43b44700) 00010000:00010000:1.0:1763333171.196710:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54a65 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x199:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.196719:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54a65 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x199:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.196726:0:28428:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54a65 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x199:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.196760:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333171.196783:0:12741:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54a65 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x199:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000100:00100000:1.0:1763333171.196790:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:2420:x1848987613583744:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 144us (465us total) trans 0 rc 0/0 00010000:00010000:2.0:1763333171.196791:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54a65 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x199:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000100:00100000:1.0:1763333171.196797:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2952 00000004:00200000:2.0:1763333171.196809:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x199:0x0]: returning size 0 00000004:00080000:2.0:1763333171.197131:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x219:0x0], index 1: 0 00000004:00080000:2.0:1763333171.197139:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x219:0x0], index 0: 0 00000004:00080000:2.0:1763333171.197144:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x21a:0x0], index 0: 0 00000004:00080000:2.0:1763333171.197148:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x21a:0x0], index 1: 0 00010000:00010000:2.0:1763333171.197250:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54a65 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x199:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.197258:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54a65 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x199:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.197264:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54a65 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x199:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.197269:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333171.197272:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54a65 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x199:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.197278:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54a65 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x199:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.197288:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x199:0x0].0x0 (ffff92fe43b44700) 00010000:00010000:2.0:1763333171.197290:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333171.197293:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54a65 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x199:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.197298:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54a65 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x199:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.197338:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54a5e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x199:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f41 expref: 229 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.197373:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x199:0x0].0x0 (ffff92fe43b44700) 00010000:00010000:2.0:1763333171.197376:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763333171.197380:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54a5e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x199:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f41 expref: 229 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.197393:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7ea00, rc 0) 00000100:00100000:2.0:1763333171.197430:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4399bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56808:x1848987613583360:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 5897us (6185us total) trans 4294972021 rc 301/301 00000100:00100000:2.0:1763333171.197437:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8981 00000100:00100000:1.0:1763333171.199879:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.199921:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.199927:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613584128 00000100:00100000:2.0:1763333171.199936:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613584128 00000100:00100000:2.0:1763333171.199993:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8983 00000100:00100000:2.0:1763333171.200002:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56810:x1848987613584128:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333171.200028:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333171.200051:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54a88 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968f4f expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.200141:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c54a8f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333171.200154:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c54a8f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.200165:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c54a8f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:2.0:1763333171.200194:0:12741:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763333171.200217:0:12741:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c54a8f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.200245:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54a88 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f4f expref: 230 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.200263:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c54a8f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f4f expref: 229 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.200270:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x199:0x0].0x0 (ffff92ff44d03200) 00010000:00010000:2.0:1763333171.200273:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333171.200276:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5000, rc 0) 00000100:00100000:3.0:1763333171.200306:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613584000 00000100:00100000:3.0:1763333171.200311:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613584000 00000100:00100000:3.0:1763333171.200343:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3063 00000100:00100000:3.0:1763333171.200376:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56808:x1848987613584000:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333171.200678:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56810:x1848987613584128:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 675us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333171.200695:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8983 00000100:00100000:1.0:1763333171.200917:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56808:x1848987613584000:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 565us (994us total) trans 4294972022 rc 0/0 00000100:00100000:1.0:1763333171.200925:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3063 00000100:00100000:1.0:1763333171.203983:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333171.205021:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613584256 00000100:00100000:3.0:1763333171.205034:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613584256 00000100:00100000:3.0:1763333171.205100:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6271 00000100:00100000:3.0:1763333171.205111:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:2421:x1848987613584256:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333171.205130:0:8611:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333171.205151:0:8611:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c54a96 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968f56 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333171.205175:0:8611:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x219:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333171.205197:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333171.205199:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333171.205211:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c54a96 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f56 expref: 30 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333171.205229:0:8611:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c54a96 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f56 expref: 30 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333171.205242:0:8611:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96c00, rc 0) 00000100:00100000:3.0:1763333171.205311:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:2421:x1848987613584256:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 201us (1337us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333171.205318:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6271 00000100:00100000:1.0:1763333171.206821:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.208372:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613584512 00000100:00100000:2.0:1763333171.208383:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613584512 00000100:00100000:0.0:1763333171.208831:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3064 00000100:00100000:0.0:1763333171.208843:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6b3ebc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56808:x1848987613584512:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333171.209098:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6b3ebc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56808:x1848987613584512:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 257us (2281us total) trans 4294972023 rc 0/0 00000100:00100000:0.0:1763333171.209107:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3064 00000100:00100000:2.0:1763333171.211567:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.211631:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613584768 00000100:00100000:1.0:1763333171.211643:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613584768 00000100:00100000:1.0:1763333171.211743:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3065 00000100:00100000:1.0:1763333171.211754:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56810:x1848987613584768:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1763333171.212502:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56810:x1848987613584768:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 747us (941us total) trans 4294972024 rc 0/0 00000100:00100000:1.0:1763333171.212511:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3065 00000100:00100000:3.0:1763333171.214608:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.215483:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613585024 00000100:00100000:2.0:1763333171.215495:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613585024 00000100:00100000:2.0:1763333171.215570:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8984 00000100:00100000:2.0:1763333171.215582:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:55917:x1848987613585024:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333171.215611:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333171.215640:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54a9d lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968f5d expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.215792:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54aa4 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333171.215807:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54aa4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.215818:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54aa4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.215831:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54aab lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333171.215838:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54aab lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.215843:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54aab lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.215898:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54ab2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333171.215905:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54ab2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.215912:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54ab2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:2.0:1763333171.215922:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x199:0x0]: returning size 0 00010000:00010000:2.0:1763333171.216001:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54aa4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.216008:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54aa4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.216014:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54aa4 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.216021:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54aa4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.216026:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333171.216029:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54aa4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.216036:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54aa4 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.216047:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff44d03a00) 00010000:00010000:2.0:1763333171.216050:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333171.216055:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54aa4 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.216061:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54aa4 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.216076:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54aab lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.216081:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54aab lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.216086:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54aab lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.216091:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4a00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333171.216093:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54aab lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.216098:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54aab lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.216105:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355b00) 00010000:00010000:2.0:1763333171.216107:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333171.216110:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54aab lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.216115:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54aab lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.216149:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54a9d lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f5d expref: 235 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.216164:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54ab2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f5d expref: 234 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.216171:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x199:0x0].0x0 (ffff92ff44d03200) 00010000:00010000:2.0:1763333171.216173:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333171.216175:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5400, rc 0) 00000100:00100000:2.0:1763333171.216249:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:55917:x1848987613585024:12345-192.168.204.28@tcp:101:bash.0 Request processed in 669us (1648us total) trans 4294972025 rc 0/0 00000100:00100000:2.0:1763333171.216257:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8984 00000100:00100000:3.0:1763333171.220332:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.220579:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.221414:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613585408 00000100:00100000:2.0:1763333171.221425:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613585408 00000100:00100000:2.0:1763333171.221678:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 405 00000100:00100000:2.0:1763333171.221689:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:2419:x1848987613585408:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333171.221706:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333171.221735:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54ab2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f5d expref: 234 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.221754:0:8423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x199:0x0].0x0 (ffff92ff44d03200) 00010000:00010000:2.0:1763333171.221760:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333171.221803:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613585280 00000100:00100000:1.0:1763333171.221808:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613585280 00000100:00100000:2.0:1763333171.221823:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:2419:x1848987613585408:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 136us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333171.221831:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 405 00000100:00100000:1.0:1763333171.221853:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8985 00000100:00100000:1.0:1763333171.221865:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56810:x1848987613585280:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333171.221888:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333171.221904:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54ac0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968f64 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333171.221905:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:1.0:1763333171.222277:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54ac7 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333171.222292:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54ac7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x199:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.222302:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54ac7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x199:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:1.0:1763333171.222314:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x199:0x0]: returning size 0 00010000:00010000:1.0:1763333171.222976:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54ac0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x199:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f64 expref: 236 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.222998:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54ac7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x199:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f64 expref: 235 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.223009:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x199:0x0].0x0 (ffff92ff44d03200) 00010000:00010000:1.0:1763333171.223011:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1763333171.223015:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e800, rc 0) 00000100:00100000:1.0:1763333171.223079:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:56810:x1848987613585280:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1213us (2756us total) trans 4294972026 rc 0/0 00000100:00100000:1.0:1763333171.223088:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8985 00000100:00100000:1.0:1763333171.223747:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613585536 00000100:00100000:1.0:1763333171.223757:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613585536 00000100:00100000:0.0:1763333171.223862:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8986 00000100:00100000:0.0:1763333171.223874:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:55917:x1848987613585536:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333171.223890:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333171.223905:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c54ad5 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968f6b expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.223930:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54adc lrc: 3/1,0 mode: --/PR res: [0x240000404:0x199:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333171.223943:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54adc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.223952:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54adc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.224379:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c54ad5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x199:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f6b expref: 237 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.224396:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54adc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f6b expref: 236 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.224403:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x199:0x0].0x0 (ffff92ff44d03200) 00010000:00010000:0.0:1763333171.226386:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763333171.226395:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea800, rc 0) 00000100:00100000:0.0:1763333171.226483:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:55917:x1848987613585536:12345-192.168.204.28@tcp:101:bash.0 Request processed in 2602us (4566us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333171.227119:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8986 00000100:00100000:2.0:1763333171.228495:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.228584:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613585664 00000100:00100000:1.0:1763333171.228598:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613585664 00000100:00100000:1.0:1763333171.228667:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3066 00000100:00100000:1.0:1763333171.228678:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56810:x1848987613585664:12345-192.168.204.28@tcp:33:lfs.0 00000100:00100000:1.0:1763333171.228859:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56810:x1848987613585664:12345-192.168.204.28@tcp:33:lfs.0 Request processed in 184us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333171.228867:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3066 00000100:00100000:2.0:1763333171.230303:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333171.233379:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613585920 00000100:00100000:0.0:1763333171.233398:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613585920 00000100:00100000:0.0:1763333171.233486:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8987 00000100:00100000:0.0:1763333171.233499:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:55917:x1848987613585920:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:0.0:1763333171.233580:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333171.233614:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c54a8f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f4f expref: 236 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.233635:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x199:0x0].0x0 (ffff92ff44d03200) 00010000:00010000:0.0:1763333171.233641:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333171.233849:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c54ae3 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333171.233865:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c54ae3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.233876:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c54ae3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000001:00080000:0.0:1763333171.233941:0:12741:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294972027 00000004:00010000:0.0:1763333171.233969:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000febaf66b reply state 00000000d001b333 transno 4294972028 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c54ae3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.233981:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c54ae3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.233988:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x199:0x0].0x0 (ffff92ff44d03200) 00010000:00010000:0.0:1763333171.233991:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333171.233993:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763333171.234119:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:55917:x1848987613585920:12345-192.168.204.28@tcp:36:bash.0 Request processed in 622us (3821us total) trans 4294972028 rc 0/0 00000100:00100000:0.0:1763333171.234128:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8987 00000020:00080000:0.0:1763333171.234135:0:12741:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763333171.239784:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.239864:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613586176 00000100:00100000:1.0:1763333171.239877:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613586176 00000100:00100000:0.0:1763333171.240540:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3067 00000100:00100000:0.0:1763333171.240569:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:55917:x1848987613586176:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:0.0:1763333171.240796:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:55917:x1848987613586176:12345-192.168.204.28@tcp:35:bash.0 Request processed in 234us (1025us total) trans 4294972029 rc 0/0 00000100:00100000:0.0:1763333171.240804:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3067 00000100:00100000:3.0:1763333171.244456:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333171.244604:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613586432 00000100:00100000:0.0:1763333171.244614:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613586432 00000100:00100000:0.0:1763333171.244665:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8988 00000100:00100000:3.0:1763333171.244675:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333171.244675:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56811:x1848987613586432:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333171.244696:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333171.244724:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c54aea lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968f72 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333171.244743:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613586688 00000100:00100000:2.0:1763333171.244748:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613586688 00000100:00100000:2.0:1763333171.244786:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8989 00000100:00100000:2.0:1763333171.244793:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:55917:x1848987613586688:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333171.244801:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c54af1 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333171.244803:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333171.244805:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763333171.244814:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c54af1 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.244823:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54ac7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x199:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f64 expref: 241 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.244824:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c54af1 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.244834:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c54af8 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333171.244838:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x199:0x0].0x0 (ffff92ff44d03200) 00010000:00010000:0.0:1763333171.244841:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c54af8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.244842:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333171.244847:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c54af8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.244849:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54aff lrc: 2/0,0 mode: --/EX res: [0x240000404:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968f79 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.244874:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54b06 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x199:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333171.244882:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54b06 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x199:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.244888:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54b06 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x199:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.244938:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54b0d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x199:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333171.244946:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54b0d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.244967:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54b0d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:0.0:1763333171.244977:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x199:0x0]: returning size 0 00010000:00010000:0.0:1763333171.245041:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54b0d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.245048:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54b0d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.245054:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54b0d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.245059:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333171.245063:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54b0d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.245071:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54b0d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00000040:00080000:2.0:1763333171.245073:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1328, 88 off112640 00010000:00010000:0.0:1763333171.245079:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x199:0x0].0x0 (ffff92ff44d03200) 00000004:00080000:2.0:1763333171.245081:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1275324731171ns, next at 1275845147255ns, rc = 0 00010000:00010000:0.0:1763333171.245081:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1763333171.245084:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54b0d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x199:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.245090:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54b0d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x199:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000040:00080000:2.0:1763333171.245103:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1329, 88 off112640 00010000:00010000:0.0:1763333171.245104:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c54af1 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00080000:2.0:1763333171.245107:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1275324757699ns, next at 1275845117682ns, rc = 0 00010000:00010000:0.0:1763333171.245109:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c54af1 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.245115:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c54af1 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00000040:00080000:2.0:1763333171.245119:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1330, 88 off112728 00010000:00010000:0.0:1763333171.245121:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c54af1 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00000004:00080000:2.0:1763333171.245122:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1275324773612ns, next at 1275845117682ns, rc = 0 00010000:00010000:0.0:1763333171.245126:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feb400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333171.245130:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c54af1 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00000040:00080000:2.0:1763333171.245131:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1329, 88 off112728 00000004:00080000:2.0:1763333171.245134:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1275324785361ns, next at 1275845147255ns, rc = 0 00010000:00010000:0.0:1763333171.245136:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c54af1 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.245142:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44300) 00010000:00010000:0.0:1763333171.245145:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333171.245147:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c54af1 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.245153:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c54af1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.245160:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c54af8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.245166:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c54af8 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.245171:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c54af8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.245176:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333171.245179:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c54af8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.245197:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c54af8 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.245205:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355b00) 00010000:00010000:0.0:1763333171.245207:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333171.245210:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c54af8 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.245219:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c54af8 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.245249:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c54aea lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f72 expref: 243 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.245256:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44300) 00010000:00010000:0.0:1763333171.245259:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763333171.245262:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c54aea lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f72 expref: 243 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.245273:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea000, rc 0) 00000100:00100000:0.0:1763333171.245326:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:56811:x1848987613586432:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 653us (884us total) trans 4294972030 rc 301/301 00000100:00100000:0.0:1763333171.245334:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8988 00000001:00080000:2.0:1763333171.248106:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972031 is committed 00000004:00080000:2.0:1763333171.248122:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 869 committed 00000004:00080000:2.0:1763333171.248139:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 872 committed 00000004:00080000:2.0:1763333171.248150:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 871 committed 00000004:00080000:2.0:1763333171.248153:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 868 committed 00000100:00100000:1.0:1763333171.248282:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77a3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627225472:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333171.248343:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333171.248402:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763333171.248409:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627225088:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763333171.248430:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763333171.248450:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c549af lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00000100:00100000:1.0:1763333171.248454:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627225216:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1763333171.248462:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c549af lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333171.248470:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c549af lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00000100:00100000:1.0:1763333171.248473:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763333171.248477:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fc00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333171.248482:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c549af lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00000100:00100000:1.0:1763333171.248487:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1763333171.248490:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c549af lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00000100:00100000:1.0:1763333171.248491:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77a3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627225344:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1763333171.248506:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355b00) 00000100:00100000:1.0:1763333171.248507:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763333171.248509:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333171.248514:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c549af lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333171.248519:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c549af lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000100:00100000:1.0:1763333171.248533:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627225472 00010000:00010000:3.0:1763333171.248534:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c54a49 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333171.248539:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c54a49 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00000100:00100000:1.0:1763333171.248540:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627225472 00010000:00010000:3.0:1763333171.248555:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c54a49 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333171.248560:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feaa00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333171.248563:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c54a49 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333171.248568:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c54a49 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333171.248575:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355b00) 00010000:00010000:3.0:1763333171.248577:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333171.248580:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c54a49 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333171.248585:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c54a49 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000100:00100000:1.0:1763333171.248597:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627225088 00000100:00100000:1.0:1763333171.248600:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627225088 00010000:00010000:3.0:1763333171.248604:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c54ae3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333171.248610:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c54ae3 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00000100:00100000:1.0:1763333171.248615:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627225216 00000100:00100000:1.0:1763333171.248617:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627225216 00010000:00010000:3.0:1763333171.248628:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c54ae3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00000100:00100000:1.0:1763333171.248631:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627225344 00000100:00100000:1.0:1763333171.248633:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627225344 00010000:00010000:3.0:1763333171.248634:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feba00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333171.248637:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c54ae3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333171.248642:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c54ae3 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00000100:00100000:1.0:1763333171.248646:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6272 00010000:00010000:3.0:1763333171.248650:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x199:0x0].0x0 (ffff92ff44d03200) 00010000:00010000:3.0:1763333171.248652:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333171.248653:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+49:3652:x1848987627225472:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1763333171.248656:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c54ae3 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333171.248660:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c54ae3 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000100:00100000:3.0:1763333171.248685:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6273 00000100:00100000:3.0:1763333171.248692:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+49:3652:x1848987627225088:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763333171.248706:0:8611:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:535 count 1 00010000:00010000:3.0:1763333171.248725:0:8611:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c54b1b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x217:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.248741:0:8611:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c549a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f09 expref: 29 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.248750:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333171.248752:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333171.248757:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c54b1b lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.248783:0:8611:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c549a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f09 expref: 29 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.248797:0:8611:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c549a1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f09 expref: 29 pid: 28651 timeout: 1375 lvb_type: 0 00000100:00100000:3.0:1763333171.248809:0:8611:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e1aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8611:1848987627225600:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333171.248821:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+50:3652:x1848987627225472:12345-0@lo:2:osp-syn-1-1.0 Request processed in 168us (478us total) trans 17179871469 rc 0/0 00000100:00100000:1.0:1763333171.248832:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6272 00000100:00100000:1.0:1763333171.248847:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6274 00000100:00100000:1.0:1763333171.248853:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+49:3654:x1848987627225216:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763333171.248864:0:8406:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:536 count 1 00000100:00100000:3.0:1763333171.248865:0:8611:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7df5d840 going to sleep for 11 seconds 00000100:00100000:3.0:1763333171.248880:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6275 00002000:00010000:1.0:1763333171.248883:0:8406:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x218:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1763333171.248887:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+49:3654:x1848987627225344:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1763333171.248889:0:8406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54b22 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.248896:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333171.248898:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333171.248902:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54b22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.248912:0:8406:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54b22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.248921:0:8406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54b22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.248928:0:8406:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54b22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333171.248942:0:28651:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x219:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333171.248945:0:28651:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x219:0x0] updating lvb mtime from disk: 0 -> 0 00010000:00010000:1.0:1763333171.248946:0:8406:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1763333171.248947:0:28651:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x219:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333171.248950:0:28651:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x219:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763333171.248952:0:28651:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x219:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333171.248987:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+50:3654:x1848987627225344:12345-0@lo:2:osp-syn-1-1.0 Request processed in 100us (478us total) trans 17179871470 rc 0/0 00000100:00100000:3.0:1763333171.248995:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6275 00000004:00080000:3.0:1763333171.249030:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff77a3e300/2, rc 0, transno 17179871470 00000100:00100000:3.0:1763333171.249035:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77a3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627225344:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333171.249105:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+50:3654:x1848987627225216:12345-0@lo:6:osp-syn-1-1.0 Request processed in 252us (631us total) trans 17179871471 rc 0/0 00000100:00100000:1.0:1763333171.249112:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6274 00000004:00080000:3.0:1763333171.249128:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44e04000/2, rc 0, transno 17179871471 00000100:00100000:3.0:1763333171.249133:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627225216:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1763333171.249143:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff77a3df80/2, rc 0, transno 17179871469 00000100:00100000:1.0:1763333171.249147:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77a3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627225472:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333171.249199:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627225728:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763333171.249225:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333171.249239:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627225984:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333171.249241:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1763333171.249246:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627226112:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333171.249261:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333171.249279:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763333171.249284:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627225856:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763333171.249306:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333171.249357:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:2.0:1763333171.249377:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333171.249384:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54b22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.249391:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333171.249394:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54b22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.249401:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54b22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.249414:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54b22 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.249420:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54b22 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.249441:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333171.249443:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333171.249444:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333171.249486:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54b06 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x199:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f79 expref: 222 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.249494:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x199:0x0].0x0 (ffff92ff44d03200) 00010000:00010000:2.0:1763333171.249496:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763333171.249509:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54aff lrc: 0/0,0 mode: --/EX res: [0x240000404:0x199:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f79 expref: 222 pid: 6519 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1763333171.249521:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54b06 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x199:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f79 expref: 221 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.249561:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x199:0x0].0x0 (ffff92ff44d03200) 00010000:00010000:2.0:1763333171.249564:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763333171.249566:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4600, rc 0) 00000100:00100000:2.0:1763333171.249606:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:55917:x1848987613586688:12345-192.168.204.28@tcp:101:bash.0 Request processed in 4814us (4931us total) trans 4294972031 rc 0/0 00000100:00100000:2.0:1763333171.249613:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8989 00000100:00100000:2.0:1763333171.249630:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613586816 00000100:00100000:2.0:1763333171.249634:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613586816 00000100:00100000:2.0:1763333171.249658:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8990 00000100:00100000:2.0:1763333171.249664:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+221:56811:x1848987613586816:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333171.249677:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333171.249688:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54b29 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968f80 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.249751:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54b30 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x199:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333171.249761:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54b30 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.249768:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54b30 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:2.0:1763333171.249790:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x199:0x0]: returning size 2 00000004:00200000:2.0:1763333171.249793:0:6519:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763333171.249808:0:6519:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54b30 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.249825:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54b29 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x199:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f80 expref: 223 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.249836:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54b30 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f80 expref: 222 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.249843:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x199:0x0].0x0 (ffff92ff44d03200) 00010000:00010000:2.0:1763333171.249845:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333171.249847:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4800, rc 0) 00000100:00100000:2.0:1763333171.249873:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:56811:x1848987613586816:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 209us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333171.249880:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8990 00000100:00100000:1.0:1763333171.250144:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627225728 00000100:00100000:1.0:1763333171.250149:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627225728 00000100:00100000:1.0:1763333171.253105:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627225984 00000100:00100000:1.0:1763333171.253119:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627225984 00000100:00100000:1.0:1763333171.253165:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627225856 00000100:00100000:1.0:1763333171.253168:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627225856 00000100:00100000:1.0:1763333171.253189:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6276 00000100:00100000:1.0:1763333171.253198:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+19:3653:x1848987627225728:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1763333171.253230:0:29010:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:535 count 1 00010000:00010000:1.0:1763333171.253258:0:29010:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54b37 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x217:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333171.253280:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6277 00000100:00100000:2.0:1763333171.253285:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6278 00000100:00100000:0.0:1763333171.253290:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+19:3655:x1848987627225984:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333171.253294:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+19:3655:x1848987627225856:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1763333171.253303:0:8404:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:536 count 1 00002000:00010000:2.0:1763333171.253322:0:8404:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x218:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763333171.253327:0:8404:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54b3e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.253341:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333171.253343:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333171.253374:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54b3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.253387:0:8404:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54b3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.253396:0:8404:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54b3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.253403:0:8404:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54b3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.253418:0:8404:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763333171.253496:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+21:3655:x1848987627225984:12345-0@lo:2:osp-syn-0-1.0 Request processed in 208us (4233us total) trans 21474838773 rc 0/0 00000100:00100000:0.0:1763333171.253503:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6277 00000100:00100000:2.0:1763333171.253584:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+20:3655:x1848987627225856:12345-0@lo:6:osp-syn-0-1.0 Request processed in 292us (4276us total) trans 21474838774 rc 0/0 00000100:00100000:2.0:1763333171.253591:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6278 00000004:00080000:3.0:1763333171.253769:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44e1b100/2, rc 0, transno 21474838774 00000100:00100000:3.0:1763333171.253776:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627225856:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1763333171.253784:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44e18700/2, rc 0, transno 21474838773 00000100:00100000:3.0:1763333171.253787:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627225984:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1763333171.254320:0:29010:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c54993 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968efb expref: 12 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.254327:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333171.254328:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333171.254331:0:29010:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54b37 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.254381:0:29010:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c54993 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968efb expref: 12 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.254397:0:29010:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c54993 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968efb expref: 12 pid: 8611 timeout: 1375 lvb_type: 0 00000100:00100000:1.0:1763333171.254412:0:29010:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77a3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:29010:1848987627226240:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333171.254480:0:29010:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe46e0e900 going to sleep for 11 seconds 00000100:00100000:1.0:1763333171.254503:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333171.254553:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627226112 00000100:00100000:1.0:1763333171.254558:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627226112 00000100:00100000:1.0:1763333171.254587:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6279 00000100:00100000:1.0:1763333171.254594:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+20:3653:x1848987627226112:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333171.254705:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+21:3653:x1848987627226112:12345-0@lo:2:osp-syn-0-1.0 Request processed in 111us (201us total) trans 21474838775 rc 0/0 00000100:00100000:1.0:1763333171.254712:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6279 00000004:00080000:1.0:1763333171.254741:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44e18000/2, rc 0, transno 21474838775 00000100:00100000:1.0:1763333171.254746:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627226112:0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1763333171.256506:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333171.256520:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54b3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.256530:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5c00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333171.256533:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54b3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.256557:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54b3e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.256577:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54b3e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.256583:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54b3e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.256607:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333171.256608:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333171.256610:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763333171.257307:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333171.257345:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.257379:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613586944 00000100:00100000:2.0:1763333171.257386:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613586944 00010000:00010000:2.0:1763333171.257419:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c549a1 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f09 expref: 30 pid: 28651 timeout: 1375 lvb_type: 0 00000100:00100000:2.0:1763333171.257460:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2953 00000100:00100000:2.0:1763333171.257469:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:2418:x1848987613586944:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333171.257494:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333171.257500:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c549a1 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x217:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f09 expref: 30 pid: 28651 timeout: 1375 lvb_type: 0 00010000:00010000:2.0:1763333171.257511:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c549a1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x217:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f09 expref: 30 pid: 28651 timeout: 1375 lvb_type: 0 00000100:00100000:1.0:1763333171.257515:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613587072 00000100:00100000:1.0:1763333171.257519:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613587072 00010000:00010000:2.0:1763333171.257536:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333171.257539:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333171.257553:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c54b1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x217:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333171.257559:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3068 00010000:00010000:2.0:1763333171.257563:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c54b1b lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x217:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333171.257565:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:55917:x1848987613587072:12345-192.168.204.28@tcp:49:bash.0 00010000:00010000:2.0:1763333171.257583:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333171.257632:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:2418:x1848987613586944:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 165us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333171.257640:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2953 00000100:00100000:1.0:1763333171.257649:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:55917:x1848987613587072:12345-192.168.204.28@tcp:49:bash.0 Request processed in 84us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333171.257656:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3068 00010000:00010000:1.0:1763333171.258652:0:8611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c549a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f09 expref: 29 pid: 28651 timeout: 1375 lvb_type: 0 00000100:00100000:1.0:1763333171.258674:0:8611:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e1aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8611:1848987627225600:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333171.258695:0:8611:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c54b1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.258704:0:8611:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c54b1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.258711:0:8611:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c54b1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.258722:0:8611:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c54b1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.258730:0:8611:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c54b1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333171.259030:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.259052:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613587328 00000100:00100000:2.0:1763333171.259056:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613587328 00010000:00010000:1.0:1763333171.259271:0:8611:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763333171.259437:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3069 00000100:00100000:2.0:1763333171.259446:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6b3e8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:56811:x1848987613587328:12345-192.168.204.28@tcp:35:lfs.0 00010000:00010000:3.0:1763333171.259472:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333171.259480:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c54b1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.259487:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333171.259491:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c54b1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.259498:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c54b1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.259518:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c54b1b lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.259524:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c54b1b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.259540:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333171.259552:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333171.259554:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763333171.259657:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6b3e8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56811:x1848987613587328:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 212us (627us total) trans 4294972032 rc 0/0 00000100:00100000:2.0:1763333171.259664:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3069 00000100:00100000:1.0:1763333171.259753:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+50:3652:x1848987627225088:12345-0@lo:6:osp-syn-1-1.0 Request processed in 11061us (11320us total) trans 17179871472 rc 0/0 00000100:00100000:1.0:1763333171.259762:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6273 00000004:00080000:1.0:1763333171.259800:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44e04380/2, rc 0, transno 17179871472 00000100:00100000:1.0:1763333171.259806:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627225088:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763333171.259808:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.259826:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613587456 00000100:00100000:2.0:1763333171.259829:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613587456 00000100:00100000:1.0:1763333171.259830:0:29010:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77a3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:29010:1848987627226240:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333171.259844:0:29010:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54b37 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.259846:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c54993 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x217:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968efb expref: 13 pid: 8611 timeout: 1375 lvb_type: 0 00000100:00100000:2.0:1763333171.259872:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2954 00000100:00100000:2.0:1763333171.259878:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2421:x1848987613587456:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333171.259889:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333171.259893:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c54993 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x217:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968efb expref: 13 pid: 8611 timeout: 1375 lvb_type: 0 00010000:00010000:2.0:1763333171.259904:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c54993 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x217:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968efb expref: 13 pid: 8611 timeout: 1375 lvb_type: 0 00010000:00010000:2.0:1763333171.259920:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c54993 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x217:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968efb expref: 13 pid: 8611 timeout: 1375 lvb_type: 0 00010000:00010000:2.0:1763333171.259930:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333171.259932:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333171.259937:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54b37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.259945:0:28428:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54b37 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.259973:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333171.259994:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:2421:x1848987613587456:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 116us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333171.260000:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2954 00010000:00010000:1.0:1763333171.261564:0:29010:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54b37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.261579:0:29010:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54b37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.261589:0:29010:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54b37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.261597:0:29010:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54b37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.261623:0:29010:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763333171.261882:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+21:3653:x1848987627225728:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8682us (12652us total) trans 21474838776 rc 0/0 00000100:00100000:1.0:1763333171.261892:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6276 00010000:00010000:3.0:1763333171.262522:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333171.262533:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54b37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.262551:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e600 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333171.262555:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54b37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.262565:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54b37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.262586:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54b37 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.262593:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54b37 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.262617:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333171.262619:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333171.262622:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763333171.263489:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44e19880/2, rc 0, transno 21474838776 00000100:00100000:2.0:1763333171.263501:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627225728:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763333171.265664:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.265860:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613587584 00000100:00100000:1.0:1763333171.265872:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613587584 00000100:00100000:1.0:1763333171.265941:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6280 00000100:00100000:1.0:1763333171.266007:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:55917:x1848987613587584:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333171.266033:0:29010:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333171.266067:0:29010:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c54b45 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968f87 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.266105:0:29010:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c54a96 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f56 expref: 30 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333171.266121:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333171.266124:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333171.266129:0:29010:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c54b45 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f87 expref: 30 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.266166:0:29010:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c54a96 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f56 expref: 30 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333171.266180:0:29010:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c54a96 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f56 expref: 30 pid: 8611 timeout: 1375 lvb_type: 1 00000100:00100000:0.0:1763333171.266490:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.266624:0:29010:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77a3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:29010:1848987627226368:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333171.266707:0:29010:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe46e0e900 going to sleep for 11 seconds 00000100:00100000:2.0:1763333171.266723:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613587840 00000100:00100000:2.0:1763333171.266728:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613587840 00000100:00100000:2.0:1763333171.267066:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8991 00000100:00100000:2.0:1763333171.267076:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56811:x1848987613587840:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333171.267092:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333171.267110:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54b4c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968f8e expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.267303:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54b53 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333171.267317:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54b53 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.267327:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54b53 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.267341:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54b5a lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333171.267365:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54b5a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.267373:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54b5a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.267485:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54b61 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x199:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333171.267494:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54b61 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.267505:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54b61 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:2.0:1763333171.267515:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x199:0x0]: returning size 2 00010000:00010000:2.0:1763333171.267602:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54b53 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.267610:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54b53 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.267616:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54b53 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.267622:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54b53 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.267627:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333171.267632:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54b53 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.267639:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54b53 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.267650:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff618aa000) 00010000:00010000:2.0:1763333171.267653:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333171.267658:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54b53 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.267664:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54b53 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.267678:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54b5a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.267686:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54b5a lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.267691:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54b5a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.267695:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333171.267698:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54b5a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.267704:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54b5a lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.267710:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff618aa900) 00010000:00010000:2.0:1763333171.267712:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333171.267715:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54b5a lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.267721:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54b5a lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.267761:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54b4c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f8e expref: 226 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.267775:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54b61 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f8e expref: 225 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.267781:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x199:0x0].0x0 (ffff92ff44d03200) 00010000:00010000:2.0:1763333171.267783:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333171.267785:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5400, rc 0) 00000100:00100000:2.0:1763333171.267839:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56811:x1848987613587840:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 765us (1349us total) trans 4294972033 rc 0/0 00000100:00100000:2.0:1763333171.267847:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8991 00000100:00100000:0.0:1763333171.270705:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.270837:0:29010:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77a3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:29010:1848987627226368:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333171.271160:0:29010:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c54b45 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f87 expref: 30 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.271182:0:29010:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7fc00, rc 0) 00000100:00100000:1.0:1763333171.271243:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:55917:x1848987613587584:12345-192.168.204.28@tcp:101:bash.0 Request processed in 5292us (5585us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333171.271253:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6280 00000100:00100000:0.0:1763333171.271555:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.271588:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613588096 00000100:00100000:0.0:1763333171.271588:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.271595:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613588096 00000100:00100000:1.0:1763333171.271631:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6281 00000100:00100000:1.0:1763333171.271639:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:2421:x1848987613588096:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333171.271654:0:29010:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333171.271670:0:29010:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54b6f lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x219:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968f95 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.271689:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1763333171.271695:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613587968 00000100:00100000:2.0:1763333171.271699:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613587968 00010000:00010000:1.0:1763333171.271699:0:29010:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54b6f lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0x219:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f95 expref: 31 pid: 29010 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333171.271714:0:29010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54b6f lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x219:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f95 expref: 32 pid: 29010 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333171.271726:0:29010:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f000, rc 0) 00000100:00100000:1.0:1763333171.271764:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1370b1d7-8612-4b90-ab37-e53288bbf9fd+31:2421:x1848987613588096:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 125us (209us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333171.271771:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6281 00010000:00010000:1.0:1763333171.271797:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c54a96 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f56 expref: 30 pid: 8611 timeout: 1375 lvb_type: 1 00000100:00100000:1.0:1763333171.271828:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613588224 00000100:00100000:1.0:1763333171.271832:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613588224 00000100:00100000:1.0:1763333171.271859:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2955 00000100:00100000:1.0:1763333171.271865:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff61b14c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:2420:x1848987613587968:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333171.271876:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333171.271881:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c54a96 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x219:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f56 expref: 30 pid: 8611 timeout: 1375 lvb_type: 1 00010000:00010000:1.0:1763333171.271893:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c54a96 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x219:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f56 expref: 30 pid: 8611 timeout: 1375 lvb_type: 1 00010000:00010000:1.0:1763333171.271911:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c54a96 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x219:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f56 expref: 30 pid: 8611 timeout: 1375 lvb_type: 1 00010000:00010000:1.0:1763333171.271919:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333171.271921:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333171.271929:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c54b45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f87 expref: 29 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.271939:0:28428:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c54b45 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f87 expref: 29 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.271984:0:28428:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c54b45 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f87 expref: 29 pid: 29010 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333171.271998:0:28428:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77a3ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:28428:1848987627226496:192.168.204.28@tcp:105: 00000100:00100000:1.0:1763333171.272048:0:28428:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe46e0e900 going to sleep for 11 seconds 00000100:00100000:1.0:1763333171.272067:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 406 00000100:00100000:1.0:1763333171.272075:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:2419:x1848987613588224:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333171.272083:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333171.272098:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54b61 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f8e expref: 225 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.272110:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x199:0x0].0x0 (ffff92ff44d03200) 00010000:00010000:1.0:1763333171.272115:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333171.272134:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:2419:x1848987613588224:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 60us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333171.272140:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 406 00000100:00100000:3.0:1763333171.275856:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333171.275905:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.276006:0:28428:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77a3ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:28428:1848987627226496:192.168.204.28@tcp:105: 00010000:00010000:1.0:1763333171.276032:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333171.276091:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff61b14c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:2420:x1848987613587968:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 4225us (5394us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333171.276103:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2955 00000100:00100000:0.0:1763333171.276206:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613588608 00000100:00100000:0.0:1763333171.276214:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613588608 00000100:00100000:0.0:1763333171.276266:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6282 00000100:00100000:0.0:1763333171.276276:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:55917:x1848987613588608:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333171.276295:0:29010:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333171.276316:0:29010:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c54b76 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968f9c expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763333171.276340:0:29010:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x219:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333171.276382:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333171.276385:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333171.276394:0:29010:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c54b76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f9c expref: 13 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.276409:0:29010:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c54b76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f9c expref: 13 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.276422:0:29010:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdfe00, rc 0) 00000100:00100000:0.0:1763333171.276445:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:55917:x1848987613588608:12345-192.168.204.28@tcp:101:bash.0 Request processed in 171us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333171.276451:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6282 00000100:00100000:2.0:1763333171.276531:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613588480 00000100:00100000:2.0:1763333171.276536:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613588480 00000100:00100000:2.0:1763333171.276575:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3070 00000100:00100000:2.0:1763333171.276583:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56811:x1848987613588480:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333171.276760:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56811:x1848987613588480:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 177us (913us total) trans 4294972034 rc 0/0 00000100:00100000:2.0:1763333171.276767:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3070 00000100:00100000:2.0:1763333171.280047:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.280091:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.280127:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.280232:0:28430:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613588736 00000100:00100000:1.0:1763333171.280243:0:28430:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613588736 00002000:00010000:1.0:1763333171.280285:0:28430:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/537 (0->18446744073709551615) 00002000:00100000:1.0:1763333171.280290:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe42f0d880 with x1848987613588736 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333171.280302:0:28430:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe42f0d880. 00000100:00100000:1.0:1763333171.280335:0:28430:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613588864 00000100:00100000:1.0:1763333171.280339:0:28430:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613588864 00002000:00010000:1.0:1763333171.280380:0:28430:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/537 (0->18446744073709551615) 00002000:00100000:1.0:1763333171.280384:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe42f0c380 with x1848987613588864 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333171.280391:0:28430:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe42f0c380. 00000100:00100000:1.0:1763333171.280413:0:28430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1562 00000100:00100000:1.0:1763333171.280423:0:28430:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:2421:x1848987613588736:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:1.0:1763333171.280613:0:28430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x219:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333171.280617:0:28430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x219:0x0] updating lvb mtime from disk: 0 -> 1763333171 00002000:00010000:1.0:1763333171.280620:0:28430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x219:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333171.280623:0:28430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x219:0x0] updating lvb ctime from disk: 0 -> 1763333171 00002000:00010000:1.0:1763333171.280626:0:28430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x219:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333171.280677:0:28430:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:2421:x1848987613588736:12345-192.168.204.28@tcp:10:bash.0 Request processed in 254us (640us total) trans 17179871473 rc 0/0 00000100:00100000:1.0:1763333171.280689:0:28430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1562 00002000:00010000:1.0:1763333171.280693:0:28430:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/537 (0->18446744073709551615) 00002000:00100000:1.0:1763333171.280696:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe42f0d880 with x1848987613588736 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333171.280701:0:28430:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe42f0d880. 00000100:00100000:1.0:1763333171.280718:0:28430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1563 00000100:00100000:1.0:1763333171.280725:0:28430:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2421:x1848987613588864:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:1.0:1763333171.280812:0:28430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x219:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333171.280815:0:28430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x219:0x0] updating lvb mtime from disk: 0 -> 1763333171 00002000:00010000:1.0:1763333171.280818:0:28430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x219:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333171.280820:0:28430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x219:0x0] updating lvb ctime from disk: 0 -> 1763333171 00002000:00010000:1.0:1763333171.280822:0:28430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x219:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333171.280846:0:28430:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2421:x1848987613588864:12345-192.168.204.28@tcp:10:bash.0 Request processed in 120us (754us total) trans 21474838777 rc 0/0 00000100:00100000:1.0:1763333171.280852:0:28430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1563 00002000:00010000:1.0:1763333171.280855:0:28430:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/537 (0->18446744073709551615) 00002000:00100000:1.0:1763333171.280858:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe42f0c380 with x1848987613588864 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333171.280862:0:28430:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe42f0c380. 00000100:00100000:3.0:1763333171.280968:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613588992 00000100:00100000:3.0:1763333171.280974:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613588992 00000100:00100000:3.0:1763333171.281003:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3071 00000100:00100000:3.0:1763333171.281011:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56811:x1848987613588992:12345-192.168.204.28@tcp:33:lfs.0 00000100:00100000:3.0:1763333171.281112:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56811:x1848987613588992:12345-192.168.204.28@tcp:33:lfs.0 Request processed in 102us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333171.281120:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3071 00000100:00100000:0.0:1763333171.281832:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46a6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627226752:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1763333171.281881:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333171.281927:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627226752 00000100:00100000:0.0:1763333171.281932:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627226752 00000100:00100000:0.0:1763333171.281964:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 776 00000100:00100000:0.0:1763333171.281971:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+50:3654:x1848987627226752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1763333171.281992:0:8408:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 484957248 pending 57344 free 3919175680 avail 3687653376 00000100:00100000:0.0:1763333171.282028:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+50:3654:x1848987627226752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333171.282035:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 776 00000100:00100000:0.0:1763333171.282081:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46a6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627226752:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1763333171.282734:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46a6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627226624:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1763333171.282775:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333171.282987:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627226624 00000100:00100000:3.0:1763333171.282993:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627226624 00000100:00100000:3.0:1763333171.283037:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1416 00000100:00100000:3.0:1763333171.283046:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3653:x1848987627226624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1763333171.283073:0:6525:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445888000 avail 1299648512 00000100:00100000:3.0:1763333171.283114:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3653:x1848987627226624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333171.283122:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1416 00000100:00100000:2.0:1763333171.283498:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46a6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627226624:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1763333171.283971:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763333171.283984:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1848987627226880:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1763333171.284024:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333171.285789:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff73164700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1848987627227136:0@lo:400:kworker.0 00000100:00100000:2.0:1763333171.285843:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333171.285870:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff73165f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3653:1848987627227648:0@lo:400:kworker.0 00000100:00100000:2.0:1763333171.285891:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333171.285910:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1763333171.285916:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4920ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5e37baad-59e1-47e8-a7d1-7559d772e0ab:3653:1848987627227008:0@lo:400:kworker.0 00000100:00100000:2.0:1763333171.285943:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333171.285981:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff73166680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3653:1848987627227520:0@lo:400:kworker.0 00000100:00100000:2.0:1763333171.286003:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333171.286020:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff73167800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1848987627228032:0@lo:400:kworker.0 00000100:00100000:2.0:1763333171.286039:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333171.286064:0:32350:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627227008 00000100:00100000:2.0:1763333171.286070:0:32350:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627227008 00000100:00100000:2.0:1763333171.286117:0:32350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1763333171.286127:0:32350:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e37baad-59e1-47e8-a7d1-7559d772e0ab+23:3653:x1848987627227008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763333171.286175:0:32350:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e37baad-59e1-47e8-a7d1-7559d772e0ab+23:3653:x1848987627227008:12345-0@lo:400:kworker.0 Request processed in 49us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333171.286184:0:32350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1763333171.286218:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627227136 00000100:00100000:2.0:1763333171.286222:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627227136 00000100:00100000:2.0:1763333171.286245:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627227648 00000100:00100000:2.0:1763333171.286248:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627227648 00000100:00100000:2.0:1763333171.286270:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627227520 00000100:00100000:2.0:1763333171.286272:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627227520 00000100:00100000:2.0:1763333171.286285:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627228032 00000100:00100000:2.0:1763333171.286288:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627228032 00000100:00100000:2.0:1763333171.286300:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1484 00000100:00100000:2.0:1763333171.286306:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1848987627227136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763333171.286336:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1848987627227136:12345-0@lo:400:kworker.0 Request processed in 30us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333171.286343:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1484 00000100:00100000:2.0:1763333171.286379:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1485 00000100:00100000:2.0:1763333171.286387:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1848987627227648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763333171.286413:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1848987627227648:12345-0@lo:400:kworker.0 Request processed in 27us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333171.286422:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1485 00000100:00100000:2.0:1763333171.286434:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1486 00000100:00100000:2.0:1763333171.286440:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1848987627227520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763333171.286466:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1848987627227520:12345-0@lo:400:kworker.0 Request processed in 27us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333171.286473:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1486 00000100:00100000:2.0:1763333171.286484:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1487 00000100:00100000:2.0:1763333171.286490:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1848987627228032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763333171.286514:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1848987627228032:12345-0@lo:400:kworker.0 Request processed in 24us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333171.286520:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1487 00000100:00100000:2.0:1763333171.286578:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4920ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5e37baad-59e1-47e8-a7d1-7559d772e0ab:3653:1848987627227008:0@lo:400:kworker.0 00000100:00100000:2.0:1763333171.286590:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff73166680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3653:1848987627227520:0@lo:400:kworker.0 00000100:00100000:2.0:1763333171.286599:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff73167800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1848987627228032:0@lo:400:kworker.0 00000100:00100000:2.0:1763333171.286608:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff73164700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1848987627227136:0@lo:400:kworker.0 00000100:00100000:2.0:1763333171.286616:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff73165f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3653:1848987627227648:0@lo:400:kworker.0 00000100:00100000:1.0:1763333171.286947:0:7798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627226880 00000100:00100000:1.0:1763333171.286952:0:7798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627226880 00000100:00100000:1.0:1763333171.286994:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1417 00000100:00100000:1.0:1763333171.287002:0:7798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1848987627226880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1763333171.287032:0:7798:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445982208 avail 1299742720 00000100:00100000:1.0:1763333171.287072:0:7798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1848987627226880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (3048us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333171.287079:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1417 00000100:00080000:1.0:1763333171.287100:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1763333171.287104:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1763333171.288590:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff73165880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1848987627227264:0@lo:400:kworker.0 00000100:00100000:0.0:1763333171.288655:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333171.288700:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff73164e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1848987627227776:0@lo:400:kworker.0 00000100:00100000:0.0:1763333171.288726:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333171.288771:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1848987627226880:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1763333171.288798:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1763333171.288805:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff73167100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1848987627227392:0@lo:400:kworker.0 00000100:00100000:0.0:1763333171.288832:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333171.288854:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff73165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1848987627227904:0@lo:400:kworker.0 00000100:00100000:0.0:1763333171.288877:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333171.288911:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627227264 00000100:00100000:0.0:1763333171.288917:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627227264 00000100:00100000:0.0:1763333171.288980:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627227392 00000100:00100000:0.0:1763333171.288984:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627227392 00000100:00100000:0.0:1763333171.289011:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1488 00000100:00100000:0.0:1763333171.289019:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1848987627227264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1763333171.289066:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1848987627227264:12345-0@lo:400:kworker.0 Request processed in 48us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333171.289074:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1488 00000100:00100000:0.0:1763333171.289092:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1489 00000100:00100000:0.0:1763333171.289098:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4960bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1848987627227392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1763333171.289126:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4960bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1848987627227392:12345-0@lo:400:kworker.0 Request processed in 29us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333171.289133:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1489 00000100:00100000:0.0:1763333171.289171:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff73167100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1848987627227392:0@lo:400:kworker.0 00000100:00100000:0.0:1763333171.289182:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff73165880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1848987627227264:0@lo:400:kworker.0 00000100:00100000:0.0:1763333171.289206:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627227776 00000100:00100000:0.0:1763333171.289210:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627227776 00000100:00100000:0.0:1763333171.289238:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627227904 00000100:00100000:0.0:1763333171.289240:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627227904 00000100:00100000:0.0:1763333171.289260:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 901 00000100:00100000:0.0:1763333171.289267:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3654:x1848987627227776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1763333171.289301:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3654:x1848987627227776:12345-0@lo:400:kworker.0 Request processed in 35us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333171.289308:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 901 00000100:00100000:0.0:1763333171.289319:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 902 00000100:00100000:0.0:1763333171.289326:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4960a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3654:x1848987627227904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1763333171.289390:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4960a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3654:x1848987627227904:12345-0@lo:400:kworker.0 Request processed in 65us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333171.289397:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 902 00000100:00100000:0.0:1763333171.289429:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff73165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1848987627227904:0@lo:400:kworker.0 00000100:00100000:0.0:1763333171.289440:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff73164e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1848987627227776:0@lo:400:kworker.0 00000100:00080000:1.0:1763333171.289721:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1763333171.289728:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1763333171.289730:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1763333171.289733:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1763333171.295011:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.295098:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613589248 00000100:00100000:2.0:1763333171.295112:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613589248 00000100:00100000:2.0:1763333171.295192:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3072 00000100:00100000:2.0:1763333171.295204:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:55917:x1848987613589248:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:2.0:1763333171.295569:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:55917:x1848987613589248:12345-192.168.204.28@tcp:35:bash.0 Request processed in 367us (576us total) trans 4294972035 rc 0/0 00000100:00100000:2.0:1763333171.295582:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3072 00000100:00100000:3.0:1763333171.301067:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.301626:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613589504 00000100:00100000:1.0:1763333171.301637:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613589504 00000100:00100000:1.0:1763333171.301695:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8992 00000100:00100000:1.0:1763333171.301704:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56812:x1848987613589504:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333171.301730:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333171.301756:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54b7d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x199:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968fa3 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.301884:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54b84 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x199:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333171.301899:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54b84 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x199:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.301910:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54b84 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x199:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:1.0:1763333171.301922:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x199:0x0]: returning size 5 00010000:00010000:1.0:1763333171.302030:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54b7d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x199:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968fa3 expref: 229 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.302047:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54b84 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x199:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968fa3 expref: 228 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.302056:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x199:0x0].0x0 (ffff92ff44d03200) 00010000:00010000:1.0:1763333171.302060:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1763333171.302064:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e800, rc 0) 00000100:00100000:1.0:1763333171.302132:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56812:x1848987613589504:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 428us (1076us total) trans 4294972036 rc 0/0 00000100:00100000:1.0:1763333171.302139:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8992 00000100:00100000:0.0:1763333171.305125:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.305217:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613589760 00000100:00100000:2.0:1763333171.305227:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613589760 00000100:00100000:2.0:1763333171.305289:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8993 00000100:00100000:2.0:1763333171.305299:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4960b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56813:x1848987613589760:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:2.0:1763333171.305381:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1763333171.305410:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54b06 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x199:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f79 expref: 228 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.305430:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54b30 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f80 expref: 227 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.305444:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c54adc lrc: 0/0,0 mode: --/PR res: [0x240000404:0x199:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f6b expref: 226 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.305454:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x199:0x0].0x0 (ffff92ff44d03200) 00010000:00010000:2.0:1763333171.305459:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333171.305489:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54b92 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333171.305501:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54b92 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.305511:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54b92 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.305524:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54b99 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333171.305531:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54b99 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.305539:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54b99 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.305648:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54ba0 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333171.305659:0:12741:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54b84 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x199:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968fa3 expref: 225 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.305669:0:12741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54ba0 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x199:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.305701:0:12741:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54b84 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x199:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968fa3 expref: 225 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.305714:0:12741:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54b84 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x199:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968fa3 expref: 225 pid: 8606 timeout: 1375 lvb_type: 0 00000100:00100000:2.0:1763333171.305729:0:12741:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe45181500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627228160:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333171.305814:0:12741:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff5119de40 going to sleep for 11 seconds 00000100:00100000:3.0:1763333171.306974:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.307040:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613589888 00000100:00100000:1.0:1763333171.307047:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613589888 00000100:00100000:1.0:1763333171.307096:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8994 00000100:00100000:1.0:1763333171.307104:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56812:x1848987613589888:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333171.307122:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333171.307138:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54ba7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968faa expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.307218:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54bae lrc: 3/1,0 mode: --/PR res: [0x240000404:0x199:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333171.307229:0:8606:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54ba0 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x199:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.307236:0:8606:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54bae lrc: 4/1,0 mode: --/PR res: [0x240000404:0x199:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.307249:0:8606:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54ba0 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x199:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.307258:0:8606:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54bae lrc: 3/1,0 mode: --/PR res: [0x240000404:0x199:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000100:00100000:2.0:1763333171.309486:0:12741:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe45181500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627228160:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333171.309530:0:12741:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54ba0 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x199:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12741 initiator: MDT1 00000100:00100000:3.0:1763333171.310595:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.310688:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613590016 00000100:00100000:1.0:1763333171.310697:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613590016 00010000:00010000:1.0:1763333171.310740:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54b84 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x199:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968fa3 expref: 228 pid: 8606 timeout: 1375 lvb_type: 0 00000100:00100000:1.0:1763333171.310783:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2956 00000100:00100000:1.0:1763333171.310793:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:2421:x1848987613590016:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333171.310809:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333171.310816:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54b84 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x199:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968fa3 expref: 228 pid: 8606 timeout: 1375 lvb_type: 0 00010000:00010000:1.0:1763333171.310829:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54b84 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x199:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968fa3 expref: 228 pid: 8606 timeout: 1375 lvb_type: 0 00010000:00010000:1.0:1763333171.310852:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54b84 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x199:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968fa3 expref: 228 pid: 8606 timeout: 1375 lvb_type: 0 00010000:00010000:1.0:1763333171.310869:0:28428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x199:0x0].0x0 (ffff92ff44d03200) 00010000:00010000:1.0:1763333171.310875:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54ba0 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x199:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.310885:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54ba0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x199:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.310893:0:28428:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54ba0 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x199:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.310900:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54bae lrc: 3/1,0 mode: --/PR res: [0x240000404:0x199:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.310908:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54bae lrc: 3/1,0 mode: --/PR res: [0x240000404:0x199:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.310914:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54bae lrc: 3/1,0 mode: --/PR res: [0x240000404:0x199:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.310943:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333171.311015:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:2421:x1848987613590016:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 223us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333171.311024:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2956 00010000:00010000:2.0:1763333171.311101:0:12741:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54ba0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x199:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.311110:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54ba0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x199:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 12741 initiator: MDT1 00000004:00080000:2.0:1763333171.311388:0:12741:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x199:0x0] is inserted into orphan list, open count = 1 00010000:00010000:2.0:1763333171.311472:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54ba0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x199:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.311480:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54ba0 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x199:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.311487:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54ba0 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x199:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.311492:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333171.311496:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54ba0 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x199:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.311503:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54ba0 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x199:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.311513:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x199:0x0].0x0 (ffff92ff44d03200) 00010000:00010000:2.0:1763333171.311515:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763333171.311518:0:12741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54bae lrc: 3/1,0 mode: --/PR res: [0x240000404:0x199:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.311524:0:12741:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54bae lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.311530:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54bae lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.311563:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54ba0 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x199:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.311570:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54ba0 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x199:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.311591:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54b92 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.311598:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54b92 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.311603:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54b92 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.311608:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54b92 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.311613:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333171.311616:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54b92 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.311622:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54b92 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.311629:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff618aa000) 00010000:00010000:2.0:1763333171.311632:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333171.311635:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54b92 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.311640:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54b92 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000004:00010000:2.0:1763333171.311656:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002526f1a9 reply state 00000000b5d61774 transno 4294972037 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54b99 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.311667:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54b99 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.311673:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff618aa900) 00010000:00010000:2.0:1763333171.311676:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333171.311679:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763333171.311725:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4960b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56813:x1848987613589760:12345-192.168.204.28@tcp:36:rm.0 Request processed in 6427us (6609us total) trans 4294972037 rc 0/0 00000100:00100000:2.0:1763333171.311734:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8993 00010000:00010000:1.0:1763333171.312275:0:8606:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54bae lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.312285:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54bae lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:1.0:1763333171.312315:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x199:0x0]: returning size 5 00000004:00200000:1.0:1763333171.312319:0:8606:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763333171.312334:0:8606:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54bae lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.312396:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54ba7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968faa expref: 228 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.312412:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f400/0xb32e3ef184c54bae lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968faa expref: 227 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.312420:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x199:0x0].0x0 (ffff92ff44d03200) 00010000:00010000:1.0:1763333171.312423:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333171.312426:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f400, rc 0) 00000100:00100000:1.0:1763333171.312455:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56812:x1848987613589888:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 5352us (5485us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333171.312463:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8994 00000100:00100000:3.0:1763333171.326453:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333171.326624:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613590272 00000100:00100000:0.0:1763333171.326635:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613590272 00000100:00100000:0.0:1763333171.326703:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3073 00000100:00100000:0.0:1763333171.326715:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56812:x1848987613590272:12345-192.168.204.28@tcp:35:lfs.0 00000004:00080000:0.0:1763333171.326973:0:6523:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x199:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1763333171.327052:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1330, 64 off112792 00000040:00080000:0.0:1763333171.327080:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1331, 64 off112792 00000040:00080000:0.0:1763333171.327093:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1332, 64 off112856 00000040:00080000:0.0:1763333171.327103:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1331, 64 off112856 00010000:00010000:0.0:1763333171.327166:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54bb5 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763333171.327185:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54bb5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x199:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT1 00010000:00010000:0.0:1763333171.327197:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54bb5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x199:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT1 00010000:00010000:0.0:1763333171.327206:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54bb5 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x199:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT1 00010000:00010000:0.0:1763333171.327213:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54bb5 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x199:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT1 00010000:00010000:0.0:1763333171.327219:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54bb5 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x199:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT1 00010000:00010000:0.0:1763333171.327257:0:6523:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763333171.327515:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56812:x1848987613590272:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 801us (1070us total) trans 4294972038 rc 0/0 00000100:00100000:0.0:1763333171.327528:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3073 00010000:00010000:1.0:1763333171.328500:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333171.328510:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54bb5 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x199:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT1 00010000:00010000:1.0:1763333171.328521:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abde400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333171.328525:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54bb5 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x199:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT1 00010000:00010000:1.0:1763333171.328535:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54bb5 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x199:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT1 00010000:00010000:1.0:1763333171.328560:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x199:0x0].0x0 (ffff92ff44d03200) 00010000:00010000:1.0:1763333171.328564:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1763333171.328568:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54bb5 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x199:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT1 00010000:00010000:1.0:1763333171.328574:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54bb5 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x199:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT1 00010000:00010000:1.0:1763333171.328590:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333171.328592:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333171.328594:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763333171.342608:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.342744:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613590400 00000100:00100000:1.0:1763333171.342757:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613590400 00000100:00100000:1.0:1763333171.342841:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8995 00000100:00100000:1.0:1763333171.342855:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56812:x1848987613590400:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333171.342889:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333171.342920:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54bbc lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968fb1 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.343006:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54bc3 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333171.343023:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54bc3 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.343034:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54bc3 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.343044:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54bca lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333171.343051:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54bca lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.343056:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54bca lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.343110:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54bc3 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.343118:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54bc3 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.343125:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54bc3 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.343131:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54bc3 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.343137:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333171.343141:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54bc3 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.343149:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54bc3 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.343161:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355d00) 00010000:00010000:1.0:1763333171.343165:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333171.343171:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54bc3 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.343177:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54bc3 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.343191:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54bca lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.343198:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54bca lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.343203:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54bca lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.343208:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333171.343211:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54bca lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.343217:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54bca lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.343225:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff618aa900) 00010000:00010000:1.0:1763333171.343228:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333171.343231:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54bca lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.343236:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54bca lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.343267:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54bbc lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968fb1 expref: 229 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.343277:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355d00) 00010000:00010000:1.0:1763333171.343280:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333171.343284:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54bbc lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968fb1 expref: 229 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.343298:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7ea00, rc 0) 00000100:00100000:1.0:1763333171.343420:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56812:x1848987613590400:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 567us (829us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333171.343428:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8995 00000100:00100000:3.0:1763333171.350776:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.350887:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613590528 00000100:00100000:2.0:1763333171.350899:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613590528 00000100:00100000:2.0:1763333171.350976:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8996 00000100:00100000:2.0:1763333171.350988:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56814:x1848987613590528:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333171.351009:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333171.351038:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54bd1 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968fb8 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.351111:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54bd8 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333171.351126:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54bd8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.351139:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54bd8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.351151:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54bdf lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333171.351157:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54bdf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.351164:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54bdf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.351213:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54bd8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.351221:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54bd8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.351228:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54bd8 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.351235:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54bd8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.351240:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333171.351244:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54bd8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.351252:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54bd8 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.351264:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff618aa000) 00010000:00010000:2.0:1763333171.351267:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333171.351272:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54bd8 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.351278:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54bd8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.351293:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54bdf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.351299:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54bdf lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.351305:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54bdf lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.351310:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333171.351314:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54bdf lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.351319:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54bdf lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.351327:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff618aa900) 00010000:00010000:2.0:1763333171.351330:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333171.351332:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54bdf lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.351337:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54bdf lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.351406:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54bd1 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968fb8 expref: 229 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.351417:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff618aa000) 00010000:00010000:2.0:1763333171.351420:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333171.351424:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54bd1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968fb8 expref: 229 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.351438:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5c00, rc 0) 00000100:00100000:2.0:1763333171.351492:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56814:x1848987613590528:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 506us (730us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333171.351499:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8996 00000100:00100000:0.0:1763333171.354529:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.355824:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613590656 00000100:00100000:1.0:1763333171.355838:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613590656 00000100:00100000:1.0:1763333171.356150:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8997 00000100:00100000:1.0:1763333171.356161:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4960aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56814:x1848987613590656:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333171.356185:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333171.356211:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54be6 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968fbf expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.356289:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54bed lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333171.356303:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54bed lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.356314:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54bed lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.356326:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54bf4 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333171.356333:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54bf4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.356340:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54bf4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.356397:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54bed lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.356404:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54bed lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.356410:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54bed lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.356416:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54bed lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.356421:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333171.356426:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54bed lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.356433:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54bed lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.356444:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355d00) 00010000:00010000:1.0:1763333171.356447:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333171.356452:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54bed lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.356458:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54bed lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.356471:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54bf4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.356477:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54bf4 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.356482:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54bf4 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.356488:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333171.356490:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54bf4 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.356496:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54bf4 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.356503:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff618aa900) 00010000:00010000:1.0:1763333171.356506:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333171.356509:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54bf4 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.356515:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54bf4 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.356551:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54be6 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968fbf expref: 229 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.356562:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355d00) 00010000:00010000:1.0:1763333171.356564:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333171.356568:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54be6 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968fbf expref: 229 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.356581:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7ea00, rc 0) 00000100:00100000:1.0:1763333171.357835:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4960aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56814:x1848987613590656:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1668us (3310us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333171.357846:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8997 00000100:00100000:3.0:1763333171.362681:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333171.362721:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.362813:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613590912 00000100:00100000:2.0:1763333171.362826:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613590912 00000100:00100000:2.0:1763333171.362881:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613591040 00000100:00100000:2.0:1763333171.362884:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613591040 00000100:00100000:2.0:1763333171.362904:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8998 00000100:00100000:2.0:1763333171.362913:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56815:x1848987613590912:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333171.362934:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333171.362958:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54bfb lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968fc6 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.363042:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54c02 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333171.363056:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54c02 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.363067:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54c02 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.363077:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54c09 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333171.363085:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54c09 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.363091:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54c09 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.363131:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54c02 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.363138:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54c02 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.363144:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54c02 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.363150:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54c02 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.363159:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333171.363163:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54c02 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.363170:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54c02 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.363182:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff618aa700) 00010000:00010000:2.0:1763333171.363185:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333171.363189:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54c02 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.363196:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54c02 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.363208:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54c09 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.363213:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54c09 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.363218:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54c09 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.363223:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333171.363226:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54c09 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.363232:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54c09 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.363240:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff618aa900) 00010000:00010000:2.0:1763333171.363243:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333171.363246:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54c09 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.363251:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54c09 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.363281:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54bfb lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968fc6 expref: 230 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.363292:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff618aa700) 00010000:00010000:2.0:1763333171.363295:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763333171.363298:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54bfb lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968fc6 expref: 230 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.363316:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4800, rc 0) 00000100:00100000:2.0:1763333171.363406:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56815:x1848987613590912:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 493us (735us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333171.363414:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8998 00000100:00100000:2.0:1763333171.363438:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8999 00000100:00100000:2.0:1763333171.363448:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56814:x1848987613591040:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333171.363456:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333171.363465:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54c10 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968fcd expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.363496:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c54c17 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333171.363504:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c54c17 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.363512:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c54c17 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:2.0:1763333171.363566:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1763333171.363572:0:12741:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1763333171.363600:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54c10 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968fcd expref: 230 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.363615:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c54c17 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968fcd expref: 229 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.363623:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff618aa100) 00010000:00010000:2.0:1763333171.363625:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1763333171.363627:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4400, rc 0) 00000100:00100000:2.0:1763333171.363648:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56814:x1848987613591040:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 203us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333171.363655:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8999 00000100:00100000:3.0:1763333171.373122:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333171.373311:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613591296 00000100:00100000:0.0:1763333171.373322:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613591296 00000100:00100000:0.0:1763333171.373418:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9000 00000100:00100000:0.0:1763333171.373429:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56814:x1848987613591296:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333171.373450:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333171.373454:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763333171.373480:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c54c17 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968fcd expref: 229 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.373498:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff618aa100) 00010000:00010000:0.0:1763333171.373509:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333171.373524:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c54c1e lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968fd4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.373658:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54c25 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333171.373671:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54c25 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.373680:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54c25 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.373690:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c54c2c lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333171.373696:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c54c2c lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.373702:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c54c2c lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.374087:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54c33 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333171.374096:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54c33 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.374103:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54c33 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:0.0:1763333171.374114:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x19b:0x0]: returning size 0 00010000:00010000:0.0:1763333171.374139:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54c25 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.374145:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54c25 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.374151:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54c25 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.374157:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54c25 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.374162:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333171.374166:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54c25 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.374173:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54c25 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.374180:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:0.0:1763333171.374183:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333171.374187:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54c25 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.374192:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54c25 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000004:00010000:0.0:1763333171.374202:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003da88fa7 reply state 00000000cf58cd64 transno 4294972039 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c54c2c lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.374213:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c54c2c lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.374217:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff618aa900) 00010000:00010000:0.0:1763333171.374220:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333171.374222:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763333171.374247:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c54c1e lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968fd4 expref: 231 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.374262:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54c33 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968fd4 expref: 230 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.374268:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19b:0x0].0x0 (ffff92fe43b44200) 00010000:00010000:0.0:1763333171.374270:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333171.374272:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdf600, rc 0) 00000100:00100000:0.0:1763333171.374330:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56814:x1848987613591296:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 904us (1220us total) trans 4294972039 rc 0/0 00000100:00100000:0.0:1763333171.374338:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9000 00000100:00100000:0.0:1763333171.379849:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.382517:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613591552 00000100:00100000:2.0:1763333171.382531:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613591552 00000100:00100000:2.0:1763333171.382623:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9001 00000100:00100000:2.0:1763333171.382635:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56814:x1848987613591552:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333171.382667:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333171.382691:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54c41 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968fdb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.382807:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54c48 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333171.382824:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54c33 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968fd4 expref: 232 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.382838:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54c48 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x19b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.382875:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54c33 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968fd4 expref: 232 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.382889:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54c33 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968fd4 expref: 232 pid: 6521 timeout: 1375 lvb_type: 0 00000100:00100000:2.0:1763333171.382903:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe45181500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627228288:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333171.387087:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff5119d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763333171.392381:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe45181500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627228288:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333171.392415:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54c48 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x19b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000100:00100000:0.0:1763333171.393031:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.394272:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613591680 00000100:00100000:2.0:1763333171.394284:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613591680 00010000:00010000:2.0:1763333171.394327:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54c33 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968fd4 expref: 233 pid: 6521 timeout: 1375 lvb_type: 0 00000100:00100000:3.0:1763333171.394982:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.395215:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2957 00000100:00100000:2.0:1763333171.395231:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49609880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:2420:x1848987613591680:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333171.395251:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333171.395261:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54c33 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968fd4 expref: 233 pid: 6521 timeout: 1375 lvb_type: 0 00010000:00010000:2.0:1763333171.395275:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54c33 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968fd4 expref: 233 pid: 6521 timeout: 1375 lvb_type: 0 00010000:00010000:2.0:1763333171.395299:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54c33 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968fd4 expref: 233 pid: 6521 timeout: 1375 lvb_type: 0 00010000:00010000:2.0:1763333171.395317:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19b:0x0].0x0 (ffff92fe43b44200) 00010000:00010000:2.0:1763333171.395322:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54c48 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x19b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.395331:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54c48 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x19b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.395338:0:6506:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54c48 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x19b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.395402:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333171.395460:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49609880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:2420:x1848987613591680:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 234us (2431us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333171.395468:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2957 00000100:00100000:0.0:1763333171.395556:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613591936 00000100:00100000:0.0:1763333171.395563:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613591936 00000100:00100000:0.0:1763333171.395601:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9002 00000100:00100000:0.0:1763333171.395608:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56816:x1848987613591936:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333171.395625:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333171.395646:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c54c4f lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968fe2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.395717:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54c56 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333171.395727:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54c56 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.395736:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54c56 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.395746:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c54c5d lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333171.395753:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c54c5d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.395758:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c54c5d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.395875:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54c64 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333171.395883:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54c64 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.395890:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54c64 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:0.0:1763333171.395900:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x19b:0x0]: returning size 0 00010000:00010000:0.0:1763333171.395981:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54c64 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.395989:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54c64 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.395996:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54c64 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.396001:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abde400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333171.396005:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54c64 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.396013:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54c64 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.396021:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19b:0x0].0x0 (ffff92fe43b44200) 00010000:00010000:0.0:1763333171.396024:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1763333171.396028:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54c64 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.396033:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54c64 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.396049:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54c56 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.396055:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54c56 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.396061:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54c56 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.396066:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54c56 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.396075:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333171.396078:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54c56 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.396083:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54c56 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.396090:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:0.0:1763333171.396092:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333171.396095:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54c56 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.396099:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54c56 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.396107:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c54c5d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.396111:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c54c5d lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.396116:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c54c5d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.396121:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdee00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333171.396124:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c54c5d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.396130:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c54c5d lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.396136:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff618aa900) 00010000:00010000:0.0:1763333171.396139:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333171.396141:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c54c5d lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.396146:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c54c5d lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.396180:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c54c4f lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968fe2 expref: 234 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.396188:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:0.0:1763333171.396191:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763333171.396194:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c54c4f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968fe2 expref: 234 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.396206:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdea00, rc 0) 00000100:00100000:0.0:1763333171.396235:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56816:x1848987613591936:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 627us (1255us total) trans 4294972040 rc 301/301 00000100:00100000:0.0:1763333171.396241:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9002 00010000:00010000:3.0:1763333171.396483:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54c48 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x19b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333171.396491:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54c48 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x19b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:3.0:1763333171.396505:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x19b:0x0]: returning size 0 00000004:00080000:3.0:1763333171.396665:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x21b:0x0], index 0: 0 00000004:00080000:3.0:1763333171.396672:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x21b:0x0], index 1: 0 00000004:00080000:3.0:1763333171.396676:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x21c:0x0], index 1: 0 00000004:00080000:3.0:1763333171.396679:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x21c:0x0], index 0: 0 00010000:00010000:3.0:1763333171.396747:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54c48 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x19b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333171.396754:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54c48 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x19b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333171.396760:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54c48 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x19b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333171.396764:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333171.396767:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54c48 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x19b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333171.396773:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54c48 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x19b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333171.396781:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19b:0x0].0x0 (ffff92fe43b44200) 00010000:00010000:3.0:1763333171.396783:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763333171.396786:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54c48 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x19b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333171.396791:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54c48 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x19b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333171.396819:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54c41 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x19b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968fdb expref: 233 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.396826:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19b:0x0].0x0 (ffff92fe43b44200) 00010000:00010000:3.0:1763333171.396828:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763333171.396831:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54c41 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x19b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968fdb expref: 233 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.396841:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5400, rc 0) 00000100:00100000:3.0:1763333171.396876:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56814:x1848987613591552:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 14244us (17039us total) trans 4294972041 rc 301/301 00000100:00100000:3.0:1763333171.396883:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9001 00000100:00100000:3.0:1763333171.401584:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.402066:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613592192 00000100:00100000:2.0:1763333171.402078:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613592192 00000100:00100000:2.0:1763333171.402140:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3074 00000100:00100000:2.0:1763333171.402150:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56814:x1848987613592192:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333171.402568:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56814:x1848987613592192:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 418us (993us total) trans 4294972042 rc 0/0 00000100:00100000:2.0:1763333171.402577:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3074 00000100:00100000:0.0:1763333171.403502:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333171.404487:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.404618:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613592576 00000100:00100000:1.0:1763333171.404627:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613592320 00000100:00100000:2.0:1763333171.404629:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613592576 00000100:00100000:1.0:1763333171.404631:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613592320 00000100:00100000:1.0:1763333171.404686:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9003 00000100:00100000:1.0:1763333171.404698:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4960b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:56816:x1848987613592320:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333171.404726:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333171.404752:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54c79 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968fe9 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333171.404796:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3075 00000100:00100000:2.0:1763333171.404803:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6b3e9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:56814:x1848987613592576:12345-192.168.204.28@tcp:35:lfs.0 00010000:00010000:1.0:1763333171.404850:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54c80 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333171.404865:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54c80 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.404875:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54c80 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:1.0:1763333171.404899:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x19b:0x0]: returning size 0 00000004:00200000:1.0:1763333171.404903:0:8606:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763333171.404919:0:8606:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54c80 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.404940:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54c79 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x19b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968fe9 expref: 237 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.405221:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54c80 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968fe9 expref: 236 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.405232:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19b:0x0].0x0 (ffff92fe48355d00) 00010000:00010000:1.0:1763333171.405235:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333171.405238:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f000, rc 0) 00000100:00100000:2.0:1763333171.405255:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6b3e9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56814:x1848987613592576:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 451us (771us total) trans 4294972043 rc 0/0 00000100:00100000:2.0:1763333171.405262:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3075 00000100:00100000:1.0:1763333171.405322:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4960b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:56816:x1848987613592320:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 627us (1823us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333171.405331:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9003 00000100:00100000:3.0:1763333171.411931:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333171.411931:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333171.413553:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.413660:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613592704 00000100:00100000:1.0:1763333171.413673:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613592704 00000100:00100000:1.0:1763333171.413744:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6283 00000100:00100000:1.0:1763333171.413753:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7df38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:2420:x1848987613592704:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333171.413774:0:8611:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333171.413801:0:8611:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54c87 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968ff0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333171.413827:0:8611:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x21c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333171.413849:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333171.413851:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333171.413860:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54c87 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ff0 expref: 31 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333171.413875:0:8611:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54c87 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ff0 expref: 31 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333171.413888:0:8611:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e800, rc 0) 00000100:00100000:1.0:1763333171.413952:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7df38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+31:2420:x1848987613592704:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 199us (2033us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333171.413960:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6283 00000100:00100000:1.0:1763333171.414090:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613593088 00000100:00100000:1.0:1763333171.414096:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613593088 00000100:00100000:1.0:1763333171.414138:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9004 00000100:00100000:1.0:1763333171.414146:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:55917:x1848987613593088:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333171.414162:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333171.414177:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54c8e lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968ffe expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.414316:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54c95 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333171.414328:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54c95 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.414338:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54c95 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.414378:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54c9c lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333171.414387:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54c9c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.414394:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54c9c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.414446:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54ca3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333171.414454:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54ca3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.414475:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54ca3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:1.0:1763333171.414485:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x19b:0x0]: returning size 0 00010000:00010000:1.0:1763333171.414578:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54c95 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.414590:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54c95 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.414596:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54c95 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.414603:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54c95 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.414609:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333171.414613:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54c95 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.414620:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54c95 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.414631:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355300) 00010000:00010000:1.0:1763333171.414635:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333171.414639:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54c95 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.414645:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54c95 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.414657:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54c9c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.414663:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54c9c lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.414667:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54c9c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.414671:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7ec00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333171.414674:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54c9c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.414679:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54c9c lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.414685:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff618aa900) 00010000:00010000:1.0:1763333171.414687:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333171.414690:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54c9c lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.414694:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54c9c lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.414731:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54c8e lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ffe expref: 238 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.414751:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54ca3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ffe expref: 237 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.414758:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19b:0x0].0x0 (ffff92fe48355d00) 00010000:00010000:1.0:1763333171.414760:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333171.414763:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f600, rc 0) 00000100:00100000:1.0:1763333171.414813:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:55917:x1848987613593088:12345-192.168.204.28@tcp:101:bash.0 Request processed in 667us (2891us total) trans 4294972044 rc 0/0 00000100:00100000:1.0:1763333171.414820:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9004 00000100:00100000:1.0:1763333171.416636:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613592832 00000100:00100000:1.0:1763333171.416648:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613592832 00000100:00100000:1.0:1763333171.417149:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6284 00000100:00100000:1.0:1763333171.417171:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2420:x1848987613592832:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333171.417195:0:8611:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333171.417220:0:8611:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c54cb1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36968ff7 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333171.417245:0:8611:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x21c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333171.417263:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333171.417265:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333171.417274:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c54cb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ff7 expref: 15 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333171.417291:0:8611:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c54cb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ff7 expref: 15 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333171.417304:0:8611:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7fe00, rc 0) 00000100:00100000:1.0:1763333171.417396:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2420:x1848987613592832:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 237us (3856us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333171.417404:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6284 00000100:00100000:0.0:1763333171.421724:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333171.421848:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.421910:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613593216 00000100:00100000:2.0:1763333171.421921:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613593216 00000100:00100000:2.0:1763333171.421985:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 407 00000100:00100000:2.0:1763333171.421995:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49609500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:2420:x1848987613593216:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333171.422013:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333171.422039:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54ca3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ffe expref: 237 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.422056:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19b:0x0].0x0 (ffff92fe48355d00) 00010000:00010000:2.0:1763333171.422061:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333171.422122:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49609500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:2420:x1848987613593216:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 128us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333171.422130:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 407 00000100:00100000:3.0:1763333171.422208:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613593344 00000100:00100000:3.0:1763333171.422214:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613593344 00000100:00100000:3.0:1763333171.422254:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9005 00000100:00100000:3.0:1763333171.422261:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49608a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:55917:x1848987613593344:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333171.422279:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333171.422293:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c54cb8 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969005 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.422321:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c54cbf lrc: 3/1,0 mode: --/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333171.422334:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c54cbf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333171.422344:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c54cbf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333171.422635:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c54cb8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969005 expref: 238 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.422650:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c54cbf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969005 expref: 237 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.422696:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19b:0x0].0x0 (ffff92fe48355d00) 00010000:00010000:3.0:1763333171.422700:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763333171.422703:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96400, rc 0) 00000100:00100000:3.0:1763333171.422733:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49608a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:55917:x1848987613593344:12345-192.168.204.28@tcp:101:bash.0 Request processed in 473us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333171.422740:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9005 00000100:00100000:0.0:1763333171.422965:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333171.427065:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613593600 00000100:00100000:3.0:1763333171.427082:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613593600 00000100:00100000:3.0:1763333171.427147:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3076 00000100:00100000:3.0:1763333171.427157:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4960b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56816:x1848987613593600:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333171.427422:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4960b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56816:x1848987613593600:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 265us (4456us total) trans 4294972045 rc 0/0 00000100:00100000:3.0:1763333171.427430:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3076 00000100:00100000:3.0:1763333171.427496:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.427755:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613593856 00000100:00100000:2.0:1763333171.427760:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613593856 00000100:00100000:2.0:1763333171.427805:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9006 00000100:00100000:2.0:1763333171.427813:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:55917:x1848987613593856:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:2.0:1763333171.427841:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333171.427867:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54c80 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968fe9 expref: 238 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.427884:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19b:0x0].0x0 (ffff92fe48355d00) 00010000:00010000:2.0:1763333171.427890:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333171.428031:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54cc6 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333171.428046:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54cc6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x19b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.428055:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54cc6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x19b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000001:00080000:2.0:1763333171.428098:0:8606:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294972046 00000004:00010000:2.0:1763333171.428121:0:8606:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000024d91816 reply state 00000000fafe07bc transno 4294972047 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54cc6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x19b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.428132:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54cc6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x19b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.428138:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19b:0x0].0x0 (ffff92fe48355d00) 00010000:00010000:2.0:1763333171.428141:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333171.428143:0:8606:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763333171.428217:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:55917:x1848987613593856:12345-192.168.204.28@tcp:36:bash.0 Request processed in 405us (721us total) trans 4294972047 rc 0/0 00000100:00100000:2.0:1763333171.428224:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9006 00000020:00080000:2.0:1763333171.428228:0:8606:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763333171.438208:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.438319:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613594112 00000100:00100000:2.0:1763333171.438330:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613594112 00000100:00100000:2.0:1763333171.438428:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9007 00000100:00100000:2.0:1763333171.438438:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:56816:x1848987613594112:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333171.438466:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333171.438491:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54ccd lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696900c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.438580:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54cd4 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333171.438593:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54cd4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.438604:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54cd4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.438613:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54cdb lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333171.438619:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54cdb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.438624:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54cdb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.438734:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54ce2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333171.438741:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54ce2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.438747:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54ce2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:2.0:1763333171.438755:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x19b:0x0]: returning size 0 00010000:00010000:2.0:1763333171.438832:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54cd4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.438838:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54cd4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.438843:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54cd4 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.438848:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54cd4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.438854:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333171.438858:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54cd4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.438865:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54cd4 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.438874:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff618aa700) 00010000:00010000:2.0:1763333171.438876:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333171.438880:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54cd4 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.438885:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54cd4 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.438898:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54cdb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.438903:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54cdb lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.438907:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54cdb lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.438911:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4a00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333171.438913:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54cdb lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.438917:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54cdb lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.438921:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff618aa900) 00010000:00010000:2.0:1763333171.438923:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333171.438926:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54cdb lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.438930:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54cdb lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.438961:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54ccd lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696900c expref: 243 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.438976:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54ce2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696900c expref: 242 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.438982:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19b:0x0].0x0 (ffff92fe48355d00) 00010000:00010000:2.0:1763333171.438984:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333171.438986:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4000, rc 0) 00000100:00100000:2.0:1763333171.439054:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:56816:x1848987613594112:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 617us (856us total) trans 4294972048 rc 0/0 00000100:00100000:2.0:1763333171.439061:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9007 00000100:00100000:1.0:1763333171.442116:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.442364:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613594240 00000100:00100000:2.0:1763333171.442375:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613594240 00000100:00100000:2.0:1763333171.443754:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9008 00000100:00100000:2.0:1763333171.443773:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:55917:x1848987613594240:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333171.443797:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333171.443817:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c54cf0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969013 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.443869:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c54cf0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x19b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969013 expref: 243 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.443881:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c54cf0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x19b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969013 expref: 243 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.443899:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19b:0x0].0x0 (ffff92fe48355d00) 00010000:00010000:2.0:1763333171.443902:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333171.443905:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5000, rc 0) 00000100:00100000:2.0:1763333171.443979:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:55917:x1848987613594240:12345-192.168.204.28@tcp:101:bash.0 Request processed in 214us (1871us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333171.443986:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9008 00000100:00100000:1.0:1763333171.445239:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.445593:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613594496 00000100:00100000:2.0:1763333171.445604:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613594496 00000100:00100000:2.0:1763333171.445656:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3077 00000100:00100000:2.0:1763333171.445666:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:56816:x1848987613594496:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333171.445879:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56816:x1848987613594496:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 214us (643us total) trans 4294972049 rc 0/0 00000100:00100000:2.0:1763333171.445887:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3077 00000100:00100000:0.0:1763333171.449104:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333171.449174:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613594752 00000100:00100000:3.0:1763333171.449184:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613594752 00000100:00100000:3.0:1763333171.449242:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9009 00000100:00100000:3.0:1763333171.449252:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4960ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:55917:x1848987613594752:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333171.449274:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333171.449277:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:3.0:1763333171.449306:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c54cf0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x19b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969013 expref: 244 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.449327:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54ce2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696900c expref: 243 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.449340:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19b:0x0].0x0 (ffff92fe48355d00) 00010000:00010000:3.0:1763333171.450261:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333171.450286:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c54cf7 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696901a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.450389:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c54cfe lrc: 3/0,1 mode: --/EX res: [0x240000404:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333171.450405:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c54cfe lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x19b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333171.450416:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c54cfe lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x19b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000040:00080000:3.0:1763333171.450663:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1333, 88 off112944 00000004:00080000:3.0:1763333171.450673:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1275530323079ns, next at 1275845117682ns, rc = 0 00000040:00080000:3.0:1763333171.450698:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1332, 88 off112944 00000004:00080000:3.0:1763333171.450702:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1275530353489ns, next at 1275845147255ns, rc = 0 00000040:00080000:3.0:1763333171.450738:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1333, 88 off113032 00000004:00080000:3.0:1763333171.450743:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1275530393637ns, next at 1275845147255ns, rc = 0 00000040:00080000:3.0:1763333171.450753:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1334, 88 off113032 00000004:00080000:3.0:1763333171.450756:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1275530407304ns, next at 1275845117682ns, rc = 0 00000100:00100000:1.0:1763333171.454091:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.454312:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613595008 00000100:00100000:2.0:1763333171.454327:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613595008 00000100:00100000:2.0:1763333171.454680:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9010 00000100:00100000:2.0:1763333171.454691:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56816:x1848987613595008:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333171.454722:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333171.454758:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54d05 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969021 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.454847:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54d0c lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333171.454861:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54d0c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.454879:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54d0c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.454891:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54d13 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333171.454899:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54d13 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.454905:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54d13 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.455013:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54d1a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333171.455023:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54d1a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.455030:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54d1a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:2.0:1763333171.455042:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x19b:0x0]: returning size 2 00010000:00010000:2.0:1763333171.455129:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54d1a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.455138:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54d1a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.455145:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54d1a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.455151:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333171.455156:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54d1a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.455164:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54d1a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.455176:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19b:0x0].0x0 (ffff92fe48355d00) 00010000:00010000:2.0:1763333171.455180:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1763333171.455185:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54d1a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.455191:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54d1a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.455207:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54d0c lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.455213:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54d0c lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.455219:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54d0c lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.455225:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54d0c lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.455231:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4a00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333171.455233:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54d0c lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.455240:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54d0c lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.455247:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff618aa700) 00010000:00010000:2.0:1763333171.455249:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333171.455252:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54d0c lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.455258:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54d0c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.455268:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54d13 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.455274:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54d13 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.455279:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54d13 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.455284:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333171.455287:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54d13 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.455293:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54d13 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.455299:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff618aa900) 00010000:00010000:2.0:1763333171.455302:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333171.455305:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54d13 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.455310:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54d13 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.455341:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54d05 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969021 expref: 247 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.455376:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff618aa700) 00010000:00010000:2.0:1763333171.455378:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763333171.455382:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54d05 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969021 expref: 247 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.455396:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4c00, rc 0) 00000100:00100000:2.0:1763333171.455469:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56816:x1848987613595008:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 780us (1391us total) trans 4294972051 rc 301/301 00000100:00100000:2.0:1763333171.455477:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9010 00000001:00080000:3.0:1763333171.456954:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972050 is committed 00000004:00080000:3.0:1763333171.456964:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 874 committed 00000004:00080000:3.0:1763333171.456978:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 871 committed 00000004:00080000:3.0:1763333171.456986:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 870 committed 00000004:00080000:3.0:1763333171.456989:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 873 committed 00010000:00010000:3.0:1763333171.457084:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c54cfe lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x19b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696901a expref: 227 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.457097:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19b:0x0].0x0 (ffff92fe48355d00) 00010000:00010000:3.0:1763333171.457100:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763333171.457117:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c54cf7 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x19b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696901a expref: 227 pid: 6519 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1763333171.457132:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c54cfe lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x19b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696901a expref: 226 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.457156:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19b:0x0].0x0 (ffff92fe48355d00) 00010000:00010000:3.0:1763333171.457159:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763333171.457161:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96e00, rc 0) 00000100:00100000:3.0:1763333171.457212:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4960ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:55917:x1848987613594752:12345-192.168.204.28@tcp:101:bash.0 Request processed in 7961us (8117us total) trans 4294972050 rc 0/0 00000100:00100000:3.0:1763333171.457221:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9009 00000100:00100000:1.0:1763333171.457418:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627228800:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333171.457469:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333171.457499:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763333171.457505:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77a3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627228416:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763333171.457524:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333171.457562:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627228800 00000100:00100000:1.0:1763333171.457568:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627228800 00000100:00100000:1.0:1763333171.457599:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627228416 00000100:00100000:1.0:1763333171.457601:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627228416 00000100:00100000:1.0:1763333171.457616:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6285 00000100:00100000:1.0:1763333171.457625:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+22:3652:x1848987627228800:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1763333171.457782:0:28600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x21c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333171.457787:0:28600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x21c:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763333171.457789:0:28600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x21c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333171.457791:0:28600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x21c:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763333171.457794:0:28600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x21c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333171.457824:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+23:3652:x1848987627228800:12345-0@lo:2:osp-syn-0-1.0 Request processed in 201us (355us total) trans 21474838778 rc 0/0 00000100:00100000:1.0:1763333171.457831:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6285 00000100:00100000:1.0:1763333171.457845:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6286 00000100:00100000:1.0:1763333171.457852:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+22:3652:x1848987627228416:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1763333171.457865:0:28600:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:537 count 1 00010000:00010000:1.0:1763333171.457882:0:28600:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54d28 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.457897:0:28600:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c54b76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f9c expref: 14 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.457905:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333171.457907:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333171.457911:0:28600:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54d28 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.457935:0:28600:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c54b76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f9c expref: 14 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.457952:0:28600:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c54b76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f9c expref: 14 pid: 29010 timeout: 1375 lvb_type: 0 00000100:00100000:1.0:1763333171.457963:0:28600:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77a3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28600:1848987627228928:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333171.458005:0:28600:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe46e0e6c0 going to sleep for 11 seconds 00000004:00080000:1.0:1763333171.458036:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff77a3ed80/2, rc 0, transno 21474838778 00000100:00100000:1.0:1763333171.458041:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627228800:0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1763333171.458455:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54b99 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.458465:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54b99 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.458476:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54b99 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.458482:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333171.458487:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54b99 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.458494:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54b99 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.458508:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff618aa900) 00010000:00010000:0.0:1763333171.458511:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333171.458515:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54b99 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.458521:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54b99 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333171.458549:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c54c2c lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.458557:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c54c2c lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.458562:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c54c2c lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.458567:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333171.458570:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c54c2c lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.458576:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c54c2c lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.458585:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff618aa900) 00010000:00010000:0.0:1763333171.458587:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333171.458591:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c54c2c lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.458596:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c54c2c lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.458615:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54cc6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x19b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333171.458621:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54cc6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x19b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333171.458627:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54cc6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x19b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333171.458632:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333171.458634:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54cc6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x19b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333171.458640:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54cc6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x19b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333171.458647:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19b:0x0].0x0 (ffff92fe48355d00) 00010000:00010000:0.0:1763333171.458649:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333171.458652:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54cc6 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x19b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333171.458657:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54cc6 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x19b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000100:00100000:0.0:1763333171.458679:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627228544:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763333171.458714:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333171.458750:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763333171.458756:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627228672:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333171.458774:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333171.458804:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627228544 00000100:00100000:0.0:1763333171.458809:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627228544 00000100:00100000:0.0:1763333171.458838:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627228672 00000100:00100000:0.0:1763333171.458841:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627228672 00000100:00100000:0.0:1763333171.458859:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6287 00000100:00100000:0.0:1763333171.458866:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+24:3654:x1848987627228544:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1763333171.458880:0:28650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:538 count 1 00002000:00010000:0.0:1763333171.458903:0:28650:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x21a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333171.458909:0:28650:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54d2f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.458918:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333171.458920:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333171.458925:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54d2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.458935:0:28650:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54d2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.458944:0:28650:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54d2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.458951:0:28650:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54d2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.458973:0:28650:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763333171.459144:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+25:3654:x1848987627228544:12345-0@lo:6:osp-syn-0-1.0 Request processed in 277us (428us total) trans 21474838779 rc 0/0 00000100:00100000:0.0:1763333171.459151:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6287 00000100:00100000:0.0:1763333171.459165:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6288 00000100:00100000:0.0:1763333171.459172:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49608700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+24:3654:x1848987627228672:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333171.459244:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49608700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+25:3654:x1848987627228672:12345-0@lo:2:osp-syn-0-1.0 Request processed in 73us (469us total) trans 21474838780 rc 0/0 00000100:00100000:0.0:1763333171.459251:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6288 00010000:00010000:0.0:1763333171.459273:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333171.459278:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54d2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.459286:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf600 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333171.459289:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54d2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.459296:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54d2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.459308:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54d2f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.459316:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54d2f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.459336:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333171.459337:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333171.459339:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763333171.459394:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff77a3d500/2, rc 0, transno 21474838780 00000100:00100000:0.0:1763333171.459400:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627228672:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1763333171.459408:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff77a3d180/2, rc 0, transno 21474838779 00000100:00100000:0.0:1763333171.459411:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627228544:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763333171.461143:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe45181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627229056:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763333171.461203:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333171.461255:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763333171.461261:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627229440:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333171.461281:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333171.461497:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627229056 00000100:00100000:2.0:1763333171.461505:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627229056 00000100:00100000:2.0:1763333171.461550:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627229440 00000100:00100000:2.0:1763333171.461554:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627229440 00000100:00100000:2.0:1763333171.461571:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6289 00000100:00100000:2.0:1763333171.461579:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+51:3653:x1848987627229056:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1763333171.461602:0:29010:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:537 count 1 00010000:00010000:2.0:1763333171.461626:0:29010:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54d36 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.461646:0:29010:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c54b45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f87 expref: 30 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.461654:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333171.461656:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333171.461660:0:29010:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54d36 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.461686:0:29010:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c54b45 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f87 expref: 30 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.461698:0:29010:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c54b45 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f87 expref: 30 pid: 29010 timeout: 1375 lvb_type: 0 00000100:00100000:2.0:1763333171.461710:0:29010:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e1a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:29010:1848987627229568:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333171.461764:0:29010:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff5119de40 going to sleep for 11 seconds 00000100:00100000:1.0:1763333171.462719:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6290 00000100:00100000:1.0:1763333171.462733:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+51:3653:x1848987627229440:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1763333171.462872:0:8611:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x21c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333171.462875:0:8611:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x21c:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763333171.462878:0:8611:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x21c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333171.462880:0:8611:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x21c:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763333171.462882:0:8611:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x21c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333171.462948:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+52:3653:x1848987627229440:12345-0@lo:2:osp-syn-1-1.0 Request processed in 220us (1665us total) trans 17179871474 rc 0/0 00000100:00100000:1.0:1763333171.462956:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6290 00000004:00080000:3.0:1763333171.462984:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44e1ad80/2, rc 0, transno 17179871474 00000100:00100000:3.0:1763333171.462993:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627229440:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333171.463774:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42f0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627229312:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333171.463814:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333171.463836:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1763333171.463842:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42f0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627229184:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763333171.463857:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333171.463893:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627229312 00000100:00100000:0.0:1763333171.463898:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627229312 00000100:00100000:0.0:1763333171.463927:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627229184 00000100:00100000:0.0:1763333171.463929:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627229184 00000100:00100000:0.0:1763333171.463945:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6291 00000100:00100000:0.0:1763333171.463950:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+53:3655:x1848987627229312:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333171.464041:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+54:3655:x1848987627229312:12345-0@lo:2:osp-syn-1-1.0 Request processed in 91us (227us total) trans 17179871475 rc 0/0 00000100:00100000:0.0:1763333171.464047:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6291 00000100:00100000:0.0:1763333171.464060:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6292 00000100:00100000:0.0:1763333171.464065:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49608e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+53:3655:x1848987627229184:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1763333171.464075:0:29013:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:538 count 1 00002000:00010000:0.0:1763333171.464096:0:29013:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x21a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333171.464103:0:29013:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54d3d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.464115:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333171.464117:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333171.464122:0:29013:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54d3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.464134:0:29013:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54d3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.464143:0:29013:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54d3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.464150:0:29013:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54d3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.464165:0:29013:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763333171.464284:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49608e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+54:3655:x1848987627229184:12345-0@lo:6:osp-syn-1-1.0 Request processed in 219us (426us total) trans 17179871476 rc 0/0 00000100:00100000:0.0:1763333171.464289:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6292 00010000:00010000:0.0:1763333171.464312:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333171.464317:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54d3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.464324:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abde400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333171.464329:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54d3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.464341:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54d3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.464376:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54d3d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.464383:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54d3d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.464398:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333171.464400:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333171.464402:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763333171.464428:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe42f0ca80/2, rc 0, transno 17179871476 00000100:00100000:0.0:1763333171.464433:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42f0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627229184:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1763333171.464443:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe42f0f480/2, rc 0, transno 17179871475 00000100:00100000:0.0:1763333171.464446:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42f0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627229312:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333171.470788:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333171.471454:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613595264 00000100:00100000:3.0:1763333171.471469:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613595264 00000100:00100000:3.0:1763333171.471548:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3078 00000100:00100000:3.0:1763333171.471559:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56816:x1848987613595264:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333171.471803:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56816:x1848987613595264:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 244us (1029us total) trans 4294972052 rc 0/0 00000100:00100000:3.0:1763333171.471811:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3078 00000100:00100000:2.0:1763333171.472117:0:28600:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77a3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28600:1848987627228928:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333171.472144:0:28600:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54d28 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333171.472630:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.472664:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.472716:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613595392 00000100:00100000:2.0:1763333171.472722:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613595392 00010000:00010000:2.0:1763333171.472749:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c54b76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f9c expref: 15 pid: 29010 timeout: 1375 lvb_type: 0 00000100:00100000:2.0:1763333171.472781:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613595520 00000100:00100000:2.0:1763333171.472784:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613595520 00010000:00010000:2.0:1763333171.472798:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c54b45 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f87 expref: 31 pid: 29010 timeout: 1375 lvb_type: 0 00000100:00100000:2.0:1763333171.472816:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2958 00000100:00100000:2.0:1763333171.472823:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2418:x1848987613595392:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333171.472836:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333171.472842:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c54b76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f9c expref: 15 pid: 29010 timeout: 1375 lvb_type: 0 00010000:00010000:2.0:1763333171.472854:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c54b76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f9c expref: 15 pid: 29010 timeout: 1375 lvb_type: 0 00010000:00010000:2.0:1763333171.472883:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c54b76 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x219:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f9c expref: 15 pid: 29010 timeout: 1375 lvb_type: 0 00010000:00010000:2.0:1763333171.472901:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333171.472903:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333171.472908:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54d28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.472918:0:6506:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54d28 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.472941:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333171.473064:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2418:x1848987613595392:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 240us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333171.473072:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2958 00000100:00100000:2.0:1763333171.473090:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2959 00000100:00100000:2.0:1763333171.473097:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+31:2418:x1848987613595520:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333171.473107:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333171.473112:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c54b45 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x219:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f87 expref: 31 pid: 29010 timeout: 1375 lvb_type: 0 00010000:00010000:2.0:1763333171.473123:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c54b45 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x219:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f87 expref: 31 pid: 29010 timeout: 1375 lvb_type: 0 00010000:00010000:2.0:1763333171.473136:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333171.473138:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333171.473142:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54d36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x219:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.473150:0:6506:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54d36 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x219:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.473162:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333171.473179:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+31:2418:x1848987613595520:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 83us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333171.473185:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2959 00010000:00010000:2.0:1763333171.473207:0:28600:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54d28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.473216:0:28600:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54d28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.473225:0:28600:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54d28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.473234:0:28600:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54d28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.473251:0:28600:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763333171.473504:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+25:3652:x1848987627228416:12345-0@lo:6:osp-syn-0-1.0 Request processed in 15651us (15977us total) trans 21474838781 rc 0/0 00000100:00100000:2.0:1763333171.473513:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6286 00010000:00010000:2.0:1763333171.473533:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333171.473550:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54d28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.473560:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f800 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333171.473564:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54d28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.473573:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54d28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.473586:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54d28 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.473594:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54d28 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.473613:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333171.473615:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333171.473617:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333171.473645:0:29010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c54b45 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968f87 expref: 30 pid: 29010 timeout: 1375 lvb_type: 0 00000100:00100000:2.0:1763333171.473657:0:29010:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e1a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:29010:1848987627229568:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333171.473671:0:29010:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54d36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.473679:0:29010:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54d36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.473693:0:29010:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54d36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.473701:0:29010:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54d36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.473708:0:29010:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54d36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.473721:0:29010:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763333171.473842:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+54:3653:x1848987627229056:12345-0@lo:6:osp-syn-1-1.0 Request processed in 12264us (12638us total) trans 17179871477 rc 0/0 00000100:00100000:2.0:1763333171.473849:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6289 00000004:00080000:2.0:1763333171.473884:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe45181500/2, rc 0, transno 17179871477 00000100:00100000:2.0:1763333171.473890:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe45181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627229056:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1763333171.475071:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff77a3ea00/2, rc 0, transno 21474838781 00000100:00100000:0.0:1763333171.475081:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77a3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627228416:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1763333171.475587:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333171.475597:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54d36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.475607:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4800 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333171.475611:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54d36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.475621:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54d36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.475639:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54d36 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.475646:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54d36 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.475667:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333171.475669:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333171.475670:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763333171.476137:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.480026:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613595648 00000100:00100000:2.0:1763333171.480043:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613595648 00000100:00100000:2.0:1763333171.480108:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6293 00000100:00100000:2.0:1763333171.480119:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:55917:x1848987613595648:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333171.480139:0:29010:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333171.480165:0:29010:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54d44 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969028 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763333171.480190:0:29010:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x21b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763333171.480213:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333171.480217:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333171.480227:0:29010:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54d44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969028 expref: 15 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.480243:0:29010:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54d44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969028 expref: 15 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.480256:0:29010:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5c00, rc 0) 00000100:00100000:2.0:1763333171.480324:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:55917:x1848987613595648:12345-192.168.204.28@tcp:101:bash.0 Request processed in 206us (4188us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333171.480331:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6293 00000100:00100000:1.0:1763333171.480738:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.482320:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613595776 00000100:00100000:2.0:1763333171.482331:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613595776 00000100:00100000:0.0:1763333171.483206:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3079 00000100:00100000:0.0:1763333171.483221:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56816:x1848987613595776:12345-192.168.204.28@tcp:33:lfs.0 00000100:00100000:0.0:1763333171.483400:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56816:x1848987613595776:12345-192.168.204.28@tcp:33:lfs.0 Request processed in 184us (2662us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333171.483406:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3079 00000100:00100000:1.0:1763333171.487647:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333171.489753:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613595904 00000100:00100000:3.0:1763333171.489768:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613595904 00000100:00100000:3.0:1763333171.489846:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6294 00000100:00100000:3.0:1763333171.489856:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:55917:x1848987613595904:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333171.489875:0:28600:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333171.489901:0:28600:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c54d4b lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696902f expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333171.489925:0:28600:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x21b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333171.489948:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333171.489951:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333171.489961:0:28600:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c54d4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696902f expref: 31 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.489976:0:28600:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c54d4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696902f expref: 31 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.489991:0:28600:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a97200, rc 0) 00000100:00100000:3.0:1763333171.490067:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+31:55917:x1848987613595904:12345-192.168.204.28@tcp:101:bash.0 Request processed in 212us (2433us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333171.490075:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6294 00000100:00100000:1.0:1763333171.501682:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.501733:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.502112:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613596160 00000100:00100000:2.0:1763333171.502123:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613596160 00002000:00010000:2.0:1763333171.502165:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/539 (0->18446744073709551615) 00002000:00100000:2.0:1763333171.502170:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe46e2c700 with x1848987613596160 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333171.502182:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe46e2c700. 00000100:00100000:2.0:1763333171.502218:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613596032 00000100:00100000:2.0:1763333171.502221:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613596032 00002000:00010000:2.0:1763333171.502234:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/539 (0->18446744073709551615) 00002000:00100000:2.0:1763333171.502237:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe46e2d880 with x1848987613596032 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333171.502242:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe46e2d880. 00000100:00100000:2.0:1763333171.502261:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1564 00000100:00100000:2.0:1763333171.502270:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+31:2419:x1848987613596160:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:2.0:1763333171.502475:0:24027:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x21b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333171.502480:0:24027:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x21b:0x0] updating lvb mtime from disk: 0 -> 1763333171 00002000:00010000:2.0:1763333171.502482:0:24027:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x21b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333171.502484:0:24027:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x21b:0x0] updating lvb ctime from disk: 0 -> 1763333171 00002000:00010000:2.0:1763333171.502486:0:24027:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x21b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333171.502557:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+32:2419:x1848987613596160:12345-192.168.204.28@tcp:10:bash.0 Request processed in 287us (887us total) trans 17179871478 rc 0/0 00000100:00100000:2.0:1763333171.502564:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1564 00002000:00010000:2.0:1763333171.502569:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/539 (0->18446744073709551615) 00002000:00100000:2.0:1763333171.502571:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe46e2c700 with x1848987613596160 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333171.502576:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe46e2c700. 00000100:00100000:2.0:1763333171.502597:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1565 00000100:00100000:2.0:1763333171.502604:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2419:x1848987613596032:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:2.0:1763333171.502700:0:24027:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x21b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333171.502703:0:24027:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x21b:0x0] updating lvb mtime from disk: 0 -> 1763333171 00002000:00010000:2.0:1763333171.502706:0:24027:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x21b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333171.502708:0:24027:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x21b:0x0] updating lvb ctime from disk: 0 -> 1763333171 00002000:00010000:2.0:1763333171.502710:0:24027:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x21b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333171.502733:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2419:x1848987613596032:12345-192.168.204.28@tcp:10:bash.0 Request processed in 130us (999us total) trans 21474838782 rc 0/0 00000100:00100000:2.0:1763333171.502739:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1565 00002000:00010000:2.0:1763333171.502742:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/539 (0->18446744073709551615) 00002000:00100000:2.0:1763333171.502745:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe46e2d880 with x1848987613596032 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333171.502749:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe46e2d880. 00000100:00100000:0.0:1763333171.511179:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.512711:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613596416 00000100:00100000:1.0:1763333171.512724:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613596416 00000100:00100000:1.0:1763333171.512792:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9011 00000100:00100000:1.0:1763333171.512802:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4960a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56817:x1848987613596416:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333171.512823:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333171.512846:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54d52 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969036 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.512927:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54d59 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333171.512940:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54d59 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333171.513495:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54d59 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333171.513513:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54d60 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333171.513521:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54d60 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333171.513527:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54d60 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333171.513645:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54d67 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00000100:00100000:3.0:1763333171.513648:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:1.0:1763333171.513654:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54d67 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333171.513661:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54d67 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:1.0:1763333171.513671:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x19b:0x0]: returning size 2 00010000:00010000:1.0:1763333171.513749:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54d59 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333171.513756:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54d59 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333171.513767:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54d59 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333171.513773:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54d59 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333171.513778:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333171.513782:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54d59 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333171.513788:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54d59 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333171.513799:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355300) 00010000:00010000:1.0:1763333171.513802:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333171.513806:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54d59 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333171.513811:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54d59 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333171.513822:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54d60 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333171.513828:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54d60 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333171.513832:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54d60 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333171.513837:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7ea00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333171.513839:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54d60 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333171.513848:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54d60 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333171.513854:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355900) 00010000:00010000:1.0:1763333171.513856:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333171.513857:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54d60 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333171.513862:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54d60 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333171.513896:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54d52 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969036 expref: 227 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.513909:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54d67 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969036 expref: 226 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.513915:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19b:0x0].0x0 (ffff92fe48355d00) 00010000:00010000:1.0:1763333171.513917:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333171.513919:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e600, rc 0) 00000100:00100000:1.0:1763333171.513978:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4960a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56817:x1848987613596416:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1177us (2808us total) trans 4294972053 rc 0/0 00000100:00100000:1.0:1763333171.513987:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9011 00000100:00100000:0.0:1763333171.514342:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613596672 00000100:00100000:0.0:1763333171.514373:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613596672 00000100:00100000:0.0:1763333171.514419:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3080 00000100:00100000:0.0:1763333171.514428:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:55917:x1848987613596672:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:0.0:1763333171.514630:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:55917:x1848987613596672:12345-192.168.204.28@tcp:35:bash.0 Request processed in 204us (983us total) trans 4294972054 rc 0/0 00000100:00100000:0.0:1763333171.514637:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3080 00000100:00100000:2.0:1763333171.517523:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333171.517611:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613596928 00000100:00100000:0.0:1763333171.517619:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613596928 00000100:00100000:0.0:1763333171.517675:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3081 00000100:00100000:0.0:1763333171.517684:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6b3eac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56817:x1848987613596928:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333171.517952:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6b3eac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56817:x1848987613596928:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 268us (436us total) trans 4294972055 rc 0/0 00000100:00100000:0.0:1763333171.517961:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3081 00000100:00100000:1.0:1763333171.521573:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333171.521678:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613597184 00000100:00100000:3.0:1763333171.521689:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613597184 00000100:00100000:3.0:1763333171.521791:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9012 00000100:00100000:3.0:1763333171.521801:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56818:x1848987613597184:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:3.0:1763333171.521862:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1763333171.521890:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c54cfe lrc: 0/0,0 mode: --/CR res: [0x240000404:0x19b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696901a expref: 228 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.521912:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54d67 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969036 expref: 227 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.521925:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c54cbf lrc: 0/0,0 mode: --/PR res: [0x240000404:0x19b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969005 expref: 226 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.521935:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19b:0x0].0x0 (ffff92fe48355d00) 00010000:00010000:3.0:1763333171.521945:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333171.521975:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c54d75 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333171.521988:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c54d75 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333171.522001:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c54d75 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333171.522014:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c54d7c lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333171.522021:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c54d7c lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333171.522027:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c54d7c lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333171.522116:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c54d83 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333171.522124:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c54d83 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x19b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333171.522130:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c54d83 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x19b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000040:00080000:2.0:1763333171.522886:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1335, 64 off113096 00000040:00080000:2.0:1763333171.522915:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1334, 64 off113096 00000040:00080000:2.0:1763333171.522925:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1335, 64 off113160 00000040:00080000:2.0:1763333171.522934:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1336, 64 off113160 00010000:00010000:2.0:1763333171.523001:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54d8a lrc: 3/0,1 mode: --/PW res: [0x240000404:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333171.523012:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54d8a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x19b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.523020:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54d8a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x19b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.523028:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54d8a lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x19b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.523034:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54d8a lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x19b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.523040:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54d8a lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x19b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.523108:0:6519:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763333171.523128:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c54d83 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x19b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.523134:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c54d83 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x19b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.523141:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c54d83 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x19b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.523147:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333171.523151:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c54d83 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x19b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.523158:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c54d83 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x19b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.523168:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19b:0x0].0x0 (ffff92ff80045800) 00010000:00010000:2.0:1763333171.523172:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763333171.523175:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c54d83 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x19b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.523181:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c54d83 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x19b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.523316:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c54d75 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.523324:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c54d75 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.523329:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c54d75 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.523335:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c54d75 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.523339:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333171.523342:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c54d75 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.523384:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c54d75 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.523392:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff80045900) 00010000:00010000:2.0:1763333171.523394:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333171.523397:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c54d75 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.523403:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c54d75 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:2.0:1763333171.523418:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000853ea6b4 reply state 00000000c33daa62 transno 4294972056 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c54d7c lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.523430:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c54d7c lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.523436:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045e00) 00010000:00010000:2.0:1763333171.523438:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333171.523442:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763333171.523715:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333171.523722:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54d8a lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x19b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.523729:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333171.523733:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54d8a lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x19b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.523739:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54d8a lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x19b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.523748:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19b:0x0].0x0 (ffff92ff80045800) 00010000:00010000:0.0:1763333171.523751:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763333171.523753:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54d8a lrc: 1/0,0 mode: --/PW res: [0x240000404:0x19b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.523759:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54d8a lrc: 0/0,0 mode: --/PW res: [0x240000404:0x19b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.523772:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333171.523774:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333171.523776:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763333171.524067:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56818:x1848987613597184:12345-192.168.204.28@tcp:36:rm.0 Request processed in 2263us (2501us total) trans 4294972056 rc 0/0 00000100:00100000:2.0:1763333171.524076:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9012 00000100:00100000:3.0:1763333171.532921:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.533024:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613597312 00000100:00100000:2.0:1763333171.533035:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613597312 00000100:00100000:2.0:1763333171.533101:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9013 00000100:00100000:2.0:1763333171.533113:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56817:x1848987613597312:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333171.533141:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333171.533168:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54d91 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696903d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.533243:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54d98 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333171.533258:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54d98 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.533270:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54d98 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.533280:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54d9f lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333171.533287:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54d9f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.533295:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54d9f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.533341:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54d98 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.533421:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54d98 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.533428:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54d98 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.533435:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54d98 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.533441:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333171.533445:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54d98 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.533452:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54d98 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.533464:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff618aa200) 00010000:00010000:2.0:1763333171.533467:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333171.533472:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54d98 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.533479:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54d98 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.533491:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54d9f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.533496:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54d9f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.533502:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54d9f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.533507:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333171.533510:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54d9f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.533515:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54d9f lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.533523:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045e00) 00010000:00010000:2.0:1763333171.533526:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333171.533530:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54d9f lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.533546:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54d9f lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333171.533575:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54d91 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696903d expref: 228 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.533585:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff618aa200) 00010000:00010000:2.0:1763333171.533587:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333171.533591:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54d91 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696903d expref: 228 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.533605:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4800, rc 0) 00000100:00100000:2.0:1763333171.533660:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56817:x1848987613597312:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 549us (749us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333171.533667:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9013 00000100:00100000:1.0:1763333171.537325:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333171.544741:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613597440 00000100:00100000:0.0:1763333171.544761:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613597440 00000100:00100000:0.0:1763333171.544848:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9014 00000100:00100000:0.0:1763333171.544861:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56819:x1848987613597440:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333171.544888:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333171.544917:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c54da6 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969044 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.545021:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54dad lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333171.545039:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54dad lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.545051:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54dad lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.545062:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54db4 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333171.545070:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54db4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.545075:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54db4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.545134:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54dad lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.545140:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54dad lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.545146:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54dad lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.545152:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54dad lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.545157:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333171.545161:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54dad lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.545168:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54dad lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.545179:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44800) 00010000:00010000:0.0:1763333171.545182:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333171.545186:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54dad lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.545193:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54dad lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.545206:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54db4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.545211:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54db4 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.545216:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54db4 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.545220:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abde400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333171.545223:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54db4 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.545227:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54db4 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.545234:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045e00) 00010000:00010000:0.0:1763333171.545236:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333171.545239:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54db4 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.545245:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54db4 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.545278:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c54da6 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969044 expref: 228 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.545287:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44800) 00010000:00010000:0.0:1763333171.545289:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333171.545292:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c54da6 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969044 expref: 228 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.545304:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdee00, rc 0) 00000100:00100000:0.0:1763333171.547878:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56819:x1848987613597440:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 3007us (10550us total) trans 0 rc 301/301 00000100:00100000:0.0:1763333171.547892:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9014 00000100:00100000:1.0:1763333171.550819:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333171.550909:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613597568 00000100:00100000:0.0:1763333171.550918:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613597568 00000100:00100000:0.0:1763333171.550991:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9015 00000100:00100000:0.0:1763333171.551001:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56819:x1848987613597568:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333171.551023:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333171.551046:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c54dbb lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696904b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.551112:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c54dc2 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333171.551125:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c54dc2 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.551135:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c54dc2 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.551147:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54dc9 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333171.551154:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54dc9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.551160:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54dc9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.551391:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c54dc2 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.551399:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c54dc2 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.551405:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c54dc2 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.551411:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c54dc2 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.551416:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333171.551420:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c54dc2 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.551427:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c54dc2 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.551438:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:0.0:1763333171.551441:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333171.551445:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c54dc2 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.551451:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c54dc2 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.551464:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54dc9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.551470:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54dc9 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.551475:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54dc9 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.551479:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333171.551482:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54dc9 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.551488:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54dc9 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.551493:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045e00) 00010000:00010000:0.0:1763333171.551496:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333171.551498:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54dc9 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.551503:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54dc9 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.551529:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c54dbb lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696904b expref: 228 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.551549:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:0.0:1763333171.551552:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333171.551556:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c54dbb lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696904b expref: 228 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.551569:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdfe00, rc 0) 00000100:00100000:0.0:1763333171.551624:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56819:x1848987613597568:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 623us (813us total) trans 0 rc 301/301 00000100:00100000:0.0:1763333171.551631:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9015 00000100:00100000:3.0:1763333171.554277:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.554580:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333171.554710:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613597696 00000100:00100000:3.0:1763333171.554719:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613597696 00000100:00100000:3.0:1763333171.554947:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613597952 00000100:00100000:3.0:1763333171.554962:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613597952 00000100:00100000:1.0:1763333171.555133:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9016 00000100:00100000:0.0:1763333171.555140:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9017 00000100:00100000:1.0:1763333171.555145:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56819:x1848987613597696:12345-192.168.204.28@tcp:101:lfs.0 00000100:00100000:0.0:1763333171.555149:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff59229880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56820:x1848987613597952:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333171.555164:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333171.555164:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333171.555330:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c54dd7 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969059 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.555590:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54dde lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333171.555607:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54dde lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.555620:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54dde lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.555632:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54de5 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333171.555639:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54de5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.555645:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54de5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.555665:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54dd0 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969052 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.555684:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54dde lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.555691:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54dde lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.555696:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54dde lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.555701:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c54dec lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333171.555703:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54dde lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.555709:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c54dec lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.555716:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c54dec lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333171.555716:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abde400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333171.555720:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54dde lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.555726:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54dde lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.555736:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355300) 00010000:00010000:0.0:1763333171.555739:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333171.555743:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54dde lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.555749:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c54dde lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000004:00200000:1.0:1763333171.555756:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00010000:00010000:0.0:1763333171.555759:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54de5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00000004:00200000:1.0:1763333171.555760:0:8606:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763333171.555764:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54de5 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.555769:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54de5 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.555773:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333171.555776:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54de5 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.555781:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54de5 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.555787:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045e00) 00010000:00010000:1.0:1763333171.555790:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54dd0 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969052 expref: 231 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.555790:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333171.555793:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54de5 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.555798:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54de5 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.555803:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c54dec lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969052 expref: 230 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.555809:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355300) 00010000:00010000:1.0:1763333171.555811:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1763333171.555814:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7fc00, rc 0) 00010000:00010000:0.0:1763333171.555818:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c54dd7 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969059 expref: 230 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.555826:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355300) 00010000:00010000:0.0:1763333171.555828:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763333171.555831:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c54dd7 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969059 expref: 230 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.555842:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdee00, rc 0) 00000100:00100000:1.0:1763333171.556746:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56819:x1848987613597696:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1596us (2473us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333171.556756:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9016 00000100:00100000:0.0:1763333171.556814:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff59229880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56820:x1848987613597952:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1667us (2233us total) trans 0 rc 301/301 00000100:00100000:0.0:1763333171.556820:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9017 00000100:00100000:3.0:1763333171.563117:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333171.566735:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613598208 00000100:00100000:0.0:1763333171.566752:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613598208 00000100:00100000:1.0:1763333171.566903:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9018 00000100:00100000:1.0:1763333171.566916:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56819:x1848987613598208:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333171.566944:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333171.566947:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763333171.566976:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c54dec lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969052 expref: 228 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.566993:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355300) 00010000:00010000:1.0:1763333171.567003:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333171.567019:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54df3 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969060 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.567149:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54dfa lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333171.567164:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54dfa lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.567174:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54dfa lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.567186:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54e01 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333171.567194:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54e01 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.567201:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54e01 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.567654:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54e08 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333171.567663:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54e08 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.567675:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54e08 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:1.0:1763333171.567688:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x19d:0x0]: returning size 0 00010000:00010000:1.0:1763333171.567719:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54dfa lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.567727:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54dfa lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.567733:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54dfa lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.567740:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54dfa lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.567746:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333171.567750:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54dfa lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.567758:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54dfa lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.567770:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355900) 00010000:00010000:1.0:1763333171.567772:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333171.567776:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54dfa lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.567781:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54dfa lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000004:00010000:1.0:1763333171.567793:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000353bdd0 reply state 00000000124044fc transno 4294972057 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54e01 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.567808:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54e01 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.567813:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045e00) 00010000:00010000:1.0:1763333171.567815:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333171.567818:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763333171.567847:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54df3 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969060 expref: 230 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.567862:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54e08 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969060 expref: 229 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.567870:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19d:0x0].0x0 (ffff92fe48355c00) 00010000:00010000:1.0:1763333171.567872:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333171.567875:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f600, rc 0) 00000100:00100000:1.0:1763333171.567958:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56819:x1848987613598208:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1044us (4850us total) trans 4294972057 rc 0/0 00000100:00100000:1.0:1763333171.567968:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9018 00000100:00100000:2.0:1763333171.573272:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.573938:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613598464 00000100:00100000:1.0:1763333171.574050:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613598464 00000100:00100000:3.0:1763333171.574486:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9019 00000100:00100000:2.0:1763333171.574612:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56819:x1848987613598464:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333171.574641:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333171.574663:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54e16 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969067 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.574775:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54e1d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333171.574791:0:6521:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54e08 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969060 expref: 231 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.574799:0:6521:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54e1d lrc: 4/0,1 mode: --/EX res: [0x240000404:0x19d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.574836:0:6521:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54e08 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969060 expref: 231 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.574849:0:6521:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54e08 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969060 expref: 231 pid: 6521 timeout: 1375 lvb_type: 0 00000100:00100000:2.0:1763333171.574863:0:6521:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e18a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6521:1848987627229696:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333171.575491:0:6521:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff5119d540 going to sleep for 11 seconds 00000100:00100000:0.0:1763333171.576763:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.577490:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613598720 00000100:00100000:1.0:1763333171.577500:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613598720 00000100:00100000:1.0:1763333171.577570:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9020 00000100:00100000:1.0:1763333171.577580:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4960b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56821:x1848987613598720:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333171.577599:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333171.577619:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54e24 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696906e expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.577726:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54e2b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333171.577739:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54e2b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.577750:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54e2b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:1.0:1763333171.577761:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x19d:0x0]: returning size 0 00010000:00010000:1.0:1763333171.579222:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54e2b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.579235:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54e2b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.579242:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54e2b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.579248:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333171.579252:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54e2b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.579260:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54e2b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.579272:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19d:0x0].0x0 (ffff92fe48355c00) 00010000:00010000:1.0:1763333171.579276:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1763333171.579280:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54e2b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.579286:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54e2b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.579336:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54e24 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x19d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696906e expref: 234 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.579383:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19d:0x0].0x0 (ffff92fe48355c00) 00010000:00010000:1.0:1763333171.579386:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763333171.579391:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54e24 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x19d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696906e expref: 234 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.579400:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7ea00, rc 0) 00000100:00100000:1.0:1763333171.579459:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4960b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56821:x1848987613598720:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1881us (2702us total) trans 4294972058 rc 301/301 00000100:00100000:1.0:1763333171.579468:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9020 00000100:00100000:1.0:1763333171.581650:0:6521:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e18a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6521:1848987627229696:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333171.581684:0:6521:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54e1d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x19d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000100:00100000:2.0:1763333171.582399:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.582684:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613598848 00000100:00100000:1.0:1763333171.582693:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613598848 00010000:00010000:1.0:1763333171.582735:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54e08 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969060 expref: 233 pid: 6521 timeout: 1375 lvb_type: 0 00000100:00100000:1.0:1763333171.583271:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2960 00000100:00100000:1.0:1763333171.583282:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff61b17450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:2420:x1848987613598848:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333171.583299:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333171.583308:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54e08 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969060 expref: 233 pid: 6521 timeout: 1375 lvb_type: 0 00010000:00010000:1.0:1763333171.583329:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54e08 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969060 expref: 233 pid: 6521 timeout: 1375 lvb_type: 0 00010000:00010000:1.0:1763333171.583385:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54e08 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969060 expref: 233 pid: 6521 timeout: 1375 lvb_type: 0 00010000:00010000:1.0:1763333171.583403:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19d:0x0].0x0 (ffff92fe48355c00) 00010000:00010000:1.0:1763333171.583409:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54e1d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x19d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.583419:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54e1d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x19d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.583427:0:6505:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54e1d lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x19d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.583464:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333171.583525:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff61b17450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:2420:x1848987613598848:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 245us (1130us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333171.583533:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2960 00010000:00010000:2.0:1763333171.584247:0:6521:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54e1d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x19d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.584257:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54e1d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x19d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:2.0:1763333171.584286:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x19d:0x0]: returning size 0 00000004:00080000:2.0:1763333171.584497:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x21d:0x0], index 1: 0 00000004:00080000:2.0:1763333171.584504:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x21d:0x0], index 0: 0 00000004:00080000:2.0:1763333171.584508:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x21e:0x0], index 0: 0 00000004:00080000:2.0:1763333171.584511:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x21e:0x0], index 1: 0 00010000:00010000:2.0:1763333171.585831:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54e1d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x19d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.585846:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54e1d lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x19d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.585854:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54e1d lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x19d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.585859:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333171.585864:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54e1d lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x19d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.585871:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54e1d lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x19d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.585886:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19d:0x0].0x0 (ffff92fe48355c00) 00010000:00010000:2.0:1763333171.585888:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333171.585893:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54e1d lrc: 2/0,0 mode: --/EX res: [0x240000404:0x19d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.585898:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54e1d lrc: 0/0,0 mode: --/EX res: [0x240000404:0x19d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.585962:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54e16 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x19d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969067 expref: 232 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.585978:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19d:0x0].0x0 (ffff92fe48355c00) 00010000:00010000:2.0:1763333171.585981:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763333171.585984:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54e16 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x19d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969067 expref: 232 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.585999:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4600, rc 0) 00000100:00100000:2.0:1763333171.586085:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56819:x1848987613598464:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 11589us (12826us total) trans 4294972059 rc 301/301 00000100:00100000:2.0:1763333171.586094:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9019 00000100:00100000:2.0:1763333171.587392:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333171.588032:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613599104 00000100:00100000:0.0:1763333171.591001:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613599104 00000100:00100000:0.0:1763333171.591098:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3082 00000100:00100000:0.0:1763333171.591109:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56821:x1848987613599104:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333171.591469:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56821:x1848987613599104:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 361us (4082us total) trans 4294972060 rc 0/0 00000100:00100000:0.0:1763333171.591477:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3082 00000100:00100000:1.0:1763333171.592689:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333171.593223:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613599360 00000100:00100000:3.0:1763333171.593233:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613599360 00000100:00100000:0.0:1763333171.593505:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3083 00000100:00100000:0.0:1763333171.593518:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff59228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56819:x1848987613599360:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333171.595011:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff59228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56819:x1848987613599360:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 1489us (2321us total) trans 4294972061 rc 0/0 00000100:00100000:0.0:1763333171.595024:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3083 00000100:00100000:1.0:1763333171.602528:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.602578:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333171.603045:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613599616 00000100:00100000:3.0:1763333171.603057:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613599616 00000100:00100000:3.0:1763333171.603118:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9021 00000100:00100000:3.0:1763333171.603129:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5922ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56821:x1848987613599616:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333171.603155:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333171.603179:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c54e40 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969075 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.603261:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c54e47 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333171.603276:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c54e47 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333171.603287:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c54e47 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333171.603299:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c54e4e lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333171.603305:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c54e4e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333171.603311:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c54e4e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333171.603461:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c54e55 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333171.603470:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c54e55 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333171.603477:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c54e55 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:3.0:1763333171.603488:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x19d:0x0]: returning size 0 00010000:00010000:3.0:1763333171.603580:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c54e47 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333171.603588:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c54e47 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333171.603594:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c54e47 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333171.603602:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c54e47 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333171.603608:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333171.603612:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c54e47 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333171.603620:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c54e47 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333171.603633:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff80045200) 00010000:00010000:3.0:1763333171.603636:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333171.603642:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c54e47 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333171.603649:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c54e47 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333171.603663:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c54e4e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333171.603668:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c54e4e lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333171.603673:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c54e4e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333171.603683:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333171.603685:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c54e4e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333171.603690:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c54e4e lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333171.603696:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045e00) 00010000:00010000:3.0:1763333171.603698:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333171.603701:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c54e4e lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333171.603707:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c54e4e lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333171.603740:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c54e40 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969075 expref: 236 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.603756:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c54e55 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969075 expref: 235 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.603763:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19d:0x0].0x0 (ffff92ff80045300) 00010000:00010000:3.0:1763333171.603766:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333171.603768:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a97800, rc 0) 00000100:00100000:3.0:1763333171.603827:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5922ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:56821:x1848987613599616:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 699us (1306us total) trans 4294972062 rc 0/0 00000100:00100000:3.0:1763333171.603834:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9021 00000100:00100000:0.0:1763333171.606445:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613599872 00000100:00100000:0.0:1763333171.606460:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613599872 00000100:00100000:0.0:1763333171.606531:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3084 00000100:00100000:0.0:1763333171.606550:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:56819:x1848987613599872:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333171.607860:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56819:x1848987613599872:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 1314us (5272us total) trans 4294972063 rc 0/0 00000100:00100000:0.0:1763333171.607874:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3084 00000100:00100000:2.0:1763333171.608753:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333171.608895:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613600000 00000100:00100000:0.0:1763333171.608905:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613600000 00000100:00100000:0.0:1763333171.609382:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6295 00000100:00100000:0.0:1763333171.609395:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+32:2420:x1848987613600000:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333171.609414:0:28600:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333171.609436:0:28600:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54e63 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696907c expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763333171.609461:0:28600:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x21d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333171.609482:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333171.609484:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333171.609496:0:28600:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54e63 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696907c expref: 33 pid: 28600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333171.609514:0:28600:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54e63 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696907c expref: 33 pid: 28600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333171.609528:0:28600:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdf400, rc 0) 00000100:00100000:0.0:1763333171.609590:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+33:2420:x1848987613600000:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 198us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333171.609598:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6295 00000100:00100000:2.0:1763333171.612725:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.613063:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613600256 00000100:00100000:1.0:1763333171.613074:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613600256 00000100:00100000:1.0:1763333171.613132:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9022 00000100:00100000:1.0:1763333171.613142:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:55917:x1848987613600256:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333171.613167:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333171.613170:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763333171.613197:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c54e55 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969075 expref: 236 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.613216:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19d:0x0].0x0 (ffff92ff80045300) 00010000:00010000:1.0:1763333171.613227:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333171.613242:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54e6a lrc: 2/0,0 mode: --/CW res: [0x240000404:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969083 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.613928:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c54e71 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333171.613946:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c54e71 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x19d:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.613957:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c54e71 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x19d:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:1.0:1763333171.613975:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x19d:0x0]: returning size 0 00010000:00010000:1.0:1763333171.614109:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54e6a lrc: 0/0,0 mode: --/CW res: [0x240000404:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969083 expref: 238 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.614126:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c54e71 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x19d:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969083 expref: 237 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.614134:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19d:0x0].0x0 (ffff92fe48355900) 00010000:00010000:1.0:1763333171.614136:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:1.0:1763333171.614139:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7fc00, rc 0) 00000100:00100000:1.0:1763333171.614199:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:55917:x1848987613600256:12345-192.168.204.28@tcp:101:bash.0 Request processed in 1058us (1483us total) trans 4294972064 rc 0/0 00000100:00100000:1.0:1763333171.614208:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9022 00000100:00100000:1.0:1763333171.619105:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333171.619212:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613600640 00000100:00100000:0.0:1763333171.619223:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613600640 00000100:00100000:0.0:1763333171.619293:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3085 00000100:00100000:0.0:1763333171.619303:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56821:x1848987613600640:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333171.619595:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56821:x1848987613600640:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 292us (501us total) trans 4294972065 rc 0/0 00000100:00100000:0.0:1763333171.619603:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3085 00000100:00100000:1.0:1763333171.622566:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333171.622671:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613600384 00000100:00100000:3.0:1763333171.622683:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613600384 00000100:00100000:3.0:1763333171.622942:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9023 00000100:00100000:3.0:1763333171.622953:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:55917:x1848987613600384:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333171.622973:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333171.622993:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c54e7f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696908a expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.623025:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c54e86 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333171.623039:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c54e86 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333171.623051:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c54e86 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333171.623162:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c54e7f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696908a expref: 240 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.623176:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c54e86 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696908a expref: 239 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.623184:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19d:0x0].0x0 (ffff92fe48355900) 00010000:00010000:3.0:1763333171.623188:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763333171.623191:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96e00, rc 0) 00000100:00100000:3.0:1763333171.623849:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:55917:x1848987613600384:12345-192.168.204.28@tcp:101:bash.0 Request processed in 894us (1293us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333171.623859:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9023 00000100:00100000:3.0:1763333171.624855:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.629240:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613600896 00000100:00100000:1.0:1763333171.629257:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613600896 00000100:00100000:1.0:1763333171.629340:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9024 00000100:00100000:1.0:1763333171.629370:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56821:x1848987613600896:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333171.629389:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333171.629414:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54e8d lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969091 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.629493:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54e94 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333171.629507:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54e94 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.629518:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54e94 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.629530:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54e9b lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333171.629547:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54e9b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.629554:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54e9b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.629662:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54ea2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333171.629674:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54ea2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.629692:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54ea2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.629699:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54ea2 lrc: 3/0,0 mode: --/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.629705:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333171.629710:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54ea2 lrc: 3/0,0 mode: --/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.629718:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54ea2 lrc: 4/0,0 mode: --/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.629728:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19d:0x0].0x0 (ffff92fe48355900) 00010000:00010000:1.0:1763333171.629733:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54ea2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.629739:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54ea2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000004:00200000:1.0:1763333171.629754:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x19d:0x0]: returning size 0 00010000:00010000:1.0:1763333171.629834:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54e94 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.629842:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54e94 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.629848:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54e94 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.629854:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54e94 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.629859:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333171.629862:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54e94 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.629868:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54e94 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.629877:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355300) 00010000:00010000:1.0:1763333171.629879:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333171.629882:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54e94 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.629888:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54e94 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.629898:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54e9b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.629903:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54e9b lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.629909:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54e9b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.629915:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333171.629917:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54e9b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.629922:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54e9b lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.629929:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045e00) 00010000:00010000:1.0:1763333171.629932:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333171.629935:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54e9b lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.629945:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54e9b lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.629979:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54e8d lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969091 expref: 241 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.629988:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355300) 00010000:00010000:1.0:1763333171.629991:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763333171.629994:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c54e8d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969091 expref: 241 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.630006:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f000, rc 0) 00000100:00100000:1.0:1763333171.630069:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:56821:x1848987613600896:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 721us (5218us total) trans 4294972066 rc 301/301 00000100:00100000:1.0:1763333171.630078:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9024 00000100:00100000:2.0:1763333171.631397:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333171.632020:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613601152 00000100:00100000:0.0:1763333171.632030:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613601152 00000100:00100000:0.0:1763333171.632091:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9025 00000100:00100000:0.0:1763333171.632100:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:55917:x1848987613601152:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:0.0:1763333171.632146:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333171.632171:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c54e71 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x19d:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969083 expref: 240 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.632258:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19d:0x0].0x0 (ffff92fe48355900) 00010000:00010000:0.0:1763333171.632264:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333171.632465:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54eb0 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333171.632478:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54eb0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.632488:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54eb0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000001:00080000:0.0:1763333171.632531:0:6521:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294972067 00000004:00010000:0.0:1763333171.632566:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006949d0e5 reply state 00000000bc005f64 transno 4294972068 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54eb0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.632578:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54eb0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.632584:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19d:0x0].0x0 (ffff92fe48355900) 00010000:00010000:0.0:1763333171.632588:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333171.632660:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763333171.632762:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:55917:x1848987613601152:12345-192.168.204.28@tcp:36:bash.0 Request processed in 661us (1370us total) trans 4294972068 rc 0/0 00000100:00100000:0.0:1763333171.632771:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9025 00000020:00080000:0.0:1763333171.632776:0:6521:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763333171.637517:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333171.637579:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.637877:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613601408 00000100:00100000:2.0:1763333171.637889:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613601408 00000100:00100000:2.0:1763333171.637956:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3086 00000100:00100000:2.0:1763333171.637974:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:56821:x1848987613601408:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333171.638341:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613601536 00000100:00100000:0.0:1763333171.638376:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613601536 00000100:00100000:0.0:1763333171.638416:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9026 00000100:00100000:0.0:1763333171.638424:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:55917:x1848987613601536:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333171.638441:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333171.638462:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c54eb7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969098 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.638508:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c54eb7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x19d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969098 expref: 245 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.638523:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c54eb7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x19d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969098 expref: 245 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.638552:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19d:0x0].0x0 (ffff92fe48355900) 00010000:00010000:0.0:1763333171.638555:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333171.638560:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdf200, rc 0) 00000100:00100000:2.0:1763333171.638717:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56821:x1848987613601408:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 752us (1211us total) trans 4294972069 rc 0/0 00000100:00100000:2.0:1763333171.638726:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3086 00000100:00100000:0.0:1763333171.638782:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:55917:x1848987613601536:12345-192.168.204.28@tcp:101:bash.0 Request processed in 358us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333171.638789:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9026 00000100:00100000:2.0:1763333171.644306:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333171.644532:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613601664 00000100:00100000:3.0:1763333171.644554:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613601664 00000100:00100000:0.0:1763333171.649852:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3087 00000100:00100000:0.0:1763333171.649885:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bd5e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56821:x1848987613601664:12345-192.168.204.28@tcp:33:lfs.0 00000100:00100000:0.0:1763333171.650085:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bd5e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56821:x1848987613601664:12345-192.168.204.28@tcp:33:lfs.0 Request processed in 217us (5789us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333171.650093:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3087 00000100:00100000:1.0:1763333171.650805:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333171.651002:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613601920 00000100:00100000:0.0:1763333171.651009:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613601920 00000100:00100000:3.0:1763333171.651787:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9027 00000100:00100000:3.0:1763333171.651799:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:55917:x1848987613601920:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333171.651818:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333171.651820:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763333171.651846:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c54eb7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x19d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969098 expref: 244 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.651863:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19d:0x0].0x0 (ffff92fe48355900) 00010000:00010000:3.0:1763333171.651868:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333171.651880:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c54ebe lrc: 2/0,0 mode: --/EX res: [0x240000404:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696909f expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.651920:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c54ec5 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333171.651931:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c54ec5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x19d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333171.651939:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c54ec5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x19d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000040:00080000:3.0:1763333171.652139:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1336, 88 off113248 00000004:00080000:3.0:1763333171.652146:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1275731797086ns, next at 1275845147255ns, rc = 0 00000040:00080000:3.0:1763333171.652179:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1337, 88 off113248 00000004:00080000:3.0:1763333171.652182:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1275731833531ns, next at 1275845117682ns, rc = 0 00000040:00080000:3.0:1763333171.652195:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1338, 88 off113336 00000004:00080000:3.0:1763333171.652198:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1275731849176ns, next at 1275845117682ns, rc = 0 00000040:00080000:3.0:1763333171.652205:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1337, 88 off113336 00000004:00080000:3.0:1763333171.652209:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1275731859874ns, next at 1275845147255ns, rc = 0 00000001:00080000:3.0:1763333171.661720:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972070 is committed 00000004:00080000:3.0:1763333171.661733:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 873 committed 00000004:00080000:3.0:1763333171.661749:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 876 committed 00000004:00080000:3.0:1763333171.661765:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 875 committed 00000004:00080000:3.0:1763333171.661769:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 872 committed 00000100:00100000:2.0:1763333171.661878:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff73165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627229824:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1763333171.661882:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c54ec5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x19d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696909f expref: 226 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.661896:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19d:0x0].0x0 (ffff92fe48355900) 00010000:00010000:3.0:1763333171.661900:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763333171.661917:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c54ebe lrc: 0/0,0 mode: --/EX res: [0x240000404:0x19d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696909f expref: 226 pid: 8606 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1763333171.661935:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c54ec5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x19d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696909f expref: 225 pid: 8606 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333171.661941:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763333171.661989:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19d:0x0].0x0 (ffff92fe48355900) 00000100:00100000:2.0:1763333171.661992:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1763333171.661993:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763333171.661998:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96400, rc 0) 00000100:00100000:2.0:1763333171.662002:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff73165f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627230208:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333171.662027:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333171.662055:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff73165880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627229952:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763333171.662065:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:55917:x1848987613601920:12345-192.168.204.28@tcp:101:bash.0 Request processed in 10266us (11259us total) trans 4294972070 rc 0/0 00000100:00100000:3.0:1763333171.662078:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9027 00000100:00100000:2.0:1763333171.662079:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333171.662101:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1763333171.662106:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff73167100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627230080:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333171.662123:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333171.662161:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627229824 00000100:00100000:2.0:1763333171.662169:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627229824 00000100:00100000:2.0:1763333171.662209:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627230208 00000100:00100000:2.0:1763333171.662211:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627230208 00000100:00100000:2.0:1763333171.662225:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627229952 00000100:00100000:2.0:1763333171.662227:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627229952 00000100:00100000:2.0:1763333171.662239:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627230080 00000100:00100000:2.0:1763333171.662241:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627230080 00000100:00100000:2.0:1763333171.662257:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6296 00000100:00100000:2.0:1763333171.662264:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73164700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+57:3653:x1848987627229824:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1763333171.662288:0:28650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:539 count 1 00000100:00100000:3.0:1763333171.662307:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6297 00010000:00010000:2.0:1763333171.662312:0:28650:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54ecc lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x21b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333171.662321:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73167800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+57:3653:x1848987627230208:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1763333171.662333:0:28650:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c54d4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696902f expref: 32 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.662342:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333171.662345:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333171.662374:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54ecc lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.662402:0:28650:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c54d4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696902f expref: 32 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.662416:0:28650:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c54d4b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696902f expref: 32 pid: 28600 timeout: 1375 lvb_type: 0 00000100:00100000:2.0:1763333171.662428:0:28650:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff75667b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28650:1848987627230336:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333171.662470:0:28650:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff5119de40 going to sleep for 11 seconds 00000100:00100000:2.0:1763333171.662489:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6298 00000100:00100000:2.0:1763333171.662497:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+58:3654:x1848987627229952:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1763333171.662510:0:8406:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:540 count 1 00010000:00010000:2.0:1763333171.662521:0:8406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c54ed3 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333171.662530:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73167800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+58:3653:x1848987627230208:12345-0@lo:2:osp-syn-1-1.0 Request processed in 211us (499us total) trans 17179871479 rc 0/0 00010000:00010000:2.0:1763333171.662547:0:8406:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54c87 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ff0 expref: 32 pid: 8611 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1763333171.662553:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6297 00010000:00010000:2.0:1763333171.662561:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333171.662563:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333171.662566:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c54ed3 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333171.662578:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6299 00000100:00100000:3.0:1763333171.662587:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+57:3654:x1848987627230080:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1763333171.662593:0:8406:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54c87 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ff0 expref: 32 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333171.662603:0:8406:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54c87 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ff0 expref: 32 pid: 8611 timeout: 1375 lvb_type: 1 00000100:00100000:2.0:1763333171.662613:0:8406:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff75664380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8406:1848987627230464:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333171.662641:0:8406:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff5119d540 going to sleep for 11 seconds 00002000:00010000:3.0:1763333171.662650:0:8611:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x21d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333171.662654:0:8611:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x21d:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763333171.662657:0:8611:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x21d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333171.662659:0:8611:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x21d:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763333171.662662:0:8611:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x21d:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00080000:2.0:1763333171.662695:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff73165f80/2, rc 0, transno 17179871479 00000100:00100000:3.0:1763333171.662697:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+58:3654:x1848987627230080:12345-0@lo:2:osp-syn-1-1.0 Request processed in 111us (571us total) trans 17179871480 rc 0/0 00000100:00100000:2.0:1763333171.662704:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff73165f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627230208:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333171.662707:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6299 00000004:00080000:2.0:1763333171.662733:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff73167100/2, rc 0, transno 17179871480 00000100:00100000:2.0:1763333171.662739:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff73167100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627230080:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333171.663062:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627230848:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333171.663088:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333171.663105:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1763333171.663109:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627230720:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763333171.663124:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333171.663144:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627230848 00000100:00100000:1.0:1763333171.663148:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627230848 00000100:00100000:1.0:1763333171.663166:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627230720 00000100:00100000:1.0:1763333171.663169:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627230720 00000100:00100000:1.0:1763333171.663181:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6300 00000100:00100000:1.0:1763333171.663185:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+26:3655:x1848987627230848:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333171.663270:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+27:3655:x1848987627230848:12345-0@lo:2:osp-syn-0-1.0 Request processed in 84us (180us total) trans 21474838783 rc 0/0 00000100:00100000:1.0:1763333171.663276:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6300 00000100:00100000:1.0:1763333171.663288:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6301 00000100:00100000:1.0:1763333171.663293:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+26:3655:x1848987627230720:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1763333171.663301:0:8611:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:540 count 1 00010000:00010000:1.0:1763333171.663312:0:8611:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54eda lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.663324:0:8611:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c54cb1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ff7 expref: 15 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333171.663330:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333171.663331:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333171.663334:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54eda lrc: 4/0,1 mode: --/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.663385:0:8611:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c54cb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ff7 expref: 15 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333171.663395:0:8611:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c54cb1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ff7 expref: 15 pid: 8611 timeout: 1375 lvb_type: 1 00000100:00100000:1.0:1763333171.663405:0:8611:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46a6d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8611:1848987627231104:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333171.663438:0:8611:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe46e0e3c0 going to sleep for 11 seconds 00000004:00080000:1.0:1763333171.663464:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44e07100/2, rc 0, transno 21474838783 00000100:00100000:1.0:1763333171.663468:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627230848:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333171.663607:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627230592:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763333171.663636:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333171.663664:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1763333171.663669:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627230976:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333171.663690:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333171.663712:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627230592 00000100:00100000:2.0:1763333171.663716:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627230592 00000100:00100000:2.0:1763333171.663736:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627230976 00000100:00100000:2.0:1763333171.663738:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627230976 00000100:00100000:2.0:1763333171.663751:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6302 00000100:00100000:2.0:1763333171.663756:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+28:3653:x1848987627230592:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1763333171.663766:0:28600:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:539 count 1 00010000:00010000:2.0:1763333171.663779:0:28600:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54ee1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.663789:0:28600:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54d44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969028 expref: 15 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.663795:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333171.663797:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333171.663799:0:28600:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54ee1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.663822:0:28600:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54d44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969028 expref: 15 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.663831:0:28600:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54d44 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969028 expref: 15 pid: 29010 timeout: 1375 lvb_type: 0 00000100:00100000:2.0:1763333171.663840:0:28600:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff75665880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28600:1848987627231232:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333171.663865:0:28600:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff5119d780 going to sleep for 11 seconds 00000100:00100000:2.0:1763333171.663881:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6303 00000100:00100000:2.0:1763333171.663888:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75665500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+28:3653:x1848987627230976:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333171.664042:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75665500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+29:3653:x1848987627230976:12345-0@lo:2:osp-syn-0-1.0 Request processed in 154us (350us total) trans 21474838784 rc 0/0 00000100:00100000:2.0:1763333171.664050:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6303 00000004:00080000:2.0:1763333171.664080:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44e06300/2, rc 0, transno 21474838784 00000100:00100000:2.0:1763333171.664086:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627230976:0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1763333171.664167:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c54d7c lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.664176:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c54d7c lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.664183:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c54d7c lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.664189:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333171.664193:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c54d7c lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.664200:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c54d7c lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.664214:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045e00) 00010000:00010000:0.0:1763333171.664218:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333171.664222:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c54d7c lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.664228:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c54d7c lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.664245:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54e01 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.664250:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54e01 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.664256:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54e01 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.664260:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7ec00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333171.664263:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54e01 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.664268:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54e01 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.664275:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045e00) 00010000:00010000:0.0:1763333171.664278:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333171.664280:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54e01 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.664285:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54e01 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.664301:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54eb0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.664307:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54eb0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.664312:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54eb0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.664316:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333171.664319:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54eb0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.664324:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54eb0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.664333:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19d:0x0].0x0 (ffff92fe48355900) 00010000:00010000:0.0:1763333171.664336:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333171.664340:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54eb0 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.664386:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c54eb0 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000100:00100000:1.0:1763333171.675699:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333171.675874:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613602176 00000100:00100000:3.0:1763333171.675887:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613602176 00000100:00100000:3.0:1763333171.675963:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9028 00000100:00100000:3.0:1763333171.675974:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:56822:x1848987613602176:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333171.675998:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333171.676023:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c54ee8 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369690a6 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.676103:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c54eef lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333171.676117:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c54eef lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333171.676128:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c54eef lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333171.676140:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c54ef6 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333171.676150:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c54ef6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333171.676156:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c54ef6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333171.676271:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c54efd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333171.676280:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c54efd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333171.676287:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c54efd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:3.0:1763333171.676298:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x19d:0x0]: returning size 2 00000100:00100000:1.0:1763333171.676829:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.676852:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613602304 00000100:00100000:1.0:1763333171.676857:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613602304 00010000:00010000:1.0:1763333171.676881:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c54d4b lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696902f expref: 33 pid: 28600 timeout: 1375 lvb_type: 0 00000100:00100000:1.0:1763333171.676907:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2961 00000100:00100000:1.0:1763333171.676915:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+33:2418:x1848987613602304:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333171.676926:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333171.676930:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c54d4b lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x21b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696902f expref: 33 pid: 28600 timeout: 1375 lvb_type: 0 00010000:00010000:1.0:1763333171.676944:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c54d4b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x21b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696902f expref: 33 pid: 28600 timeout: 1375 lvb_type: 0 00010000:00010000:1.0:1763333171.676984:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333171.676986:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333171.676993:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54ecc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.677004:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54ecc lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x21b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.677028:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333171.677078:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+33:2418:x1848987613602304:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 163us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333171.677085:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2961 00000100:00100000:1.0:1763333171.677129:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.677148:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613602432 00000100:00100000:1.0:1763333171.677151:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613602432 00010000:00010000:1.0:1763333171.677165:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54c87 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ff0 expref: 33 pid: 8611 timeout: 1375 lvb_type: 1 00000100:00100000:1.0:1763333171.677183:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2962 00000100:00100000:1.0:1763333171.677189:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+33:2418:x1848987613602432:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333171.677197:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333171.677201:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54c87 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x21c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ff0 expref: 33 pid: 8611 timeout: 1375 lvb_type: 1 00010000:00010000:1.0:1763333171.677210:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54c87 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x21c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ff0 expref: 33 pid: 8611 timeout: 1375 lvb_type: 1 00010000:00010000:1.0:1763333171.677221:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333171.677223:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333171.677226:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c54ed3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.677233:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c54ed3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x21c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.677245:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333171.677262:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+33:2418:x1848987613602432:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 73us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333171.677268:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2962 00000100:00100000:1.0:1763333171.677371:0:8611:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46a6d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8611:1848987627231104:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333171.677392:0:8611:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54eda lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333171.677465:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.677477:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613602688 00000100:00100000:1.0:1763333171.677481:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613602688 00010000:00010000:1.0:1763333171.677495:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54d44 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969028 expref: 16 pid: 29010 timeout: 1375 lvb_type: 0 00000100:00100000:1.0:1763333171.677512:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2963 00000100:00100000:1.0:1763333171.677518:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2419:x1848987613602688:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333171.677526:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333171.677529:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54d44 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969028 expref: 16 pid: 29010 timeout: 1375 lvb_type: 0 00010000:00010000:1.0:1763333171.677550:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54d44 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969028 expref: 16 pid: 29010 timeout: 1375 lvb_type: 0 00010000:00010000:1.0:1763333171.677564:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333171.677565:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333171.677569:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54ee1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.677575:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54ee1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.677587:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333171.677607:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2419:x1848987613602688:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 89us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333171.677613:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2963 00000100:00100000:1.0:1763333171.677642:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.677654:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613602560 00000100:00100000:1.0:1763333171.677657:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613602560 00010000:00010000:1.0:1763333171.677667:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c54cb1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ff7 expref: 16 pid: 8611 timeout: 1375 lvb_type: 1 00000100:00100000:1.0:1763333171.677683:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2964 00000100:00100000:1.0:1763333171.677688:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2419:x1848987613602560:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333171.677697:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333171.677702:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c54cb1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ff7 expref: 16 pid: 8611 timeout: 1375 lvb_type: 1 00010000:00010000:1.0:1763333171.677711:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c54cb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ff7 expref: 16 pid: 8611 timeout: 1375 lvb_type: 1 00010000:00010000:1.0:1763333171.677723:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c54cb1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x21c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ff7 expref: 16 pid: 8611 timeout: 1375 lvb_type: 1 00010000:00010000:1.0:1763333171.677734:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333171.677736:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333171.677739:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54eda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.677745:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54eda lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.677764:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333171.677780:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2419:x1848987613602560:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 92us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333171.677786:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2964 00010000:00010000:1.0:1763333171.677801:0:8611:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54eda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.677808:0:8611:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54eda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.677817:0:8611:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54eda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.677824:0:8611:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54eda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.677840:0:8611:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763333171.678046:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+29:3655:x1848987627230720:12345-0@lo:6:osp-syn-0-1.0 Request processed in 14751us (14919us total) trans 21474838785 rc 0/0 00000100:00100000:1.0:1763333171.678054:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6301 00010000:00010000:1.0:1763333171.678072:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333171.678077:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54eda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.678085:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333171.678089:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54eda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.678097:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54eda lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.678109:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54eda lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.678116:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c54eda lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.678133:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333171.678135:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333171.678136:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763333171.678162:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44e05f80/2, rc 0, transno 21474838785 00000100:00100000:1.0:1763333171.678168:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627230720:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763333171.678242:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.678259:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613602816 00000100:00100000:1.0:1763333171.678263:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613602816 00000100:00100000:1.0:1763333171.678286:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6304 00000100:00100000:1.0:1763333171.678294:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+33:55917:x1848987613602816:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333171.678306:0:8611:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333171.678319:0:8611:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54f0b lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x21d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369690ad expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.678337:0:8611:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54e63 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696907c expref: 34 pid: 28600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333171.678386:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333171.678387:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333171.678391:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54f0b lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x21d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690ad expref: 34 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.678416:0:8611:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54e63 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696907c expref: 34 pid: 28600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333171.678428:0:8611:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54e63 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696907c expref: 34 pid: 28600 timeout: 1375 lvb_type: 1 00000100:00100000:1.0:1763333171.678441:0:8611:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46a6d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8611:1848987627231360:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333171.678486:0:8611:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe46e0e3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1763333171.678655:0:28600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54d44 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969028 expref: 14 pid: 29010 timeout: 1375 lvb_type: 0 00000100:00100000:2.0:1763333171.678667:0:28600:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff75665880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28600:1848987627231232:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333171.678684:0:28600:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54ee1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.678692:0:28600:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54ee1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.678698:0:28600:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54ee1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.678706:0:28600:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54ee1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.678712:0:28600:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54ee1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.678736:0:28600:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763333171.678859:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+29:3653:x1848987627230592:12345-0@lo:6:osp-syn-0-1.0 Request processed in 15102us (15222us total) trans 21474838786 rc 0/0 00000100:00100000:2.0:1763333171.678866:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6302 00010000:00010000:2.0:1763333171.678899:0:28650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c54d4b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696902f expref: 34 pid: 28600 timeout: 1375 lvb_type: 0 00000100:00100000:2.0:1763333171.678910:0:28650:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff75667b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28650:1848987627230336:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333171.678921:0:28650:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54ecc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.678929:0:28650:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54ecc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.678936:0:28650:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54ecc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.678950:0:28650:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54ecc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.678957:0:28650:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54ecc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.678971:0:28650:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1763333171.679084:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73164700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+58:3653:x1848987627229824:12345-0@lo:6:osp-syn-1-1.0 Request processed in 16819us (17145us total) trans 17179871481 rc 0/0 00000100:00100000:2.0:1763333171.679092:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6296 00010000:00010000:2.0:1763333171.679109:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1763333171.679115:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54ee1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.679122:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4600 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333171.679126:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54ee1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.679133:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54ee1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.679145:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54ee1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.679151:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54ee1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.679177:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333171.679181:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54ecc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.679189:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333171.679192:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54ecc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.679199:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54ecc lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.679209:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54ecc lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.679217:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54ecc lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.679229:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333171.679230:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333171.679232:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763333171.679256:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44e06a00/2, rc 0, transno 21474838786 00000100:00100000:2.0:1763333171.679261:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627230592:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1763333171.679272:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff73165180/2, rc 0, transno 17179871481 00000100:00100000:2.0:1763333171.679276:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff73165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627229824:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1763333171.679550:0:8406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c54c87 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36968ff0 expref: 33 pid: 8611 timeout: 1375 lvb_type: 1 00000100:00100000:0.0:1763333171.679562:0:8406:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff75664380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8406:1848987627230464:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333171.679577:0:8406:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c54ed3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.679578:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c54eef lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333171.679597:0:8406:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c54ed3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.679598:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c54eef lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333171.679616:0:8406:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c54ed3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.679617:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c54eef lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333171.679629:0:8406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c54ed3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.679636:0:8406:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c54ed3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.679650:0:8406:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763333171.679757:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+58:3654:x1848987627229952:12345-0@lo:6:osp-syn-1-1.0 Request processed in 17260us (17680us total) trans 17179871482 rc 0/0 00010000:00010000:3.0:1763333171.679764:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c54eef lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00000100:00100000:0.0:1763333171.679769:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6298 00010000:00010000:3.0:1763333171.679776:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333171.679780:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c54eef lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333171.679787:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c54eef lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00000004:00080000:0.0:1763333171.679803:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff73165880/2, rc 0, transno 17179871482 00000100:00100000:0.0:1763333171.679808:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff73165880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627229952:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1763333171.679860:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6231ed00) 00010000:00010000:3.0:1763333171.679864:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333171.679869:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c54eef lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333171.679875:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c54eef lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333171.679886:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c54ef6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333171.679891:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c54ef6 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333171.679896:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c54ef6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333171.679901:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333171.679904:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c54ef6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.679920:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333171.679926:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c54ed3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.679934:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333171.679938:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c54ed3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.679946:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c54ed3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.679971:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c54ed3 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.679978:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c54ed3 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.679993:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333171.679995:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333171.679996:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333171.680413:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c54ef6 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333171.680424:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6231ec00) 00010000:00010000:3.0:1763333171.680427:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333171.680431:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c54ef6 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333171.680437:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c54ef6 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.680558:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c54ee8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690a6 expref: 225 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.680577:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c54efd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690a6 expref: 224 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.680585:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19d:0x0].0x0 (ffff92fe48355900) 00010000:00010000:2.0:1763333171.680587:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333171.680590:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a97800, rc 0) 00000100:00100000:2.0:1763333171.680640:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56822:x1848987613602176:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 4668us (4951us total) trans 4294972071 rc 0/0 00000100:00100000:2.0:1763333171.680650:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9028 00010000:00010000:1.0:1763333171.685048:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763333171.686251:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.686391:0:8611:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46a6d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8611:1848987627231360:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333171.686429:0:8611:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54f0b lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x21d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690ad expref: 32 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.686450:0:8611:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7ea00, rc 0) 00000100:00100000:2.0:1763333171.686511:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+32:55917:x1848987613602816:12345-192.168.204.28@tcp:101:bash.0 Request processed in 8216us (8267us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333171.686520:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6304 00000100:00100000:3.0:1763333171.687473:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613602944 00000100:00100000:3.0:1763333171.687485:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613602944 00010000:00010000:3.0:1763333171.687524:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54e63 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696907c expref: 32 pid: 28600 timeout: 1375 lvb_type: 1 00000100:00100000:3.0:1763333171.687563:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2965 00000100:00100000:3.0:1763333171.687573:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+32:2418:x1848987613602944:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333171.687591:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333171.687596:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54e63 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x21d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696907c expref: 32 pid: 28600 timeout: 1375 lvb_type: 1 00010000:00010000:3.0:1763333171.687610:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54e63 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x21d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696907c expref: 32 pid: 28600 timeout: 1375 lvb_type: 1 00010000:00010000:3.0:1763333171.687639:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c54e63 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x21d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696907c expref: 32 pid: 28600 timeout: 1375 lvb_type: 1 00010000:00010000:3.0:1763333171.687655:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333171.687657:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333171.687664:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54f0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690ad expref: 31 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.687674:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54f0b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690ad expref: 31 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.687712:0:8423:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54f0b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690ad expref: 31 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333171.687726:0:8423:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7569d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8423:1848987627231488:192.168.204.28@tcp:105: 00000100:00100000:3.0:1763333171.687797:0:8423:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7df5d840 going to sleep for 11 seconds 00000100:00100000:3.0:1763333171.691218:0:8423:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7569d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8423:1848987627231488:192.168.204.28@tcp:105: 00010000:00010000:3.0:1763333171.691244:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333171.691302:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+31:2418:x1848987613602944:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 3730us (5059us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333171.691312:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2965 00000100:00100000:0.0:1763333171.692777:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333171.693392:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.693633:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613603072 00000100:00100000:2.0:1763333171.693644:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613603072 00000100:00100000:2.0:1763333171.694392:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6305 00000100:00100000:2.0:1763333171.694403:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49609880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:55917:x1848987613603072:12345-192.168.204.28@tcp:101:bash.0 00000100:00100000:3.0:1763333171.694415:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613603328 00000100:00100000:3.0:1763333171.694420:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613603328 00010000:00010000:2.0:1763333171.694422:0:8611:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333171.694444:0:8611:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c54f12 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369690b4 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333171.694453:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3088 00000100:00100000:3.0:1763333171.694458:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56822:x1848987613603328:12345-192.168.204.28@tcp:35:lfs.0 00002000:00010000:2.0:1763333171.694467:0:8611:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x21d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763333171.694486:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333171.694488:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333171.694497:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c54f12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690b4 expref: 15 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.694510:0:8611:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c54f12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690b4 expref: 15 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.694526:0:8611:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4400, rc 0) 00000100:00100000:2.0:1763333171.694593:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49609880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:55917:x1848987613603072:12345-192.168.204.28@tcp:101:bash.0 Request processed in 191us (1819us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333171.694600:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6305 00000100:00100000:3.0:1763333171.694633:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56822:x1848987613603328:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 174us (1243us total) trans 4294972072 rc 0/0 00000100:00100000:3.0:1763333171.694639:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3088 00000100:00100000:1.0:1763333171.698096:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.699827:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333171.700122:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613603456 00000100:00100000:0.0:1763333171.700135:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613603456 00002000:00010000:0.0:1763333171.700182:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/541 (0->18446744073709551615) 00002000:00100000:0.0:1763333171.700188:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe44de0a80 with x1848987613603456 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333171.700204:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe44de0a80. 00000100:00100000:0.0:1763333171.700239:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613603584 00000100:00100000:0.0:1763333171.700242:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613603584 00002000:00010000:0.0:1763333171.700254:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/541 (0->18446744073709551615) 00002000:00100000:0.0:1763333171.700257:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe44de2680 with x1848987613603584 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333171.700263:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe44de2680. 00000100:00100000:0.0:1763333171.700291:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1566 00000100:00100000:0.0:1763333171.700300:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+31:2420:x1848987613603456:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:0.0:1763333171.700506:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x21d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333171.700511:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x21d:0x0] updating lvb mtime from disk: 0 -> 1763333171 00002000:00010000:0.0:1763333171.700513:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x21d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333171.700515:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x21d:0x0] updating lvb ctime from disk: 0 -> 1763333171 00002000:00010000:0.0:1763333171.700518:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x21d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333171.700586:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+32:2420:x1848987613603456:12345-192.168.204.28@tcp:10:bash.0 Request processed in 286us (2499us total) trans 17179871483 rc 0/0 00000100:00100000:0.0:1763333171.700597:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1566 00002000:00010000:0.0:1763333171.700601:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/541 (0->18446744073709551615) 00002000:00100000:0.0:1763333171.700604:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe44de0a80 with x1848987613603456 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333171.700608:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe44de0a80. 00000100:00100000:0.0:1763333171.700624:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1567 00000100:00100000:0.0:1763333171.700632:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2420:x1848987613603584:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:0.0:1763333171.700720:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x21d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333171.700723:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x21d:0x0] updating lvb mtime from disk: 0 -> 1763333171 00002000:00010000:0.0:1763333171.700725:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x21d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333171.700727:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x21d:0x0] updating lvb ctime from disk: 0 -> 1763333171 00002000:00010000:0.0:1763333171.700730:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x21d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333171.700761:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2420:x1848987613603584:12345-192.168.204.28@tcp:10:bash.0 Request processed in 130us (945us total) trans 21474838787 rc 0/0 00000100:00100000:0.0:1763333171.700767:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1567 00002000:00010000:0.0:1763333171.700770:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/541 (0->18446744073709551615) 00002000:00100000:0.0:1763333171.700772:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe44de2680 with x1848987613603584 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333171.700777:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe44de2680. 00000100:00100000:1.0:1763333171.711761:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333171.713045:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613603840 00000100:00100000:0.0:1763333171.713059:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613603840 00000100:00100000:0.0:1763333171.713138:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3089 00000100:00100000:0.0:1763333171.713148:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:55917:x1848987613603840:12345-192.168.204.28@tcp:35:bash.0 00000001:00080000:0.0:1763333171.713410:0:6523:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294972073 00000100:00100000:0.0:1763333171.713518:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:55917:x1848987613603840:12345-192.168.204.28@tcp:35:bash.0 Request processed in 371us (1765us total) trans 4294972074 rc 0/0 00000100:00100000:0.0:1763333171.713529:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3089 00000020:00080000:0.0:1763333171.713542:0:6523:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763333171.725719:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.725815:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613604096 00000100:00100000:2.0:1763333171.725829:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613604096 00000100:00100000:2.0:1763333171.726089:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9029 00000100:00100000:2.0:1763333171.726103:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56824:x1848987613604096:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:2.0:1763333171.726179:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1763333171.726213:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c54ec5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x19d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696909f expref: 227 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.726234:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c54efd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690a6 expref: 226 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.726246:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c54e86 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x19d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696908a expref: 225 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.726256:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19d:0x0].0x0 (ffff92fe48355900) 00010000:00010000:2.0:1763333171.726269:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333171.726301:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54f19 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333171.726314:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54f19 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.726323:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54f19 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.726334:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54f20 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333171.726341:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54f20 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.726497:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54f20 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.726595:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54f27 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333171.726604:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54f27 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x19d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.726611:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54f27 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x19d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000040:00080000:2.0:1763333171.726882:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1338, 64 off113400 00000040:00080000:2.0:1763333171.726906:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1339, 64 off113400 00000040:00080000:2.0:1763333171.726916:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1340, 64 off113464 00000040:00080000:2.0:1763333171.726924:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1339, 64 off113464 00010000:00010000:2.0:1763333171.726983:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54f2e lrc: 3/0,1 mode: --/PW res: [0x240000404:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333171.726992:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54f2e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x19d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.726999:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54f2e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x19d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.727077:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54f2e lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x19d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.727089:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54f2e lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x19d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.727095:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54f2e lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x19d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.727592:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333171.727602:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54f2e lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x19d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.727610:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5e00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333171.727614:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54f2e lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x19d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.727622:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54f2e lrc: 5/0,0 mode: PW/PW res: [0x240000404:0x19d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.727634:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19d:0x0].0x0 (ffff92ff618aa900) 00010000:00010000:1.0:1763333171.727637:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1763333171.727642:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54f2e lrc: 3/0,0 mode: --/PW res: [0x240000404:0x19d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.727649:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333171.727651:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333171.727653:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333171.727701:0:8606:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1763333171.727707:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54f2e lrc: 0/0,0 mode: --/PW res: [0x240000404:0x19d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.727786:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54f27 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x19d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.727793:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54f27 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x19d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.727798:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54f27 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x19d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.727802:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333171.727806:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54f27 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x19d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.727812:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54f27 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x19d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.727820:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19d:0x0].0x0 (ffff92ff618aa900) 00010000:00010000:2.0:1763333171.727822:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763333171.727825:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54f27 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x19d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.727830:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54f27 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x19d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.728153:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54f19 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.728161:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54f19 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.728166:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54f19 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.728171:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54f19 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.728177:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333171.728180:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54f19 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.728186:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54f19 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.728195:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff618aa200) 00010000:00010000:2.0:1763333171.728197:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333171.728201:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54f19 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.728206:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54f19 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000004:00010000:2.0:1763333171.728219:0:8606:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000008edbccae reply state 0000000050b50230 transno 4294972075 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54f20 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.728230:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54f20 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.728236:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff618aa300) 00010000:00010000:2.0:1763333171.728239:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333171.728242:0:8606:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763333171.728340:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56824:x1848987613604096:12345-192.168.204.28@tcp:36:rm.0 Request processed in 2235us (2628us total) trans 4294972075 rc 0/0 00000100:00100000:2.0:1763333171.728377:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9029 00000100:00100000:1.0:1763333171.735143:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.735332:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613604352 00000100:00100000:2.0:1763333171.735344:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613604352 00000100:00100000:2.0:1763333171.735429:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9030 00000100:00100000:2.0:1763333171.735440:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56823:x1848987613604352:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333171.735464:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333171.735490:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54f35 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369690bb expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.735616:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54f3c lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333171.735630:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54f3c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.735641:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54f3c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.735651:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54f43 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333171.735657:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54f43 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.735663:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54f43 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.735708:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54f3c lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.735715:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54f3c lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.735720:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54f3c lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.735726:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54f3c lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.735732:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4a00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333171.735735:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54f3c lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.735743:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54f3c lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.735754:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff618aa100) 00010000:00010000:2.0:1763333171.735756:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333171.735761:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54f3c lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.735767:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54f3c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.735779:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54f43 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.735785:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54f43 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.735790:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54f43 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.735795:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333171.735798:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54f43 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.735804:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54f43 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.735810:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff618aa300) 00010000:00010000:2.0:1763333171.735813:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333171.735873:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54f43 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.735881:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54f43 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.735913:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54f35 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690bb expref: 227 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.735923:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff618aa100) 00010000:00010000:2.0:1763333171.735924:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763333171.735928:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54f35 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690bb expref: 227 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.735944:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4800, rc 0) 00000100:00100000:2.0:1763333171.736551:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56823:x1848987613604352:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1111us (1419us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333171.736560:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9030 00000100:00100000:1.0:1763333171.741410:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.741470:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613604480 00000100:00100000:1.0:1763333171.741480:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613604480 00000100:00100000:1.0:1763333171.741551:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9031 00000100:00100000:1.0:1763333171.741563:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56825:x1848987613604480:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333171.741586:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333171.741611:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54f4a lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369690c2 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.741685:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54f51 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333171.741699:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54f51 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.741711:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54f51 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.741721:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54f58 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333171.741729:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54f58 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.741736:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54f58 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.741784:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54f51 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.741790:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54f51 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.741796:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54f51 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.741801:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54f51 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.741807:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333171.741811:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54f51 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.741818:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54f51 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.741829:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355000) 00010000:00010000:1.0:1763333171.741832:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333171.741837:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54f51 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.741843:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54f51 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.741854:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54f58 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.741859:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54f58 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.741866:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54f58 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.741871:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333171.741873:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54f58 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.741879:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54f58 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.741885:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff618aa300) 00010000:00010000:1.0:1763333171.741888:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333171.741890:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54f58 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.741896:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54f58 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.741925:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54f4a lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690c2 expref: 227 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.741934:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355000) 00010000:00010000:1.0:1763333171.741937:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333171.741940:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c54f4a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690c2 expref: 227 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.741964:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e600, rc 0) 00000100:00100000:1.0:1763333171.742033:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56825:x1848987613604480:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 473us (695us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333171.742041:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9031 00000100:00100000:1.0:1763333171.745119:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333171.745699:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613604608 00000100:00100000:3.0:1763333171.745710:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613604608 00000100:00100000:2.0:1763333171.745840:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9032 00000100:00100000:2.0:1763333171.745851:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74035c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56823:x1848987613604608:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333171.745870:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333171.745893:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54f5f lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369690c9 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.745973:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54f66 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333171.745985:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54f66 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.745996:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54f66 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.746006:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54f6d lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333171.746012:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54f6d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.746017:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54f6d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.746054:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54f66 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.746061:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54f66 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.746067:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54f66 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.746073:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54f66 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.746079:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333171.746083:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54f66 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.746093:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54f66 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.746103:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff618aa200) 00010000:00010000:2.0:1763333171.746106:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333171.746111:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54f66 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.746117:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54f66 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.746131:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54f6d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.746136:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54f6d lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.746142:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54f6d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.746146:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333171.746149:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54f6d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.746154:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54f6d lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.746160:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff618aa300) 00010000:00010000:2.0:1763333171.746162:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333171.746165:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54f6d lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.746170:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54f6d lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.746198:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54f5f lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690c9 expref: 227 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.746208:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff618aa200) 00010000:00010000:2.0:1763333171.746210:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333171.746214:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54f5f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690c9 expref: 227 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.746228:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5c00, rc 0) 00000100:00100000:2.0:1763333171.746292:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74035c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56823:x1848987613604608:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 441us (1180us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333171.746299:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9032 00000100:00100000:2.0:1763333171.759830:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.760019:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613604736 00000100:00100000:1.0:1763333171.760034:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613604736 00000100:00100000:1.0:1763333171.760111:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9033 00000100:00100000:1.0:1763333171.760124:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56825:x1848987613604736:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333171.760150:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333171.760179:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54f74 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369690d0 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.760289:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54f7b lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333171.760303:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54f7b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.760314:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54f7b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.760326:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54f82 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333171.760333:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54f82 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.760340:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54f82 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.760433:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54f7b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.760441:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54f7b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.760447:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54f7b lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.760454:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54f7b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.760459:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333171.760463:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54f7b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.760469:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54f7b lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.760479:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355000) 00010000:00010000:1.0:1763333171.760482:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333171.760487:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54f7b lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.760492:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54f7b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.760504:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54f82 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.760510:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54f82 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.760515:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54f82 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.760520:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333171.760522:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54f82 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.760528:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54f82 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.760548:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff618aa300) 00010000:00010000:1.0:1763333171.760550:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333171.760553:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54f82 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.760557:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c54f82 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.760584:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54f74 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690d0 expref: 227 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.760593:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355000) 00010000:00010000:1.0:1763333171.760595:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333171.760598:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c54f74 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690d0 expref: 227 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.760611:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f600, rc 0) 00000100:00100000:1.0:1763333171.760683:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56825:x1848987613604736:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 562us (865us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333171.760692:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9033 00000100:00100000:1.0:1763333171.768822:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.768901:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613604864 00000100:00100000:2.0:1763333171.768912:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613604864 00000100:00100000:2.0:1763333171.768985:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9034 00000100:00100000:2.0:1763333171.768996:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74035880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56825:x1848987613604864:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333171.769019:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333171.769044:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54f89 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369690d7 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.769107:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54f90 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333171.769120:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54f90 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333171.769133:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54f90 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:2.0:1763333171.769181:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1763333171.769186:0:8606:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1763333171.769221:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54f89 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690d7 expref: 228 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.769239:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54f90 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690d7 expref: 227 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.769248:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff618aa200) 00010000:00010000:2.0:1763333171.769251:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1763333171.769254:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4000, rc 0) 00000100:00100000:2.0:1763333171.769317:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74035880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56825:x1848987613604864:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 323us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333171.769325:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9034 00000100:00100000:0.0:1763333171.774175:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.774426:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613605120 00000100:00100000:2.0:1763333171.774438:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613605120 00000100:00100000:2.0:1763333171.774495:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9035 00000100:00100000:2.0:1763333171.774505:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff59228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56826:x1848987613605120:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333171.774527:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333171.774744:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54f97 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369690de expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.774841:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54f9e lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333171.774857:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54f9e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.774867:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54f9e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.774878:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54fa5 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333171.774885:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54fa5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.774891:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54fa5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.774931:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54f9e lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.774937:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54f9e lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.774942:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54f9e lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.775518:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54f9e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.775529:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333171.775542:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54f9e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.775549:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54f9e lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.775561:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff618aa200) 00010000:00010000:2.0:1763333171.775563:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333171.775568:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54f9e lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.775574:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c54f9e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.775590:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54fa5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.775596:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54fa5 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.775601:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54fa5 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.775605:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333171.775608:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54fa5 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.775613:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54fa5 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.775619:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff618aa300) 00010000:00010000:2.0:1763333171.775621:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333171.775624:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54fa5 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.775628:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54fa5 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.775664:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54f97 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690de expref: 228 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.775674:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff618aa200) 00010000:00010000:2.0:1763333171.775677:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763333171.775680:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54f97 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690de expref: 228 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.775696:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5e00, rc 0) 00000100:00100000:2.0:1763333171.776039:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff59228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56826:x1848987613605120:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1534us (1877us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333171.776048:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9035 00000100:00100000:1.0:1763333171.780275:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.780378:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613605248 00000100:00100000:2.0:1763333171.780388:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613605248 00000100:00100000:2.0:1763333171.780555:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9036 00000100:00100000:2.0:1763333171.780565:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74034a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56825:x1848987613605248:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333171.780583:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333171.780603:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54fac lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369690e5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.780686:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54fb3 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333171.780700:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54fb3 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.780709:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54fb3 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.780721:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54fba lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333171.780727:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54fba lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.780733:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54fba lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.780776:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54fb3 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.780782:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54fb3 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.780789:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54fb3 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.780795:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54fb3 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.780800:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4a00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333171.780804:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54fb3 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.780810:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54fb3 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.780821:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff618aa200) 00010000:00010000:2.0:1763333171.780824:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333171.780828:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54fb3 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.780833:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54fb3 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.780846:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54fba lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.780851:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54fba lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.780856:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54fba lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.780862:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333171.780864:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54fba lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.780870:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54fba lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.780877:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff618aa300) 00010000:00010000:2.0:1763333171.780879:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333171.780882:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54fba lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.780887:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54fba lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.780911:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54fac lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690e5 expref: 228 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.780920:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff618aa200) 00010000:00010000:2.0:1763333171.780923:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333171.780926:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54fac lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690e5 expref: 228 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.780934:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5c00, rc 0) 00000100:00100000:2.0:1763333171.781291:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74034a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56825:x1848987613605248:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 726us (1022us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333171.781300:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9036 00000100:00100000:3.0:1763333171.789230:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.789642:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613605504 00000100:00100000:2.0:1763333171.789652:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613605504 00000100:00100000:2.0:1763333171.789821:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9037 00000100:00100000:2.0:1763333171.789832:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56825:x1848987613605504:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333171.789854:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333171.789858:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763333171.789885:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54f90 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690d7 expref: 227 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.789903:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff618aa200) 00010000:00010000:2.0:1763333171.789913:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333171.789928:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54fc1 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369690ec expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.790031:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54fc8 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333171.790043:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54fc8 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.790053:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54fc8 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.790064:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54fcf lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333171.790070:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54fcf lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.790076:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54fcf lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.790478:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54fd6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333171.790492:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54fd6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.790499:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54fd6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:2.0:1763333171.790508:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x19e:0x0]: returning size 0 00010000:00010000:2.0:1763333171.790528:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54fc8 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.790544:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54fc8 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.790550:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54fc8 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.790557:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54fc8 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.790563:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333171.790567:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54fc8 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.790573:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54fc8 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.790581:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff618aa100) 00010000:00010000:2.0:1763333171.790584:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333171.790587:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54fc8 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.790592:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c54fc8 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000004:00010000:2.0:1763333171.790607:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000077ed938b reply state 000000005097b5cc transno 4294972076 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54fcf lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.790617:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54fcf lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.790623:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff618aa300) 00010000:00010000:2.0:1763333171.790625:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333171.790628:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763333171.790651:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c54fc1 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690ec expref: 229 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.793456:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763333171.793514:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff74036a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1848987627231616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1763333171.793589:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333171.793685:0:8409:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627231616 00000100:00100000:1.0:1763333171.793695:0:8409:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627231616 00000100:00100000:1.0:1763333171.793751:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 777 00000100:00100000:1.0:1763333171.793760:0:8409:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1848987627231616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1763333171.793781:0:8409:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 484899904 pending 0 free 3920232448 avail 3688681472 00000100:00100000:1.0:1763333171.793823:0:8409:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1848987627231616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333171.793830:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 777 00000100:00100000:1.0:1763333171.793876:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff74036a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1848987627231616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1763333171.795001:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1848987627231744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1763333171.795048:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333171.795208:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627231744 00000100:00100000:3.0:1763333171.795215:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627231744 00000100:00100000:3.0:1763333171.795259:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 778 00000100:00100000:3.0:1763333171.795267:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74036a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1848987627231744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1763333171.795283:0:8408:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 484957248 pending 57344 free 3919175680 avail 3687653376 00000100:00100000:3.0:1763333171.796695:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74036a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1848987627231744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1424us (1640us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333171.796706:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 778 00000100:00100000:1.0:1763333171.796855:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1848987627231744:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1763333171.797014:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54fd6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690ec expref: 228 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.797033:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19e:0x0].0x0 (ffff92ff618aa900) 00010000:00010000:2.0:1763333171.797036:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333171.797040:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5e00, rc 0) 00000100:00100000:2.0:1763333171.797584:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56825:x1848987613605504:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 7752us (8361us total) trans 4294972076 rc 0/0 00000100:00100000:2.0:1763333171.797592:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9037 00000004:00080000:0.0:1763333171.799255:0:8605:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1275878904614ns, next at 1276878902000ns, rc = 0 00000100:00100000:2.0:1763333171.799390:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627231872:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1763333171.799445:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333171.800491:0:8409:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627231872 00000100:00100000:0.0:1763333171.800501:0:8409:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627231872 00000100:00100000:0.0:1763333171.800568:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 779 00000100:00100000:0.0:1763333171.800578:0:8409:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75665880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+29:3655:x1848987627231872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1763333171.800602:0:8409:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 484899904 pending 0 free 3920232448 avail 3688681472 00000100:00100000:0.0:1763333171.800665:0:8409:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75665880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+29:3655:x1848987627231872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (1219us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333171.800672:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 779 00000100:00100000:0.0:1763333171.800731:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627231872:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1763333171.801827:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.802147:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613605760 00000100:00100000:2.0:1763333171.802155:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613605760 00000100:00100000:2.0:1763333171.802214:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9038 00000100:00100000:2.0:1763333171.802223:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74037480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56825:x1848987613605760:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333171.802245:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333171.802268:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54fe4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369690f3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333171.803222:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:2.0:1763333171.804382:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54feb lrc: 3/0,1 mode: --/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333171.804403:0:6521:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54fd6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690ec expref: 230 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.804412:0:6521:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54feb lrc: 4/0,1 mode: --/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.804449:0:6521:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54fd6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690ec expref: 230 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.804462:0:6521:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54fd6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690ec expref: 230 pid: 6521 timeout: 1375 lvb_type: 0 00000100:00100000:2.0:1763333171.804477:0:6521:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff75665f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6521:1848987627232000:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333171.804571:0:6521:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff5119de40 going to sleep for 11 seconds 00000100:00100000:1.0:1763333171.804643:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613606016 00000100:00100000:1.0:1763333171.804651:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613606016 00000100:00100000:1.0:1763333171.804704:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9039 00000100:00100000:1.0:1763333171.804714:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56827:x1848987613606016:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333171.804729:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333171.804740:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54ff2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369690fa expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.804808:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54ff9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333171.804818:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54ff9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.804828:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54ff9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:1.0:1763333171.804838:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x19e:0x0]: returning size 0 00010000:00010000:1.0:1763333171.804921:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54ff9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.804932:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54ff9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.804938:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54ff9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.804943:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7ec00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333171.804946:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54ff9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.804953:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54ff9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.804963:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19e:0x0].0x0 (ffff92ff618aa900) 00010000:00010000:1.0:1763333171.804965:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1763333171.804969:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54ff9 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.804973:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c54ff9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333171.805007:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54ff2 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x19e:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690fa expref: 233 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.805016:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19e:0x0].0x0 (ffff92ff618aa900) 00010000:00010000:1.0:1763333171.805018:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763333171.805021:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c54ff2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x19e:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690fa expref: 233 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.805029:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f800, rc 0) 00000100:00100000:1.0:1763333171.805061:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56827:x1848987613606016:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 349us (1844us total) trans 4294972077 rc 301/301 00000100:00100000:1.0:1763333171.805068:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9039 00000100:00100000:0.0:1763333171.809661:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333171.809695:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333171.809772:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613606144 00000100:00100000:3.0:1763333171.809783:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613606144 00010000:00010000:3.0:1763333171.809823:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54fd6 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690ec expref: 232 pid: 6521 timeout: 1375 lvb_type: 0 00000100:00100000:3.0:1763333171.809861:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2966 00000100:00100000:3.0:1763333171.809870:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:2419:x1848987613606144:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333171.809886:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333171.809893:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54fd6 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690ec expref: 232 pid: 6521 timeout: 1375 lvb_type: 0 00010000:00010000:3.0:1763333171.809904:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54fd6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690ec expref: 232 pid: 6521 timeout: 1375 lvb_type: 0 00010000:00010000:3.0:1763333171.809925:0:8423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19e:0x0].0x0 (ffff92ff618aa900) 00010000:00010000:3.0:1763333171.809931:0:8423:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54feb lrc: 3/0,1 mode: --/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333171.809940:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54feb lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333171.809946:0:8423:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54feb lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.810084:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c54fd6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690ec expref: 232 pid: 6521 timeout: 1375 lvb_type: 0 00000100:00100000:2.0:1763333171.810101:0:6521:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff75665f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6521:1848987627232000:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333171.810187:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613606400 00000100:00100000:1.0:1763333171.810193:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613606400 00000100:00100000:1.0:1763333171.810230:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3090 00000100:00100000:1.0:1763333171.810238:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56827:x1848987613606400:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1763333171.810478:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56827:x1848987613606400:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 240us (780us total) trans 4294972078 rc 0/0 00000100:00100000:1.0:1763333171.810485:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3090 00010000:00010000:2.0:1763333171.811320:0:6521:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54feb lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333171.812377:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333171.812444:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:2419:x1848987613606144:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 2570us (2787us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333171.812455:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2966 00010000:00010000:2.0:1763333171.812552:0:6521:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54feb lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.812561:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54feb lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:2.0:1763333171.812590:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x19e:0x0]: returning size 0 00000004:00080000:2.0:1763333171.812784:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x21f:0x0], index 0: 0 00000004:00080000:2.0:1763333171.812791:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x21f:0x0], index 1: 0 00000004:00080000:2.0:1763333171.812796:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x220:0x0], index 1: 0 00000004:00080000:2.0:1763333171.812799:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x220:0x0], index 0: 0 00010000:00010000:2.0:1763333171.812898:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54feb lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.812905:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54feb lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.812911:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54feb lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.812916:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333171.812920:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54feb lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.812927:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54feb lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.812941:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19e:0x0].0x0 (ffff92ff618aa900) 00010000:00010000:2.0:1763333171.812944:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333171.812964:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54feb lrc: 2/0,0 mode: --/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.812970:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c54feb lrc: 0/0,0 mode: --/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.813018:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54fe4 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x19e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690f3 expref: 232 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.813033:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19e:0x0].0x0 (ffff92ff618aa900) 00010000:00010000:2.0:1763333171.813035:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763333171.813038:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c54fe4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x19e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690f3 expref: 232 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.813052:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4000, rc 0) 00000100:00100000:2.0:1763333171.813100:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74037480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56825:x1848987613605760:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 10878us (11278us total) trans 4294972079 rc 301/301 00000100:00100000:2.0:1763333171.813107:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9038 00000100:00100000:2.0:1763333171.819344:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333171.819845:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.819970:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613606912 00000100:00100000:1.0:1763333171.819982:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613606912 00000100:00100000:1.0:1763333171.820041:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3091 00000100:00100000:1.0:1763333171.820051:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56825:x1848987613606912:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1763333171.820318:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56825:x1848987613606912:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 267us (473us total) trans 4294972080 rc 0/0 00000100:00100000:1.0:1763333171.820325:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3091 00000100:00100000:0.0:1763333171.820486:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613606656 00000100:00100000:0.0:1763333171.820490:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613606656 00000100:00100000:0.0:1763333171.820527:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9040 00000100:00100000:0.0:1763333171.820542:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56827:x1848987613606656:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333171.820552:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333171.820571:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c5500e lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969101 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.820648:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c55015 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333171.820667:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c55015 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.820679:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c55015 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.820689:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5501c lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333171.820697:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5501c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.820703:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5501c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.820791:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c55023 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333171.820799:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c55023 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.820806:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c55023 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:0.0:1763333171.820816:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x19e:0x0]: returning size 0 00010000:00010000:0.0:1763333171.820866:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c55015 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.820872:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c55015 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.820877:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c55015 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.820883:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c55015 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.820889:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333171.820893:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c55015 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.820899:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c55015 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.820909:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44200) 00010000:00010000:0.0:1763333171.820912:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333171.820917:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c55015 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.820922:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c55015 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.820934:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5501c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.820940:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5501c lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.820945:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5501c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.820951:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333171.820953:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5501c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.820958:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5501c lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.820964:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff618aa300) 00010000:00010000:0.0:1763333171.820966:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333171.820969:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5501c lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.820974:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5501c lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.820998:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c5500e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969101 expref: 235 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.821012:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c55023 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969101 expref: 234 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.821019:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19e:0x0].0x0 (ffff92fe43b44700) 00010000:00010000:0.0:1763333171.821021:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333171.821023:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdea00, rc 0) 00000100:00100000:0.0:1763333171.821047:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:56827:x1848987613606656:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 514us (1713us total) trans 4294972081 rc 0/0 00000100:00100000:0.0:1763333171.821052:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9040 00000100:00100000:1.0:1763333171.824903:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.825280:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613607168 00000100:00100000:2.0:1763333171.825291:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613607168 00000100:00100000:2.0:1763333171.825772:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3092 00000100:00100000:2.0:1763333171.825784:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:56825:x1848987613607168:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333171.826006:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:56825:x1848987613607168:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 224us (1111us total) trans 4294972082 rc 0/0 00000100:00100000:2.0:1763333171.826013:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3092 00000100:00100000:3.0:1763333171.827824:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.828116:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613607296 00000100:00100000:1.0:1763333171.828124:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613607296 00000100:00100000:0.0:1763333171.828500:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6306 00000100:00100000:0.0:1763333171.828514:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+32:2420:x1848987613607296:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333171.828540:0:8406:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333171.828561:0:8406:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55031 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969108 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763333171.828587:0:8406:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x220:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333171.828608:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333171.828610:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333171.828619:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55031 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969108 expref: 33 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333171.828641:0:8406:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55031 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969108 expref: 33 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333171.828654:0:8406:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdf600, rc 0) 00000100:00100000:0.0:1763333171.828701:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+33:2420:x1848987613607296:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 192us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333171.828707:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6306 00000100:00100000:2.0:1763333171.832446:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333171.832652:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613607424 00000100:00100000:0.0:1763333171.832663:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613607424 00000100:00100000:0.0:1763333171.832727:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6307 00000100:00100000:0.0:1763333171.832738:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2420:x1848987613607424:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333171.832757:0:8611:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333171.832781:0:8611:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdee00/0xb32e3ef184c55038 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696910f expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763333171.832805:0:8611:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x220:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333171.832824:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333171.832826:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333171.832834:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdee00/0xb32e3ef184c55038 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696910f expref: 17 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333171.832851:0:8611:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdee00/0xb32e3ef184c55038 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696910f expref: 17 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333171.832862:0:8611:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdee00, rc 0) 00000100:00100000:0.0:1763333171.832914:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2420:x1848987613607424:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 178us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333171.832920:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6307 00000100:00100000:3.0:1763333171.834028:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.834147:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613607680 00000100:00100000:1.0:1763333171.834155:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613607680 00000100:00100000:1.0:1763333171.834210:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9041 00000100:00100000:1.0:1763333171.834219:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:55917:x1848987613607680:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333171.834242:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333171.834245:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763333171.834272:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c55023 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969101 expref: 235 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.834293:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19e:0x0].0x0 (ffff92fe43b44700) 00010000:00010000:1.0:1763333171.834306:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333171.834321:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5503f lrc: 2/0,0 mode: --/CW res: [0x240000404:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969116 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.835529:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c55046 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333171.835556:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c55046 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x19e:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333171.835567:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c55046 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x19e:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:1.0:1763333171.835583:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x19e:0x0]: returning size 0 00010000:00010000:1.0:1763333171.835698:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5503f lrc: 0/0,0 mode: --/CW res: [0x240000404:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969116 expref: 237 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.835713:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c55046 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x19e:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969116 expref: 236 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.835720:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19e:0x0].0x0 (ffff92fe48355000) 00010000:00010000:1.0:1763333171.835723:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:1.0:1763333171.835726:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f000, rc 0) 00000100:00100000:1.0:1763333171.836415:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:55917:x1848987613607680:12345-192.168.204.28@tcp:101:bash.0 Request processed in 2193us (2387us total) trans 4294972083 rc 0/0 00000100:00100000:1.0:1763333171.836425:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9041 00000100:00100000:3.0:1763333171.838150:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.838235:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613607808 00000100:00100000:1.0:1763333171.838246:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613607808 00000100:00100000:1.0:1763333171.838306:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9042 00000100:00100000:1.0:1763333171.838316:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56827:x1848987613607808:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333171.838338:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333171.838381:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55054 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696911d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.838432:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55054 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696911d expref: 237 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.838445:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55054 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696911d expref: 237 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.838462:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19e:0x0].0x0 (ffff92fe48355000) 00010000:00010000:1.0:1763333171.838465:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763333171.838468:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7fc00, rc 0) 00000100:00100000:1.0:1763333171.838596:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56827:x1848987613607808:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 281us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333171.838603:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9042 00000100:00100000:2.0:1763333171.838835:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.839079:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613607936 00000100:00100000:1.0:1763333171.839084:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613607936 00000100:00100000:1.0:1763333171.839118:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9043 00000100:00100000:1.0:1763333171.839125:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:55917:x1848987613607936:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333171.839135:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333171.839145:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c5505b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969124 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.839168:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55062 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333171.839177:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55062 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333171.839186:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55062 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333171.839290:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c5505b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969124 expref: 239 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.839308:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55062 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969124 expref: 238 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.839315:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19e:0x0].0x0 (ffff92fe48355000) 00010000:00010000:1.0:1763333171.839317:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763333171.839320:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f200, rc 0) 00000100:00100000:1.0:1763333171.839384:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:55917:x1848987613607936:12345-192.168.204.28@tcp:101:bash.0 Request processed in 258us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333171.839390:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9043 00000100:00100000:3.0:1763333171.841497:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333171.841580:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.841640:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613608448 00000100:00100000:1.0:1763333171.841649:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613608448 00000100:00100000:2.0:1763333171.841702:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613608192 00000100:00100000:2.0:1763333171.841707:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613608192 00000100:00100000:2.0:1763333171.841765:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3093 00000100:00100000:2.0:1763333171.841775:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bd5fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56827:x1848987613608192:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333171.841977:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bd5fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56827:x1848987613608192:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 202us (486us total) trans 4294972084 rc 0/0 00000100:00100000:2.0:1763333171.841987:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3093 00000100:00100000:1.0:1763333171.842779:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9044 00000100:00100000:1.0:1763333171.842787:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:55917:x1848987613608448:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:1.0:1763333171.842818:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333171.842844:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c55046 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x19e:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969116 expref: 239 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.842872:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19e:0x0].0x0 (ffff92fe48355000) 00010000:00010000:1.0:1763333171.842878:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333171.843009:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55069 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333171.843022:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55069 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333171.843030:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55069 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000001:00080000:1.0:1763333171.843069:0:6519:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294972085 00000004:00010000:1.0:1763333171.843090:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000944f1fe7 reply state 0000000012d87602 transno 4294972086 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55069 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333171.843101:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55069 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333171.843108:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19e:0x0].0x0 (ffff92fe48355000) 00010000:00010000:1.0:1763333171.843110:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333171.843113:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763333171.843186:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:55917:x1848987613608448:12345-192.168.204.28@tcp:36:bash.0 Request processed in 399us (1604us total) trans 4294972086 rc 0/0 00000100:00100000:1.0:1763333171.843192:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9044 00000020:00080000:1.0:1763333171.843196:0:6519:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763333171.846316:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.846821:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613608704 00000100:00100000:1.0:1763333171.846831:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613608704 00000100:00100000:2.0:1763333171.846894:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.847081:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613608960 00000100:00100000:1.0:1763333171.847086:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613608960 00000100:00100000:1.0:1763333171.847147:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9045 00000100:00100000:1.0:1763333171.847157:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:55917:x1848987613608960:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333171.847185:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333171.847189:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763333171.847221:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55054 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696911d expref: 242 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.847241:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19e:0x0].0x0 (ffff92fe48355000) 00010000:00010000:1.0:1763333171.847246:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333171.847261:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55070 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969132 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.847314:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55077 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333171.847328:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55077 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x19e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.847336:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55077 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x19e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000040:00080000:1.0:1763333171.847603:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1341, 88 off113552 00000004:00080000:1.0:1763333171.847613:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1275927263263ns, next at 1276878902000ns, rc = 0 00000040:00080000:1.0:1763333171.847648:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1340, 88 off113552 00000004:00080000:1.0:1763333171.847652:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1275927303437ns, next at 1275845147255ns, rc = 0 00000040:00080000:1.0:1763333171.847683:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1341, 88 off113640 00000004:00080000:1.0:1763333171.847687:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1275927338507ns, next at 1275845147255ns, rc = 0 00000040:00080000:1.0:1763333171.847697:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1342, 88 off113640 00000004:00080000:1.0:1763333171.847700:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1275927351480ns, next at 1276878902000ns, rc = 0 00000100:00100000:0.0:1763333171.847844:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9046 00000100:00100000:0.0:1763333171.847852:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:56827:x1848987613608704:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333171.847861:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333171.847875:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c5507e lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696912b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.847938:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c55085 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333171.847955:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c55085 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.847963:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c55085 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.847974:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c5508c lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333171.847980:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c5508c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.847986:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c5508c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.848066:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c55093 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333171.848074:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c55093 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.848085:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c55093 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:0.0:1763333171.848094:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x19e:0x0]: returning size 2 00010000:00010000:0.0:1763333171.848143:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c55093 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.848150:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c55093 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.848157:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c55093 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.848162:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdfe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333171.848166:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c55093 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.848172:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c55093 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.848179:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19e:0x0].0x0 (ffff92fe48355000) 00010000:00010000:0.0:1763333171.848182:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1763333171.848187:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c55093 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.848192:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c55093 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.848207:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c55085 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.848212:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c55085 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.848220:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c55085 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.848225:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c55085 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.848229:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333171.848232:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c55085 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.848237:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c55085 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.848244:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44200) 00010000:00010000:0.0:1763333171.848246:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333171.848249:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c55085 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.848254:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c55085 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.848262:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c5508c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.848267:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c5508c lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.848273:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c5508c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.848277:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333171.848280:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c5508c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.848288:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c5508c lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.848295:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff618aa300) 00010000:00010000:0.0:1763333171.848297:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333171.848300:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c5508c lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.848305:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c5508c lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.848335:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c5507e lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696912b expref: 245 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.848343:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44200) 00010000:00010000:0.0:1763333171.848345:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763333171.848381:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c5507e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696912b expref: 245 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.848396:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abde400, rc 0) 00000100:00100000:0.0:1763333171.848459:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56827:x1848987613608704:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 608us (2152us total) trans 4294972088 rc 301/301 00000100:00100000:0.0:1763333171.848467:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9046 00000001:00080000:3.0:1763333171.853577:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972088 is committed 00000004:00080000:3.0:1763333171.853594:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 879 committed 00000004:00080000:3.0:1763333171.854461:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 875 committed 00000004:00080000:3.0:1763333171.854483:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 874 committed 00000004:00080000:3.0:1763333171.854486:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 878 committed 00000004:00080000:3.0:1763333171.854509:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 877 committed 00000100:00100000:1.0:1763333171.854684:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff74037100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627232256:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763333171.854744:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333171.854779:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1763333171.854784:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff74036680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627232128:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763333171.854799:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333171.854820:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff74034000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627232384:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333171.854838:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333171.854850:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1763333171.854854:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff74036300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627232512:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333171.854868:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1763333171.854926:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55077 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x19e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969132 expref: 226 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.854940:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19e:0x0].0x0 (ffff92fe48355000) 00010000:00010000:1.0:1763333171.854943:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763333171.854957:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55070 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969132 expref: 226 pid: 6521 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763333171.854974:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55077 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x19e:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969132 expref: 225 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.855001:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19e:0x0].0x0 (ffff92fe48355000) 00010000:00010000:1.0:1763333171.855004:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763333171.855006:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7ec00, rc 0) 00000100:00100000:1.0:1763333171.855053:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:55917:x1848987613608960:12345-192.168.204.28@tcp:101:bash.0 Request processed in 7897us (8159us total) trans 4294972087 rc 0/0 00000100:00100000:1.0:1763333171.855062:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9045 00010000:00010000:0.0:1763333171.855377:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54f20 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333171.855387:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54f20 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333171.855393:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54f20 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333171.855399:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333171.855404:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54f20 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333171.855411:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54f20 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333171.855422:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff618aa300) 00010000:00010000:0.0:1763333171.855424:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333171.855428:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54f20 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333171.855434:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c54f20 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333171.855448:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54fcf lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.855453:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54fcf lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.855458:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54fcf lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.855462:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4a00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333171.855464:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54fcf lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.855469:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54fcf lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.855474:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff618aa300) 00010000:00010000:0.0:1763333171.855477:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333171.855479:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54fcf lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.855484:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c54fcf lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.855498:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55069 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.855503:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55069 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.855508:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55069 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.855513:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333171.855515:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55069 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.855519:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55069 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.855525:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19e:0x0].0x0 (ffff92fe48355000) 00010000:00010000:0.0:1763333171.855527:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333171.855529:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55069 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333171.855541:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55069 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000100:00100000:0.0:1763333171.855564:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627232256 00000100:00100000:0.0:1763333171.855570:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627232256 00000100:00100000:0.0:1763333171.855603:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627232128 00000100:00100000:0.0:1763333171.855606:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627232128 00000100:00100000:0.0:1763333171.855619:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627232384 00000100:00100000:0.0:1763333171.855621:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627232384 00000100:00100000:0.0:1763333171.855632:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627232512 00000100:00100000:0.0:1763333171.855634:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627232512 00000100:00100000:0.0:1763333171.855648:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6308 00000100:00100000:0.0:1763333171.855654:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74035f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+61:3653:x1848987627232256:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1763333171.855676:0:8611:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:542 count 1 00002000:00010000:0.0:1763333171.855700:0:8611:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x21e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333171.855705:0:8611:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c550a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.855716:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333171.855719:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333171.855723:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c550a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.855734:0:8611:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c550a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.855741:0:8611:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c550a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.855747:0:8611:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c550a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.855761:0:8611:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763333171.855942:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74035f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+62:3653:x1848987627232256:12345-0@lo:6:osp-syn-1-1.0 Request processed in 287us (1197us total) trans 17179871484 rc 0/0 00000100:00100000:0.0:1763333171.855965:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6308 00000100:00100000:0.0:1763333171.855979:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6309 00000100:00100000:0.0:1763333171.855986:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74034380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+61:3653:x1848987627232128:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1763333171.855998:0:8611:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:541 count 1 00010000:00010000:0.0:1763333171.856009:0:8611:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c550a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x21d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.856021:0:8611:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54f0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690ad expref: 32 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.856027:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333171.856029:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333171.856031:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c550a8 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.856059:0:8611:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54f0b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690ad expref: 32 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.856072:0:8611:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54f0b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690ad expref: 32 pid: 8611 timeout: 1375 lvb_type: 0 00000100:00100000:0.0:1763333171.856086:0:8611:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77a3c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8611:1848987627232640:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333171.856140:0:8611:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff47d41480 going to sleep for 11 seconds 00000100:00100000:0.0:1763333171.856158:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6310 00000100:00100000:0.0:1763333171.856165:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74035180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+61:3654:x1848987627232384:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333171.856267:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74035180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+62:3654:x1848987627232384:12345-0@lo:2:osp-syn-1-1.0 Request processed in 102us (1427us total) trans 17179871485 rc 0/0 00000100:00100000:0.0:1763333171.856275:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6310 00000100:00100000:0.0:1763333171.856288:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6311 00000100:00100000:0.0:1763333171.856295:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74037b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+61:3654:x1848987627232512:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1763333171.856346:0:29010:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x220:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333171.856370:0:29010:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x220:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763333171.856372:0:29010:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x220:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333171.856374:0:29010:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x220:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763333171.856377:0:29010:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x220:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333171.856401:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74037b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+62:3654:x1848987627232512:12345-0@lo:2:osp-syn-1-1.0 Request processed in 107us (1531us total) trans 17179871486 rc 0/0 00000100:00100000:0.0:1763333171.856408:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6311 00010000:00010000:0.0:1763333171.856429:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333171.856435:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c550a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.856443:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdea00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333171.856446:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c550a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.856453:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c550a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.856467:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c550a1 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.856473:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c550a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.856489:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333171.856491:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333171.856492:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763333171.856525:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff74037100/2, rc 0, transno 17179871484 00000100:00100000:0.0:1763333171.856541:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff74037100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627232256:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1763333171.856562:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff74036300/2, rc 0, transno 17179871486 00000100:00100000:0.0:1763333171.856566:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff74036300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627232512:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1763333171.856573:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff74034000/2, rc 0, transno 17179871485 00000100:00100000:0.0:1763333171.856576:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff74034000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627232384:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333171.857499:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff75665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627232768:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763333171.857556:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333171.857578:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627232768 00000100:00100000:2.0:1763333171.857584:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763333171.857586:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627232768 00000100:00100000:2.0:1763333171.857593:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff75664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627232896:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763333171.857618:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333171.857629:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627232896 00000100:00100000:1.0:1763333171.857634:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627232896 00000100:00100000:2.0:1763333171.857655:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff75665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627233152:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333171.857662:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6312 00000100:00100000:1.0:1763333171.857673:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+30:3652:x1848987627232768:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763333171.857684:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1763333171.857699:0:8404:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:541 count 1 00000100:00100000:2.0:1763333171.857702:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1763333171.857709:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff75666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627233024:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1763333171.857723:0:8404:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c550af lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333171.857733:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1763333171.857750:0:8404:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c54f12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690b4 expref: 16 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333171.857756:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627233152 00010000:00010000:1.0:1763333171.857760:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1763333171.857761:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627233152 00010000:00010000:1.0:1763333171.857764:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333171.857770:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c550af lrc: 4/0,1 mode: --/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333171.857787:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627233024 00000100:00100000:2.0:1763333171.857791:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627233024 00000100:00100000:2.0:1763333171.857810:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6313 00000100:00100000:2.0:1763333171.857819:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75667800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+32:3652:x1848987627232896:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1763333171.857819:0:8404:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c54f12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690b4 expref: 16 pid: 8611 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1763333171.857835:0:28600:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:542 count 1 00010000:00010000:1.0:1763333171.857839:0:8404:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c54f12 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690b4 expref: 16 pid: 8611 timeout: 1375 lvb_type: 0 00000100:00100000:1.0:1763333171.857853:0:8404:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff74035500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8404:1848987627233280:192.168.204.28@tcp:104: 00002000:00010000:2.0:1763333171.857859:0:28600:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x21e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763333171.857867:0:28600:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c550b6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.857876:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333171.857877:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333171.857882:0:28600:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c550b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.857899:0:28600:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c550b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.857908:0:28600:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c550b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333171.857912:0:8404:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe46e0e6c0 going to sleep for 11 seconds 00010000:00010000:2.0:1763333171.857918:0:28600:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c550b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.857938:0:28600:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763333171.857964:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333171.859486:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6314 00000100:00100000:3.0:1763333171.859501:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+33:3655:x1848987627233152:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1763333171.859650:0:28651:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x220:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333171.859654:0:28651:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x220:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763333171.859656:0:28651:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x220:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333171.859658:0:28651:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x220:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763333171.859661:0:28651:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x220:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333171.859998:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75667800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+34:3652:x1848987627232896:12345-0@lo:6:osp-syn-0-1.0 Request processed in 2180us (2378us total) trans 21474838788 rc 0/0 00000100:00100000:2.0:1763333171.860007:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6313 00000100:00100000:2.0:1763333171.860027:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6315 00000100:00100000:2.0:1763333171.860034:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+33:3655:x1848987627233024:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333171.860107:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+34:3655:x1848987627233024:12345-0@lo:2:osp-syn-0-1.0 Request processed in 74us (2376us total) trans 21474838790 rc 0/0 00000100:00100000:2.0:1763333171.860113:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6315 00010000:00010000:2.0:1763333171.860139:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333171.860147:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c550b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.860157:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4800 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333171.860161:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c550b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.860177:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c550b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.860195:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c550b6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.860203:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c550b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.860222:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333171.860223:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333171.860225:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763333171.860255:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff75664a80/2, rc 0, transno 21474838788 00000100:00100000:2.0:1763333171.860261:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff75664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627232896:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1763333171.860278:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff75666680/2, rc 0, transno 21474838790 00000100:00100000:2.0:1763333171.860282:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff75666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627233024:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333171.861396:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613609216 00000100:00100000:0.0:1763333171.861407:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613609216 00000100:00100000:0.0:1763333171.861468:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3094 00000100:00100000:0.0:1763333171.861476:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:56827:x1848987613609216:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333171.861573:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+33:3655:x1848987627233152:12345-0@lo:2:osp-syn-0-1.0 Request processed in 2074us (3887us total) trans 21474838789 rc 0/0 00000100:00100000:3.0:1763333171.861584:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6314 00000100:00100000:0.0:1763333171.861717:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56827:x1848987613609216:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 238us (3750us total) trans 4294972089 rc 0/0 00000100:00100000:0.0:1763333171.861725:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3094 00000004:00080000:2.0:1763333171.862981:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff75665180/2, rc 0, transno 21474838789 00000100:00100000:2.0:1763333171.862992:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff75665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627233152:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333171.863544:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333171.863722:0:8611:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77a3c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8611:1848987627232640:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333171.863748:0:8611:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c550a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333171.863895:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613609344 00000100:00100000:3.0:1763333171.863903:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613609344 00000100:00100000:3.0:1763333171.863963:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6316 00000100:00100000:3.0:1763333171.863974:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74034e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:55917:x1848987613609344:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333171.863989:0:8406:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333171.864012:0:8406:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c550bd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969139 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333171.864039:0:8406:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x21f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333171.864064:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333171.864067:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333171.864078:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c550bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969139 expref: 18 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.864096:0:8406:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c550bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969139 expref: 18 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.864109:0:8406:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96000, rc 0) 00000100:00100000:3.0:1763333171.864172:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74034e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:55917:x1848987613609344:12345-192.168.204.28@tcp:101:bash.0 Request processed in 199us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333171.864179:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6316 00000100:00100000:3.0:1763333171.866685:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.866735:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613609472 00000100:00100000:1.0:1763333171.866745:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613609472 00010000:00010000:1.0:1763333171.866782:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54f0b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690ad expref: 33 pid: 8611 timeout: 1375 lvb_type: 0 00000100:00100000:1.0:1763333171.866819:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2967 00000100:00100000:1.0:1763333171.866828:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff82065050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+33:2421:x1848987613609472:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333171.866842:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333171.866846:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54f0b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x21d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690ad expref: 33 pid: 8611 timeout: 1375 lvb_type: 0 00010000:00010000:1.0:1763333171.866858:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54f0b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x21d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690ad expref: 33 pid: 8611 timeout: 1375 lvb_type: 0 00010000:00010000:1.0:1763333171.866878:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c54f0b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x21d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690ad expref: 33 pid: 8611 timeout: 1375 lvb_type: 0 00010000:00010000:1.0:1763333171.866893:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333171.866895:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333171.866899:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c550a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.866908:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c550a8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.866935:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333171.866968:0:8611:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c550a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.866981:0:8611:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c550a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333171.866983:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff82065050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+32:2421:x1848987613609472:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 154us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333171.866996:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2967 00010000:00010000:0.0:1763333171.867001:0:8611:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c550a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.867010:0:8611:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c550a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.867034:0:8611:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763333171.867263:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74034380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+62:3653:x1848987627232128:12345-0@lo:6:osp-syn-1-1.0 Request processed in 11276us (12460us total) trans 17179871487 rc 0/0 00000100:00100000:0.0:1763333171.867271:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6309 00000004:00080000:1.0:1763333171.868068:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff74036680/2, rc 0, transno 17179871487 00000100:00100000:1.0:1763333171.868079:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff74036680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627232128:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1763333171.869424:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333171.869437:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c550a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.869449:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea800 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333171.869453:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c550a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.869462:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c550a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.869483:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c550a8 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.869492:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c550a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.869515:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333171.869517:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333171.869518:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763333171.869894:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.869976:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.870179:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613609600 00000100:00100000:2.0:1763333171.870189:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613609600 00000100:00100000:2.0:1763333171.870247:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3095 00000100:00100000:2.0:1763333171.870256:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56827:x1848987613609600:12345-192.168.204.28@tcp:33:lfs.0 00000100:00100000:2.0:1763333171.870464:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56827:x1848987613609600:12345-192.168.204.28@tcp:33:lfs.0 Request processed in 207us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333171.870475:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3095 00000100:00100000:0.0:1763333171.870817:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613609728 00000100:00100000:0.0:1763333171.870823:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613609728 00010000:00010000:0.0:1763333171.870849:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c54f12 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690b4 expref: 18 pid: 8611 timeout: 1375 lvb_type: 0 00000100:00100000:0.0:1763333171.870883:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2968 00000100:00100000:0.0:1763333171.870891:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2420:x1848987613609728:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333171.870902:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333171.870907:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c54f12 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690b4 expref: 18 pid: 8611 timeout: 1375 lvb_type: 0 00010000:00010000:0.0:1763333171.870918:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c54f12 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690b4 expref: 18 pid: 8611 timeout: 1375 lvb_type: 0 00010000:00010000:0.0:1763333171.870940:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333171.870942:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333171.870958:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c550af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.870969:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c550af lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.870988:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333171.871014:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2420:x1848987613609728:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 125us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333171.871021:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2968 00010000:00010000:3.0:1763333171.871458:0:8404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c54f12 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369690b4 expref: 17 pid: 8611 timeout: 1375 lvb_type: 0 00000100:00100000:3.0:1763333171.871471:0:8404:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff74035500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8404:1848987627233280:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333171.871492:0:8404:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c550af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.871501:0:8404:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c550af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.871507:0:8404:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c550af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.871516:0:8404:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c550af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.871523:0:8404:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c550af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.871545:0:8404:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763333171.871754:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+33:3652:x1848987627232768:12345-0@lo:6:osp-syn-0-1.0 Request processed in 14083us (14197us total) trans 21474838791 rc 0/0 00000100:00100000:3.0:1763333171.871763:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6312 00010000:00010000:1.0:1763333171.871861:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333171.871868:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c550af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.871875:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e600 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333171.871879:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c550af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.871887:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c550af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.871901:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c550af lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.871908:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c550af lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.871928:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333171.871930:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333171.871932:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763333171.872394:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000004:00080000:2.0:1763333171.872886:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff75665c00/2, rc 0, transno 21474838791 00000100:00100000:2.0:1763333171.872893:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff75665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627232768:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763333171.873841:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613609856 00000100:00100000:3.0:1763333171.873855:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613609856 00000100:00100000:3.0:1763333171.873923:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6317 00000100:00100000:3.0:1763333171.873934:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+32:55917:x1848987613609856:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333171.873952:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333171.873975:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c550c4 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969140 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333171.874000:0:8404:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x21f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333171.874024:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333171.874027:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333171.874036:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c550c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969140 expref: 33 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.874053:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c550c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969140 expref: 33 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.874066:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a97000, rc 0) 00000100:00100000:3.0:1763333171.874142:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+33:55917:x1848987613609856:12345-192.168.204.28@tcp:101:bash.0 Request processed in 209us (1748us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333171.874150:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6317 00000100:00100000:0.0:1763333171.881954:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333171.882003:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.882071:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613609984 00000100:00100000:1.0:1763333171.882082:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613609984 00002000:00010000:1.0:1763333171.882125:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/543 (0->18446744073709551615) 00002000:00100000:1.0:1763333171.882130:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff77a3f480 with x1848987613609984 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333171.882144:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff77a3f480. 00000100:00100000:1.0:1763333171.882176:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613610112 00000100:00100000:1.0:1763333171.882179:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613610112 00002000:00010000:1.0:1763333171.882194:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/543 (0->18446744073709551615) 00002000:00100000:1.0:1763333171.882198:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff77a3f800 with x1848987613610112 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333171.882207:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff77a3f800. 00000100:00100000:2.0:1763333171.882221:0:28430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1568 00000100:00100000:1.0:1763333171.882233:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1569 00000100:00100000:2.0:1763333171.882238:0:28430:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2418:x1848987613609984:12345-192.168.204.28@tcp:10:bash.0 00000100:00100000:1.0:1763333171.882246:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+33:2418:x1848987613610112:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:2.0:1763333171.882467:0:28430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x21f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333171.882467:0:28427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x21f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333171.882473:0:28430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x21f:0x0] updating lvb mtime from disk: 0 -> 1763333172 00002000:00010000:1.0:1763333171.882473:0:28427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x21f:0x0] updating lvb mtime from disk: 0 -> 1763333172 00002000:00010000:2.0:1763333171.882478:0:28430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x21f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333171.882479:0:28427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x21f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333171.882482:0:28430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x21f:0x0] updating lvb ctime from disk: 0 -> 1763333172 00002000:00010000:1.0:1763333171.882484:0:28427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x21f:0x0] updating lvb ctime from disk: 0 -> 1763333172 00002000:00010000:2.0:1763333171.882486:0:28430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x21f:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1763333171.882489:0:28427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x21f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333171.882556:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+34:2418:x1848987613610112:12345-192.168.204.28@tcp:10:bash.0 Request processed in 312us (552us total) trans 17179871488 rc 0/0 00000100:00100000:1.0:1763333171.882564:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1569 00002000:00010000:1.0:1763333171.882568:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/543 (0->18446744073709551615) 00002000:00100000:1.0:1763333171.882571:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff77a3f800 with x1848987613610112 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333171.882575:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff77a3f800. 00000100:00100000:2.0:1763333171.882639:0:28430:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2418:x1848987613609984:12345-192.168.204.28@tcp:10:bash.0 Request processed in 406us (699us total) trans 21474838792 rc 0/0 00000100:00100000:2.0:1763333171.882647:0:28430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1568 00002000:00010000:2.0:1763333171.882650:0:28430:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/543 (0->18446744073709551615) 00002000:00100000:2.0:1763333171.882653:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff77a3f480 with x1848987613609984 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333171.882667:0:28430:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff77a3f480. 00000100:00100000:2.0:1763333171.892226:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.892896:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613610368 00000100:00100000:1.0:1763333171.892906:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613610368 00000100:00100000:1.0:1763333171.892970:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9047 00000100:00100000:1.0:1763333171.892979:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56828:x1848987613610368:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333171.893000:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333171.893024:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c550cb lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969147 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.893102:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c550d2 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333171.893116:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c550d2 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.893132:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c550d2 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.893144:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c550d9 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333171.893151:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c550d9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.893157:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c550d9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.893261:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c550e0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333171.893271:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c550e0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.893278:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c550e0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:1.0:1763333171.893287:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x19e:0x0]: returning size 2 00010000:00010000:1.0:1763333171.893391:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c550d2 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.893399:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c550d2 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.893405:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c550d2 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.893412:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c550d2 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.893418:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7ea00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333171.893423:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c550d2 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.893431:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c550d2 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.893443:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355600) 00010000:00010000:1.0:1763333171.893446:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333171.893451:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c550d2 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.893458:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c550d2 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.893471:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c550d9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.893478:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c550d9 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.893483:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c550d9 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.893489:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333171.893492:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c550d9 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.893497:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c550d9 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.893504:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355300) 00010000:00010000:1.0:1763333171.893507:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333171.893509:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c550d9 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.893519:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c550d9 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.893570:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c550cb lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969147 expref: 226 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.893586:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c550e0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969147 expref: 225 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.893594:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19e:0x0].0x0 (ffff92fe48355000) 00010000:00010000:1.0:1763333171.893597:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333171.893599:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7fc00, rc 0) 00000100:00100000:1.0:1763333171.893663:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56828:x1848987613610368:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 684us (1445us total) trans 4294972090 rc 0/0 00000100:00100000:1.0:1763333171.893670:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9047 00000100:00100000:3.0:1763333171.893953:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.894885:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613610624 00000100:00100000:1.0:1763333171.894893:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613610624 00000100:00100000:0.0:1763333171.897550:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3096 00000100:00100000:0.0:1763333171.897576:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:55917:x1848987613610624:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:0.0:1763333171.897899:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:55917:x1848987613610624:12345-192.168.204.28@tcp:35:bash.0 Request processed in 336us (3945us total) trans 4294972091 rc 0/0 00000100:00100000:0.0:1763333171.897908:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3096 00000100:00100000:3.0:1763333171.900039:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.900132:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613610880 00000100:00100000:2.0:1763333171.900142:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613610880 00000100:00100000:2.0:1763333171.900199:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3097 00000100:00100000:2.0:1763333171.900209:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56828:x1848987613610880:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333171.903061:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56828:x1848987613610880:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 2843us (3019us total) trans 4294972092 rc 0/0 00000100:00100000:2.0:1763333171.903076:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3097 00000100:00100000:3.0:1763333171.908858:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.909026:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613611136 00000100:00100000:2.0:1763333171.909040:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613611136 00000100:00100000:2.0:1763333171.909569:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9048 00000100:00100000:2.0:1763333171.909583:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56828:x1848987613611136:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333171.909614:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333171.909638:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c550ee lrc: 2/0,0 mode: --/CR res: [0x240000404:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696914e expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.909764:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c550f5 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333171.909780:0:12741:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c550e0 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969147 expref: 228 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.909790:0:12741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c550f5 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x19e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.909825:0:12741:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c550e0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969147 expref: 228 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333171.909839:0:12741:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c550e0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969147 expref: 228 pid: 6521 timeout: 1375 lvb_type: 0 00000100:00100000:2.0:1763333171.909856:0:12741:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe49609500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627233408:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333171.909951:0:12741:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff5119d780 going to sleep for 11 seconds 00000100:00100000:2.0:1763333171.914207:0:12741:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe49609500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627233408:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333171.914242:0:12741:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c550f5 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x19e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000100:00100000:3.0:1763333171.915716:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.916242:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613611392 00000100:00100000:1.0:1763333171.916252:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613611392 00000100:00100000:1.0:1763333171.916312:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9049 00000100:00100000:1.0:1763333171.916322:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56829:x1848987613611392:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:1.0:1763333171.916392:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1763333171.916416:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55077 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x19e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969132 expref: 229 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.916434:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55062 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969124 expref: 228 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.916448:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19e:0x0].0x0 (ffff92fe48355000) 00010000:00010000:1.0:1763333171.916453:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c550f5 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x19e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.916461:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c550f5 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x19e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.916466:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333171.916489:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c550fc lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333171.916498:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c550fc lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.916506:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c550fc lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.916515:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55103 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333171.916520:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55103 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.916525:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55103 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.916607:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c5510a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333171.916614:0:6521:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c550f5 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x19e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.916619:0:6521:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c5510a lrc: 4/0,1 mode: --/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.916636:0:6521:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c550f5 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x19e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.916644:0:6521:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c5510a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000100:00100000:3.0:1763333171.920846:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.921009:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613611520 00000100:00100000:2.0:1763333171.921021:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613611520 00010000:00010000:2.0:1763333171.924335:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c550e0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969147 expref: 228 pid: 6521 timeout: 1375 lvb_type: 0 00000100:00100000:2.0:1763333171.924396:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2969 00000100:00100000:2.0:1763333171.924417:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:2421:x1848987613611520:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333171.924434:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333171.924441:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c550e0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969147 expref: 228 pid: 6521 timeout: 1375 lvb_type: 0 00010000:00010000:2.0:1763333171.924454:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c550e0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969147 expref: 228 pid: 6521 timeout: 1375 lvb_type: 0 00010000:00010000:2.0:1763333171.924478:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c550e0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969147 expref: 228 pid: 6521 timeout: 1375 lvb_type: 0 00010000:00010000:2.0:1763333171.924494:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19e:0x0].0x0 (ffff92fe48355000) 00010000:00010000:2.0:1763333171.924498:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c550f5 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x19e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.924508:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c550f5 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x19e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.924515:0:6505:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c550f5 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x19e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333171.924522:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c5510a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.924544:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c5510a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.924582:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333171.924664:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:2421:x1848987613611520:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 258us (3826us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333171.924671:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2969 00010000:00010000:1.0:1763333171.924724:0:12741:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c550f5 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x19e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.924734:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c550f5 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x19e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 12741 initiator: MDT1 00000004:00200000:1.0:1763333171.924757:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x19e:0x0]: returning size 5 00010000:00010000:1.0:1763333171.924899:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c550ee lrc: 0/0,0 mode: --/CR res: [0x240000404:0x19e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696914e expref: 228 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.924920:0:12741:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c550f5 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x19e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696914e expref: 227 pid: 12741 timeout: 1376 lvb_type: 0 00010000:00010000:1.0:1763333171.924929:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c550f5 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x19e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696914e expref: 227 pid: 12741 timeout: 1376 lvb_type: 0 00010000:00010000:1.0:1763333171.924936:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4c00, rc 0) 00000100:00100000:1.0:1763333171.924979:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56828:x1848987613611136:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 15400us (16135us total) trans 4294972093 rc 0/0 00000100:00100000:1.0:1763333171.924986:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9048 00000100:00100000:3.0:1763333171.937458:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333171.937553:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613611648 00000100:00100000:0.0:1763333171.937563:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613611648 00010000:00010000:0.0:1763333171.937604:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c550f5 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x19e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696914e expref: 227 pid: 12741 timeout: 1376 lvb_type: 0 00000100:00100000:2.0:1763333171.938207:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2970 00000100:00100000:2.0:1763333171.938221:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:2421:x1848987613611648:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333171.938238:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333171.938246:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c550f5 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x19e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696914e expref: 227 pid: 12741 timeout: 1376 lvb_type: 0 00010000:00010000:2.0:1763333171.938260:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c550f5 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x19e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696914e expref: 227 pid: 12741 timeout: 1376 lvb_type: 0 00010000:00010000:2.0:1763333171.938283:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c550f5 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x19e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696914e expref: 227 pid: 12741 timeout: 1376 lvb_type: 0 00010000:00010000:2.0:1763333171.938299:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19e:0x0].0x0 (ffff92fe48355000) 00010000:00010000:2.0:1763333171.938304:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c5510a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.938312:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c5510a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.938319:0:6505:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c5510a lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333171.938392:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333171.938446:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:2421:x1848987613611648:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 229us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333171.938454:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2970 00010000:00010000:1.0:1763333171.938517:0:6521:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c5510a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.938526:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c5510a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000100:00100000:3.0:1763333171.939000:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.939138:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613611776 00000100:00100000:2.0:1763333171.939144:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613611776 00000004:00080000:1.0:1763333171.939384:0:6521:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x19e:0x0] is inserted into orphan list, open count = 1 00010000:00010000:1.0:1763333171.939474:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c5510a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.939482:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c5510a lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.939488:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c5510a lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.939493:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7ea00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333171.939497:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c5510a lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.939504:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c5510a lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.939515:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19e:0x0].0x0 (ffff92fe48355000) 00010000:00010000:1.0:1763333171.939518:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763333171.939522:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c5510a lrc: 2/0,0 mode: --/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.939527:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c5510a lrc: 0/0,0 mode: --/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.939556:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c550fc lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.939562:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c550fc lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.939566:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c550fc lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.939575:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c550fc lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.939580:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333171.939583:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c550fc lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.939589:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c550fc lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.939596:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355600) 00010000:00010000:1.0:1763333171.939599:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333171.939602:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c550fc lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.939607:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c550fc lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000004:00010000:1.0:1763333171.939619:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000006f1b35c reply state 00000000e99355fc transno 4294972094 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55103 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.939630:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55103 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.939637:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355300) 00010000:00010000:1.0:1763333171.939639:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333171.939642:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763333171.939706:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56829:x1848987613611392:12345-192.168.204.28@tcp:36:rm.0 Request processed in 23384us (23996us total) trans 4294972094 rc 0/0 00000100:00100000:1.0:1763333171.939714:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9049 00000100:00100000:1.0:1763333171.939735:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9050 00000100:00100000:1.0:1763333171.939744:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56828:x1848987613611776:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333171.939761:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333171.939778:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55118 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969155 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.939856:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5511f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333171.939866:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5511f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.939875:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5511f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:1.0:1763333171.939896:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x19e:0x0]: returning size 5 00000004:00200000:1.0:1763333171.939901:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763333171.939914:0:6521:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5511f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.939936:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55118 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969155 expref: 229 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.939949:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5511f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969155 expref: 228 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.939957:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19e:0x0].0x0 (ffff92fe48355800) 00010000:00010000:1.0:1763333171.939960:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1763333171.939963:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7ec00, rc 0) 00000100:00100000:1.0:1763333171.939999:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56828:x1848987613611776:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 256us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333171.940007:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9050 00000100:00100000:0.0:1763333171.953072:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.953144:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613612032 00000100:00100000:2.0:1763333171.953155:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613612032 00000100:00100000:1.0:1763333171.954297:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9051 00000100:00100000:0.0:1763333171.954666:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56828:x1848987613612032:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333171.954696:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333171.954721:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c55126 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696915c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.954828:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5512d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333171.954843:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5512d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x19e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.954856:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5512d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x19e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:0.0:1763333171.954868:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x19e:0x0]: returning size 5 00010000:00010000:0.0:1763333171.954982:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c55126 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x19e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696915c expref: 231 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.955001:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5512d lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x19e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696915c expref: 230 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.955009:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19e:0x0].0x0 (ffff92fe48355800) 00010000:00010000:0.0:1763333171.955012:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763333171.955016:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feaa00, rc 0) 00000100:00100000:0.0:1763333171.961912:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56828:x1848987613612032:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 7587us (8833us total) trans 4294972095 rc 0/0 00000100:00100000:0.0:1763333171.961928:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9051 00000100:00100000:1.0:1763333171.966153:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333171.966392:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.966458:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613612288 00000100:00100000:1.0:1763333171.966469:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613612288 00000100:00100000:1.0:1763333171.966542:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6318 00000100:00100000:1.0:1763333171.966552:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7df39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2421:x1848987613612288:12345-192.168.204.28@tcp:1:lfs.0 00010000:00010000:1.0:1763333171.966601:0:8404:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5513b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.966621:0:8404:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c550bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969139 expref: 18 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.966629:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333171.966631:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333171.966635:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5513b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.966671:0:8404:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c550bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969139 expref: 18 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.966685:0:8404:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c550bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969139 expref: 18 pid: 8406 timeout: 1376 lvb_type: 0 00000100:00100000:1.0:1763333171.966701:0:8404:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe438aa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8404:1848987627233536:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333171.966783:0:8404:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe46e0ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1763333171.967052:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613612160 00000100:00100000:0.0:1763333171.967057:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613612160 00000100:00100000:0.0:1763333171.967092:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9052 00000100:00100000:0.0:1763333171.967099:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56830:x1848987613612160:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333171.967112:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333171.967130:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c55142 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969163 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.967189:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55149 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333171.967202:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55149 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.967212:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55149 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.967223:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c55150 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333171.967231:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c55150 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.967237:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c55150 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.967280:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55149 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.967287:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55149 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.967294:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55149 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.967300:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55149 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.967305:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feba00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333171.967309:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55149 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.967318:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55149 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.967329:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44100) 00010000:00010000:0.0:1763333171.967332:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333171.967337:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55149 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.967343:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55149 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.967385:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c55150 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.967392:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c55150 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.967398:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c55150 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.967403:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333171.967406:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c55150 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.967413:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c55150 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.967419:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355300) 00010000:00010000:0.0:1763333171.967421:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333171.967424:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c55150 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.967429:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c55150 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333171.967456:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c55142 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969163 expref: 231 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.967465:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44100) 00010000:00010000:0.0:1763333171.967468:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333171.967471:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c55142 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969163 expref: 231 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.967483:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea000, rc 0) 00000100:00100000:0.0:1763333171.967518:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56830:x1848987613612160:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 419us (1373us total) trans 0 rc 301/301 00000100:00100000:0.0:1763333171.967525:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9052 00000100:00100000:2.0:1763333171.977495:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.977544:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333171.977654:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613612416 00000100:00100000:0.0:1763333171.977666:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613612416 00002000:00100000:0.0:1763333171.977720:0:24027:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0x21f:0x0] (0->4) req@ffff92fe49609500 x1848987613612416/t0(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:482/0 lens 496/0 e 0 to 0 dl 1763333182 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763333171.977731:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe49609500 with x1848987613612416 ext(0->4) 00010000:00010000:0.0:1763333171.977741:0:24027:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c550bd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969139 expref: 19 pid: 8406 timeout: 1376 lvb_type: 0 00010000:00010000:0.0:1763333171.977755:0:24027:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c550bd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969139 expref: 19 pid: 8406 timeout: 1376 lvb_type: 0 00002000:00010000:0.0:1763333171.977763:0:24027:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff92fe49609500 00000100:00100000:0.0:1763333171.977797:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 101 00000100:00100000:0.0:1763333171.977807:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2421:x1848987613612416:12345-192.168.204.28@tcp:4:bash.0 00000100:00100000:3.0:1763333171.978306:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613612544 00000100:00100000:3.0:1763333171.978311:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613612544 00000100:00100000:3.0:1763333171.978377:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9053 00000100:00100000:3.0:1763333171.978385:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56830:x1848987613612544:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333171.978402:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333171.978424:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55157 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696916a expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.978501:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c5515e lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333171.978515:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c5515e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333171.978526:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c5515e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333171.978551:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55165 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333171.978558:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55165 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333171.978565:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55165 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333171.978598:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c5515e lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333171.978610:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c5515e lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333171.978617:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c5515e lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333171.978624:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c5515e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333171.978630:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333171.978634:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c5515e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333171.978642:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c5515e lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333171.978654:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff80045800) 00010000:00010000:3.0:1763333171.978658:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333171.978663:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c5515e lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333171.978669:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c5515e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333171.978682:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55165 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333171.978689:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55165 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333171.978695:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55165 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333171.978700:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333171.978704:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55165 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333171.978710:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55165 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333171.978717:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355300) 00010000:00010000:3.0:1763333171.978719:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333171.978722:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55165 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333171.978728:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55165 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333171.978755:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55157 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696916a expref: 231 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.978766:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff80045800) 00010000:00010000:3.0:1763333171.978768:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333171.978772:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55157 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696916a expref: 231 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333171.978784:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96e00, rc 0) 00000100:00100000:3.0:1763333171.978851:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56830:x1848987613612544:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 467us (1306us total) trans 0 rc 301/301 00000100:00100000:3.0:1763333171.978859:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9053 00000100:00100000:3.0:1763333171.981767:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2421:x1848987613612416:12345-192.168.204.28@tcp:4:bash.0 Request processed in 3951us (4271us total) trans 21474838793 rc 0/0 00000100:00100000:3.0:1763333171.981782:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 101 00002000:00100000:3.0:1763333171.981795:0:24027:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0x21f:0x0] (0->4) req@ffff92fe49609500 x1848987613612416/t21474838793(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:482/0 lens 496/448 e 0 to 0 dl 1763333182 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763333171.981806:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe49609500 with x1848987613612416 ext(0->4) 00010000:00010000:3.0:1763333171.981817:0:24027:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c550bd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969139 expref: 21 pid: 8406 timeout: 1376 lvb_type: 0 00010000:00010000:3.0:1763333171.981835:0:24027:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c550bd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969139 expref: 21 pid: 8406 timeout: 1376 lvb_type: 0 00002000:00010000:3.0:1763333171.981844:0:24027:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff92fe49609500 00000100:00100000:1.0:1763333171.982958:0:8404:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe438aa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8404:1848987627233536:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333171.982988:0:8404:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5513b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333171.989083:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333171.989140:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333171.989258:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613612672 00000100:00100000:0.0:1763333171.989271:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613612672 00010000:00010000:0.0:1763333171.989314:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c550bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969139 expref: 21 pid: 8406 timeout: 1376 lvb_type: 0 00000100:00100000:0.0:1763333171.989389:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2971 00000100:00100000:0.0:1763333171.989399:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2420:x1848987613612672:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333171.989415:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1763333171.989435:0:8423:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x21f:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:0.0:1763333171.989439:0:8423:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x21f:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1763333171.989445:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c550bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969139 expref: 21 pid: 8406 timeout: 1376 lvb_type: 0 00010000:00010000:0.0:1763333171.989460:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c550bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969139 expref: 21 pid: 8406 timeout: 1376 lvb_type: 0 00010000:00010000:0.0:1763333171.989485:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c550bd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969139 expref: 21 pid: 8406 timeout: 1376 lvb_type: 0 00010000:00010000:0.0:1763333171.989502:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333171.989504:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333171.989508:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5513b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.989518:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5513b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.989564:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333171.989619:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2420:x1848987613612672:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 221us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333171.989627:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2971 00010000:00010000:0.0:1763333171.990966:0:8404:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5513b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.990982:0:8404:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5513b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.991012:0:8404:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5513b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.991020:0:8404:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5513b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.991029:0:8404:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5513b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.991036:0:8404:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f200 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333171.991040:0:8404:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5513b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.991050:0:8404:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5513b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.991072:0:8404:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5513b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333171.991079:0:8404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5513b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333171.991259:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613612800 00000100:00100000:1.0:1763333171.991267:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613612800 00000100:00100000:1.0:1763333171.991324:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9054 00000100:00100000:1.0:1763333171.991334:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56830:x1848987613612800:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333171.991373:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333171.991404:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c5516c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969171 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333171.991420:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7df39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2421:x1848987613612288:12345-192.168.204.28@tcp:1:lfs.0 Request processed in 24869us (25028us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333171.991428:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6318 00010000:00010000:1.0:1763333171.991469:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c55173 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333171.991482:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c55173 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333171.991491:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c55173 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:1.0:1763333171.991545:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1763333171.991550:0:12741:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1763333171.991584:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c5516c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969171 expref: 232 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.991603:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c55173 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969171 expref: 231 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.992871:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355600) 00010000:00010000:1.0:1763333171.992882:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1763333171.992888:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7ea00, rc 0) 00000100:00100000:1.0:1763333171.992950:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56830:x1848987613612800:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1614us (3806us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333171.992959:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9054 00000100:00100000:3.0:1763333171.998801:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333171.998856:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613613056 00000100:00100000:1.0:1763333171.998867:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613613056 00000100:00100000:1.0:1763333171.998934:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9055 00000100:00100000:1.0:1763333171.998944:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56828:x1848987613613056:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:1.0:1763333171.998994:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333171.999021:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5511f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969155 expref: 231 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333171.999038:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19e:0x0].0x0 (ffff92fe48355800) 00010000:00010000:1.0:1763333171.999043:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333171.999071:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5517a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333171.999085:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5517a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333171.999093:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5517a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000040:00080000:1.0:1763333171.999303:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1343, 88 off113728 00000004:00080000:1.0:1763333171.999311:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1276078961468ns, next at 1276878902000ns, rc = 0 00000040:00080000:1.0:1763333171.999389:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1342, 88 off113728 00000004:00080000:1.0:1763333171.999395:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1276079046548ns, next at 1275845147255ns, rc = 0 00000040:00080000:1.0:1763333171.999428:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1343, 88 off113816 00000004:00080000:1.0:1763333171.999433:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1276079084015ns, next at 1275845147255ns, rc = 0 00000040:00080000:1.0:1763333171.999444:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1344, 88 off113816 00000004:00080000:1.0:1763333171.999448:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1276079098783ns, next at 1276878902000ns, rc = 0 00000001:00080000:3.0:1763333172.001598:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972096 is committed 00000004:00080000:3.0:1763333172.001612:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 881 committed 00000004:00080000:3.0:1763333172.001625:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 877 committed 00000004:00080000:3.0:1763333172.001641:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 876 committed 00000004:00080000:3.0:1763333172.001644:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 880 committed 00000100:00100000:1.0:1763333172.002101:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe438aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627233792:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333172.002160:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333172.002190:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1763333172.002195:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe438aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627233664:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333172.002210:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:1.0:1763333172.002259:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000001d6fe7e reply state 0000000015589ac8 transno 4294972096 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5517a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333172.002279:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5517a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333172.002288:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19e:0x0].0x0 (ffff92fe48355800) 00010000:00010000:1.0:1763333172.002292:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1763333172.002296:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1763333172.002399:0:6521:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1763333172.002412:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56828:x1848987613613056:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 3467us (3620us total) trans 4294972096 rc 0/0 00000100:00100000:1.0:1763333172.002421:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9055 00010000:00010000:0.0:1763333172.003127:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55103 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.003138:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55103 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.003146:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55103 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.003151:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333172.003156:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55103 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.003164:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55103 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.003177:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355300) 00010000:00010000:0.0:1763333172.003180:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333172.003184:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55103 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.003194:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55103 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.003226:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5517a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.003233:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5517a lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.003238:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5517a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.003244:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333172.003247:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5517a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.003253:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5517a lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.003260:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19e:0x0].0x0 (ffff92fe48355800) 00010000:00010000:0.0:1763333172.003263:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333172.003266:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5517a lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.003272:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5517a lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000100:00100000:0.0:1763333172.003295:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627233792 00000100:00100000:0.0:1763333172.003304:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627233792 00000100:00100000:0.0:1763333172.003392:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627233664 00000100:00100000:0.0:1763333172.003396:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627233664 00000100:00100000:0.0:1763333172.003425:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6319 00000100:00100000:0.0:1763333172.003433:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+63:3653:x1848987627233792:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1763333172.003585:0:8406:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x220:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333172.003589:0:8406:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x220:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763333172.003592:0:8406:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x220:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333172.003594:0:8406:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x220:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763333172.003596:0:8406:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x220:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333172.003646:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+64:3653:x1848987627233792:12345-0@lo:2:osp-syn-1-1.0 Request processed in 212us (1484us total) trans 17179871489 rc 0/0 00000100:00100000:0.0:1763333172.003653:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6319 00000100:00100000:0.0:1763333172.003668:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6320 00000100:00100000:0.0:1763333172.003674:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+63:3653:x1848987627233664:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1763333172.003726:0:8406:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x21f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333172.003729:0:8406:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x21f:0x0] updating lvb mtime from disk: 1763333172 -> 1763333172 00002000:00010000:0.0:1763333172.003732:0:8406:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x21f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333172.003734:0:8406:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x21f:0x0] updating lvb ctime from disk: 1763333172 -> 1763333172 00002000:00010000:0.0:1763333172.003737:0:8406:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x21f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333172.003761:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+64:3653:x1848987627233664:12345-0@lo:2:osp-syn-1-1.0 Request processed in 87us (1549us total) trans 17179871490 rc 0/0 00000100:00100000:0.0:1763333172.003767:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6320 00000100:00100000:2.0:1763333172.003938:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e00fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627234048:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333172.003974:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333172.004000:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1763333172.004005:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46a6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627233920:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333172.004023:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333172.004045:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627234048 00000100:00100000:2.0:1763333172.004049:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627234048 00000100:00100000:2.0:1763333172.004074:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627233920 00000100:00100000:2.0:1763333172.004077:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627233920 00000100:00100000:2.0:1763333172.004097:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6321 00000100:00100000:2.0:1763333172.004103:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+34:3655:x1848987627234048:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:2.0:1763333172.004170:0:8611:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x220:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333172.004173:0:8611:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x220:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1763333172.004175:0:8611:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x220:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333172.004177:0:8611:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x220:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1763333172.004179:0:8611:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x220:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333172.004207:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+35:3655:x1848987627234048:12345-0@lo:2:osp-syn-0-1.0 Request processed in 104us (233us total) trans 21474838794 rc 0/0 00000100:00100000:2.0:1763333172.004217:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6321 00000100:00100000:2.0:1763333172.004230:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6322 00000100:00100000:2.0:1763333172.004236:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+34:3655:x1848987627233920:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333172.004299:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+35:3655:x1848987627233920:12345-0@lo:2:osp-syn-0-1.0 Request processed in 63us (275us total) trans 21474838795 rc 0/0 00000100:00100000:2.0:1763333172.004305:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6322 00000004:00080000:2.0:1763333172.004344:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe46a6e300/2, rc 0, transno 21474838795 00000100:00100000:2.0:1763333172.004382:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46a6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627233920:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1763333172.004393:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7e00fb80/2, rc 0, transno 21474838794 00000100:00100000:2.0:1763333172.004396:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e00fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627234048:0@lo:2:osp-syn-0-1.0 00000100:00080000:1.0:1763333172.005309:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1763333172.005316:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1763333172.005362:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe438aa680/2, rc 0, transno 17179871490 00000100:00100000:1.0:1763333172.005370:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe438aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627233664:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1763333172.005383:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe438aa300/2, rc 0, transno 17179871489 00000100:00100000:1.0:1763333172.005388:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe438aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627233792:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333172.006882:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333172.006935:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613613184 00000100:00100000:1.0:1763333172.006943:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613613184 00000100:00100000:1.0:1763333172.007014:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9056 00000100:00100000:1.0:1763333172.007024:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74035f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+222:56828:x1848987613613184:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333172.007050:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333172.007069:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55181 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969178 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.007123:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55181 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969178 expref: 223 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.007137:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55181 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969178 expref: 223 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.007154:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19e:0x0].0x0 (ffff92fe48355800) 00010000:00010000:1.0:1763333172.007158:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763333172.007161:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e600, rc 0) 00000100:00100000:1.0:1763333172.007224:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74035f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56828:x1848987613613184:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 201us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333172.007231:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9056 00000100:00080000:2.0:1763333172.007339:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1763333172.007716:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333172.008298:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613613312 00000100:00100000:3.0:1763333172.008304:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613613312 00000100:00100000:3.0:1763333172.008424:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9057 00000100:00100000:3.0:1763333172.008434:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56830:x1848987613613312:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333172.008453:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333172.008474:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c55188 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696917f expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.008545:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5518f lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333172.008556:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5518f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333172.008566:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5518f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333172.008580:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55196 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333172.008587:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55196 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333172.008593:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55196 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333172.008634:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5518f lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333172.008642:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5518f lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333172.008648:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5518f lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333172.008655:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5518f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333172.008661:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333172.008664:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5518f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333172.008671:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5518f lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333172.008681:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355600) 00010000:00010000:3.0:1763333172.008683:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333172.008688:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5518f lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333172.008694:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5518f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333172.008708:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55196 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333172.008713:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55196 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333172.008719:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55196 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333172.008723:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333172.008726:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55196 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333172.008731:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55196 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333172.008737:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045800) 00010000:00010000:3.0:1763333172.008739:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333172.008742:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55196 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333172.008747:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55196 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333172.008778:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c55188 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696917f expref: 224 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.008786:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355600) 00010000:00010000:3.0:1763333172.008789:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333172.008793:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c55188 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696917f expref: 224 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.008801:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a97200, rc 0) 00000100:00100000:3.0:1763333172.008901:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56830:x1848987613613312:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 469us (1185us total) trans 0 rc 301/301 00000100:00100000:3.0:1763333172.008909:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9057 00000100:00100000:0.0:1763333172.009661:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333172.009739:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613613440 00000100:00100000:3.0:1763333172.009746:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613613440 00000100:00100000:3.0:1763333172.009788:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9058 00000100:00100000:3.0:1763333172.009796:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:56828:x1848987613613440:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333172.009813:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333172.009830:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c5519d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969186 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.009971:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c551a4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333172.009986:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c551a4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.009995:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c551a4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:1.0:1763333172.010036:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x19e:0x0]: returning size 5 00000004:00200000:1.0:1763333172.010041:0:12741:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763333172.010056:0:12741:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c551a4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.010078:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c5519d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969186 expref: 225 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.010093:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c551a4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969186 expref: 224 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.010100:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19e:0x0].0x0 (ffff92fe48355800) 00010000:00010000:1.0:1763333172.010102:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1763333172.010105:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7fe00, rc 0) 00000100:00100000:1.0:1763333172.010160:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56828:x1848987613613440:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 365us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333172.010167:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9058 00000100:00100000:2.0:1763333172.014783:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.014844:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333172.018654:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613613824 00000100:00100000:1.0:1763333172.018671:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613613824 00000100:00100000:1.0:1763333172.018739:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9059 00000100:00100000:1.0:1763333172.018749:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+224:56830:x1848987613613824:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333172.018770:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333172.018773:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763333172.018800:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c55173 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969171 expref: 224 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.018820:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355600) 00010000:00010000:1.0:1763333172.018831:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333172.018847:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c551ab lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969194 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.018948:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c551b2 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333172.018961:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c551b2 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.018972:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c551b2 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.018984:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c551b9 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333172.018991:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c551b9 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.018997:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c551b9 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.019428:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c551c0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333172.019438:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c551c0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.019447:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c551c0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:1.0:1763333172.019458:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x19f:0x0]: returning size 0 00010000:00010000:1.0:1763333172.019485:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c551b2 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.019492:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c551b2 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.019499:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c551b2 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.019505:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c551b2 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.019511:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333172.019516:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c551b2 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.019524:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c551b2 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.019568:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355000) 00010000:00010000:1.0:1763333172.019572:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333172.019576:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c551b2 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.019583:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c551b2 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000004:00010000:1.0:1763333172.019595:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e258051e reply state 000000009f620b1e transno 4294972097 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c551b9 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.019607:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c551b9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.019613:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355700) 00010000:00010000:1.0:1763333172.019616:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333172.019618:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763333172.019646:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c551ab lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969194 expref: 226 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.019664:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c551c0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969194 expref: 225 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.019671:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19f:0x0].0x0 (ffff92fe48355900) 00010000:00010000:1.0:1763333172.019674:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333172.019676:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f600, rc 0) 00000100:00100000:1.0:1763333172.019754:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56830:x1848987613613824:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1005us (4908us total) trans 4294972097 rc 0/0 00000100:00100000:1.0:1763333172.019763:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9059 00000100:00100000:3.0:1763333172.019895:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613613568 00000100:00100000:3.0:1763333172.019903:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613613568 00000100:00100000:3.0:1763333172.019954:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6323 00000100:00100000:3.0:1763333172.019962:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2420:x1848987613613568:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333172.019972:0:28650:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333172.019986:0:28650:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c551ce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696918d expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333172.020008:0:28650:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x21f:0x0] initial LVB size: 5, mtime: 0x691a5434, atime: 0x0, ctime: 0x691a5434, blocks: 0x8 00010000:00010000:3.0:1763333172.020023:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333172.020026:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333172.020036:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c551ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696918d expref: 20 pid: 28650 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333172.020050:0:28650:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c551ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696918d expref: 20 pid: 28650 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333172.020062:0:28650:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a97800, rc 0) 00000100:00100000:3.0:1763333172.020084:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2420:x1848987613613568:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 123us (5311us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333172.020090:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6323 00000100:00080000:3.0:1763333172.020109:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1763333172.024105:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333172.024189:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613614080 00000100:00100000:1.0:1763333172.024199:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613614080 00000100:00100000:1.0:1763333172.024257:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9060 00000100:00100000:1.0:1763333172.024267:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56830:x1848987613614080:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333172.024291:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333172.024312:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c551d5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696919b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.024485:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c551dc lrc: 3/0,1 mode: --/EX res: [0x240000404:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333172.024502:0:6521:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c551c0 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969194 expref: 227 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.024511:0:6521:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c551dc lrc: 4/0,1 mode: --/EX res: [0x240000404:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333172.024554:0:6521:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c551c0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969194 expref: 227 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.024567:0:6521:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c551c0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969194 expref: 227 pid: 12741 timeout: 1376 lvb_type: 0 00000100:00100000:1.0:1763333172.024580:0:6521:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77b14000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6521:1848987627234176:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333172.024655:0:6521:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe46e0ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1763333172.032547:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333172.032605:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613614208 00000100:00100000:3.0:1763333172.032617:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613614208 00010000:00010000:3.0:1763333172.032663:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c551c0 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969194 expref: 228 pid: 12741 timeout: 1376 lvb_type: 0 00000100:00100000:3.0:1763333172.032707:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2972 00000100:00100000:3.0:1763333172.032717:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:2420:x1848987613614208:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333172.032734:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333172.032742:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c551c0 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969194 expref: 228 pid: 12741 timeout: 1376 lvb_type: 0 00010000:00010000:3.0:1763333172.032756:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c551c0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969194 expref: 228 pid: 12741 timeout: 1376 lvb_type: 0 00010000:00010000:3.0:1763333172.032780:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19f:0x0].0x0 (ffff92fe48355900) 00010000:00010000:3.0:1763333172.032786:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c551dc lrc: 3/0,1 mode: --/EX res: [0x240000404:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.032800:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c551dc lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.032808:0:6505:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c551dc lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.032829:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333172.032894:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:2420:x1848987613614208:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 178us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333172.032903:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2972 00010000:00010000:1.0:1763333172.034652:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c551c0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969194 expref: 227 pid: 12741 timeout: 1376 lvb_type: 0 00000100:00100000:1.0:1763333172.034686:0:6521:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77b14000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6521:1848987627234176:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333172.034720:0:6521:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c551dc lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333172.034732:0:6521:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c551dc lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333172.034739:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c551dc lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:1.0:1763333172.034774:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x19f:0x0]: returning size 0 00000004:00080000:1.0:1763333172.035466:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x221:0x0], index 1: 0 00000004:00080000:1.0:1763333172.035475:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x221:0x0], index 0: 0 00000004:00080000:1.0:1763333172.035480:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x222:0x0], index 0: 0 00000004:00080000:1.0:1763333172.035483:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x222:0x0], index 1: 0 00010000:00010000:1.0:1763333172.035622:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c551dc lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333172.035630:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c551dc lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333172.035637:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c551dc lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333172.035644:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333172.035648:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c551dc lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333172.035655:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c551dc lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333172.035675:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19f:0x0].0x0 (ffff92fe48355900) 00010000:00010000:1.0:1763333172.035678:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763333172.035683:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c551dc lrc: 2/0,0 mode: --/EX res: [0x240000404:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333172.035688:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c551dc lrc: 0/0,0 mode: --/EX res: [0x240000404:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333172.035746:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c551d5 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x19f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696919b expref: 227 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.035757:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19f:0x0].0x0 (ffff92fe48355900) 00010000:00010000:1.0:1763333172.035759:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763333172.035763:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c551d5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x19f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696919b expref: 227 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.035776:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e800, rc 0) 00000100:00100000:1.0:1763333172.035858:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56830:x1848987613614080:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 11592us (11764us total) trans 4294972098 rc 301/301 00000100:00100000:1.0:1763333172.035869:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9060 00000100:00100000:0.0:1763333172.041508:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.041586:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613614464 00000100:00100000:2.0:1763333172.041598:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613614464 00000100:00100000:2.0:1763333172.041663:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3098 00000100:00100000:2.0:1763333172.041672:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56830:x1848987613614464:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333172.041989:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56830:x1848987613614464:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 316us (489us total) trans 4294972099 rc 0/0 00000100:00100000:2.0:1763333172.041996:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3098 00000100:00100000:0.0:1763333172.045979:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.046148:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613614720 00000100:00100000:2.0:1763333172.046159:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613614720 00000100:00100000:2.0:1763333172.046213:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3099 00000100:00100000:2.0:1763333172.046222:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bd5c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56830:x1848987613614720:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333172.046538:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bd5c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56830:x1848987613614720:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 306us (560us total) trans 4294972100 rc 0/0 00000100:00100000:2.0:1763333172.046545:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3099 00000100:00100000:0.0:1763333172.051326:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333172.051464:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613614976 00000100:00100000:1.0:1763333172.051475:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613614976 00000100:00100000:1.0:1763333172.051525:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9061 00000100:00100000:1.0:1763333172.051546:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:55917:x1848987613614976:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333172.051572:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333172.051595:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c551ea lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369691a2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.051752:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c551f1 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333172.051767:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c551f1 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333172.051779:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c551f1 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333172.051789:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c551f8 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333172.051796:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c551f8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333172.051802:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c551f8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333172.051859:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c551ff lrc: 3/1,0 mode: --/PR res: [0x240000404:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333172.051867:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c551ff lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333172.051873:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c551ff lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:1.0:1763333172.051883:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x19f:0x0]: returning size 0 00010000:00010000:1.0:1763333172.051983:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c551f1 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333172.051991:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c551f1 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333172.052000:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c551f1 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333172.052006:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c551f1 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333172.052012:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333172.052016:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c551f1 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333172.052023:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c551f1 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333172.052035:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355900) 00010000:00010000:1.0:1763333172.052038:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333172.052042:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c551f1 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333172.052048:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c551f1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333172.052061:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c551f8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333172.052066:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c551f8 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333172.052072:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c551f8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333172.052076:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333172.052078:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c551f8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333172.052087:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c551f8 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333172.052094:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355700) 00010000:00010000:1.0:1763333172.052096:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333172.052099:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c551f8 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333172.052104:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c551f8 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333172.052141:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c551ea lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691a2 expref: 231 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.052158:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c551ff lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691a2 expref: 230 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.052165:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19f:0x0].0x0 (ffff92fe48355000) 00010000:00010000:1.0:1763333172.052167:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333172.052169:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7ec00, rc 0) 00000100:00100000:1.0:1763333172.053602:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:55917:x1848987613614976:12345-192.168.204.28@tcp:101:bash.0 Request processed in 2047us (2274us total) trans 4294972101 rc 0/0 00000100:00100000:1.0:1763333172.053613:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9061 00000100:00100000:3.0:1763333172.056812:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333172.057670:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613615104 00000100:00100000:1.0:1763333172.057682:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613615104 00000100:00100000:2.0:1763333172.057853:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9062 00000100:00100000:2.0:1763333172.057864:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:55917:x1848987613615104:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333172.057887:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333172.057909:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5520d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369691a9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.057943:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55214 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333172.058076:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55214 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333172.058089:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55214 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333172.058207:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5520d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x19f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691a9 expref: 232 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.058226:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55214 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x19f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691a9 expref: 231 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.058235:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19f:0x0].0x0 (ffff92fe48355000) 00010000:00010000:2.0:1763333172.058239:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763333172.058243:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4a00, rc 0) 00000100:00100000:2.0:1763333172.058309:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:55917:x1848987613615104:12345-192.168.204.28@tcp:101:bash.0 Request processed in 446us (1507us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333172.058318:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9062 00000100:00100000:0.0:1763333172.069595:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.070123:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613615360 00000100:00100000:2.0:1763333172.070134:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613615360 00000100:00100000:2.0:1763333172.070191:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9063 00000100:00100000:2.0:1763333172.070199:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:55917:x1848987613615360:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:2.0:1763333172.070260:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333172.070287:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c551ff lrc: 0/0,0 mode: --/PR res: [0x240000404:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691a2 expref: 231 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.070303:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19f:0x0].0x0 (ffff92fe48355000) 00010000:00010000:2.0:1763333172.070308:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333172.070541:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5521b lrc: 3/0,1 mode: --/PW res: [0x240000404:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333172.070561:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5521b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333172.070570:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5521b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000001:00080000:2.0:1763333172.070618:0:6521:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294972102 00000004:00010000:2.0:1763333172.070640:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001811dc62 reply state 00000000d61ad8b9 transno 4294972103 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5521b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333172.070654:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5521b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333172.070662:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19f:0x0].0x0 (ffff92fe48355000) 00010000:00010000:2.0:1763333172.070665:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333172.070667:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763333172.070755:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:55917:x1848987613615360:12345-192.168.204.28@tcp:36:bash.0 Request processed in 556us (1168us total) trans 4294972103 rc 0/0 00000100:00100000:2.0:1763333172.070762:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9063 00000020:00080000:2.0:1763333172.070767:0:6521:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763333172.073213:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.073282:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613615488 00000100:00100000:2.0:1763333172.073290:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613615488 00000100:00100000:2.0:1763333172.073343:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9064 00000100:00100000:2.0:1763333172.073414:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:55917:x1848987613615488:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333172.073435:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333172.073454:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55222 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369691b0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.073504:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55222 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691b0 expref: 234 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.073521:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55222 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691b0 expref: 234 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.073545:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19f:0x0].0x0 (ffff92fe48355000) 00010000:00010000:2.0:1763333172.073548:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333172.073551:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4400, rc 0) 00000100:00100000:2.0:1763333172.073596:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:55917:x1848987613615488:12345-192.168.204.28@tcp:101:bash.0 Request processed in 199us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333172.073603:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9064 00000100:00100000:3.0:1763333172.077679:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333172.078675:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613615744 00000100:00100000:1.0:1763333172.078688:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613615744 00000100:00100000:1.0:1763333172.078757:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9065 00000100:00100000:1.0:1763333172.078768:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74037b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:55917:x1848987613615744:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333172.078789:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333172.078792:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763333172.078820:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55222 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691b0 expref: 234 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.078842:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19f:0x0].0x0 (ffff92fe48355000) 00010000:00010000:1.0:1763333172.078847:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333172.078860:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c55229 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369691b7 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.078911:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55230 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333172.078925:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55230 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x19f:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.078934:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55230 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x19f:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000040:00080000:1.0:1763333172.079184:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1344, 88 off113904 00000004:00080000:1.0:1763333172.079195:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1276158845541ns, next at 1275845147255ns, rc = 0 00000040:00080000:1.0:1763333172.079241:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1345, 88 off113904 00000004:00080000:1.0:1763333172.079249:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1276158900322ns, next at 1276878902000ns, rc = 0 00000040:00080000:1.0:1763333172.079271:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1346, 88 off113992 00000004:00080000:1.0:1763333172.079275:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1276158926158ns, next at 1276878902000ns, rc = 0 00000040:00080000:1.0:1763333172.079283:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1345, 88 off113992 00000004:00080000:1.0:1763333172.079286:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1276158936941ns, next at 1275845147255ns, rc = 0 00000001:00080000:1.0:1763333172.081688:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972104 is committed 00000004:00080000:1.0:1763333172.081701:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 879 committed 00010000:00010000:0.0:1763333172.082112:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c551b9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333172.082127:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c551b9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333172.082136:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c551b9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333172.082143:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fc00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333172.082149:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c551b9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333172.082157:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c551b9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333172.082178:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355700) 00010000:00010000:0.0:1763333172.082181:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333172.082185:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c551b9 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333172.082191:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c551b9 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333172.082223:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5521b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.082230:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5521b lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.082236:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5521b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.082241:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333172.082243:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5521b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.082250:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5521b lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.082257:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19f:0x0].0x0 (ffff92fe48355000) 00010000:00010000:0.0:1763333172.082260:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333172.082263:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5521b lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.082269:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5521b lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000004:00080000:1.0:1763333172.082308:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 883 committed 00000004:00080000:1.0:1763333172.082332:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 882 committed 00000004:00080000:1.0:1763333172.082336:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 878 committed 00000100:00100000:2.0:1763333172.082617:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff74034e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627234560:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333172.082706:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333172.083080:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e00dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627234432:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333172.083114:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333172.083140:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1763333172.083145:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e00d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627234304:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333172.083164:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333172.083197:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627234560 00000100:00100000:1.0:1763333172.083204:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627234560 00000100:00100000:1.0:1763333172.083243:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627234432 00000100:00100000:1.0:1763333172.083246:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627234432 00000100:00100000:1.0:1763333172.083262:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627234304 00000100:00100000:1.0:1763333172.083265:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627234304 00000100:00100000:1.0:1763333172.083285:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6324 00000100:00100000:1.0:1763333172.083294:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+35:3654:x1848987627234560:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333172.083910:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff74034380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627234688:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333172.083944:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333172.084006:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627234688 00000100:00100000:3.0:1763333172.084011:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627234688 00000100:00100000:3.0:1763333172.084041:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6325 00000100:00100000:3.0:1763333172.084049:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+65:3653:x1848987627234432:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333172.084170:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+66:3653:x1848987627234432:12345-0@lo:2:osp-syn-1-1.0 Request processed in 121us (1054us total) trans 17179871491 rc 0/0 00000100:00100000:3.0:1763333172.084180:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6325 00000100:00100000:3.0:1763333172.084199:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6326 00000100:00100000:3.0:1763333172.084205:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+65:3653:x1848987627234304:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333172.084273:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+66:3653:x1848987627234304:12345-0@lo:2:osp-syn-1-1.0 Request processed in 68us (1107us total) trans 17179871492 rc 0/0 00000100:00100000:3.0:1763333172.084279:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6326 00000100:00100000:3.0:1763333172.084291:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6327 00000100:00100000:3.0:1763333172.084296:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74035500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+37:3655:x1848987627234688:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333172.084407:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74035500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+38:3655:x1848987627234688:12345-0@lo:2:osp-syn-0-1.0 Request processed in 110us (461us total) trans 21474838797 rc 0/0 00000100:00100000:3.0:1763333172.084413:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6327 00000004:00080000:3.0:1763333172.084463:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff74034380/2, rc 0, transno 21474838797 00000100:00100000:3.0:1763333172.084470:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff74034380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627234688:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333172.085385:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+37:3654:x1848987627234560:12345-0@lo:2:osp-syn-0-1.0 Request processed in 2089us (2674us total) trans 21474838796 rc 0/0 00000100:00100000:1.0:1763333172.085393:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6324 00000004:00080000:1.0:1763333172.085440:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7e00d880/2, rc 0, transno 17179871492 00000100:00100000:1.0:1763333172.085444:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e00d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627234304:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1763333172.085452:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7e00dc00/2, rc 0, transno 17179871491 00000100:00100000:1.0:1763333172.085454:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e00dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627234432:0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1763333172.085537:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55230 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x19f:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691b7 expref: 226 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.085550:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19f:0x0].0x0 (ffff92fe48355000) 00010000:00010000:1.0:1763333172.085553:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763333172.085570:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c55229 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691b7 expref: 226 pid: 12741 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763333172.085586:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55230 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x19f:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691b7 expref: 225 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.085612:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19f:0x0].0x0 (ffff92fe48355000) 00010000:00010000:1.0:1763333172.085615:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763333172.085617:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f600, rc 0) 00000100:00100000:1.0:1763333172.085668:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74037b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:55917:x1848987613615744:12345-192.168.204.28@tcp:101:bash.0 Request processed in 6903us (8000us total) trans 4294972104 rc 0/0 00000100:00100000:1.0:1763333172.085675:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9065 00000004:00080000:2.0:1763333172.086309:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff74034e00/2, rc 0, transno 21474838796 00000100:00100000:2.0:1763333172.086316:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff74034e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627234560:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333172.093847:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333172.096329:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613615872 00000100:00100000:1.0:1763333172.096372:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613615872 00000100:00080000:3.0:1763333172.096943:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1763333172.097068:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6328 00000100:00100000:2.0:1763333172.097081:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+34:55917:x1848987613615872:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333172.097105:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333172.097133:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55237 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369691be expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763333172.097160:0:8404:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x221:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763333172.097188:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333172.097191:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333172.097199:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55237 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691be expref: 35 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.097217:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55237 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691be expref: 35 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.097231:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4800, rc 0) 00000100:00100000:2.0:1763333172.097324:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+35:55917:x1848987613615872:12345-192.168.204.28@tcp:101:bash.0 Request processed in 246us (3492us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333172.097331:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6328 00000100:00100000:0.0:1763333172.101513:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.101626:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613616000 00000100:00100000:2.0:1763333172.101639:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613616000 00000100:00100000:2.0:1763333172.102106:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6329 00000100:00100000:2.0:1763333172.102121:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2418:x1848987613616000:12345-192.168.204.28@tcp:23:lfs.0 00000100:00100000:2.0:1763333172.102860:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2418:x1848987613616000:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 740us (1355us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333172.102870:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6329 00000100:00100000:3.0:1763333172.108970:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.111075:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613616128 00000100:00100000:2.0:1763333172.111093:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613616128 00000100:00100000:2.0:1763333172.111160:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6330 00000100:00100000:2.0:1763333172.111170:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74036d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:55917:x1848987613616128:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333172.111187:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333172.111211:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5523e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369691c5 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763333172.111235:0:8404:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x221:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763333172.111258:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333172.111261:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333172.111270:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5523e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691c5 expref: 21 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.111284:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5523e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691c5 expref: 21 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.111297:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4000, rc 0) 00000100:00100000:2.0:1763333172.111388:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74036d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:55917:x1848987613616128:12345-192.168.204.28@tcp:101:bash.0 Request processed in 219us (2427us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333172.111395:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6330 00000100:00100000:0.0:1763333172.114036:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.114088:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613616256 00000100:00100000:2.0:1763333172.114099:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613616256 00000100:00100000:2.0:1763333172.114151:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6331 00000100:00100000:2.0:1763333172.114159:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2421:x1848987613616256:12345-192.168.204.28@tcp:23:lfs.0 00000100:00100000:2.0:1763333172.114279:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2421:x1848987613616256:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 120us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333172.114292:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6331 00000100:00100000:0.0:1763333172.119985:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.120069:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333172.120134:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613616384 00000100:00100000:3.0:1763333172.120147:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613616384 00002000:00010000:3.0:1763333172.120189:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/545 (0->18446744073709551615) 00000100:00100000:2.0:1763333172.120193:0:28430:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613616512 00002000:00100000:3.0:1763333172.120194:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe44e05500 with x1848987613616384 ext(0->18446744073709551615) 00000100:00100000:2.0:1763333172.120197:0:28430:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613616512 00002000:00010000:3.0:1763333172.120206:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe44e05500. 00002000:00010000:2.0:1763333172.120213:0:28430:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/545 (0->18446744073709551615) 00002000:00100000:2.0:1763333172.120217:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff73167800 with x1848987613616512 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333172.120223:0:28430:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff73167800. 00000100:00100000:3.0:1763333172.120241:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1570 00000100:00100000:2.0:1763333172.120247:0:28430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1571 00000100:00100000:3.0:1763333172.120250:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+35:2421:x1848987613616384:12345-192.168.204.28@tcp:10:bash.0 00000100:00100000:2.0:1763333172.120253:0:28430:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73167800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2421:x1848987613616512:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:3.0:1763333172.120432:0:24027:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x221:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333172.120432:0:28430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x221:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333172.120436:0:24027:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x221:0x0] updating lvb mtime from disk: 0 -> 1763333172 00002000:00010000:2.0:1763333172.120436:0:28430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x221:0x0] updating lvb mtime from disk: 0 -> 1763333172 00002000:00010000:3.0:1763333172.120439:0:24027:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x221:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333172.120439:0:28430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x221:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333172.120442:0:24027:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x221:0x0] updating lvb ctime from disk: 0 -> 1763333172 00002000:00010000:2.0:1763333172.120442:0:28430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x221:0x0] updating lvb ctime from disk: 0 -> 1763333172 00002000:00010000:3.0:1763333172.120445:0:24027:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x221:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:2.0:1763333172.120445:0:28430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x221:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333172.120904:0:28430:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73167800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2421:x1848987613616512:12345-192.168.204.28@tcp:10:bash.0 Request processed in 648us (833us total) trans 21474838798 rc 0/0 00000100:00100000:2.0:1763333172.120912:0:28430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1571 00002000:00010000:2.0:1763333172.120916:0:28430:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/545 (0->18446744073709551615) 00002000:00100000:2.0:1763333172.120919:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff73167800 with x1848987613616512 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333172.120924:0:28430:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff73167800. 00000100:00100000:3.0:1763333172.120931:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+36:2421:x1848987613616384:12345-192.168.204.28@tcp:10:bash.0 Request processed in 683us (956us total) trans 17179871493 rc 0/0 00000100:00100000:3.0:1763333172.120937:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1570 00002000:00010000:3.0:1763333172.120940:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/545 (0->18446744073709551615) 00002000:00100000:3.0:1763333172.120942:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe44e05500 with x1848987613616384 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333172.120947:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe44e05500. 00000100:00100000:3.0:1763333172.124308:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333172.124444:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333172.124490:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613616896 00000100:00100000:1.0:1763333172.124500:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613616896 00000100:00100000:1.0:1763333172.124569:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3100 00000100:00100000:1.0:1763333172.124579:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50064380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:55917:x1848987613616896:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:0.0:1763333172.124705:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613616640 00000100:00100000:0.0:1763333172.124710:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613616640 00000100:00100000:0.0:1763333172.124873:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1572 00000100:00100000:0.0:1763333172.124882:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50067800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2420:x1848987613616640:12345-192.168.204.28@tcp:3:lfs.0 00000100:00100000:1.0:1763333172.124887:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50064380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:55917:x1848987613616896:12345-192.168.204.28@tcp:35:bash.0 Request processed in 309us (442us total) trans 4294972105 rc 0/0 00000100:00100000:1.0:1763333172.124893:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3100 00010000:00010000:0.0:1763333172.124934:0:24027:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c55245 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.124950:0:24027:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333172.124952:0:24027:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333172.124959:0:24027:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c55245 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.124973:0:24027:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c55245 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.125075:0:24027:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c55245 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.125084:0:24027:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c55245 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.125092:0:24027:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c55245 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.125099:0:24027:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feba00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333172.125103:0:24027:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c55245 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.125111:0:24027:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c55245 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.125128:0:24027:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c55245 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.125136:0:24027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c55245 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333172.125182:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50067800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2420:x1848987613616640:12345-192.168.204.28@tcp:3:lfs.0 Request processed in 300us (884us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1763333172.125189:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1572 00000100:00100000:3.0:1763333172.135191:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333172.135234:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333172.135334:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613617024 00000100:00100000:1.0:1763333172.135344:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613617024 00000100:00100000:1.0:1763333172.135414:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613617152 00000100:00100000:1.0:1763333172.135417:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613617152 00000100:00100000:1.0:1763333172.135445:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9066 00000100:00100000:1.0:1763333172.135454:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50065c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56828:x1848987613617024:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333172.135478:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333172.135501:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5524c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369691cc expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.135542:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c55253 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333172.135557:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c55253 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.135566:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c55253 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.135676:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5524c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691cc expref: 229 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.135693:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ea00/0xb32e3ef184c55253 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691cc expref: 228 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.135701:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19e:0x0].0x0 (ffff92fe48355800) 00010000:00010000:1.0:1763333172.135705:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763333172.135708:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7ea00, rc 0) 00000100:00100000:1.0:1763333172.135757:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50065c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56828:x1848987613617024:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 304us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333172.135763:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9066 00000100:00100000:1.0:1763333172.135780:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9067 00000100:00100000:1.0:1763333172.135786:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50065500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56831:x1848987613617152:12345-192.168.204.28@tcp:101:rm.0 00010000:00010000:1.0:1763333172.135793:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333172.135803:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5525a lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369691d3 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.135942:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55261 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333172.135951:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55261 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.135958:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55261 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.135969:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55268 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333172.135975:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55268 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.135981:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55268 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.136042:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5526f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333172.136049:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5526f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.136055:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5526f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:1.0:1763333172.136078:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x19f:0x0]: returning size 5 00000004:00200000:1.0:1763333172.136082:0:12741:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763333172.136096:0:12741:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5526f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.136105:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5526f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.136115:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55261 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.136121:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55261 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.136127:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55261 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.136133:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55261 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.136139:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fc00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333172.136142:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55261 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.136149:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55261 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.136157:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe4388eb00) 00010000:00010000:1.0:1763333172.136160:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333172.136163:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55261 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.136168:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55261 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.136177:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55268 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.136182:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55268 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.136188:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55268 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.136193:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7ec00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333172.136196:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55268 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.136202:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55268 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.136207:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe4388e200) 00010000:00010000:1.0:1763333172.136209:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333172.136212:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55268 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.136216:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55268 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.136235:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5525a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691d3 expref: 229 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.136245:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5526f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691d3 expref: 228 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.136252:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19f:0x0].0x0 (ffff92fe48355000) 00010000:00010000:1.0:1763333172.136254:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333172.136256:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e000, rc 0) 00000100:00100000:1.0:1763333172.136275:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50065500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56831:x1848987613617152:12345-192.168.204.28@tcp:101:rm.0 Request processed in 489us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333172.136280:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9067 00000100:00100000:1.0:1763333172.141103:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.141189:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613617280 00000100:00100000:0.0:1763333172.141202:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613617280 00000100:00100000:0.0:1763333172.141280:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1573 00000100:00100000:0.0:1763333172.141292:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+36:2421:x1848987613617280:12345-192.168.204.28@tcp:4:lfs.0 00010000:00010000:0.0:1763333172.141329:0:24027:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55276 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.141382:0:24027:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55031 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969108 expref: 36 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333172.141392:0:24027:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333172.141394:0:24027:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333172.141398:0:24027:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55276 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.141436:0:24027:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55031 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969108 expref: 36 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333172.141450:0:24027:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55031 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969108 expref: 36 pid: 8406 timeout: 1376 lvb_type: 1 00000100:00100000:0.0:1763333172.141464:0:24027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff73164700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:24027:1848987627234816:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333172.141553:0:24027:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff61af3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1763333172.142931:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333172.142983:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613617536 00000100:00100000:3.0:1763333172.142993:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613617536 00000100:00100000:3.0:1763333172.143052:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9068 00000100:00100000:3.0:1763333172.143062:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56831:x1848987613617536:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:3.0:1763333172.143120:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1763333172.143148:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55230 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x19f:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691b7 expref: 228 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.143168:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5526f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691d3 expref: 227 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.143180:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55214 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x19f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691a9 expref: 226 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.143191:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19f:0x0].0x0 (ffff92fe48355000) 00010000:00010000:3.0:1763333172.143200:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333172.143227:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c5527d lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333172.143240:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c5527d lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.143249:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c5527d lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.143264:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55284 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333172.143270:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55284 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.143277:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55284 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.143414:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5528b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333172.143423:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5528b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x19f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.143430:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5528b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x19f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000040:00080000:3.0:1763333172.143706:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1346, 64 off114056 00000004:00080000:3.0:1763333172.143714:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1276223364515ns, next at 1277223362238ns, rc = 0 00000040:00080000:3.0:1763333172.143738:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1347, 64 off114056 00000040:00080000:3.0:1763333172.143748:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1348, 64 off114120 00000040:00080000:3.0:1763333172.143757:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1347, 64 off114120 00010000:00010000:3.0:1763333172.143811:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55292 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333172.143821:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55292 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x19f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.143828:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55292 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x19f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.143835:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55292 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x19f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.143840:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55292 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x19f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.143846:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55292 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x19f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.143874:0:6519:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763333172.143894:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5528b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x19f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.143899:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5528b lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x19f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.143905:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5528b lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x19f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.143910:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333172.143914:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5528b lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x19f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.143921:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5528b lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x19f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.143929:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19f:0x0].0x0 (ffff92ff80045a00) 00010000:00010000:3.0:1763333172.143932:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1763333172.143935:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5528b lrc: 2/0,0 mode: --/EX res: [0x240000404:0x19f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.143940:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5528b lrc: 0/0,0 mode: --/EX res: [0x240000404:0x19f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.144050:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c5527d lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.144059:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c5527d lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.144063:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c5527d lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.144068:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c5527d lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.144073:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333172.144075:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c5527d lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.144081:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c5527d lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.144088:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff80045800) 00010000:00010000:3.0:1763333172.144091:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333172.144093:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c5527d lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.144098:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c5527d lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:3.0:1763333172.144108:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004ad03a27 reply state 0000000018b8199a transno 4294972106 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55284 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.144118:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55284 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.144124:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045c00) 00010000:00010000:3.0:1763333172.144126:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763333172.144128:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763333172.144203:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56831:x1848987613617536:12345-192.168.204.28@tcp:36:rm.0 Request processed in 1141us (1275us total) trans 4294972106 rc 0/0 00000100:00100000:3.0:1763333172.144212:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9068 00010000:00010000:0.0:1763333172.144379:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333172.144385:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55292 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x19f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333172.144392:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333172.144395:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55292 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x19f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333172.144401:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55292 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x19f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333172.144410:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19f:0x0].0x0 (ffff92ff80045a00) 00010000:00010000:0.0:1763333172.144412:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763333172.144415:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55292 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x19f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333172.144421:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55292 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x19f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333172.144433:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333172.144435:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333172.144436:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763333172.151993:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333172.152037:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.152143:0:32351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613617664 00000100:00100000:2.0:1763333172.152153:0:32351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613617664 00000100:00100000:3.0:1763333172.152220:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613617792 00000100:00100000:2.0:1763333172.152222:0:32351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 153 00000100:00100000:3.0:1763333172.152224:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613617792 00000100:00100000:2.0:1763333172.152232:0:32351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae3ba77-d588-4a44-b5f9-fbec4e33064f+9:2420:x1848987613617664:12345-192.168.204.28@tcp:400:kworker.0 00000100:00080000:3.0:1763333172.152246:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1763333172.152276:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1490 00000100:00100000:3.0:1763333172.152282:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2420:x1848987613617792:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1763333172.152305:0:32351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae3ba77-d588-4a44-b5f9-fbec4e33064f+9:2420:x1848987613617664:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 74us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333172.152316:0:32351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 153 00000100:00100000:0.0:1763333172.152473:0:24027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff73164700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:24027:1848987627234816:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333172.152504:0:24027:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55276 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333172.152578:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.152608:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.152650:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.152695:0:28430:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613617920 00000100:00100000:2.0:1763333172.152700:0:28430:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613617920 00002000:00100000:2.0:1763333172.152728:0:28430:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x2c0000400:0x221:0x0] (0->4) req@ffff92ff7e00e300 x1848987613617920/t0(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:483/0 lens 496/0 e 0 to 0 dl 1763333183 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763333172.152738:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7e00e300 with x1848987613617920 ext(0->4) 00002000:00010000:2.0:1763333172.152742:0:28430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff7e00e300 00000100:00100000:2.0:1763333172.152758:0:28430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1574 00000100:00100000:2.0:1763333172.152765:0:28430:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+37:2420:x1848987613617920:12345-192.168.204.28@tcp:4:bash.0 00000100:00100000:0.0:1763333172.152969:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613618048 00000100:00100000:0.0:1763333172.152973:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613618048 00000100:00100000:0.0:1763333172.153000:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6332 00000100:00100000:0.0:1763333172.153007:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+38:2420:x1848987613618048:12345-192.168.204.28@tcp:16:kworker.0 00000100:00100000:3.0:1763333172.153138:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2420:x1848987613617792:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 855us (1100us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333172.153146:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1490 00000100:00100000:1.0:1763333172.154108:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613618176 00000100:00100000:1.0:1763333172.154116:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613618176 00010000:00010000:1.0:1763333172.154146:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55031 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969108 expref: 41 pid: 8406 timeout: 1376 lvb_type: 1 00000100:00100000:1.0:1763333172.154170:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2973 00000100:00100000:1.0:1763333172.154178:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+41:2420:x1848987613618176:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333172.154189:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333172.154206:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55031 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x220:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969108 expref: 41 pid: 8406 timeout: 1376 lvb_type: 1 00010000:00010000:1.0:1763333172.154218:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55031 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x220:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969108 expref: 41 pid: 8406 timeout: 1376 lvb_type: 1 00010000:00010000:1.0:1763333172.154240:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55031 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x220:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969108 expref: 41 pid: 8406 timeout: 1376 lvb_type: 1 00010000:00010000:1.0:1763333172.154257:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333172.154259:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333172.154264:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55276 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.154273:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55276 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.154300:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333172.154312:0:24027:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55276 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.154320:0:24027:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55276 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333172.154346:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+40:2420:x1848987613618176:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 169us (1737us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333172.154368:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2973 00000100:00100000:3.0:1763333172.155226:0:28430:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+41:2420:x1848987613617920:12345-192.168.204.28@tcp:4:bash.0 Request processed in 2458us (2645us total) trans 17179871494 rc 0/0 00000100:00100000:3.0:1763333172.155236:0:28430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1574 00002000:00100000:3.0:1763333172.155245:0:28430:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x2c0000400:0x221:0x0] (0->4) req@ffff92ff7e00e300 x1848987613617920/t17179871494(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:483/0 lens 496/448 e 0 to 0 dl 1763333183 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763333172.155254:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7e00e300 with x1848987613617920 ext(0->4) 00002000:00010000:3.0:1763333172.155259:0:28430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff7e00e300 00000001:00080000:2.0:1763333172.157449:0:26035:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871494 is committed 00000001:00080000:2.0:1763333172.157466:0:26035:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871492 is committed 00000100:00100000:0.0:1763333172.159162:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2420:x1848987613618048:12345-192.168.204.28@tcp:16:kworker.0 Request processed in 6144us (6499us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333172.159176:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6332 00000001:00080000:2.0:1763333172.161655:0:26035:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871495 is committed 00002000:00010000:0.0:1763333172.162385:0:24027:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x220:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:0.0:1763333172.162391:0:24027:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x220:0x0] updating lvb mtime from disk: 0 -> 1763333172 00002000:00010000:0.0:1763333172.162394:0:24027:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x220:0x0] updating lvb ctime from disk: 0 -> 1763333172 00002000:00010000:0.0:1763333172.162397:0:24027:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x220:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1763333172.162411:0:24027:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55276 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.162424:0:24027:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55276 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.162432:0:24027:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55276 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.162439:0:24027:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feba00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333172.162443:0:24027:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55276 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.162451:0:24027:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55276 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.162470:0:24027:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55276 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.162478:0:24027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55276 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333172.162579:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2421:x1848987613617280:12345-192.168.204.28@tcp:4:lfs.0 Request processed in 21283us (21486us total) trans 17179871495 rc 0/0 00000100:00100000:0.0:1763333172.162588:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1573 00000100:00100000:2.0:1763333172.170592:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.172231:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613618304 00000100:00100000:0.0:1763333172.172248:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613618304 00000100:00100000:0.0:1763333172.172327:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9069 00000100:00100000:0.0:1763333172.172336:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56832:x1848987613618304:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333172.172392:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333172.172416:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c55299 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369691da expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.172484:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c552a0 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333172.172497:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c552a0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.172507:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c552a0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.172517:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c552a7 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333172.172524:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c552a7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.172543:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c552a7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.172586:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c552a0 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.172592:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c552a0 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.172598:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c552a0 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.172605:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c552a0 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.172610:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333172.172615:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c552a0 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.172622:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c552a0 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.172634:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12c00) 00010000:00010000:0.0:1763333172.172637:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333172.172641:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c552a0 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.172647:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c552a0 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.172658:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c552a7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.172664:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c552a7 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.172670:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c552a7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.172674:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333172.172677:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c552a7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.172682:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c552a7 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.172689:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045c00) 00010000:00010000:0.0:1763333172.172691:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333172.172694:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c552a7 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.172699:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c552a7 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.172728:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c55299 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691da expref: 228 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.172738:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12c00) 00010000:00010000:0.0:1763333172.172740:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333172.172743:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c55299 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691da expref: 228 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.172756:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feb400, rc 0) 00000100:00100000:0.0:1763333172.172827:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56832:x1848987613618304:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 491us (2245us total) trans 0 rc 301/301 00000100:00100000:0.0:1763333172.172835:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9069 00000100:00100000:1.0:1763333172.178461:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.178573:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613618432 00000100:00100000:2.0:1763333172.178583:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613618432 00000100:00100000:2.0:1763333172.178639:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9070 00000100:00100000:2.0:1763333172.178649:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56832:x1848987613618432:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333172.178670:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333172.178693:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c552ae lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369691e1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.178781:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c552b5 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333172.178799:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c552b5 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.178810:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c552b5 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.178822:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c552bc lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333172.178828:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c552bc lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.178834:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c552bc lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.178883:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c552b5 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.178889:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c552b5 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.178896:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c552b5 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.178901:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c552b5 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.178907:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333172.178911:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c552b5 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.178923:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c552b5 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.178940:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff61a46400) 00010000:00010000:2.0:1763333172.178943:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333172.178948:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c552b5 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.178954:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c552b5 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.178968:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c552bc lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.178974:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c552bc lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.178978:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c552bc lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.178983:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333172.178986:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c552bc lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.178991:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c552bc lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.178998:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045c00) 00010000:00010000:2.0:1763333172.179000:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333172.179003:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c552bc lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.179008:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c552bc lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.179033:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c552ae lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691e1 expref: 228 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.179043:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff61a46400) 00010000:00010000:2.0:1763333172.179046:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333172.179049:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c552ae lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691e1 expref: 228 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.179061:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5e00, rc 0) 00000100:00100000:2.0:1763333172.179126:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56832:x1848987613618432:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 478us (676us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333172.179133:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9070 00000100:00100000:1.0:1763333172.181341:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.182779:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613618560 00000100:00100000:2.0:1763333172.182793:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613618560 00000100:00100000:2.0:1763333172.182877:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9071 00000100:00100000:2.0:1763333172.182888:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56832:x1848987613618560:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333172.182909:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333172.182931:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c552c3 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369691e8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.182994:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c552ca lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333172.183008:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c552ca lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.183018:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c552ca lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:2.0:1763333172.183063:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1763333172.183068:0:6519:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1763333172.183104:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c552c3 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691e8 expref: 229 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.183123:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c552ca lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691e8 expref: 228 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.183131:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff61a46900) 00010000:00010000:2.0:1763333172.183134:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1763333172.183138:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4c00, rc 0) 00000100:00100000:2.0:1763333172.184539:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56832:x1848987613618560:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1639us (3192us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333172.184550:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9071 00000100:00100000:3.0:1763333172.188643:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.188744:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613618816 00000100:00100000:2.0:1763333172.188757:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613618816 00000100:00100000:2.0:1763333172.188810:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9072 00000100:00100000:2.0:1763333172.188818:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56828:x1848987613618816:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:2.0:1763333172.188876:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333172.188902:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c551a4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x19e:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969186 expref: 228 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.188921:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19e:0x0].0x0 (ffff92fe48355800) 00010000:00010000:2.0:1763333172.188925:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333172.188996:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c552d1 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333172.189010:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c552d1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.189019:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c552d1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00010000:2.0:1763333172.189141:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f4009ce6 reply state 000000008e97c1fe transno 4294972107 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c552d1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.189155:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c552d1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.189160:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19e:0x0].0x0 (ffff92fe48355800) 00010000:00010000:2.0:1763333172.189162:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333172.189165:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763333172.189250:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56828:x1848987613618816:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 432us (619us total) trans 4294972107 rc 0/0 00000100:00100000:2.0:1763333172.189257:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9072 00000100:00100000:1.0:1763333172.198454:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.198551:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613618944 00000100:00100000:0.0:1763333172.198563:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613618944 00000100:00100000:0.0:1763333172.198625:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6333 00000100:00100000:0.0:1763333172.198638:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:56828:x1848987613618944:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333172.198661:0:29013:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333172.198688:0:29013:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c552d8 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369691ef expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763333172.198713:0:29013:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x220:0x0] initial LVB size: 4096, mtime: 0x691a5434, atime: 0x0, ctime: 0x691a5434, blocks: 0x8 00010000:00010000:0.0:1763333172.198736:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333172.198738:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333172.198746:0:29013:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c552d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691ef expref: 14 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.198761:0:29013:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c552d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691ef expref: 14 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.198774:0:29013:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feb400, rc 0) 00000100:00100000:0.0:1763333172.198838:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:56828:x1848987613618944:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 203us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333172.198845:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6333 00000100:00100000:3.0:1763333172.199464:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333172.199546:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613619072 00000100:00100000:1.0:1763333172.199551:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613619072 00000100:00100000:1.0:1763333172.199596:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9073 00000100:00100000:1.0:1763333172.199605:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50066a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56832:x1848987613619072:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333172.199620:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333172.199638:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c552df lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369691f6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.200261:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c552e6 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333172.200276:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c552e6 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.200286:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c552e6 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.200295:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c552ed lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333172.200300:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c552ed lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.200306:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c552ed lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.200342:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c552e6 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.200399:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c552e6 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.200405:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c552e6 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.200411:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c552e6 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.200417:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333172.200420:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c552e6 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.200426:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c552e6 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.200437:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff61a46900) 00010000:00010000:0.0:1763333172.200440:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333172.200444:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c552e6 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.200449:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c552e6 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.200460:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c552ed lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.200465:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c552ed lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.200470:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c552ed lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.200474:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333172.200476:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c552ed lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.200481:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c552ed lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.200486:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045c00) 00010000:00010000:0.0:1763333172.200488:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333172.200491:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c552ed lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.200497:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c552ed lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.200523:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c552df lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691f6 expref: 230 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.200544:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff61a46900) 00010000:00010000:0.0:1763333172.200546:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333172.200550:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c552df lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691f6 expref: 230 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.200560:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f600, rc 0) 00000100:00100000:0.0:1763333172.200619:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50066a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56832:x1848987613619072:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1015us (1156us total) trans 0 rc 301/301 00000100:00100000:0.0:1763333172.200626:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9073 00000100:00100000:1.0:1763333172.201998:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.202345:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613619200 00000100:00100000:0.0:1763333172.202385:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613619200 00000100:00100000:0.0:1763333172.202894:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6334 00000100:00100000:0.0:1763333172.202906:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:56828:x1848987613619200:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333172.202924:0:29013:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333172.203168:0:29013:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c552f4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369691fd expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.203203:0:29013:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdee00/0xb32e3ef184c55038 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696910f expref: 23 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333172.203216:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333172.203219:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333172.203223:0:29013:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c552f4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691fd expref: 23 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.203259:0:29013:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdee00/0xb32e3ef184c55038 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696910f expref: 23 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333172.203273:0:29013:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdee00/0xb32e3ef184c55038 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696910f expref: 23 pid: 8611 timeout: 1376 lvb_type: 1 00000100:00100000:0.0:1763333172.203287:0:29013:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff73164700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29013:1848987627234944:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333172.203404:0:29013:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff61af3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1763333172.203777:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.203895:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613619456 00000100:00100000:0.0:1763333172.203902:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613619456 00000100:00100000:0.0:1763333172.203950:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9074 00000100:00100000:0.0:1763333172.203962:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50064e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56832:x1848987613619456:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333172.203974:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333172.203977:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763333172.203998:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c552ca lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691e8 expref: 229 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.204015:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff61a46900) 00010000:00010000:0.0:1763333172.204024:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333172.204035:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c552fb lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969204 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.204130:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55302 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333172.204141:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55302 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.204149:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55302 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.204159:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c55309 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333172.204165:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c55309 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.204171:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c55309 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.204598:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c55310 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333172.204607:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c55310 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.204614:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c55310 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:0.0:1763333172.204625:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1a1:0x0]: returning size 0 00010000:00010000:0.0:1763333172.204652:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55302 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.204658:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55302 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.204667:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55302 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.204673:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55302 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.204678:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333172.204682:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55302 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.204689:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55302 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.204697:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12700) 00010000:00010000:0.0:1763333172.204700:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333172.204704:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55302 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.204710:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55302 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000004:00010000:0.0:1763333172.204722:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d7c05de9 reply state 00000000abdbffb9 transno 4294972108 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c55309 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.204732:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c55309 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.204737:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045c00) 00010000:00010000:0.0:1763333172.204740:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333172.204742:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763333172.204767:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c552fb lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969204 expref: 231 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.204789:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c55310 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969204 expref: 230 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.204796:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a1:0x0].0x0 (ffff92fe44e12100) 00010000:00010000:0.0:1763333172.204798:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333172.204801:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abde400, rc 0) 00000100:00100000:0.0:1763333172.204844:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50064e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56832:x1848987613619456:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 883us (1068us total) trans 4294972108 rc 0/0 00000100:00100000:0.0:1763333172.204851:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9074 00000100:00100000:3.0:1763333172.206715:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.206930:0:29013:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff73164700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29013:1848987627234944:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333172.206938:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:0.0:1763333172.206968:0:29013:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c552f4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691fd expref: 23 pid: 29013 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333172.206982:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613619840 00000100:00100000:3.0:1763333172.206988:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613619840 00010000:00010000:0.0:1763333172.206988:0:29013:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feba00, rc 0) 00000100:00100000:0.0:1763333172.207033:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:56828:x1848987613619200:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 4130us (5043us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333172.207034:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9075 00000100:00100000:0.0:1763333172.207041:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6334 00000100:00100000:3.0:1763333172.207043:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50067b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56832:x1848987613619840:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333172.207062:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333172.207081:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c5531e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696920b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333172.207085:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613619584 00000100:00100000:2.0:1763333172.207090:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613619584 00010000:00010000:2.0:1763333172.207113:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdee00/0xb32e3ef184c55038 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696910f expref: 23 pid: 8611 timeout: 1376 lvb_type: 1 00000100:00100000:2.0:1763333172.207145:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2974 00000100:00100000:2.0:1763333172.207152:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff82066450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2420:x1848987613619584:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333172.207164:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333172.207186:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdee00/0xb32e3ef184c55038 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x220:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696910f expref: 23 pid: 8611 timeout: 1376 lvb_type: 1 00010000:00010000:3.0:1763333172.207195:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55325 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333172.207199:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdee00/0xb32e3ef184c55038 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x220:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696910f expref: 23 pid: 8611 timeout: 1376 lvb_type: 1 00010000:00010000:3.0:1763333172.207208:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c55310 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969204 expref: 232 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.207217:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55325 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.207220:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdee00/0xb32e3ef184c55038 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x220:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696910f expref: 23 pid: 8611 timeout: 1376 lvb_type: 1 00010000:00010000:2.0:1763333172.207234:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333172.207237:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333172.207242:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c552f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691fd expref: 22 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.207248:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c55310 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969204 expref: 232 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.207250:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c552f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691fd expref: 22 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.207260:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c55310 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969204 expref: 232 pid: 6521 timeout: 1376 lvb_type: 0 00010000:00010000:2.0:1763333172.207270:0:8423:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c552f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691fd expref: 22 pid: 29013 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333172.207273:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff50065880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627235072:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333172.207279:0:8423:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e00f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8423:1848987627235200:192.168.204.28@tcp:105: 00000100:00100000:3.0:1763333172.207318:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7df5de40 going to sleep for 11 seconds 00000100:00100000:2.0:1763333172.207732:0:8423:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff5119d780 going to sleep for 11 seconds 00000100:00100000:3.0:1763333172.210849:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.210868:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff50065880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627235072:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333172.210877:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:2.0:1763333172.210906:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55325 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000100:00100000:3.0:1763333172.210909:0:28430:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613619968 00000100:00100000:3.0:1763333172.210916:0:28430:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613619968 00002000:00010000:3.0:1763333172.210974:0:28430:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/544 (5->18446744073709551615) 00002000:00100000:3.0:1763333172.210979:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff50064000 with x1848987613619968 ext(5->18446744073709551615) 00002000:00010000:3.0:1763333172.210990:0:28430:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff50064000. 00000100:00100000:0.0:1763333172.211083:0:8423:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e00f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8423:1848987627235200:192.168.204.28@tcp:105: 00010000:00010000:0.0:1763333172.211098:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333172.211158:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff82066450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2420:x1848987613619584:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 4004us (4451us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333172.211168:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2974 00000100:00100000:1.0:1763333172.211182:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613620096 00000100:00100000:1.0:1763333172.211186:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613620096 00002000:00010000:1.0:1763333172.211202:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/544 (0->18446744073709551615) 00002000:00100000:1.0:1763333172.211205:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff50064a80 with x1848987613620096 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333172.211212:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff50064a80. 00000100:00100000:1.0:1763333172.211231:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1575 00000100:00100000:1.0:1763333172.211240:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50064000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2420:x1848987613619968:12345-192.168.204.28@tcp:10:lfs.0 00002000:00010000:1.0:1763333172.211615:0:24027:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x220:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:1.0:1763333172.211619:0:24027:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x220:0x0] updating lvb mtime from disk: 1763333172 -> 1763333172 00002000:00010000:1.0:1763333172.211622:0:24027:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x220:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333172.211625:0:24027:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x220:0x0] updating lvb ctime from disk: 1763333172 -> 1763333172 00002000:00010000:1.0:1763333172.211628:0:24027:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x220:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1763333172.211856:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1576 00000100:00100000:2.0:1763333172.211866:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50064a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2421:x1848987613620096:12345-192.168.204.28@tcp:10:lfs.0 00002000:00010000:2.0:1763333172.212002:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x220:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333172.212005:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x220:0x0] updating lvb mtime from disk: 0 -> 1763333172 00002000:00010000:2.0:1763333172.212007:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x220:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333172.212009:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x220:0x0] updating lvb ctime from disk: 0 -> 1763333172 00002000:00010000:2.0:1763333172.212011:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x220:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333172.212034:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50064a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2421:x1848987613620096:12345-192.168.204.28@tcp:10:lfs.0 Request processed in 171us (1156us total) trans 21474838799 rc 0/0 00000100:00100000:2.0:1763333172.212041:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1576 00002000:00010000:2.0:1763333172.212045:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/544 (0->18446744073709551615) 00002000:00100000:2.0:1763333172.212047:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff50064a80 with x1848987613620096 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333172.212051:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff50064a80. 00000100:00100000:3.0:1763333172.212296:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.212585:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613620224 00000100:00100000:0.0:1763333172.212592:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613620224 00010000:00010000:0.0:1763333172.212625:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c55310 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969204 expref: 233 pid: 6521 timeout: 1376 lvb_type: 0 00000100:00100000:0.0:1763333172.212652:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2975 00000100:00100000:0.0:1763333172.212660:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50065f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:2420:x1848987613620224:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333172.212672:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333172.212679:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c55310 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969204 expref: 233 pid: 6521 timeout: 1376 lvb_type: 0 00010000:00010000:0.0:1763333172.212691:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c55310 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969204 expref: 233 pid: 6521 timeout: 1376 lvb_type: 0 00010000:00010000:0.0:1763333172.212713:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c55310 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969204 expref: 233 pid: 6521 timeout: 1376 lvb_type: 0 00010000:00010000:0.0:1763333172.212730:0:8423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a1:0x0].0x0 (ffff92fe44e12100) 00010000:00010000:0.0:1763333172.212736:0:8423:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55325 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333172.212745:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55325 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333172.212753:0:8423:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55325 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333172.212779:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333172.212802:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50065f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:2420:x1848987613620224:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 143us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333172.212809:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2975 00010000:00010000:2.0:1763333172.212879:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55325 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.212886:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55325 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:2.0:1763333172.212909:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1a1:0x0]: returning size 0 00000004:00080000:2.0:1763333172.213120:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x223:0x0], index 0: 0 00000004:00080000:2.0:1763333172.213127:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x223:0x0], index 1: 0 00000004:00080000:2.0:1763333172.213132:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x224:0x0], index 1: 0 00000100:00100000:1.0:1763333172.213135:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50064000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2420:x1848987613619968:12345-192.168.204.28@tcp:10:lfs.0 Request processed in 1895us (2297us total) trans 17179871496 rc 0/0 00000004:00080000:2.0:1763333172.213136:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x224:0x0], index 0: 0 00000100:00100000:1.0:1763333172.213143:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1575 00002000:00010000:1.0:1763333172.213147:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/544 (5->18446744073709551615) 00002000:00100000:1.0:1763333172.213150:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff50064000 with x1848987613619968 ext(5->18446744073709551615) 00002000:00010000:1.0:1763333172.213156:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff50064000. 00010000:00010000:2.0:1763333172.213228:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55325 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.213237:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55325 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.213243:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55325 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.213249:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333172.213254:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55325 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.213261:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55325 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.213280:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a1:0x0].0x0 (ffff92fe44e12100) 00010000:00010000:2.0:1763333172.213283:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333172.213287:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55325 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.213293:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55325 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.213339:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c5531e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1a1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696920b expref: 232 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.213364:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a1:0x0].0x0 (ffff92fe44e12100) 00010000:00010000:2.0:1763333172.213367:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763333172.213371:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c5531e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1a1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696920b expref: 232 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.213385:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a97200, rc 0) 00000100:00100000:2.0:1763333172.213427:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50067b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56832:x1848987613619840:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 6385us (6487us total) trans 4294972109 rc 301/301 00000100:00100000:2.0:1763333172.213434:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9075 00000100:00100000:2.0:1763333172.216544:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333172.216696:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613620480 00000100:00100000:1.0:1763333172.216708:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613620480 00000100:00100000:1.0:1763333172.216778:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3101 00000100:00100000:1.0:1763333172.216789:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56832:x1848987613620480:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1763333172.217114:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56832:x1848987613620480:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 325us (586us total) trans 4294972110 rc 0/0 00000100:00100000:1.0:1763333172.217123:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3101 00000100:00100000:3.0:1763333172.217401:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.218299:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613620736 00000100:00100000:2.0:1763333172.218308:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613620736 00000100:00100000:2.0:1763333172.218562:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9076 00000100:00100000:2.0:1763333172.218574:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50064700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56828:x1848987613620736:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:2.0:1763333172.218673:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c55333 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333172.218694:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c55333 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.218709:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c55333 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00010000:2.0:1763333172.218834:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e02d21a1 reply state 000000007d59028f transno 4294972111 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c55333 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.218847:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c55333 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.218854:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19e:0x0].0x0 (ffff92fe48355800) 00010000:00010000:2.0:1763333172.218858:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333172.218862:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763333172.219714:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50064700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:56828:x1848987613620736:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 1137us (2307us total) trans 4294972111 rc 0/0 00000100:00100000:2.0:1763333172.219723:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9076 00000100:00100000:3.0:1763333172.223236:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.223863:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613620992 00000100:00100000:0.0:1763333172.223875:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613620992 00000100:00100000:0.0:1763333172.223942:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3102 00000100:00100000:0.0:1763333172.223964:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50066d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:56832:x1848987613620992:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333172.224189:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50066d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:56832:x1848987613620992:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 237us (965us total) trans 4294972112 rc 0/0 00000100:00100000:0.0:1763333172.224197:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3102 00000100:00100000:0.0:1763333172.225994:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.226145:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613621120 00000100:00100000:2.0:1763333172.226156:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613621120 00000100:00100000:2.0:1763333172.226216:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6335 00000100:00100000:2.0:1763333172.226227:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73164700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2420:x1848987613621120:12345-192.168.204.28@tcp:2:lfs.0 00002000:00010000:2.0:1763333172.226419:0:29013:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x21f:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1763333172.226423:0:29013:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x21f:0x0] updating lvb mtime from disk: 1763333172 -> 1763333172 00002000:00010000:2.0:1763333172.226425:0:29013:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x21f:0x0] updating lvb atime from disk: 0 -> 1763333172 00002000:00010000:2.0:1763333172.226428:0:29013:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x21f:0x0] updating lvb ctime from disk: 1763333172 -> 1763333172 00002000:00010000:2.0:1763333172.226430:0:29013:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x21f:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1763333172.226485:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73164700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:2420:x1848987613621120:12345-192.168.204.28@tcp:2:lfs.0 Request processed in 260us (500us total) trans 21474838800 rc 0/0 00000100:00100000:2.0:1763333172.226492:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6335 00000100:00100000:1.0:1763333172.231137:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.233457:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333172.233558:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613621632 00000100:00100000:1.0:1763333172.233569:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613621632 00000100:00100000:1.0:1763333172.233673:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3103 00000100:00100000:1.0:1763333172.233684:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73166680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:56828:x1848987613621632:12345-192.168.204.28@tcp:35:lfs.0 00000004:00010000:1.0:1763333172.233752:0:6522:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x240000404:0x19e:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5512d lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x19e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696915c expref: 235 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.233805:0:6522:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5533a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 00010000:00010000:1.0:1763333172.233820:0:6522:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55181 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969178 expref: 235 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.233834:0:6522:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5533a lrc: 4/0,1 mode: --/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 00010000:00010000:1.0:1763333172.233871:0:6522:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55181 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969178 expref: 235 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.233886:0:6522:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55181 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969178 expref: 235 pid: 6521 timeout: 1376 lvb_type: 0 00000100:00100000:1.0:1763333172.233902:0:6522:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f6d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6522:1848987627235328:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333172.234823:0:6522:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe46e0e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763333172.235955:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613621376 00000100:00100000:2.0:1763333172.235975:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613621376 00000100:00100000:2.0:1763333172.236069:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9077 00000100:00100000:2.0:1763333172.236082:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:55917:x1848987613621376:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333172.236106:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333172.236137:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55341 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969212 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.236320:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55348 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333172.236334:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55348 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.236346:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55348 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.236400:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5534f lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333172.236408:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5534f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.236415:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5534f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.236482:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55356 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333172.236491:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55356 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.236497:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55356 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:2.0:1763333172.236513:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1a1:0x0]: returning size 0 00010000:00010000:2.0:1763333172.236623:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55348 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.236630:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55348 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.236636:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55348 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.236642:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55348 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.236647:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333172.236651:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55348 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.236659:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55348 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.236672:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff61a46400) 00010000:00010000:2.0:1763333172.236675:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333172.236680:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55348 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.236686:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55348 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.236705:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5534f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.236712:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5534f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.236722:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5534f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.236727:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333172.236729:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5534f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.236735:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5534f lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.236743:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045c00) 00010000:00010000:2.0:1763333172.236745:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333172.236748:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5534f lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.236754:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5534f lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.236804:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55341 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969212 expref: 239 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.236824:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55356 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969212 expref: 238 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.236831:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a1:0x0].0x0 (ffff92ff61a46000) 00010000:00010000:2.0:1763333172.236834:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333172.236836:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4400, rc 0) 00000100:00100000:2.0:1763333172.236927:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:55917:x1848987613621376:12345-192.168.204.28@tcp:101:bash.0 Request processed in 848us (5800us total) trans 4294972113 rc 0/0 00000100:00100000:2.0:1763333172.236935:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9077 00000100:00100000:0.0:1763333172.239427:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333172.239574:0:6522:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f6d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6522:1848987627235328:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333172.239606:0:6522:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5533a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 00000100:00100000:3.0:1763333172.239674:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613621760 00000100:00100000:3.0:1763333172.239683:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613621760 00010000:00010000:3.0:1763333172.239720:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55181 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969178 expref: 238 pid: 6521 timeout: 1376 lvb_type: 0 00000100:00100000:3.0:1763333172.239750:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2976 00000100:00100000:3.0:1763333172.239759:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:2421:x1848987613621760:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333172.239773:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333172.239779:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55181 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969178 expref: 238 pid: 6521 timeout: 1376 lvb_type: 0 00010000:00010000:3.0:1763333172.239791:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55181 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969178 expref: 238 pid: 6521 timeout: 1376 lvb_type: 0 00010000:00010000:3.0:1763333172.239813:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55181 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969178 expref: 238 pid: 6521 timeout: 1376 lvb_type: 0 00010000:00010000:3.0:1763333172.239827:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19e:0x0].0x0 (ffff92fe48355800) 00010000:00010000:3.0:1763333172.239832:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5533a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 00010000:00010000:3.0:1763333172.239846:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5533a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT1 00010000:00010000:3.0:1763333172.239854:0:6505:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5533a lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT1 00010000:00010000:3.0:1763333172.239887:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333172.239961:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:2421:x1848987613621760:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 189us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333172.239969:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2976 00010000:00010000:1.0:1763333172.241158:0:6522:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5533a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 00010000:00010000:1.0:1763333172.241173:0:6522:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5533a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 00000040:00080000:1.0:1763333172.241447:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1349, 88 off114208 00000004:00080000:1.0:1763333172.241456:0:6522:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1276321106449ns, next at 1276878902000ns, rc = 0 00000040:00080000:1.0:1763333172.241489:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1348, 88 off114208 00000004:00080000:1.0:1763333172.241494:0:6522:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1276321144831ns, next at 1277223362238ns, rc = 0 00000040:00080000:1.0:1763333172.241522:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1349, 88 off114296 00000004:00080000:1.0:1763333172.241536:0:6522:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1276321186661ns, next at 1277223362238ns, rc = 0 00000040:00080000:1.0:1763333172.241548:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1350, 88 off114296 00000004:00080000:1.0:1763333172.241553:0:6522:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1276321203936ns, next at 1276878902000ns, rc = 0 00000100:00100000:1.0:1763333172.242742:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.243437:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613621888 00000100:00100000:0.0:1763333172.243449:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613621888 00000100:00100000:2.0:1763333172.244322:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9078 00000100:00100000:2.0:1763333172.244337:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:55917:x1848987613621888:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333172.244390:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333172.244417:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55364 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969219 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.244453:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5536b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333172.244468:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5536b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.244480:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5536b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.244604:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55364 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969219 expref: 240 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.244622:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5536b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969219 expref: 239 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.244632:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a1:0x0].0x0 (ffff92ff61a46000) 00010000:00010000:2.0:1763333172.244635:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763333172.244638:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5c00, rc 0) 00000100:00100000:2.0:1763333172.244711:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:55917:x1848987613621888:12345-192.168.204.28@tcp:101:bash.0 Request processed in 378us (1978us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333172.244718:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9078 00000001:00080000:1.0:1763333172.246207:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972114 is committed 00000004:00080000:1.0:1763333172.246220:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 885 committed 00000004:00080000:1.0:1763333172.246237:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 882 committed 00000004:00080000:1.0:1763333172.246255:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 881 committed 00000004:00080000:1.0:1763333172.246257:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 884 committed 00000004:00080000:1.0:1763333172.246276:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 880 committed 00000004:00010000:1.0:1763333172.246334:0:6522:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000057666a5b reply state 0000000020c209f1 transno 4294972114 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5533a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 00010000:00010000:1.0:1763333172.246399:0:6522:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5533a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 00010000:00010000:1.0:1763333172.246407:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19e:0x0].0x0 (ffff92fe48355800) 00010000:00010000:1.0:1763333172.246410:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1763333172.246413:0:6522:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763333172.246421:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19e:0x0].0x0 (ffff92fe48355800) 00010000:00010000:1.0:1763333172.246423:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763333172.246430:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5512d lrc: 0/0,0 mode: --/PW res: [0x240000404:0x19e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696915c expref: 228 pid: 6521 timeout: 0 lvb_type: 0 00010000:00080000:1.0:1763333172.246550:0:6522:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1763333172.246565:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73166680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56828:x1848987613621632:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 12883us (13118us total) trans 4294972114 rc 0/0 00000100:00100000:1.0:1763333172.246577:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3103 00010000:00010000:0.0:1763333172.246815:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5533a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 00010000:00010000:0.0:1763333172.246823:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5533a lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 00010000:00010000:0.0:1763333172.246831:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5533a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 00010000:00010000:0.0:1763333172.246837:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333172.246843:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5533a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 00010000:00010000:0.0:1763333172.246852:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5533a lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 00010000:00010000:0.0:1763333172.246863:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19e:0x0].0x0 (ffff92fe48355800) 00010000:00010000:0.0:1763333172.246865:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333172.246869:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5533a lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 00010000:00010000:0.0:1763333172.246879:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5533a lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 00000100:00100000:0.0:1763333172.246913:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe49609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627235584:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763333172.247148:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333172.247196:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1763333172.247204:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77a3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627235456:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763333172.247226:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333172.247257:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe49608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627235712:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333172.247286:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333172.247306:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763333172.247311:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe49608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627235840:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333172.247330:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333172.247394:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627235584 00000100:00100000:0.0:1763333172.247401:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627235584 00000100:00100000:0.0:1763333172.247437:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627235456 00000100:00100000:0.0:1763333172.247439:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627235456 00000100:00100000:0.0:1763333172.247452:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627235712 00000100:00100000:0.0:1763333172.247454:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627235712 00000100:00100000:0.0:1763333172.247465:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627235840 00000100:00100000:0.0:1763333172.247468:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627235840 00000100:00100000:0.0:1763333172.247483:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6336 00000100:00100000:0.0:1763333172.247490:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49608e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+8:3653:x1848987627235584:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1763333172.247535:0:29013:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:546 count 1 00002000:00010000:0.0:1763333172.247574:0:29013:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x222:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333172.247580:0:29013:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55372 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.247599:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333172.247601:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333172.247606:0:29013:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55372 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.247617:0:29013:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55372 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.247626:0:29013:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55372 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.247632:0:29013:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55372 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.247649:0:29013:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763333172.247876:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49608e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+9:3653:x1848987627235584:12345-0@lo:6:osp-syn-1-1.0 Request processed in 385us (729us total) trans 17179871497 rc 0/0 00000100:00100000:0.0:1763333172.247883:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6336 00000100:00100000:0.0:1763333172.247903:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6337 00000100:00100000:0.0:1763333172.247909:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49609880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+8:3653:x1848987627235456:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1763333172.247921:0:29013:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:545 count 1 00010000:00010000:0.0:1763333172.247933:0:29013:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c55379 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x221:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.247956:0:29013:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55237 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691be expref: 14 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.247969:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333172.247971:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333172.247974:0:29013:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c55379 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.248013:0:29013:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55237 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691be expref: 14 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.248028:0:29013:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55237 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691be expref: 14 pid: 8404 timeout: 1376 lvb_type: 0 00000100:00100000:0.0:1763333172.248040:0:29013:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff75666d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:29013:1848987627235968:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333172.248103:0:29013:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff44fdfc00 going to sleep for 11 seconds 00000100:00100000:0.0:1763333172.248126:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6338 00000100:00100000:0.0:1763333172.248135:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75665500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+8:3654:x1848987627235712:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1763333172.248248:0:8611:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x21f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333172.248252:0:8611:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x21f:0x0] updating lvb mtime from disk: 1763333172 -> 1763333172 00002000:00010000:0.0:1763333172.248255:0:8611:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x21f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333172.248258:0:8611:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x21f:0x0] updating lvb ctime from disk: 1763333172 -> 1763333172 00002000:00010000:0.0:1763333172.248261:0:8611:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x21f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333172.248297:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75665500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+9:3654:x1848987627235712:12345-0@lo:2:osp-syn-1-1.0 Request processed in 163us (1009us total) trans 17179871498 rc 0/0 00000100:00100000:0.0:1763333172.248304:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6338 00000100:00100000:0.0:1763333172.248317:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6339 00000100:00100000:0.0:1763333172.248323:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+8:3654:x1848987627235840:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1763333172.248420:0:8611:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x220:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1763333172.248423:0:8611:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x220:0x0] updating lvb mtime from disk: 1763333172 -> 1763333172 00002000:00010000:0.0:1763333172.248426:0:8611:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x220:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333172.248427:0:8611:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x220:0x0] updating lvb ctime from disk: 1763333172 -> 1763333172 00002000:00010000:0.0:1763333172.248430:0:8611:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x220:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1763333172.248474:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+9:3654:x1848987627235840:12345-0@lo:2:osp-syn-1-1.0 Request processed in 151us (1142us total) trans 17179871499 rc 0/0 00000100:00100000:0.0:1763333172.248481:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6339 00010000:00010000:0.0:1763333172.248535:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333172.248543:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55372 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.248550:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf600 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333172.248554:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55372 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.248563:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55372 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.248581:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55372 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.248588:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55372 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.248608:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333172.248609:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333172.248611:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763333172.248762:0:3654:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179871492 gen 2 00000004:00080000:0.0:1763333172.248770:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7dcfdf80, transno 17179871415 00000004:00080000:0.0:1763333172.248782:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7dcfc380, transno 17179871416 00000004:00080000:0.0:1763333172.248785:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7dcfea00, transno 17179871417 00000004:00080000:0.0:1763333172.248788:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7dcfd880, transno 17179871418 00000004:00080000:0.0:1763333172.248791:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe438abb80, transno 17179871419 00000004:00080000:0.0:1763333172.248794:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe43998700, transno 17179871420 00000004:00080000:0.0:1763333172.248797:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7dcfd180, transno 17179871421 00000004:00080000:0.0:1763333172.248800:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7dcfc700, transno 17179871422 00000004:00080000:0.0:1763333172.248803:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe469a3480, transno 17179871424 00000004:00080000:0.0:1763333172.248806:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe469a1880, transno 17179871425 00000004:00080000:0.0:1763333172.248809:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4684ed80, transno 17179871426 00000004:00080000:0.0:1763333172.248811:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe469a3100, transno 17179871427 00000004:00080000:0.0:1763333172.248814:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4399b800, transno 17179871430 00000004:00080000:0.0:1763333172.248817:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe43998000, transno 17179871431 00000004:00080000:0.0:1763333172.248820:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46e2ea00, transno 17179871432 00000004:00080000:0.0:1763333172.248823:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46e2d500, transno 17179871433 00000004:00080000:0.0:1763333172.248826:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4920fb80, transno 17179871437 00000004:00080000:0.0:1763333172.248829:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4920e680, transno 17179871438 00000004:00080000:0.0:1763333172.248831:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4920f800, transno 17179871439 00000004:00080000:0.0:1763333172.248845:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4920ea00, transno 17179871441 00000004:00080000:0.0:1763333172.248848:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46a6c380, transno 17179871442 00000004:00080000:0.0:1763333172.248851:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46a6f480, transno 17179871443 00000004:00080000:0.0:1763333172.248853:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46a6c700, transno 17179871444 00000004:00080000:0.0:1763333172.248856:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46a6dc00, transno 17179871445 00000004:00080000:0.0:1763333172.248860:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe42f0ed80, transno 17179871448 00000004:00080000:0.0:1763333172.248862:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe42f0dc00, transno 17179871449 00000004:00080000:0.0:1763333172.248864:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff73165500, transno 17179871450 00000004:00080000:0.0:1763333172.248866:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff73166a00, transno 17179871451 00000004:00080000:0.0:1763333172.248870:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff59229f80, transno 17179871455 00000004:00080000:0.0:1763333172.248872:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff5922bb80, transno 17179871456 00000004:00080000:0.0:1763333172.248874:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff59228700, transno 17179871457 00000004:00080000:0.0:1763333172.248877:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff5922a680, transno 17179871458 00000004:00080000:0.0:1763333172.248879:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44de2a00, transno 17179871459 00000004:00080000:0.0:1763333172.248881:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44de1500, transno 17179871460 00000004:00080000:0.0:1763333172.248884:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44de1f80, transno 17179871461 00000004:00080000:0.0:1763333172.248886:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44de3100, transno 17179871462 00000004:00080000:0.0:1763333172.248889:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff59228e00, transno 17179871464 00000004:00080000:0.0:1763333172.248891:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff59229500, transno 17179871465 00000004:00080000:0.0:1763333172.248893:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff5922b480, transno 17179871466 00000004:00080000:0.0:1763333172.248895:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff5922aa00, transno 17179871467 00000004:00080000:0.0:1763333172.248898:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff77a3df80, transno 17179871469 00000004:00080000:0.0:1763333172.248900:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff77a3e300, transno 17179871470 00000004:00080000:0.0:1763333172.248903:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44e04000, transno 17179871471 00000004:00080000:0.0:1763333172.248905:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44e04380, transno 17179871472 00000004:00080000:0.0:1763333172.248907:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44e1ad80, transno 17179871474 00000004:00080000:0.0:1763333172.248910:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe42f0f480, transno 17179871475 00000004:00080000:0.0:1763333172.248912:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe42f0ca80, transno 17179871476 00000004:00080000:0.0:1763333172.248914:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe45181500, transno 17179871477 00000004:00080000:0.0:1763333172.248916:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff73165f80, transno 17179871479 00000004:00080000:0.0:1763333172.248918:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff73167100, transno 17179871480 00000004:00080000:0.0:1763333172.248921:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff73165180, transno 17179871481 00000004:00080000:0.0:1763333172.248923:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff73165880, transno 17179871482 00000004:00080000:0.0:1763333172.248926:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff74037100, transno 17179871484 00000004:00080000:0.0:1763333172.248928:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff74034000, transno 17179871485 00000004:00080000:0.0:1763333172.248930:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff74036300, transno 17179871486 00000004:00080000:0.0:1763333172.248932:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff74036680, transno 17179871487 00000004:00080000:0.0:1763333172.248934:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe438aa300, transno 17179871489 00000004:00080000:0.0:1763333172.248937:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe438aa680, transno 17179871490 00000004:00080000:0.0:1763333172.248939:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7e00dc00, transno 17179871491 00000004:00080000:0.0:1763333172.248942:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7e00d880, transno 17179871492 00000100:00100000:0.0:1763333172.248949:0:3654:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff92fe49608000 x1848987627235840/t17179871499(17179871499) o2->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763333188 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1763333172.248962:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe49608000/2, rc 0, transno 17179871499 00000100:00100000:0.0:1763333172.248966:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe49608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627235840:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1763333172.248977:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe49608700/2, rc 0, transno 17179871498 00000100:00100000:0.0:1763333172.248981:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe49608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627235712:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1763333172.249259:0:9836:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 4 in progress, 2 in flight, 60 done 00000004:00080000:0.0:1763333172.249285:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe49609c00/2, rc 0, transno 17179871497 00000100:00100000:0.0:1763333172.249288:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe49609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627235584:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763333172.249557:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff6bc10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627236480:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333172.249614:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333172.249652:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763333172.249657:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff6bc11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627236352:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333172.249679:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333172.249709:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627236480 00000100:00100000:3.0:1763333172.249716:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627236480 00000100:00100000:3.0:1763333172.249763:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627236352 00000100:00100000:3.0:1763333172.249766:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627236352 00000100:00100000:3.0:1763333172.249787:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6340 00000100:00100000:3.0:1763333172.249794:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+38:3655:x1848987627236480:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1763333172.249911:0:28650:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x220:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333172.249914:0:28650:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x220:0x0] updating lvb mtime from disk: 1763333172 -> 1763333172 00002000:00010000:3.0:1763333172.249917:0:28650:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x220:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333172.249919:0:28650:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x220:0x0] updating lvb ctime from disk: 1763333172 -> 1763333172 00002000:00010000:3.0:1763333172.249921:0:28650:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x220:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333172.249958:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+39:3655:x1848987627236480:12345-0@lo:2:osp-syn-0-1.0 Request processed in 164us (344us total) trans 21474838801 rc 0/0 00000100:00100000:3.0:1763333172.249969:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6340 00000100:00100000:3.0:1763333172.249985:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6341 00000100:00100000:3.0:1763333172.249992:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+38:3655:x1848987627236352:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1763333172.250040:0:28650:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x21f:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1763333172.250043:0:28650:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x21f:0x0] updating lvb mtime from disk: 1763333172 -> 1763333172 00002000:00010000:3.0:1763333172.250046:0:28650:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x21f:0x0] updating lvb atime from disk: 1763333172 -> 1763333172 00002000:00010000:3.0:1763333172.250048:0:28650:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x21f:0x0] updating lvb ctime from disk: 1763333172 -> 1763333172 00002000:00010000:3.0:1763333172.250050:0:28650:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x21f:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763333172.250074:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+39:3655:x1848987627236352:12345-0@lo:2:osp-syn-0-1.0 Request processed in 82us (394us total) trans 21474838802 rc 0/0 00000100:00100000:3.0:1763333172.250080:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6341 00000004:00080000:3.0:1763333172.250116:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff6bc11180/2, rc 0, transno 21474838802 00000100:00100000:3.0:1763333172.250121:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff6bc11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627236352:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1763333172.250128:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff6bc10700/2, rc 0, transno 21474838801 00000100:00100000:3.0:1763333172.250131:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff6bc10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627236480:0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1763333172.250230:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55284 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.250243:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55284 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.250250:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55284 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.250256:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333172.250260:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55284 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.250266:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55284 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.250280:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045c00) 00010000:00010000:2.0:1763333172.250283:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333172.250287:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55284 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.250292:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55284 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.250308:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c552d1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.250313:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c552d1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.250319:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c552d1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.250322:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4a00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333172.250325:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c552d1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.250330:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c552d1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.250336:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19e:0x0].0x0 (ffff92fe48355800) 00010000:00010000:2.0:1763333172.250338:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333172.250341:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c552d1 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.250345:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c552d1 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.250375:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c55309 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333172.250380:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c55309 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333172.250385:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c55309 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333172.250389:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdea00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333172.250392:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c55309 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333172.250397:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c55309 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333172.250403:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045c00) 00010000:00010000:2.0:1763333172.250405:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333172.250407:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c55309 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333172.250411:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c55309 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333172.250426:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c55333 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.250431:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c55333 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.250436:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c55333 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.250440:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333172.250442:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c55333 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.250447:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c55333 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.250452:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19e:0x0].0x0 (ffff92fe48355800) 00010000:00010000:2.0:1763333172.250454:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333172.250456:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c55333 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.250460:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c55333 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x19e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000100:00100000:1.0:1763333172.251773:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff50065180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627236096:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763333172.251828:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333172.251866:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763333172.251872:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff50065880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627236224:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763333172.251890:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333172.252142:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627236096 00000100:00100000:2.0:1763333172.252150:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627236096 00000100:00100000:2.0:1763333172.252199:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627236224 00000100:00100000:2.0:1763333172.252203:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627236224 00000100:00100000:2.0:1763333172.252224:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6342 00000100:00100000:2.0:1763333172.252233:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+40:3652:x1848987627236096:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1763333172.252260:0:17605:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:545 count 1 00010000:00010000:2.0:1763333172.252290:0:17605:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55380 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x221:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.252326:0:17605:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5523e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691c5 expref: 23 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.252334:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333172.252336:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333172.252341:0:17605:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55380 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.252392:0:17605:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5523e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691c5 expref: 23 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.252404:0:17605:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5523e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691c5 expref: 23 pid: 8404 timeout: 1376 lvb_type: 0 00000100:00100000:2.0:1763333172.252416:0:17605:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e00dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17605:1848987627236608:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333172.252473:0:17605:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff5119d180 going to sleep for 11 seconds 00000100:00100000:2.0:1763333172.252490:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6343 00000100:00100000:2.0:1763333172.252498:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+40:3652:x1848987627236224:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1763333172.252509:0:28650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:546 count 1 00002000:00010000:2.0:1763333172.252540:0:28650:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x222:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763333172.252546:0:28650:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55387 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.252554:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333172.252555:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333172.252559:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55387 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.252571:0:28650:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55387 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.252579:0:28650:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55387 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.252586:0:28650:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55387 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.252601:0:28650:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763333172.252799:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+41:3652:x1848987627236224:12345-0@lo:6:osp-syn-0-1.0 Request processed in 301us (906us total) trans 21474838803 rc 0/0 00000100:00100000:2.0:1763333172.252806:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6343 00010000:00010000:2.0:1763333172.252829:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333172.252835:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55387 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.252841:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4c00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333172.252844:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55387 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.252852:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55387 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.252867:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55387 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.252879:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55387 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.252893:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333172.252895:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333172.252896:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763333172.252926:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff50065880/2, rc 0, transno 21474838803 00000100:00100000:2.0:1763333172.252933:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff50065880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627236224:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763333172.255159:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333172.255602:0:29013:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff75666d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:29013:1848987627235968:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333172.255632:0:29013:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c55379 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333172.255703:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613622144 00000100:00100000:1.0:1763333172.255711:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613622144 00000100:00100000:1.0:1763333172.255776:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9079 00000100:00100000:1.0:1763333172.255786:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+223:55917:x1848987613622144:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:1.0:1763333172.255857:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333172.255888:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55356 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969212 expref: 223 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.255908:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a1:0x0].0x0 (ffff92ff61a46000) 00010000:00010000:1.0:1763333172.255913:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333172.256129:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5538e lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333172.256144:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5538e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333172.256152:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5538e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000001:00080000:1.0:1763333172.256201:0:6521:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294972115 00000004:00010000:1.0:1763333172.256224:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000203c38cf reply state 00000000bb482697 transno 4294972116 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5538e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333172.256237:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5538e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333172.256243:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a1:0x0].0x0 (ffff92ff61a46000) 00010000:00010000:1.0:1763333172.256246:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333172.256248:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763333172.256381:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:55917:x1848987613622144:12345-192.168.204.28@tcp:36:bash.0 Request processed in 595us (1231us total) trans 4294972116 rc 0/0 00000100:00100000:1.0:1763333172.256390:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9079 00000020:00080000:1.0:1763333172.256398:0:6521:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763333172.258193:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.258244:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.258378:0:17605:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e00dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17605:1848987627236608:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333172.258411:0:17605:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55380 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333172.258555:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613622272 00000100:00100000:3.0:1763333172.258563:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613622272 00000100:00100000:3.0:1763333172.258624:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9080 00000100:00100000:3.0:1763333172.258633:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56828:x1848987613622272:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333172.258654:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333172.258672:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c55395 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969220 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.258730:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c55395 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969220 expref: 226 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.258745:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42c00/0xb32e3ef184c55395 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x19e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969220 expref: 226 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.258763:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19e:0x0].0x0 (ffff92fe48355800) 00010000:00010000:3.0:1763333172.258766:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763333172.258769:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46e42c00, rc 0) 00000100:00100000:3.0:1763333172.258830:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56828:x1848987613622272:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 198us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333172.258838:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9080 00000100:00100000:1.0:1763333172.258936:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613622400 00000100:00100000:1.0:1763333172.258942:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613622400 00010000:00010000:1.0:1763333172.258978:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55237 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691be expref: 15 pid: 8404 timeout: 1376 lvb_type: 0 00000100:00100000:1.0:1763333172.258999:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2977 00000100:00100000:1.0:1763333172.259005:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2420:x1848987613622400:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333172.259017:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333172.259023:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55237 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x221:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691be expref: 15 pid: 8404 timeout: 1376 lvb_type: 0 00010000:00010000:1.0:1763333172.259036:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55237 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x221:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691be expref: 15 pid: 8404 timeout: 1376 lvb_type: 0 00010000:00010000:1.0:1763333172.259059:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55237 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x221:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691be expref: 15 pid: 8404 timeout: 1376 lvb_type: 0 00010000:00010000:1.0:1763333172.259077:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333172.259079:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333172.259084:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c55379 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.259095:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c55379 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.259125:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333172.259147:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2420:x1848987613622400:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 142us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333172.259154:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2977 00010000:00010000:3.0:1763333172.259750:0:29013:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c55379 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.259762:0:29013:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c55379 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.259772:0:29013:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c55379 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.259780:0:29013:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c55379 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.259800:0:29013:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763333172.260433:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333172.260443:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c55379 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.260452:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333172.260456:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c55379 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.260466:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c55379 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.260482:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c55379 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.260489:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c55379 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.260511:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333172.260513:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333172.260515:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763333172.261725:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49609880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+9:3653:x1848987627235456:12345-0@lo:6:osp-syn-1-1.0 Request processed in 13807us (14489us total) trans 17179871500 rc 0/0 00000100:00100000:3.0:1763333172.261740:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6337 00000004:00080000:0.0:1763333172.263210:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff77a3dc00/2, rc 0, transno 17179871500 00000100:00100000:0.0:1763333172.263222:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77a3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627235456:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763333172.263608:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333172.263685:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333172.263753:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613622784 00000100:00100000:1.0:1763333172.263760:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613622784 00000100:00100000:1.0:1763333172.263811:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3104 00000100:00100000:1.0:1763333172.263821:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bd5d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56828:x1848987613622784:12345-192.168.204.28@tcp:35:lfs.0 00000004:00080000:1.0:1763333172.264100:0:6522:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x19e:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1763333172.264150:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1351, 64 off114360 00000040:00080000:1.0:1763333172.264167:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1350, 64 off114360 00000040:00080000:1.0:1763333172.264174:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1351, 64 off114424 00000040:00080000:1.0:1763333172.264181:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1352, 64 off114424 00010000:00010000:1.0:1763333172.264228:0:6522:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5539c lrc: 3/0,1 mode: --/PW res: [0x240000404:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 00010000:00010000:1.0:1763333172.264243:0:6522:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5539c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x19e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT1 00010000:00010000:1.0:1763333172.264253:0:6522:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5539c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x19e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT1 00010000:00010000:1.0:1763333172.264261:0:6522:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5539c lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x19e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT1 00010000:00010000:1.0:1763333172.264266:0:6522:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5539c lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x19e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT1 00010000:00010000:1.0:1763333172.264272:0:6522:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5539c lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x19e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT1 00010000:00010000:1.0:1763333172.264299:0:6522:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763333172.264484:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bd5d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56828:x1848987613622784:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 664us (797us total) trans 4294972117 rc 0/0 00000100:00100000:1.0:1763333172.264491:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3104 00000100:00100000:0.0:1763333172.264591:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613622528 00000100:00100000:0.0:1763333172.264595:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613622528 00010000:00010000:0.0:1763333172.264618:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5523e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691c5 expref: 24 pid: 8404 timeout: 1376 lvb_type: 0 00000100:00100000:0.0:1763333172.264646:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2978 00000100:00100000:0.0:1763333172.264652:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:2420:x1848987613622528:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333172.264662:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333172.264666:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5523e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x221:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691c5 expref: 24 pid: 8404 timeout: 1376 lvb_type: 0 00010000:00010000:0.0:1763333172.264677:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5523e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x221:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691c5 expref: 24 pid: 8404 timeout: 1376 lvb_type: 0 00010000:00010000:0.0:1763333172.264696:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5523e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x221:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691c5 expref: 24 pid: 8404 timeout: 1376 lvb_type: 0 00010000:00010000:0.0:1763333172.264708:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333172.264710:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333172.264715:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55380 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.264723:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55380 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.264747:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333172.264765:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2420:x1848987613622528:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 113us (1159us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333172.264770:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2978 00010000:00010000:0.0:1763333172.264788:0:17605:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55380 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.264796:0:17605:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55380 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.264803:0:17605:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55380 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.264810:0:17605:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55380 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.264828:0:17605:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1763333172.264991:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+41:3652:x1848987627236096:12345-0@lo:6:osp-syn-0-1.0 Request processed in 12758us (13161us total) trans 21474838804 rc 0/0 00000100:00100000:0.0:1763333172.264998:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6342 00000004:00080000:0.0:1763333172.265037:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff50065180/2, rc 0, transno 21474838804 00000100:00100000:0.0:1763333172.265047:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff50065180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627236096:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1763333172.265087:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1763333172.265092:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5539c lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x19e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT1 00010000:00010000:0.0:1763333172.265099:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fe00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333172.265102:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5539c lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x19e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT1 00010000:00010000:0.0:1763333172.265109:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5539c lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x19e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT1 00010000:00010000:0.0:1763333172.265119:0:8422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x19e:0x0].0x0 (ffff92fe48355800) 00010000:00010000:0.0:1763333172.265122:0:8422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763333172.265125:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5539c lrc: 1/0,0 mode: --/PW res: [0x240000404:0x19e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT1 00010000:00010000:0.0:1763333172.265130:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5539c lrc: 0/0,0 mode: --/PW res: [0x240000404:0x19e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT1 00010000:00010000:0.0:1763333172.265138:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333172.265141:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55380 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.265151:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4600 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333172.265154:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55380 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.265160:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55380 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.265167:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55380 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.265173:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55380 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.265187:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333172.265188:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333172.265190:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333172.265639:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763333172.266981:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.267918:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613622912 00000100:00100000:0.0:1763333172.267933:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613622912 00000100:00100000:0.0:1763333172.268016:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9081 00000100:00100000:0.0:1763333172.268026:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:55917:x1848987613622912:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333172.268049:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333172.268074:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c553a3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969227 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.268144:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c553a3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969227 expref: 228 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.268166:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c553a3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969227 expref: 228 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.268183:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a1:0x0].0x0 (ffff92ff61a46000) 00010000:00010000:0.0:1763333172.268187:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333172.268190:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdf600, rc 0) 00000100:00100000:0.0:1763333172.268243:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:55917:x1848987613622912:12345-192.168.204.28@tcp:101:bash.0 Request processed in 218us (1269us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333172.268250:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9081 00000100:00100000:2.0:1763333172.269098:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333172.269339:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613623168 00000100:00100000:3.0:1763333172.269370:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613623168 00000100:00100000:3.0:1763333172.269411:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9082 00000100:00100000:3.0:1763333172.269419:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6b3cc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56828:x1848987613623168:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333172.269439:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333172.269459:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c553aa lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696922e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.269534:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c553b1 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333172.269545:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c553b1 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.269554:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c553b1 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.269566:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c553b8 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333172.269573:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c553b8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.269579:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c553b8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.269689:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c553bf lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333172.269701:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c553bf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.269707:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c553bf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:3.0:1763333172.269717:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1a1:0x0]: returning size 0 00010000:00010000:3.0:1763333172.269790:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c553b1 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.269797:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c553b1 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.269803:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c553b1 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.269810:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c553b1 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.269816:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333172.269820:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c553b1 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.269827:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c553b1 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.269837:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff80045800) 00010000:00010000:3.0:1763333172.269841:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333172.269845:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c553b1 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.269851:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c553b1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.269865:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c553b8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.269870:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c553b8 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.269876:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c553b8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.269880:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333172.269883:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c553b8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.269888:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c553b8 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.269895:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045200) 00010000:00010000:3.0:1763333172.269897:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333172.269900:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c553b8 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.269905:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c553b8 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.269946:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c553aa lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696922e expref: 231 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.269961:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c553bf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696922e expref: 230 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.269968:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a1:0x0].0x0 (ffff92ff61a46000) 00010000:00010000:3.0:1763333172.269971:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333172.269973:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96c00, rc 0) 00000100:00100000:3.0:1763333172.270028:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6b3cc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56828:x1848987613623168:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 608us (931us total) trans 4294972118 rc 0/0 00000100:00100000:3.0:1763333172.270035:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9082 00000100:00100000:3.0:1763333172.274851:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333172.275698:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.276565:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613623424 00000100:00100000:0.0:1763333172.276577:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613623424 00000100:00100000:0.0:1763333172.276641:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613623552 00000100:00100000:0.0:1763333172.276645:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613623552 00000100:00100000:2.0:1763333172.276964:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9083 00000100:00100000:2.0:1763333172.276978:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:55917:x1848987613623424:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333172.277002:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333172.277005:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1763333172.277032:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c553a3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969227 expref: 231 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.277062:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c553bf lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696922e expref: 230 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.277074:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a1:0x0].0x0 (ffff92ff61a46000) 00010000:00010000:2.0:1763333172.277081:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333172.277096:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c553cd lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969235 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.277148:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c553d4 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333172.277161:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c553d4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.277171:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c553d4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000040:00080000:2.0:1763333172.277430:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1353, 88 off114512 00000004:00080000:2.0:1763333172.277439:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1276357089381ns, next at 1276878902000ns, rc = 0 00000040:00080000:2.0:1763333172.277480:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1352, 88 off114512 00000004:00080000:2.0:1763333172.277486:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1276357136676ns, next at 1277223362238ns, rc = 0 00000040:00080000:2.0:1763333172.277505:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1353, 88 off114600 00000004:00080000:2.0:1763333172.277509:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1276357160234ns, next at 1277223362238ns, rc = 0 00000040:00080000:2.0:1763333172.277518:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1354, 88 off114600 00000004:00080000:2.0:1763333172.277532:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1276357173382ns, next at 1276878902000ns, rc = 0 00000100:00100000:0.0:1763333172.277784:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9084 00000100:00100000:0.0:1763333172.277795:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56828:x1848987613623552:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333172.277806:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333172.277818:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c553db lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696923c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.277881:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c553e2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333172.277891:0:6521:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c553d4 lrc: 2/0,1 mode: EX/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333172.277898:0:6521:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c553e2 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.277914:0:6521:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c553d4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333172.277925:0:6521:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c553e2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000001:00080000:1.0:1763333172.286136:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972119 is committed 00000004:00080000:1.0:1763333172.286157:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 887 committed 00000004:00080000:1.0:1763333172.286183:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 884 committed 00000004:00080000:1.0:1763333172.286206:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 883 committed 00000004:00080000:1.0:1763333172.286210:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 886 committed 00000100:00100000:3.0:1763333172.286482:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff6bc12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627236864:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763333172.286556:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333172.286596:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763333172.286601:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff6bc10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627236736:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763333172.286617:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333172.286639:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff6bc13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627236992:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333172.286655:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333172.286667:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763333172.286671:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff6bc11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627237120:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333172.286692:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333172.286723:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627236864 00000100:00100000:3.0:1763333172.286732:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627236864 00000100:00100000:3.0:1763333172.286779:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627236736 00000100:00100000:3.0:1763333172.286781:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627236736 00000100:00100000:3.0:1763333172.286792:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627236992 00000100:00100000:3.0:1763333172.286794:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627236992 00000100:00100000:3.0:1763333172.286804:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627237120 00000100:00100000:3.0:1763333172.286806:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627237120 00000100:00100000:3.0:1763333172.286821:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6344 00000100:00100000:3.0:1763333172.286828:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+12:3653:x1848987627236864:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763333172.286858:0:17605:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:544 count 1 00010000:00010000:3.0:1763333172.286892:0:17605:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c553e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.286919:0:17605:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c552d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691ef expref: 13 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.286927:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333172.286929:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333172.286933:0:17605:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c553e9 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.286961:0:17605:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c552d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691ef expref: 13 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.286978:0:17605:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c552d8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691ef expref: 13 pid: 29013 timeout: 1376 lvb_type: 0 00000100:00100000:3.0:1763333172.286990:0:17605:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe49609180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17605:1848987627237248:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333172.287062:0:17605:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7df5d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763333172.287084:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6345 00000100:00100000:3.0:1763333172.287091:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+12:3653:x1848987627236736:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763333172.287104:0:8407:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:543 count 1 00010000:00010000:3.0:1763333172.287117:0:8407:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c553f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.287129:0:8407:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c550c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969140 expref: 13 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.287140:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333172.287142:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333172.287145:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c553f0 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.287164:0:8407:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c550c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969140 expref: 13 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.287172:0:8407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c550c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969140 expref: 13 pid: 8404 timeout: 1376 lvb_type: 0 00000100:00100000:3.0:1763333172.287181:0:8407:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4960aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8407:1848987627237376:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333172.287205:0:8407:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7df5de40 going to sleep for 11 seconds 00000100:00100000:3.0:1763333172.287224:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6346 00000100:00100000:3.0:1763333172.287231:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4960bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+12:3654:x1848987627236992:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333172.290720:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4960bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+13:3654:x1848987627236992:12345-0@lo:2:osp-syn-1-1.0 Request processed in 3479us (4053us total) trans 17179871501 rc 0/0 00000100:00100000:3.0:1763333172.290735:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6346 00000100:00100000:3.0:1763333172.290772:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6347 00000100:00100000:3.0:1763333172.290785:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4960b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+12:3654:x1848987627237120:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333172.290915:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4960b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+13:3654:x1848987627237120:12345-0@lo:2:osp-syn-1-1.0 Request processed in 134us (4220us total) trans 17179871502 rc 0/0 00000100:00100000:3.0:1763333172.290922:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6347 00000004:00080000:3.0:1763333172.290983:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff6bc11c00/2, rc 0, transno 17179871502 00000100:00100000:3.0:1763333172.290989:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff6bc11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627237120:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763333172.290999:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff6bc13100/2, rc 0, transno 17179871501 00000100:00100000:3.0:1763333172.291002:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff6bc13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627236992:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333172.291759:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e00ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627237504:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763333172.291805:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333172.291838:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763333172.291844:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e00c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627237632:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763333172.291864:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333172.293218:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627237504 00000100:00100000:1.0:1763333172.293230:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627237504 00000100:00100000:1.0:1763333172.293276:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627237632 00000100:00100000:1.0:1763333172.293279:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627237632 00000100:00100000:1.0:1763333172.293299:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6348 00000100:00100000:1.0:1763333172.293307:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+42:3652:x1848987627237504:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1763333172.293335:0:8404:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:543 count 1 00010000:00010000:1.0:1763333172.293382:0:8404:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c553f7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.293403:0:8404:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c551ce lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696918d expref: 22 pid: 28650 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333172.293411:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333172.293413:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333172.293417:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c553f7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.293450:0:8404:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c551ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696918d expref: 22 pid: 28650 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333172.293461:0:8404:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c551ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696918d expref: 22 pid: 28650 timeout: 1376 lvb_type: 1 00000100:00100000:1.0:1763333172.293480:0:8404:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77c6d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8404:1848987627238016:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333172.293557:0:8404:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe46e0e9c0 going to sleep for 11 seconds 00010000:00010000:1.0:1763333172.293629:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c553d4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a1:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969235 expref: 228 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.293641:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a1:0x0].0x0 (ffff92ff61a46000) 00010000:00010000:1.0:1763333172.293644:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763333172.293647:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c553e2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333172.293656:0:6519:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c553e2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333172.293661:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c553e2 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333172.293694:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c553cd lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969235 expref: 228 pid: 6519 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763333172.293713:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c553d4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a1:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969235 expref: 227 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.293747:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4a00, rc 0) 00000100:00100000:1.0:1763333172.293781:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:55917:x1848987613623424:12345-192.168.204.28@tcp:101:bash.0 Request processed in 16807us (18943us total) trans 4294972119 rc 0/0 00000100:00100000:1.0:1763333172.293791:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9083 00010000:00010000:0.0:1763333172.293896:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5538e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.293904:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5538e lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.293910:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5538e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.293915:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333172.293919:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5538e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.293926:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5538e lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.293938:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a1:0x0].0x0 (ffff92ff61a46000) 00010000:00010000:0.0:1763333172.293940:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333172.293943:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5538e lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.293948:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5538e lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000100:00100000:0.0:1763333172.293979:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6349 00000100:00100000:0.0:1763333172.293990:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+42:3652:x1848987627237632:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1763333172.294005:0:8406:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:544 count 1 00010000:00010000:0.0:1763333172.294019:0:8406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c553fe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.294030:0:8406:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c552f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691fd expref: 22 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.294037:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333172.294039:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333172.294042:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c553fe lrc: 4/0,1 mode: --/PW res: [0x280000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.294061:0:8406:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c552f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691fd expref: 22 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.294069:0:8406:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c552f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691fd expref: 22 pid: 29013 timeout: 1376 lvb_type: 0 00000100:00100000:0.0:1763333172.294079:0:8406:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff75667800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8406:1848987627238144:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333172.294110:0:8406:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff44fdfa80 going to sleep for 11 seconds 00010000:00010000:0.0:1763333172.294135:0:6521:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c553e2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.294142:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c553e2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:0.0:1763333172.294184:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1a1:0x0]: returning size 2 00000004:00200000:0.0:1763333172.294190:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763333172.294209:0:6521:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c553e2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.294234:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c553db lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696923c expref: 226 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.294247:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c553e2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696923c expref: 225 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.294254:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a1:0x0].0x0 (ffff92ff61a46000) 00010000:00010000:0.0:1763333172.294257:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1763333172.294259:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdfe00, rc 0) 00000100:00100000:0.0:1763333172.294303:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56828:x1848987613623552:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 16510us (18606us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333172.294309:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9084 00000100:00100000:0.0:1763333172.294681:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e00f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627237888:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333172.294723:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333172.294756:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1763333172.294762:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e00e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627237760:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333172.294782:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333172.294803:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627237888 00000100:00100000:0.0:1763333172.294808:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627237888 00000100:00100000:0.0:1763333172.294833:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627237760 00000100:00100000:0.0:1763333172.294836:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627237760 00000100:00100000:0.0:1763333172.294849:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6350 00000100:00100000:0.0:1763333172.294854:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+44:3655:x1848987627237888:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333172.295021:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+45:3655:x1848987627237888:12345-0@lo:2:osp-syn-0-1.0 Request processed in 166us (297us total) trans 21474838805 rc 0/0 00000100:00100000:0.0:1763333172.295028:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6350 00000100:00100000:0.0:1763333172.295041:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6351 00000100:00100000:0.0:1763333172.295049:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+44:3655:x1848987627237760:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333172.295119:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+45:3655:x1848987627237760:12345-0@lo:2:osp-syn-0-1.0 Request processed in 71us (336us total) trans 21474838806 rc 0/0 00000100:00100000:0.0:1763333172.295125:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6351 00000004:00080000:0.0:1763333172.295170:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7e00e680/2, rc 0, transno 21474838806 00000100:00100000:0.0:1763333172.295176:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e00e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627237760:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1763333172.295185:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7e00f100/2, rc 0, transno 21474838805 00000100:00100000:0.0:1763333172.295188:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e00f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627237888:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333172.299847:0:17605:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe49609180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17605:1848987627237248:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333172.299881:0:17605:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c553e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333172.301491:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.301531:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.301633:0:8406:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff75667800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8406:1848987627238144:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333172.301661:0:8406:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c553fe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333172.301697:0:8404:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77c6d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8404:1848987627238016:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333172.301711:0:8404:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c553f7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333172.301745:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.301770:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613623680 00000100:00100000:0.0:1763333172.301776:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613623680 00010000:00010000:0.0:1763333172.301823:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c552d8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691ef expref: 14 pid: 29013 timeout: 1376 lvb_type: 0 00000100:00100000:0.0:1763333172.301852:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613623808 00000100:00100000:0.0:1763333172.301855:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613623808 00010000:00010000:0.0:1763333172.301868:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c550c4 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969140 expref: 15 pid: 8404 timeout: 1376 lvb_type: 0 00000100:00100000:0.0:1763333172.301883:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613624064 00000100:00100000:0.0:1763333172.301886:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613624064 00010000:00010000:0.0:1763333172.301897:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c551ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696918d expref: 23 pid: 28650 timeout: 1376 lvb_type: 1 00000100:00100000:0.0:1763333172.301912:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2979 00000100:00100000:0.0:1763333172.301921:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75666a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2421:x1848987613623680:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333172.301936:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333172.301942:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c552d8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x220:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691ef expref: 15 pid: 29013 timeout: 1376 lvb_type: 0 00010000:00010000:0.0:1763333172.301954:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c552d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x220:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691ef expref: 15 pid: 29013 timeout: 1376 lvb_type: 0 00010000:00010000:0.0:1763333172.301978:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c552d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x220:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691ef expref: 15 pid: 29013 timeout: 1376 lvb_type: 0 00010000:00010000:0.0:1763333172.301996:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333172.301998:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333172.302003:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c553e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.302014:0:28428:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c553e9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.302042:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333172.302094:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75666a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2421:x1848987613623680:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 173us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333172.302103:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2979 00000100:00100000:0.0:1763333172.302125:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2980 00000100:00100000:0.0:1763333172.302132:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75667b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2421:x1848987613623808:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333172.302140:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333172.302145:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c550c4 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x21f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969140 expref: 13 pid: 8404 timeout: 1376 lvb_type: 0 00010000:00010000:0.0:1763333172.302155:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c550c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x21f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969140 expref: 13 pid: 8404 timeout: 1376 lvb_type: 0 00010000:00010000:0.0:1763333172.302165:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333172.302166:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333172.302170:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c553f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.302177:0:28428:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c553f0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x21f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.302188:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333172.302207:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75667b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2421:x1848987613623808:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 76us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333172.302214:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2980 00000100:00100000:0.0:1763333172.302228:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2981 00000100:00100000:0.0:1763333172.302235:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff82064c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2421:x1848987613624064:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333172.302245:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333172.302249:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c551ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696918d expref: 23 pid: 28650 timeout: 1376 lvb_type: 1 00010000:00010000:0.0:1763333172.302259:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c551ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696918d expref: 23 pid: 28650 timeout: 1376 lvb_type: 1 00010000:00010000:0.0:1763333172.302273:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c551ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x21f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696918d expref: 23 pid: 28650 timeout: 1376 lvb_type: 1 00010000:00010000:0.0:1763333172.302283:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333172.302285:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333172.302287:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c553f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.302294:0:28428:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c553f7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.302313:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333172.302332:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff82064c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2421:x1848987613624064:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 97us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333172.302338:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2981 00010000:00010000:0.0:1763333172.302459:0:8404:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c553f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.302467:0:8404:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c553f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.302481:0:8404:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c553f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.302488:0:8404:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c553f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.302504:0:8404:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763333172.302835:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+45:3652:x1848987627237504:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9527us (11029us total) trans 21474838807 rc 0/0 00000100:00100000:0.0:1763333172.302843:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6348 00000004:00080000:0.0:1763333172.302886:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7e00ca80/2, rc 0, transno 21474838807 00000100:00100000:0.0:1763333172.302892:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e00ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627237504:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763333172.302940:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.302959:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613624192 00000100:00100000:0.0:1763333172.302963:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613624192 00010000:00010000:0.0:1763333172.302980:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c552f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691fd expref: 22 pid: 29013 timeout: 1376 lvb_type: 0 00000100:00100000:0.0:1763333172.302996:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2982 00000100:00100000:0.0:1763333172.303002:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75666a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2421:x1848987613624192:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333172.303010:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333172.303014:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c552f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691fd expref: 22 pid: 29013 timeout: 1376 lvb_type: 0 00010000:00010000:0.0:1763333172.303025:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c552f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691fd expref: 22 pid: 29013 timeout: 1376 lvb_type: 0 00010000:00010000:0.0:1763333172.303040:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c552f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x220:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369691fd expref: 22 pid: 29013 timeout: 1376 lvb_type: 0 00010000:00010000:0.0:1763333172.303050:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333172.303052:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333172.303055:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c553fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.303063:0:28428:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c553fe lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.303082:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333172.303102:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75666a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2421:x1848987613624192:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 99us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333172.303108:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2982 00010000:00010000:0.0:1763333172.303125:0:8406:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c553fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.303134:0:8406:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c553fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.303142:0:8406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c553fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.303149:0:8406:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c553fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.303169:0:8406:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1763333172.303270:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+45:3652:x1848987627237632:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9283us (11403us total) trans 21474838808 rc 0/0 00000100:00100000:0.0:1763333172.303277:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6349 00010000:00010000:0.0:1763333172.303294:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1763333172.303300:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c553f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.303307:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7ec00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333172.303311:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c553f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.303320:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c553f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.303331:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c553f7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.303338:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c553f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.303385:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333172.303389:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c553fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.303396:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf600 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333172.303399:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c553fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.303406:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c553fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.303415:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c553fe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.303422:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c553fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.303434:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333172.303435:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333172.303437:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763333172.303454:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7e00c700/2, rc 0, transno 21474838808 00000100:00100000:0.0:1763333172.303458:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e00c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627237632:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1763333172.303711:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333172.304333:0:17605:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c553e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.304376:0:17605:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c553e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.304387:0:17605:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c553e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.304397:0:17605:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c553e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.304434:0:17605:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763333172.304709:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+13:3653:x1848987627236864:12345-0@lo:6:osp-syn-1-1.0 Request processed in 17879us (18151us total) trans 17179871503 rc 0/0 00000100:00100000:3.0:1763333172.304717:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6344 00000004:00080000:3.0:1763333172.304762:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff6bc12300/2, rc 0, transno 17179871503 00000100:00100000:3.0:1763333172.304768:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff6bc12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627236864:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1763333172.304840:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333172.304847:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c553e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.304855:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97200 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333172.304859:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c553e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.304867:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c553e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.304884:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c553e9 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.304891:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c553e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.304913:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333172.304914:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333172.304916:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763333172.306593:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.306686:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613623936 00000100:00100000:2.0:1763333172.306697:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613623936 00000100:00100000:2.0:1763333172.306763:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9085 00000100:00100000:2.0:1763333172.306773:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56828:x1848987613623936:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333172.306799:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333172.306823:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55405 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969243 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.306894:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55405 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969243 expref: 226 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.306914:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55405 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969243 expref: 226 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.306935:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a1:0x0].0x0 (ffff92ff61a46000) 00010000:00010000:2.0:1763333172.306939:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333172.306942:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4600, rc 0) 00000100:00100000:2.0:1763333172.306998:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56828:x1848987613623936:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 227us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333172.307005:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9085 00010000:00010000:1.0:1763333172.307596:0:8407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c550c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969140 expref: 12 pid: 8404 timeout: 1376 lvb_type: 0 00000100:00100000:1.0:1763333172.307620:0:8407:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4960aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8407:1848987627237376:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333172.307641:0:8407:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c553f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.307652:0:8407:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c553f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.307660:0:8407:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c553f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.307671:0:8407:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c553f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.307679:0:8407:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c553f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.307706:0:8407:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763333172.307917:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+13:3653:x1848987627236736:12345-0@lo:6:osp-syn-1-1.0 Request processed in 20825us (21297us total) trans 17179871504 rc 0/0 00000100:00100000:1.0:1763333172.307925:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6345 00010000:00010000:2.0:1763333172.307991:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333172.307998:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c553f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.308006:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96e00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333172.308010:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c553f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.308019:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c553f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.308037:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c553f0 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.308045:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c553f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.308066:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333172.308068:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333172.308070:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763333172.308621:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff6bc10a80/2, rc 0, transno 17179871504 00000100:00100000:3.0:1763333172.308628:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff6bc10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627236736:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763333172.308763:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333172.308867:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613624320 00000100:00100000:1.0:1763333172.308873:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613624320 00000100:00100000:1.0:1763333172.308921:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6352 00000100:00100000:1.0:1763333172.308929:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:55917:x1848987613624320:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333172.308943:0:8407:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333172.308970:0:8407:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5540c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696924a expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333172.308990:0:8407:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x223:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333172.309008:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333172.309011:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333172.309020:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5540c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696924a expref: 22 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.309034:0:8407:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5540c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696924a expref: 22 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.309043:0:8407:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e000, rc 0) 00000100:00100000:1.0:1763333172.309095:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:55917:x1848987613624320:12345-192.168.204.28@tcp:101:bash.0 Request processed in 166us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333172.309101:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6352 00000100:00100000:2.0:1763333172.314927:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.315153:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333172.315216:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613624448 00000100:00100000:3.0:1763333172.315226:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613624448 00000100:00100000:2.0:1763333172.315398:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 408 00000100:00100000:2.0:1763333172.315408:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:2421:x1848987613624448:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333172.315426:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1763333172.315441:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613624576 00000100:00100000:0.0:1763333172.315448:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613624576 00010000:00010000:2.0:1763333172.315452:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55405 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969243 expref: 226 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.315472:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a1:0x0].0x0 (ffff92ff61a46000) 00010000:00010000:2.0:1763333172.315478:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333172.315492:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6353 00000100:00100000:0.0:1763333172.315502:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7df39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2420:x1848987613624576:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333172.315517:0:17605:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1763333172.315537:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:2421:x1848987613624448:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 118us (737us total) trans 0 rc 0/0 00010000:00010000:0.0:1763333172.315543:0:17605:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55413 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969251 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333172.315548:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 408 00000100:00100000:0.0:1763333172.315600:0:17605:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff75667b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17605:1848987627238272:192.168.204.28@tcp:106: 00000100:00100000:0.0:1763333172.315661:0:17605:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff44fdfc00 going to sleep for 11 seconds 00000100:00100000:0.0:1763333172.318345:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333172.318429:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613624704 00000100:00100000:1.0:1763333172.318440:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613624704 00000100:00100000:1.0:1763333172.318514:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6354 00000100:00100000:1.0:1763333172.318534:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75667800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:55917:x1848987613624704:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333172.318552:0:8407:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333172.318579:0:8407:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5541a lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969258 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333172.318604:0:8407:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x223:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333172.318626:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333172.318629:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333172.318638:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5541a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969258 expref: 13 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.318656:0:8407:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5541a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969258 expref: 13 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.318669:0:8407:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7fc00, rc 0) 00000100:00100000:1.0:1763333172.318731:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75667800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:55917:x1848987613624704:12345-192.168.204.28@tcp:101:bash.0 Request processed in 208us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333172.318740:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6354 00002000:00010000:3.0:1763333172.318889:0:17605:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x223:0x0] updating lvb mtime: 0 -> 1763333172 00002000:00010000:3.0:1763333172.318893:0:17605:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x223:0x0] updating lvb atime: 0 -> 1763333172 00002000:00010000:3.0:1763333172.318895:0:17605:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x223:0x0] updating lvb ctime: 0 -> 1763333172 00000100:00100000:3.0:1763333172.318910:0:17605:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff75667b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17605:1848987627238272:192.168.204.28@tcp:106: 00010000:00010000:3.0:1763333172.318945:0:17605:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55413 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969251 expref: 23 pid: 17605 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333172.318960:0:17605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55413 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969251 expref: 23 pid: 17605 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333172.318972:0:17605:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdf600, rc 0) 00000100:00100000:3.0:1763333172.318997:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7df39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2420:x1848987613624576:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 3497us (3843us total) trans 0 rc 301/301 00000100:00100000:3.0:1763333172.319004:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6353 00000100:00100000:2.0:1763333172.329290:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.329327:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.329400:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333172.329475:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613624832 00000100:00100000:3.0:1763333172.329485:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613624832 00002000:00010000:3.0:1763333172.329558:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/547 (0->18446744073709551615) 00002000:00100000:3.0:1763333172.329564:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7e00dc00 with x1848987613624832 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333172.329577:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7e00dc00. 00000100:00100000:3.0:1763333172.329604:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613624960 00000100:00100000:3.0:1763333172.329608:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613624960 00002000:00010000:3.0:1763333172.329621:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/547 (0->18446744073709551615) 00002000:00100000:3.0:1763333172.329624:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7e00ce00 with x1848987613624960 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333172.329630:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff7e00ce00. 00000100:00100000:3.0:1763333172.329646:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1577 00000100:00100000:3.0:1763333172.329655:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2420:x1848987613624832:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:3.0:1763333172.329833:0:28427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x223:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333172.329837:0:28427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x223:0x0] updating lvb mtime from disk: 1763333172 -> 1763333172 00002000:00010000:3.0:1763333172.329839:0:28427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x223:0x0] updating lvb atime from disk: 1763333172 -> 0 00002000:00010000:3.0:1763333172.329841:0:28427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x223:0x0] updating lvb ctime from disk: 1763333172 -> 1763333172 00002000:00010000:3.0:1763333172.329844:0:28427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x223:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333172.329890:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2420:x1848987613624832:12345-192.168.204.28@tcp:10:bash.0 Request processed in 236us (611us total) trans 21474838809 rc 0/0 00000100:00100000:3.0:1763333172.329896:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1577 00002000:00010000:3.0:1763333172.329899:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/547 (0->18446744073709551615) 00002000:00100000:3.0:1763333172.329902:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7e00dc00 with x1848987613624832 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333172.329905:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7e00dc00. 00000100:00100000:3.0:1763333172.329921:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1578 00000100:00100000:3.0:1763333172.329926:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2421:x1848987613624960:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:3.0:1763333172.329995:0:28427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x223:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333172.329998:0:28427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x223:0x0] updating lvb mtime from disk: 0 -> 1763333172 00002000:00010000:3.0:1763333172.330000:0:28427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x223:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333172.330002:0:28427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x223:0x0] updating lvb ctime from disk: 0 -> 1763333172 00002000:00010000:3.0:1763333172.330004:0:28427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x223:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333172.330021:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2421:x1848987613624960:12345-192.168.204.28@tcp:10:bash.0 Request processed in 95us (694us total) trans 17179871505 rc 0/0 00000100:00100000:3.0:1763333172.330026:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1578 00002000:00010000:3.0:1763333172.330029:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/547 (0->18446744073709551615) 00002000:00100000:3.0:1763333172.330031:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7e00ce00 with x1848987613624960 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333172.330035:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff7e00ce00. 00000100:00100000:0.0:1763333172.330178:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613625216 00000100:00100000:0.0:1763333172.330183:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613625216 00000100:00100000:0.0:1763333172.330220:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3105 00000100:00100000:0.0:1763333172.330226:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56828:x1848987613625216:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333172.330396:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56828:x1848987613625216:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 169us (995us total) trans 4294972120 rc 0/0 00000100:00100000:0.0:1763333172.330403:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3105 00000100:00100000:2.0:1763333172.341496:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333172.341653:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613625472 00000100:00100000:3.0:1763333172.341665:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613625472 00000100:00100000:3.0:1763333172.341730:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9086 00000100:00100000:3.0:1763333172.341740:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56828:x1848987613625472:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333172.341765:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333172.341791:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55421 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696925f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.341988:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55428 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333172.342002:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55428 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.342014:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55428 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.342027:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5542f lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333172.342034:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5542f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.342040:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5542f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.342151:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55436 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333172.342162:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55436 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.342173:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55436 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:3.0:1763333172.342183:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1a1:0x0]: returning size 2 00010000:00010000:3.0:1763333172.342269:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55428 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.342276:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55428 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.342283:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55428 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.342289:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55428 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.342296:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333172.342300:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55428 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.342306:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55428 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.342318:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff80045800) 00010000:00010000:3.0:1763333172.342321:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333172.342325:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55428 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.342332:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55428 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.342344:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5542f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.342586:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5542f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.342593:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5542f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.342598:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333172.342601:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5542f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.342607:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5542f lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.342615:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045200) 00010000:00010000:3.0:1763333172.342618:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333172.342621:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5542f lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.342627:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5542f lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.342674:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55421 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696925f expref: 229 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.342690:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55436 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696925f expref: 228 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.342697:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a1:0x0].0x0 (ffff92ff61a46000) 00010000:00010000:3.0:1763333172.342699:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333172.342701:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96e00, rc 0) 00000100:00100000:3.0:1763333172.342973:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56828:x1848987613625472:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1232us (1488us total) trans 4294972121 rc 0/0 00000100:00100000:3.0:1763333172.342984:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9086 00000100:00100000:3.0:1763333172.352836:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333172.352910:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.354703:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613625728 00000100:00100000:0.0:1763333172.354718:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613625728 00000100:00100000:0.0:1763333172.354786:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613625856 00000100:00100000:0.0:1763333172.354790:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613625856 00000100:00100000:0.0:1763333172.354817:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3106 00000100:00100000:0.0:1763333172.354827:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:55917:x1848987613625728:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:0.0:1763333172.355109:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:55917:x1848987613625728:12345-192.168.204.28@tcp:35:bash.0 Request processed in 283us (2283us total) trans 4294972122 rc 0/0 00000100:00100000:0.0:1763333172.355118:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3106 00000100:00100000:0.0:1763333172.355135:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3107 00000100:00100000:0.0:1763333172.355142:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49609880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56828:x1848987613625856:12345-192.168.204.28@tcp:33:lfs.0 00000100:00100000:0.0:1763333172.355207:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49609880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56828:x1848987613625856:12345-192.168.204.28@tcp:33:lfs.0 Request processed in 65us (2296us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333172.355213:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3107 00000100:00100000:2.0:1763333172.364205:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333172.364533:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613626112 00000100:00100000:3.0:1763333172.364544:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613626112 00000100:00100000:3.0:1763333172.364613:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9087 00000100:00100000:3.0:1763333172.364625:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56828:x1848987613626112:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333172.364644:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333172.364665:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55444 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969266 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.364781:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5544b lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333172.364798:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5544b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a1:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.364810:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5544b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a1:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:3.0:1763333172.364823:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1a1:0x0]: returning size 5 00010000:00010000:3.0:1763333172.364935:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55444 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1a1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969266 expref: 232 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.364953:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5544b lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1a1:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969266 expref: 231 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.364964:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a1:0x0].0x0 (ffff92ff61a46000) 00010000:00010000:3.0:1763333172.364967:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763333172.364972:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a97000, rc 0) 00000100:00100000:3.0:1763333172.365054:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56828:x1848987613626112:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 430us (866us total) trans 4294972123 rc 0/0 00000100:00100000:3.0:1763333172.365061:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9087 00000100:00100000:0.0:1763333172.367166:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333172.368156:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613626368 00000100:00100000:1.0:1763333172.368168:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613626368 00000100:00100000:1.0:1763333172.368235:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3108 00000100:00100000:1.0:1763333172.368246:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56828:x1848987613626368:12345-192.168.204.28@tcp:35:lfs.0 00000004:00010000:1.0:1763333172.368327:0:6522:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x1a1:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5544b lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1a1:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969266 expref: 231 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.368408:0:6522:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55459 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 00010000:00010000:1.0:1763333172.368422:0:6522:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5536b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969219 expref: 231 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.368430:0:6522:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55436 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696925f expref: 231 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.368438:0:6522:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c553d4 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x1a1:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969235 expref: 231 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.368445:0:6522:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55459 lrc: 6/0,1 mode: --/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 00010000:00010000:1.0:1763333172.368484:0:6522:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c553d4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a1:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969235 expref: 231 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.368497:0:6522:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c553d4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1a1:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969235 expref: 231 pid: 6519 timeout: 1376 lvb_type: 0 00000100:00100000:1.0:1763333172.368512:0:6522:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77c6ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6522:1848987627238400:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333172.368618:0:6522:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55436 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696925f expref: 231 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.368627:0:6522:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55436 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696925f expref: 231 pid: 6519 timeout: 1376 lvb_type: 0 00000100:00100000:1.0:1763333172.368636:0:6522:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77c6ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6522:1848987627238528:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333172.368667:0:6522:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5536b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969219 expref: 231 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.368675:0:6522:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5536b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969219 expref: 231 pid: 6519 timeout: 1376 lvb_type: 0 00000100:00100000:1.0:1763333172.368683:0:6522:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77c6df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6522:1848987627238656:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333172.368704:0:6522:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe46e0e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763333172.372007:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333172.372230:0:6522:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77c6ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6522:1848987627238400:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333172.372242:0:6522:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77c6ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6522:1848987627238528:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333172.372249:0:6522:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77c6df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6522:1848987627238656:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333172.372280:0:6522:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55459 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 00000100:00100000:2.0:1763333172.372444:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.372600:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333172.372652:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613626496 00000100:00100000:3.0:1763333172.372661:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613626496 00000100:00100000:2.0:1763333172.373275:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613626752 00000100:00100000:2.0:1763333172.373282:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613626752 00010000:00010000:2.0:1763333172.373327:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5536b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969219 expref: 233 pid: 6519 timeout: 1376 lvb_type: 0 00000100:00100000:0.0:1763333172.373459:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613626624 00000100:00100000:0.0:1763333172.373464:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613626624 00010000:00010000:0.0:1763333172.373485:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55436 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696925f expref: 234 pid: 6519 timeout: 1376 lvb_type: 0 00000100:00100000:0.0:1763333172.373531:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2983 00000100:00100000:0.0:1763333172.373542:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:2419:x1848987613626624:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333172.373559:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333172.373566:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55436 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696925f expref: 234 pid: 6519 timeout: 1376 lvb_type: 0 00010000:00010000:0.0:1763333172.373579:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55436 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696925f expref: 234 pid: 6519 timeout: 1376 lvb_type: 0 00010000:00010000:0.0:1763333172.373603:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55436 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696925f expref: 234 pid: 6519 timeout: 1376 lvb_type: 0 00010000:00010000:0.0:1763333172.373620:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a1:0x0].0x0 (ffff92ff61a46000) 00010000:00010000:0.0:1763333172.373625:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55459 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x28/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 00010000:00010000:0.0:1763333172.373634:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55459 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x28/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 00010000:00010000:0.0:1763333172.373641:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333172.373693:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:2419:x1848987613626624:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 153us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333172.373701:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2983 00000100:00100000:2.0:1763333172.373922:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2984 00000100:00100000:2.0:1763333172.373930:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:2419:x1848987613626752:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333172.373940:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333172.373945:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5536b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969219 expref: 232 pid: 6519 timeout: 1376 lvb_type: 0 00010000:00010000:2.0:1763333172.373954:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5536b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969219 expref: 232 pid: 6519 timeout: 1376 lvb_type: 0 00010000:00010000:2.0:1763333172.373968:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5536b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969219 expref: 232 pid: 6519 timeout: 1376 lvb_type: 0 00010000:00010000:2.0:1763333172.373978:0:8423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a1:0x0].0x0 (ffff92ff61a46000) 00010000:00010000:2.0:1763333172.373982:0:8423:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55459 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 00010000:00010000:2.0:1763333172.373988:0:8423:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55459 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 00010000:00010000:2.0:1763333172.373993:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333172.374020:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:2419:x1848987613626752:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 91us (1575us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333172.374026:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2984 00010000:00010000:1.0:1763333172.374518:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c553d4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1a1:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969235 expref: 230 pid: 6519 timeout: 1376 lvb_type: 0 00000100:00100000:1.0:1763333172.374558:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2985 00000100:00100000:1.0:1763333172.374565:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:2419:x1848987613626496:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333172.374573:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333172.374578:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c553d4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1a1:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969235 expref: 230 pid: 6519 timeout: 1376 lvb_type: 0 00010000:00010000:1.0:1763333172.374590:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c553d4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a1:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969235 expref: 230 pid: 6519 timeout: 1376 lvb_type: 0 00010000:00010000:1.0:1763333172.374606:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c553d4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1a1:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969235 expref: 230 pid: 6519 timeout: 1376 lvb_type: 0 00010000:00010000:1.0:1763333172.374618:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a1:0x0].0x0 (ffff92ff61a46000) 00010000:00010000:1.0:1763333172.374622:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55459 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 00010000:00010000:1.0:1763333172.374629:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55459 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT1 00010000:00010000:1.0:1763333172.374636:0:6504:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55459 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT1 00010000:00010000:1.0:1763333172.374673:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333172.374705:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:2419:x1848987613626496:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 141us (2712us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333172.374713:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2985 00010000:00010000:3.0:1763333172.374773:0:6522:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55459 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 00010000:00010000:3.0:1763333172.374782:0:6522:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55459 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 00000004:00020000:3.0:1763333172.374950:0:6522:0:(lod_lov.c:1523:lod_parse_striping()) lustre-MDT0001-mdtlov: can not set all stale mirrors for [0x240000404:0x1a1:0x0]: rc = -1 00010000:00010000:3.0:1763333172.374984:0:6522:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55459 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 00010000:00010000:3.0:1763333172.374992:0:6522:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55459 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 00010000:00010000:3.0:1763333172.374999:0:6522:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55459 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 00010000:00010000:3.0:1763333172.375004:0:6522:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333172.375008:0:6522:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55459 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 00010000:00010000:3.0:1763333172.375014:0:6522:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55459 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 00010000:00010000:3.0:1763333172.375023:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a1:0x0].0x0 (ffff92ff61a46000) 00010000:00010000:3.0:1763333172.375026:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1763333172.375030:0:6522:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55459 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 00010000:00010000:3.0:1763333172.375040:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55459 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 00010000:00010000:3.0:1763333172.375049:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a1:0x0].0x0 (ffff92ff61a46000) 00010000:00010000:3.0:1763333172.375052:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763333172.375056:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5544b lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1a1:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969266 expref: 228 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333172.375179:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56828:x1848987613626368:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 6936us (8027us total) trans 4294972124 rc -1/-1 00000100:00100000:3.0:1763333172.375190:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3108 00000100:00100000:2.0:1763333172.384214:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.384277:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613626880 00000100:00100000:0.0:1763333172.384289:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613626880 00000100:00100000:3.0:1763333172.384911:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9088 00000100:00100000:3.0:1763333172.384926:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56833:x1848987613626880:12345-192.168.204.28@tcp:101:rm.0 00010000:00010000:3.0:1763333172.384960:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333172.384982:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55460 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696926d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.385043:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55460 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696926d expref: 229 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.385058:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55460 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696926d expref: 229 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.385078:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a1:0x0].0x0 (ffff92ff61a46000) 00010000:00010000:3.0:1763333172.385081:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763333172.385084:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a97000, rc 0) 00000100:00100000:3.0:1763333172.385151:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56833:x1848987613626880:12345-192.168.204.28@tcp:101:rm.0 Request processed in 229us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333172.385159:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9088 00000100:00100000:0.0:1763333172.389176:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.389275:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333172.389334:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613627136 00000100:00100000:3.0:1763333172.389343:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613627136 00000100:00100000:2.0:1763333172.389378:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613627264 00000100:00100000:2.0:1763333172.389383:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613627264 00000100:00100000:2.0:1763333172.389416:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9089 00000100:00100000:2.0:1763333172.389428:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56828:x1848987613627264:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333172.389455:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333172.389479:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c55467 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969274 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.389543:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c55467 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969274 expref: 231 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.389556:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5000/0xb32e3ef184c55467 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969274 expref: 231 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.389573:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a1:0x0].0x0 (ffff92ff61a46000) 00010000:00010000:2.0:1763333172.389576:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333172.389580:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5000, rc 0) 00000100:00100000:2.0:1763333172.389632:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56828:x1848987613627264:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 208us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333172.389638:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9089 00000100:00100000:2.0:1763333172.389655:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9090 00000100:00100000:2.0:1763333172.389661:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56833:x1848987613627136:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:2.0:1763333172.389692:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1763333172.389708:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55460 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696926d expref: 230 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.389722:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c553e2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1a1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696923c expref: 229 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.389732:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a1:0x0].0x0 (ffff92ff61a46000) 00010000:00010000:2.0:1763333172.389735:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333172.389753:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5546e lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333172.389760:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5546e lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333172.389768:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5546e lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333172.389777:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55475 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333172.389783:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55475 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333172.389789:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55475 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333172.389878:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5547c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333172.389885:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5547c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333172.389891:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5547c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00080000:2.0:1763333172.390241:0:6521:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x1a1:0x0] is inserted into orphan list, open count = 1 00010000:00010000:2.0:1763333172.390310:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5547c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333172.390321:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5547c lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333172.390327:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5547c lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333172.390332:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333172.390335:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5547c lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333172.390342:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5547c lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333172.390384:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a1:0x0].0x0 (ffff92ff61a46000) 00010000:00010000:2.0:1763333172.390387:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763333172.390391:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5547c lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333172.390397:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5547c lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1a1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333172.390408:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5546e lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333172.390413:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5546e lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333172.390418:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5546e lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333172.390424:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5546e lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333172.390428:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333172.390431:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5546e lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333172.390436:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5546e lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333172.390442:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b90a00) 00010000:00010000:2.0:1763333172.390444:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333172.390446:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5546e lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333172.390451:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5546e lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000004:00010000:2.0:1763333172.390463:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009029f415 reply state 00000000867db59c transno 4294972125 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55475 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333172.390472:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55475 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333172.390478:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b90500) 00010000:00010000:2.0:1763333172.390479:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333172.390482:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763333172.390515:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56833:x1848987613627136:12345-192.168.204.28@tcp:36:rm.0 Request processed in 853us (1351us total) trans 4294972125 rc 0/0 00000100:00100000:2.0:1763333172.390531:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9090 00000100:00100000:2.0:1763333172.396143:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333172.397199:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613627520 00000100:00100000:3.0:1763333172.397213:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613627520 00000100:00100000:3.0:1763333172.397439:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3109 00000100:00100000:3.0:1763333172.397449:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bd5ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56828:x1848987613627520:12345-192.168.204.28@tcp:35:lfs.0 00000004:00080000:3.0:1763333172.397690:0:6522:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x1a1:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1763333172.398650:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1355, 64 off114664 00000040:00080000:3.0:1763333172.398675:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1354, 64 off114664 00000040:00080000:3.0:1763333172.398841:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1356, 64 off114752 00000040:00080000:3.0:1763333172.398922:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1357, 64 off114752 00010000:00010000:3.0:1763333172.398991:0:6522:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55483 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 00010000:00010000:3.0:1763333172.399009:0:6522:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55483 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT1 00010000:00010000:3.0:1763333172.399022:0:6522:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55483 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT1 00010000:00010000:3.0:1763333172.399030:0:6522:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55483 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1a1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT1 00010000:00010000:3.0:1763333172.399036:0:6522:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55483 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1a1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT1 00010000:00010000:3.0:1763333172.399042:0:6522:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55483 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1a1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT1 00010000:00010000:3.0:1763333172.399055:0:6522:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763333172.399254:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bd5ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56828:x1848987613627520:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 1803us (3121us total) trans 4294972126 rc 0/0 00000100:00100000:3.0:1763333172.399264:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3109 00010000:00010000:0.0:1763333172.399383:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333172.399390:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55483 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1a1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT1 00010000:00010000:0.0:1763333172.399398:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333172.399402:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55483 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1a1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT1 00010000:00010000:0.0:1763333172.399410:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55483 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1a1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT1 00010000:00010000:0.0:1763333172.399424:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a1:0x0].0x0 (ffff92ff61a46000) 00010000:00010000:0.0:1763333172.399427:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763333172.399433:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55483 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1a1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT1 00010000:00010000:0.0:1763333172.399438:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55483 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1a1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT1 00010000:00010000:0.0:1763333172.399449:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333172.399451:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333172.399453:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763333172.406238:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333172.406602:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613627648 00000100:00100000:1.0:1763333172.406616:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613627648 00000100:00100000:1.0:1763333172.406693:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9091 00000100:00100000:1.0:1763333172.406704:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56834:x1848987613627648:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333172.406734:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333172.406758:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5548a lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696927b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.407243:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55491 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333172.407259:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55491 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.407271:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55491 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.407281:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55498 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333172.407288:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55498 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.407294:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55498 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.408013:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55491 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.408021:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55491 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.408027:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55491 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.408033:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55491 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.408038:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333172.408042:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55491 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.408048:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55491 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.408060:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355c00) 00010000:00010000:1.0:1763333172.408063:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333172.408068:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55491 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.408073:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55491 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.408085:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55498 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.408091:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55498 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.408096:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55498 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.408100:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333172.408102:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55498 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.408111:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55498 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.408117:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b90500) 00010000:00010000:1.0:1763333172.408119:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333172.408121:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55498 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.408125:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55498 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.408156:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5548a lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696927b expref: 232 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.408165:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355c00) 00010000:00010000:1.0:1763333172.408167:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333172.408170:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5548a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696927b expref: 232 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.408181:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7ec00, rc 0) 00000100:00100000:1.0:1763333172.408256:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56834:x1848987613627648:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1553us (2033us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333172.408264:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9091 00000100:00100000:1.0:1763333172.422914:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.425791:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613627776 00000100:00100000:2.0:1763333172.425809:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613627776 00000100:00100000:2.0:1763333172.425894:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9092 00000100:00100000:2.0:1763333172.425905:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56834:x1848987613627776:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333172.425928:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333172.425952:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5549f lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969282 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.426020:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c554a6 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333172.426033:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c554a6 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.426044:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c554a6 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.426053:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c554ad lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333172.426059:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c554ad lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.426065:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c554ad lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.426104:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c554a6 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.426111:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c554a6 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.426117:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c554a6 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.426123:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c554a6 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.426129:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333172.426133:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c554a6 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.426140:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c554a6 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.426151:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b90a00) 00010000:00010000:2.0:1763333172.426153:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333172.426157:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c554a6 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.426163:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c554a6 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.426177:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c554ad lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.426182:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c554ad lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.426188:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c554ad lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.426192:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4a00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333172.426195:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c554ad lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.426201:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c554ad lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.426207:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b90500) 00010000:00010000:2.0:1763333172.426210:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333172.426213:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c554ad lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.426222:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c554ad lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.426246:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5549f lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969282 expref: 232 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.426255:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b90a00) 00010000:00010000:2.0:1763333172.426257:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333172.426260:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5549f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969282 expref: 232 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.426272:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5400, rc 0) 00000100:00100000:2.0:1763333172.426336:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56834:x1848987613627776:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 434us (3435us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333172.426343:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9092 00000100:00100000:2.0:1763333172.431490:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.431642:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613627904 00000100:00100000:0.0:1763333172.431653:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613627904 00000100:00100000:0.0:1763333172.431720:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9093 00000100:00100000:0.0:1763333172.431730:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56834:x1848987613627904:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333172.431751:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333172.431775:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c554b4 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969289 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.431845:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c554bb lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333172.431863:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c554bb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.431874:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c554bb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:0.0:1763333172.431923:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1763333172.431928:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763333172.431963:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c554b4 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969289 expref: 233 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.431980:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c554bb lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969289 expref: 232 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.431988:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12700) 00010000:00010000:0.0:1763333172.431991:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1763333172.431995:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdf600, rc 0) 00000100:00100000:0.0:1763333172.432065:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56834:x1848987613627904:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 336us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333172.432072:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9093 00000100:00100000:3.0:1763333172.435531:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.435671:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613628160 00000100:00100000:2.0:1763333172.435682:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613628160 00000100:00100000:2.0:1763333172.435738:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9094 00000100:00100000:2.0:1763333172.435748:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56835:x1848987613628160:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333172.435769:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333172.435790:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c554c2 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969290 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.435869:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c554c9 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333172.435884:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c554c9 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.435898:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c554c9 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.435910:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c554d0 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333172.435917:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c554d0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.435924:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c554d0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.435965:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c554c9 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.435973:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c554c9 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.435979:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c554c9 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.435985:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c554c9 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.435991:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4a00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333172.435995:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c554c9 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.436001:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c554c9 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.436012:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12700) 00010000:00010000:2.0:1763333172.436014:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333172.436019:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c554c9 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.436024:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c554c9 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.436036:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c554d0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.436042:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c554d0 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.436046:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c554d0 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.436051:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333172.436054:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c554d0 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.436059:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c554d0 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.436065:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b90500) 00010000:00010000:2.0:1763333172.436067:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333172.436070:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c554d0 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.436075:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c554d0 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.436104:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c554c2 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969290 expref: 233 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.436114:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12700) 00010000:00010000:2.0:1763333172.436117:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763333172.436121:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c554c2 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969290 expref: 233 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.436129:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5400, rc 0) 00000100:00100000:2.0:1763333172.436198:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56835:x1848987613628160:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 451us (684us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333172.436205:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9094 00000100:00100000:3.0:1763333172.451171:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.452997:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613628416 00000100:00100000:0.0:1763333172.453013:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613628416 00000100:00100000:0.0:1763333172.453094:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9095 00000100:00100000:0.0:1763333172.453107:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49609880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56834:x1848987613628416:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333172.453131:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333172.453135:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763333172.453165:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c554bb lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969289 expref: 232 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.453191:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12700) 00010000:00010000:0.0:1763333172.453202:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333172.453220:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c554d7 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969297 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.453332:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c554de lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333172.453345:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c554de lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.453416:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c554de lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.453431:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c554e5 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333172.453439:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c554e5 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.453445:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c554e5 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.453893:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c554ec lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333172.453903:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c554ec lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.453910:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c554ec lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:0.0:1763333172.453922:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1a3:0x0]: returning size 0 00010000:00010000:0.0:1763333172.453952:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c554de lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.453959:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c554de lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.453965:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c554de lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.453971:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c554de lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.453978:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333172.453983:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c554de lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.453990:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c554de lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.453998:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12e00) 00010000:00010000:0.0:1763333172.454001:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333172.454005:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c554de lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.454010:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c554de lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000004:00010000:0.0:1763333172.454020:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004e7e38a5 reply state 00000000abdbffb9 transno 4294972127 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c554e5 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.454030:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c554e5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.454036:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b90500) 00010000:00010000:0.0:1763333172.454038:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333172.454041:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763333172.454069:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c554d7 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969297 expref: 234 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.454085:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c554ec lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969297 expref: 233 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.454092:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a3:0x0].0x0 (ffff92fe44e12b00) 00010000:00010000:0.0:1763333172.454094:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333172.454097:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdfe00, rc 0) 00000100:00100000:0.0:1763333172.454170:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49609880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:56834:x1848987613628416:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1065us (3008us total) trans 4294972127 rc 0/0 00000100:00100000:0.0:1763333172.454177:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9095 00000100:00100000:3.0:1763333172.470996:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.471095:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613628672 00000100:00100000:0.0:1763333172.471109:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613628672 00000100:00100000:3.0:1763333172.471497:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.472339:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613628928 00000100:00100000:2.0:1763333172.472380:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613628928 00000100:00100000:2.0:1763333172.472433:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9096 00000100:00100000:2.0:1763333172.472445:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4960bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:56834:x1848987613628672:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333172.472484:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333172.472529:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c554fa lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696929e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.472668:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c55501 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333172.472686:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c554ec lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969297 expref: 236 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.472699:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c55501 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.472746:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c554ec lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969297 expref: 236 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.472762:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c554ec lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969297 expref: 236 pid: 6521 timeout: 1376 lvb_type: 0 00000100:00100000:2.0:1763333172.472785:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe438a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627238784:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333172.472896:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff5119d780 going to sleep for 11 seconds 00000100:00100000:0.0:1763333172.473487:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9097 00000100:00100000:0.0:1763333172.473505:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4960b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56836:x1848987613628928:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333172.473528:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333172.473544:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c55508 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369692a5 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.473622:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5550f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333172.473634:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5550f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333172.473646:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5550f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:0.0:1763333172.473658:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1a3:0x0]: returning size 0 00010000:00010000:0.0:1763333172.473758:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5550f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333172.473767:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5550f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333172.473774:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5550f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333172.473780:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333172.473784:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5550f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333172.473791:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5550f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333172.473803:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a3:0x0].0x0 (ffff92fe44e12b00) 00010000:00010000:0.0:1763333172.473806:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1763333172.473811:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5550f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333172.473817:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5550f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333172.473860:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c55508 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1a3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692a5 expref: 238 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.473870:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a3:0x0].0x0 (ffff92fe44e12b00) 00010000:00010000:0.0:1763333172.473872:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763333172.473876:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c55508 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1a3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692a5 expref: 238 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.473886:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdf400, rc 0) 00000100:00100000:0.0:1763333172.473930:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4960b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56836:x1848987613628928:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 432us (2435us total) trans 4294972128 rc 301/301 00000100:00100000:0.0:1763333172.473938:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9097 00000100:00100000:2.0:1763333172.475151:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333172.475249:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe438a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627238784:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333172.475284:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c55501 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000100:00100000:3.0:1763333172.475753:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613629056 00000100:00100000:3.0:1763333172.475761:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613629056 00010000:00010000:3.0:1763333172.475798:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c554ec lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969297 expref: 237 pid: 6521 timeout: 1376 lvb_type: 0 00000100:00100000:3.0:1763333172.477699:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2986 00000100:00100000:3.0:1763333172.477725:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:2420:x1848987613629056:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333172.477746:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333172.477758:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c554ec lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969297 expref: 237 pid: 6521 timeout: 1376 lvb_type: 0 00010000:00010000:3.0:1763333172.477777:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c554ec lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969297 expref: 237 pid: 6521 timeout: 1376 lvb_type: 0 00010000:00010000:3.0:1763333172.477803:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c554ec lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969297 expref: 237 pid: 6521 timeout: 1376 lvb_type: 0 00010000:00010000:3.0:1763333172.477825:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a3:0x0].0x0 (ffff92fe44e12b00) 00010000:00010000:3.0:1763333172.477831:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c55501 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.477839:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c55501 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.477847:0:6505:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c55501 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.477876:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333172.478080:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:2420:x1848987613629056:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 365us (2934us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333172.478089:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2986 00010000:00010000:1.0:1763333172.478177:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c55501 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.478186:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c55501 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:1.0:1763333172.478211:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1a3:0x0]: returning size 0 00000004:00080000:1.0:1763333172.478424:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x225:0x0], index 1: 0 00000004:00080000:1.0:1763333172.478432:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x225:0x0], index 0: 0 00000004:00080000:1.0:1763333172.478438:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x226:0x0], index 0: 0 00000004:00080000:1.0:1763333172.478442:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x226:0x0], index 1: 0 00010000:00010000:1.0:1763333172.478583:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c55501 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.478591:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c55501 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.478598:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c55501 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.478604:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333172.478610:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c55501 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.478617:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c55501 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.478628:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a3:0x0].0x0 (ffff92fe44e12b00) 00010000:00010000:1.0:1763333172.478631:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763333172.478635:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c55501 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.478641:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c55501 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.478695:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c554fa lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1a3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696929e expref: 236 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.478705:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a3:0x0].0x0 (ffff92fe44e12b00) 00010000:00010000:1.0:1763333172.478708:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763333172.478711:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c554fa lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1a3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696929e expref: 236 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.478726:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5400, rc 0) 00000100:00100000:1.0:1763333172.478767:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4960bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:56834:x1848987613628672:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 6324us (7783us total) trans 4294972129 rc 301/301 00000100:00100000:1.0:1763333172.478775:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9096 00000100:00100000:1.0:1763333172.478865:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333172.479033:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613629312 00000100:00100000:1.0:1763333172.479040:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613629312 00000100:00100000:1.0:1763333172.479076:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3110 00000100:00100000:1.0:1763333172.479084:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:56836:x1848987613629312:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1763333172.479252:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56836:x1848987613629312:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 168us (386us total) trans 4294972130 rc 0/0 00000100:00100000:1.0:1763333172.479260:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3110 00000100:00100000:3.0:1763333172.487581:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333172.487639:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.489751:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613629568 00000100:00100000:2.0:1763333172.489767:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613629568 00000100:00100000:2.0:1763333172.489836:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3111 00000100:00100000:2.0:1763333172.489848:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56834:x1848987613629568:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333172.490087:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56834:x1848987613629568:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 241us (2518us total) trans 4294972131 rc 0/0 00000100:00100000:2.0:1763333172.490094:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3111 00000100:00100000:0.0:1763333172.490221:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613629824 00000100:00100000:0.0:1763333172.490227:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613629824 00000100:00100000:0.0:1763333172.490275:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9098 00000100:00100000:0.0:1763333172.490283:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4960b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56836:x1848987613629824:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333172.490296:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333172.490325:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c55524 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369692ac expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.490443:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5552b lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333172.490460:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5552b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333172.490472:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5552b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333172.490484:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55532 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333172.490492:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55532 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333172.490499:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55532 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333172.490604:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c55539 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333172.490612:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c55539 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333172.490620:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c55539 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:0.0:1763333172.490630:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1a3:0x0]: returning size 0 00010000:00010000:0.0:1763333172.490682:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5552b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333172.490690:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5552b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333172.490696:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5552b lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333172.490702:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5552b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333172.490708:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333172.490713:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5552b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333172.490721:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5552b lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333172.490736:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12e00) 00010000:00010000:0.0:1763333172.490740:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333172.490748:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5552b lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333172.490754:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5552b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333172.490769:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55532 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333172.490780:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55532 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333172.490786:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55532 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333172.490791:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333172.490794:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55532 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333172.490800:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55532 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333172.490806:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b90500) 00010000:00010000:0.0:1763333172.490809:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333172.490812:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55532 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333172.490818:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55532 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333172.490848:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c55524 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692ac expref: 240 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.490864:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c55539 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692ac expref: 239 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.490872:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a3:0x0].0x0 (ffff92fe44e12700) 00010000:00010000:0.0:1763333172.490875:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333172.490877:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdea00, rc 0) 00000100:00100000:0.0:1763333172.490913:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4960b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56836:x1848987613629824:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 631us (3274us total) trans 4294972132 rc 0/0 00000100:00100000:0.0:1763333172.490921:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9098 00000100:00100000:1.0:1763333172.498513:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333172.498629:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613630080 00000100:00100000:3.0:1763333172.498646:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613630080 00000100:00100000:3.0:1763333172.498725:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3112 00000100:00100000:3.0:1763333172.498737:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56834:x1848987613630080:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333172.499045:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:56834:x1848987613630080:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 308us (544us total) trans 4294972133 rc 0/0 00000100:00100000:3.0:1763333172.499054:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3112 00000100:00100000:3.0:1763333172.500216:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.502236:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333172.502335:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613630208 00000100:00100000:1.0:1763333172.502345:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613630208 00000100:00100000:1.0:1763333172.502427:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613630336 00000100:00100000:1.0:1763333172.502431:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613630336 00000100:00100000:1.0:1763333172.502458:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6355 00000100:00100000:1.0:1763333172.502469:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2419:x1848987613630208:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333172.502491:0:17605:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333172.502528:0:17605:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c55547 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369692b3 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333172.502556:0:17605:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x226:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333172.502581:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333172.502583:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333172.502593:0:17605:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c55547 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692b3 expref: 24 pid: 17605 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333172.502611:0:17605:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c55547 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692b3 expref: 24 pid: 17605 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333172.502625:0:17605:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f000, rc 0) 00000100:00100000:1.0:1763333172.502695:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:2419:x1848987613630208:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 228us (2485us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333172.502703:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6355 00000100:00100000:1.0:1763333172.502722:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6356 00000100:00100000:1.0:1763333172.502729:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2419:x1848987613630336:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333172.502736:0:17605:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333172.502748:0:17605:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5554e lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369692ba expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333172.502764:0:17605:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x226:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333172.502774:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333172.502775:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333172.502779:0:17605:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5554e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692ba expref: 15 pid: 17605 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333172.502790:0:17605:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5554e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692ba expref: 15 pid: 17605 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333172.502799:0:17605:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e800, rc 0) 00000100:00100000:1.0:1763333172.502822:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2419:x1848987613630336:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 94us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333172.502828:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6356 00000100:00100000:0.0:1763333172.506058:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333172.516885:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613630592 00000100:00100000:1.0:1763333172.516907:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613630592 00000100:00100000:1.0:1763333172.517043:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9099 00000100:00100000:1.0:1763333172.517056:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:55917:x1848987613630592:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333172.517090:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333172.517094:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763333172.517127:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c55539 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692ac expref: 240 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.517149:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a3:0x0].0x0 (ffff92fe44e12700) 00010000:00010000:1.0:1763333172.517160:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333172.517179:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55555 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369692c1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.517307:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c5555c lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333172.517321:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c5555c lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1a3:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.517336:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c5555c lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1a3:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:1.0:1763333172.517387:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1a3:0x0]: returning size 0 00010000:00010000:1.0:1763333172.517540:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55555 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692c1 expref: 242 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.517556:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c5555c lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1a3:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692c1 expref: 241 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.517564:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a3:0x0].0x0 (ffff92fe48355900) 00010000:00010000:1.0:1763333172.517567:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:1.0:1763333172.517569:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f800, rc 0) 00000100:00100000:1.0:1763333172.517658:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:55917:x1848987613630592:12345-192.168.204.28@tcp:101:bash.0 Request processed in 604us (11610us total) trans 4294972134 rc 0/0 00000100:00100000:1.0:1763333172.517667:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9099 00000100:00100000:3.0:1763333172.518741:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.518875:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613630720 00000100:00100000:0.0:1763333172.518883:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613630720 00000100:00100000:0.0:1763333172.518934:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9100 00000100:00100000:0.0:1763333172.518944:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49608a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56836:x1848987613630720:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333172.518962:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333172.518979:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c5556a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369692c8 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.519022:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c5556a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692c8 expref: 242 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.519036:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c5556a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692c8 expref: 242 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.519052:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a3:0x0].0x0 (ffff92fe48355900) 00010000:00010000:0.0:1763333172.519055:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333172.519058:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdf600, rc 0) 00000100:00100000:0.0:1763333172.519113:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49608a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:56836:x1848987613630720:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 170us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333172.519120:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9100 00000100:00100000:0.0:1763333172.522310:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.522378:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613630976 00000100:00100000:2.0:1763333172.522389:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613630976 00000100:00100000:0.0:1763333172.522395:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.522446:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3113 00000100:00100000:2.0:1763333172.522456:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:56836:x1848987613630976:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333172.522814:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:56836:x1848987613630976:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 358us (512us total) trans 4294972135 rc 0/0 00000100:00100000:2.0:1763333172.522823:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3113 00000100:00100000:1.0:1763333172.522900:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613631104 00000100:00100000:1.0:1763333172.522906:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613631104 00000100:00100000:1.0:1763333172.522953:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9101 00000100:00100000:1.0:1763333172.522963:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:55917:x1848987613631104:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333172.522977:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333172.523000:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55571 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369692cf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.523042:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55578 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333172.523061:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55578 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.523076:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55578 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.523301:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55571 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692cf expref: 245 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.523321:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55578 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692cf expref: 244 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.523331:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a3:0x0].0x0 (ffff92fe48355900) 00010000:00010000:1.0:1763333172.523334:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763333172.523339:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7ec00, rc 0) 00000100:00100000:1.0:1763333172.523407:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:55917:x1848987613631104:12345-192.168.204.28@tcp:101:bash.0 Request processed in 446us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333172.523604:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9101 00000100:00100000:0.0:1763333172.525022:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333172.525102:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613631360 00000100:00100000:1.0:1763333172.525110:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613631360 00000100:00100000:1.0:1763333172.525196:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9102 00000100:00100000:1.0:1763333172.525206:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56836:x1848987613631360:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333172.525228:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333172.525250:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5557f lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369692d6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.525323:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55586 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333172.525338:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55586 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.525991:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55586 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.526009:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c5558d lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333172.526018:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c5558d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.526024:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c5558d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.526147:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c55594 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333172.526159:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c55594 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.526165:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c55594 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.526171:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c55594 lrc: 3/0,0 mode: --/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.526178:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe44d75200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333172.526182:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c55594 lrc: 3/0,0 mode: --/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.526189:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c55594 lrc: 4/0,0 mode: --/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.526199:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a3:0x0].0x0 (ffff92fe48355900) 00010000:00010000:1.0:1763333172.526205:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c55594 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.526211:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c55594 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00200000:1.0:1763333172.526228:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1a3:0x0]: returning size 0 00010000:00010000:1.0:1763333172.526311:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55586 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.526319:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55586 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.526324:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55586 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.526330:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55586 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.526335:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333172.526337:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55586 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.526342:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55586 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.526388:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff4ad5e800) 00010000:00010000:1.0:1763333172.526392:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333172.526395:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55586 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.526401:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55586 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.526410:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c5558d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.526420:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c5558d lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.526426:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c5558d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.526430:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe44d75a00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333172.526432:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c5558d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.526438:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c5558d lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.526445:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b90500) 00010000:00010000:1.0:1763333172.526447:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333172.526450:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c5558d lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.526455:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c5558d lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.526498:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5557f lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692d6 expref: 246 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.526509:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff4ad5e800) 00010000:00010000:1.0:1763333172.526511:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763333172.526515:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5557f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692d6 expref: 246 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.526540:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f200, rc 0) 00000100:00100000:1.0:1763333172.526617:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56836:x1848987613631360:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1412us (1600us total) trans 4294972136 rc 301/301 00000100:00100000:1.0:1763333172.526626:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9102 00000100:00100000:2.0:1763333172.528013:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333172.528210:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613631616 00000100:00100000:1.0:1763333172.528220:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613631616 00000100:00100000:1.0:1763333172.528459:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9103 00000100:00100000:1.0:1763333172.528470:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:55917:x1848987613631616:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:1.0:1763333172.528540:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333172.528567:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c5555c lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1a3:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692c1 expref: 245 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.528585:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a3:0x0].0x0 (ffff92fe48355900) 00010000:00010000:1.0:1763333172.528590:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333172.528775:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c555a2 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333172.528789:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c555a2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.528799:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c555a2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000001:00080000:1.0:1763333172.528853:0:6519:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294972137 00000004:00010000:1.0:1763333172.528878:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007bfe300d reply state 000000002209d4dc transno 4294972138 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c555a2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.528892:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c555a2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333172.528898:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a3:0x0].0x0 (ffff92fe48355900) 00010000:00010000:1.0:1763333172.528900:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333172.528904:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763333172.529851:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:55917:x1848987613631616:12345-192.168.204.28@tcp:36:bash.0 Request processed in 1379us (1841us total) trans 4294972138 rc 0/0 00000100:00100000:1.0:1763333172.529862:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9103 00000020:00080000:1.0:1763333172.529869:0:6519:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763333172.533735:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333172.534043:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333172.534534:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613632128 00000100:00100000:3.0:1763333172.534546:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613632128 00000100:00100000:2.0:1763333172.534804:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613631872 00000100:00100000:2.0:1763333172.534809:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613631872 00000100:00100000:2.0:1763333172.534856:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3114 00000100:00100000:2.0:1763333172.534868:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:56836:x1848987613631872:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333172.535136:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:56836:x1848987613631872:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 269us (1410us total) trans 4294972139 rc 0/0 00000100:00100000:2.0:1763333172.535145:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3114 00000100:00100000:3.0:1763333172.535382:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9104 00000100:00100000:3.0:1763333172.535392:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:55917:x1848987613632128:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333172.535405:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333172.535408:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763333172.535432:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c5556a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692c8 expref: 248 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.535457:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a3:0x0].0x0 (ffff92fe48355900) 00010000:00010000:3.0:1763333172.535462:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333172.535598:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c555a9 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369692dd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.535642:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c555b0 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333172.535656:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c555b0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.535665:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c555b0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000040:00080000:2.0:1763333172.535851:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1357, 88 off114840 00000004:00080000:2.0:1763333172.535859:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1276615509924ns, next at 1277223362238ns, rc = 0 00000040:00080000:2.0:1763333172.535893:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1358, 88 off114840 00000004:00080000:2.0:1763333172.535898:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1276615548889ns, next at 1276878902000ns, rc = 0 00000040:00080000:2.0:1763333172.535926:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1359, 88 off114928 00000004:00080000:2.0:1763333172.535931:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1276615581832ns, next at 1276878902000ns, rc = 0 00000040:00080000:2.0:1763333172.535940:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1358, 88 off114928 00000004:00080000:2.0:1763333172.535945:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1276615595686ns, next at 1277223362238ns, rc = 0 00000100:00100000:1.0:1763333172.541111:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.541167:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613632256 00000100:00100000:0.0:1763333172.541178:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613632256 00000100:00100000:0.0:1763333172.541326:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3115 00000100:00100000:0.0:1763333172.541341:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bd5e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:56836:x1848987613632256:12345-192.168.204.28@tcp:33:lfs.0 00000001:00080000:1.0:1763333172.542648:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972140 is committed 00000004:00080000:1.0:1763333172.542663:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 886 committed 00000100:00100000:2.0:1763333172.542699:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bd5e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:56836:x1848987613632256:12345-192.168.204.28@tcp:33:lfs.0 Request processed in 1355us (1593us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333172.542710:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3115 00010000:00010000:3.0:1763333172.542723:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55475 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.542736:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55475 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.542744:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55475 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.542751:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333172.542755:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55475 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.542763:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55475 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.542780:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b90500) 00010000:00010000:3.0:1763333172.542785:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333172.542792:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55475 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.542799:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55475 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.542819:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c554e5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.542824:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c554e5 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.542835:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c554e5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.542841:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abde400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333172.542844:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c554e5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.542854:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c554e5 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00000004:00080000:1.0:1763333172.542860:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 889 committed 00010000:00010000:3.0:1763333172.542861:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b90500) 00010000:00010000:3.0:1763333172.542864:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333172.542867:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c554e5 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.542873:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c554e5 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000004:00080000:1.0:1763333172.542876:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 888 committed 00000004:00080000:1.0:1763333172.542879:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 885 committed 00010000:00010000:3.0:1763333172.542892:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c555a2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.542898:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c555a2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.542903:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c555a2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.542907:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe44d75400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333172.542910:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c555a2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.542914:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c555a2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.542922:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a3:0x0].0x0 (ffff92fe48355900) 00010000:00010000:3.0:1763333172.542924:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333172.542927:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c555a2 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.542932:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c555a2 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000100:00100000:0.0:1763333172.544188:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe438a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627238912:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763333172.544250:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333172.544282:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe438abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627239424:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333172.544305:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333172.544328:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1763333172.544333:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff75664700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627239040:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763333172.544369:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333172.544392:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff75667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627239552:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763333172.544411:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333172.544437:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe438a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627239296:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333172.544876:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333172.544903:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff75667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627239808:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333172.544926:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333172.544949:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1763333172.544954:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff75667480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627239680:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333172.544975:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333172.545012:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627238912 00000100:00100000:0.0:1763333172.545021:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627238912 00000100:00100000:0.0:1763333172.545066:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627239424 00000100:00100000:0.0:1763333172.545070:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627239424 00000100:00100000:0.0:1763333172.545085:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627239040 00000100:00100000:0.0:1763333172.545088:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627239040 00000100:00100000:1.0:1763333172.545097:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627239552 00000100:00100000:1.0:1763333172.545101:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627239552 00000100:00100000:0.0:1763333172.545102:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627239296 00000100:00100000:0.0:1763333172.545104:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627239296 00000100:00100000:0.0:1763333172.545112:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627239808 00000100:00100000:1.0:1763333172.545115:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627239680 00000100:00100000:0.0:1763333172.545115:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627239808 00000100:00100000:1.0:1763333172.545117:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627239680 00000100:00100000:1.0:1763333172.545129:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6357 00000100:00100000:1.0:1763333172.545141:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+47:3652:x1848987627238912:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1763333172.545166:0:8404:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:547 count 1 00010000:00010000:1.0:1763333172.545206:0:8404:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe44d75200/0xb32e3ef184c555b7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.545229:0:8404:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5540c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696924a expref: 23 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.545238:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333172.545240:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333172.545243:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe44d75200/0xb32e3ef184c555b7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.545281:0:8404:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5540c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696924a expref: 23 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.545297:0:8404:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5540c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696924a expref: 23 pid: 8407 timeout: 1376 lvb_type: 0 00000100:00100000:1.0:1763333172.545309:0:8404:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77c6d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8404:1848987627239936:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333172.545406:0:8404:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe46e0e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763333172.545569:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6358 00000100:00100000:0.0:1763333172.545579:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+47:3652:x1848987627239424:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333172.545671:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe438a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627239168:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763333172.545705:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1763333172.545738:0:8407:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x226:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333172.545742:0:8407:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x226:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763333172.545744:0:8407:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x226:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333172.545746:0:8407:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x226:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763333172.545748:0:8407:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x226:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:2.0:1763333172.545781:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c555b0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a3:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692dd expref: 226 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333172.545782:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+48:3652:x1848987627239424:12345-0@lo:2:osp-syn-0-1.0 Request processed in 206us (1476us total) trans 21474838810 rc 0/0 00000100:00100000:0.0:1763333172.545790:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6358 00010000:00010000:2.0:1763333172.545799:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a3:0x0].0x0 (ffff92fe48355900) 00010000:00010000:2.0:1763333172.545801:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:0.0:1763333172.545807:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627239168 00000100:00100000:0.0:1763333172.545810:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627239168 00010000:00010000:2.0:1763333172.545817:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c555a9 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692dd expref: 226 pid: 6519 timeout: 0 lvb_type: 3 00000100:00100000:0.0:1763333172.545826:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6359 00000100:00100000:0.0:1763333172.545831:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+16:3652:x1848987627239040:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1763333172.545833:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c555b0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a3:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692dd expref: 225 pid: 6519 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1763333172.545843:0:8407:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:547 count 1 00010000:00010000:0.0:1763333172.545857:0:8407:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c555be lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.545858:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a3:0x0].0x0 (ffff92fe48355900) 00010000:00010000:2.0:1763333172.545861:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763333172.545864:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4800, rc 0) 00010000:00010000:0.0:1763333172.545869:0:8407:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5541a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969258 expref: 14 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.545875:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333172.545876:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333172.545879:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c555be lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333172.545894:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:55917:x1848987613632128:12345-192.168.204.28@tcp:101:bash.0 Request processed in 10504us (11852us total) trans 4294972140 rc 0/0 00010000:00010000:0.0:1763333172.545899:0:8407:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5541a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969258 expref: 14 pid: 8407 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333172.545901:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9104 00010000:00010000:0.0:1763333172.545913:0:8407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5541a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969258 expref: 14 pid: 8407 timeout: 1376 lvb_type: 0 00000100:00100000:0.0:1763333172.545923:0:8407:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff74038000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8407:1848987627240064:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333172.545951:0:8407:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff499ad9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763333172.545969:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6360 00000100:00100000:0.0:1763333172.545976:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+48:3655:x1848987627239296:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333172.546071:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+49:3655:x1848987627239296:12345-0@lo:2:osp-syn-0-1.0 Request processed in 96us (1195us total) trans 21474838811 rc 0/0 00000100:00100000:0.0:1763333172.546078:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6360 00000100:00100000:1.0:1763333172.546088:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6361 00000100:00100000:0.0:1763333172.546092:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6362 00000100:00100000:1.0:1763333172.546096:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+16:3652:x1848987627239552:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763333172.546097:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+16:3655:x1848987627239808:12345-0@lo:2:osp-syn-1-1.0 00002000:00080000:1.0:1763333172.546109:0:28600:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:548 count 1 00002000:00010000:1.0:1763333172.546127:0:28600:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x224:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333172.546132:0:28600:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c555c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.546140:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333172.546141:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333172.546146:0:28600:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c555c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.546157:0:28600:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c555c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763333172.546162:0:29010:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x226:0x0] updating lvb size from disk: 0 -> 0 00010000:00010000:1.0:1763333172.546165:0:28600:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c555c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763333172.546165:0:29010:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x226:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763333172.546167:0:29010:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x226:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333172.546169:0:29010:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x226:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763333172.546172:0:29010:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x226:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:1.0:1763333172.546178:0:28600:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c555c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333172.546195:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+17:3655:x1848987627239808:12345-0@lo:2:osp-syn-1-1.0 Request processed in 98us (1268us total) trans 17179871506 rc 0/0 00000100:00100000:0.0:1763333172.546201:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6362 00010000:00010000:1.0:1763333172.546205:0:28600:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763333172.546212:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6363 00000100:00100000:0.0:1763333172.546218:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74039180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+16:3655:x1848987627239680:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333172.546280:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74039180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+18:3655:x1848987627239680:12345-0@lo:2:osp-syn-1-1.0 Request processed in 61us (1304us total) trans 17179871507 rc 0/0 00000100:00100000:0.0:1763333172.546286:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6363 00000100:00100000:0.0:1763333172.546299:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6364 00000100:00100000:0.0:1763333172.546304:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+48:3654:x1848987627239168:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1763333172.546314:0:29010:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:548 count 1 00002000:00010000:0.0:1763333172.546328:0:29010:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x224:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333172.546332:0:29010:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdee00/0xb32e3ef184c555cc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.546340:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333172.546341:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333172.546344:0:29010:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdee00/0xb32e3ef184c555cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333172.546375:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+17:3652:x1848987627239552:12345-0@lo:6:osp-syn-1-1.0 Request processed in 252us (1935us total) trans 17179871508 rc 0/0 00000100:00100000:1.0:1763333172.546382:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6361 00010000:00010000:0.0:1763333172.546386:0:29010:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdee00/0xb32e3ef184c555cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.546394:0:29010:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdee00/0xb32e3ef184c555cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.546401:0:29010:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdee00/0xb32e3ef184c555cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.546416:0:29010:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1763333172.546535:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+49:3654:x1848987627239168:12345-0@lo:6:osp-syn-0-1.0 Request processed in 230us (828us total) trans 21474838812 rc 0/0 00010000:00010000:1.0:1763333172.546536:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1763333172.546542:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6364 00010000:00010000:1.0:1763333172.546543:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c555c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.546550:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f200 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333172.546554:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c555c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.546564:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c555c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.546580:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c555c5 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1763333172.546585:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe438a9c00/2, rc 0, transno 21474838812 00010000:00010000:1.0:1763333172.546587:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c555c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333172.546591:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe438a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627239168:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1763333172.546603:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333172.546606:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdee00/0xb32e3ef184c555cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.546613:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdee00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333172.546616:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdee00/0xb32e3ef184c555cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.546623:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdee00/0xb32e3ef184c555cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.546637:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdee00/0xb32e3ef184c555cc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.546643:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdee00/0xb32e3ef184c555cc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.546655:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333172.546657:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333172.546658:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763333172.546681:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff75667100/2, rc 0, transno 17179871508 00000100:00100000:1.0:1763333172.546687:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff75667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627239552:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1763333172.546697:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe438abb80/2, rc 0, transno 21474838810 00000100:00100000:1.0:1763333172.546700:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe438abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627239424:0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1763333172.546875:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763333172.546898:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff75667480/2, rc 0, transno 17179871507 00000100:00100000:2.0:1763333172.546903:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff75667480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627239680:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1763333172.546912:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe438a9880/2, rc 0, transno 21474838811 00000100:00100000:2.0:1763333172.546915:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe438a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627239296:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1763333172.546921:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff75667b80/2, rc 0, transno 17179871506 00000100:00100000:2.0:1763333172.546924:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff75667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627239808:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333172.555420:0:8404:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77c6d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8404:1848987627239936:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333172.555458:0:8404:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe44d75200/0xb32e3ef184c555b7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333172.555717:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.555749:0:8407:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff74038000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8407:1848987627240064:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333172.555750:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:2.0:1763333172.555770:0:8407:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c555be lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333172.555776:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.555798:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613632384 00000100:00100000:2.0:1763333172.555805:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613632384 00000100:00100000:3.0:1763333172.555848:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613632640 00010000:00010000:2.0:1763333172.555850:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5540c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696924a expref: 24 pid: 8407 timeout: 1376 lvb_type: 0 00000100:00100000:3.0:1763333172.555853:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613632640 00000100:00100000:2.0:1763333172.555881:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613632512 00000100:00100000:2.0:1763333172.555884:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613632512 00000100:00100000:3.0:1763333172.555889:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6365 00010000:00010000:2.0:1763333172.555894:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5541a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969258 expref: 16 pid: 8407 timeout: 1376 lvb_type: 0 00000100:00100000:3.0:1763333172.555898:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:55917:x1848987613632640:12345-192.168.204.28@tcp:101:bash.0 00000100:00100000:2.0:1763333172.555911:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2987 00010000:00010000:3.0:1763333172.555916:0:28650:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1763333172.555916:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff82067050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:2420:x1848987613632384:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333172.555932:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333172.555937:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5540c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696924a expref: 24 pid: 8407 timeout: 1376 lvb_type: 0 00010000:00010000:3.0:1763333172.555940:0:28650:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c555d3 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369692e4 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333172.555964:0:28650:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x225:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333172.555982:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333172.555985:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333172.555994:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c555d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692e4 expref: 17 pid: 28650 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333172.556037:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2988 00000100:00100000:0.0:1763333172.556048:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2420:x1848987613632512:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333172.556058:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333172.556063:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5541a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x223:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969258 expref: 17 pid: 8407 timeout: 1376 lvb_type: 0 00010000:00010000:0.0:1763333172.556073:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5541a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x223:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969258 expref: 17 pid: 8407 timeout: 1376 lvb_type: 0 00010000:00010000:0.0:1763333172.556096:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5541a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x223:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969258 expref: 17 pid: 8407 timeout: 1376 lvb_type: 0 00010000:00010000:0.0:1763333172.556110:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333172.556112:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333172.556118:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c555be lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.556126:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c555be lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.556146:0:28650:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c555d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692e4 expref: 16 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.556157:0:28650:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96000, rc 0) 00000100:00100000:3.0:1763333172.556223:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:55917:x1848987613632640:12345-192.168.204.28@tcp:101:bash.0 Request processed in 325us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333172.556235:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6365 00010000:00010000:1.0:1763333172.556305:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333172.556327:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2420:x1848987613632512:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 282us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333172.556335:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2988 00010000:00010000:3.0:1763333172.556412:0:8407:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c555be lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.556421:0:8407:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c555be lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.556431:0:8407:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c555be lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.556440:0:8407:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c555be lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.556444:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5540c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696924a expref: 24 pid: 8407 timeout: 1376 lvb_type: 0 00010000:00010000:2.0:1763333172.556461:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5540c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x223:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696924a expref: 24 pid: 8407 timeout: 1376 lvb_type: 0 00010000:00010000:3.0:1763333172.556464:0:8407:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763333172.556476:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333172.556477:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333172.556480:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe44d75200/0xb32e3ef184c555b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.556486:0:6506:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe44d75200/0xb32e3ef184c555b7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.556504:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333172.556536:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff82067050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2420:x1848987613632384:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 618us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333172.556543:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2987 00010000:00010000:2.0:1763333172.556599:0:8404:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe44d75200/0xb32e3ef184c555b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.556607:0:8404:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe44d75200/0xb32e3ef184c555b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.556614:0:8404:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe44d75200/0xb32e3ef184c555b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.556621:0:8404:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe44d75200/0xb32e3ef184c555b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.556632:0:8404:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1763333172.556725:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+17:3652:x1848987627239040:12345-0@lo:6:osp-syn-1-1.0 Request processed in 10892us (12354us total) trans 17179871509 rc 0/0 00000100:00100000:3.0:1763333172.556732:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6359 00010000:00010000:0.0:1763333172.557214:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1763333172.557223:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c555be lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.557231:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf200 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333172.557235:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c555be lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.557244:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c555be lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.557256:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c555be lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1763333172.557260:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff75664700/2, rc 0, transno 17179871509 00010000:00010000:0.0:1763333172.557263:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c555be lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333172.557266:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff75664700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627239040:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1763333172.557282:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333172.557286:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe44d75200/0xb32e3ef184c555b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.557292:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe44d75200 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333172.557295:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe44d75200/0xb32e3ef184c555b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.557302:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe44d75200/0xb32e3ef184c555b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.557316:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe44d75200/0xb32e3ef184c555b7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.557325:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe44d75200/0xb32e3ef184c555b7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.557343:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333172.557344:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333172.557371:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333172.557377:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763333172.559100:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe438a9180/2, rc 0, transno 21474838813 00000100:00100000:3.0:1763333172.559114:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe438a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627238912:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763333172.559257:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+49:3652:x1848987627238912:12345-0@lo:6:osp-syn-0-1.0 Request processed in 14117us (15004us total) trans 21474838813 rc 0/0 00000100:00100000:2.0:1763333172.559273:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6357 00000100:00100000:1.0:1763333172.561934:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.562249:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613632768 00000100:00100000:2.0:1763333172.564198:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613632768 00000100:00100000:2.0:1763333172.564298:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6366 00000100:00100000:2.0:1763333172.564310:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:55917:x1848987613632768:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333172.564329:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333172.564379:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c555da lrc: 2/0,0 mode: --/PW res: [0x280000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369692eb expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763333172.564411:0:8404:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x225:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763333172.564440:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333172.564442:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333172.564454:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c555da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692eb expref: 24 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.564474:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c555da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692eb expref: 24 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.564490:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4000, rc 0) 00000100:00100000:2.0:1763333172.564584:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:55917:x1848987613632768:12345-192.168.204.28@tcp:101:bash.0 Request processed in 277us (2660us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333172.564594:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6366 00000100:00100000:1.0:1763333172.567035:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.567253:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613633024 00000100:00100000:2.0:1763333172.567264:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613633024 00000100:00100000:0.0:1763333172.568124:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9105 00000100:00100000:1.0:1763333172.568214:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56837:x1848987613633024:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333172.568291:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333172.568316:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c555e1 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369692f2 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.568661:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c555e8 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333172.568677:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c555e8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.568690:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c555e8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.568704:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c555ef lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333172.568711:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c555ef lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.568717:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c555ef lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.568843:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c555f6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333172.568853:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c555f6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.568865:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c555f6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:1.0:1763333172.568875:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1a3:0x0]: returning size 2 00010000:00010000:1.0:1763333172.568980:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c555e8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.568987:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c555e8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.568993:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c555e8 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.568999:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c555e8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.569006:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333172.569010:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c555e8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.569017:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c555e8 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.569029:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44cd0500) 00010000:00010000:1.0:1763333172.569032:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333172.569036:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c555e8 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.569042:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c555e8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.569056:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c555ef lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.569066:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c555ef lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.569071:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c555ef lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.569075:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fc00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333172.569078:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c555ef lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.569083:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c555ef lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.569090:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe44cd0c00) 00010000:00010000:1.0:1763333172.569092:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333172.569095:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c555ef lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.569100:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c555ef lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.569141:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c555e1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692f2 expref: 228 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.569157:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c555f6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692f2 expref: 227 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.569163:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a3:0x0].0x0 (ffff92fe48355900) 00010000:00010000:1.0:1763333172.569165:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333172.569167:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7fe00, rc 0) 00000100:00100000:1.0:1763333172.569244:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56837:x1848987613633024:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1108us (2218us total) trans 4294972141 rc 0/0 00000100:00100000:1.0:1763333172.569254:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9105 00000100:00100000:3.0:1763333172.569739:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.569851:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613633152 00000100:00100000:0.0:1763333172.569861:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613633152 00002000:00010000:0.0:1763333172.569900:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/549 (0->18446744073709551615) 00002000:00100000:0.0:1763333172.569905:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4960ad80 with x1848987613633152 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333172.569916:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe4960ad80. 00000100:00100000:3.0:1763333172.569934:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.570300:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613633280 00000100:00100000:0.0:1763333172.570306:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613633280 00002000:00010000:0.0:1763333172.570324:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/549 (0->18446744073709551615) 00002000:00100000:0.0:1763333172.570327:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4960a300 with x1848987613633280 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333172.570334:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe4960a300. 00000100:00100000:0.0:1763333172.570378:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1579 00000100:00100000:3.0:1763333172.570386:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1580 00000100:00100000:0.0:1763333172.570387:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4960ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2420:x1848987613633152:12345-192.168.204.28@tcp:10:bash.0 00000100:00100000:3.0:1763333172.570393:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4960a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:2420:x1848987613633280:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:3.0:1763333172.570563:0:28427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x225:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333172.570563:0:24027:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x225:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333172.570567:0:28427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x225:0x0] updating lvb mtime from disk: 0 -> 1763333172 00002000:00010000:0.0:1763333172.570567:0:24027:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x225:0x0] updating lvb mtime from disk: 0 -> 1763333172 00002000:00010000:3.0:1763333172.570570:0:28427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x225:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333172.570570:0:24027:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x225:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333172.570573:0:28427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x225:0x0] updating lvb ctime from disk: 0 -> 1763333172 00002000:00010000:0.0:1763333172.570573:0:24027:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x225:0x0] updating lvb ctime from disk: 0 -> 1763333172 00002000:00010000:3.0:1763333172.570576:0:28427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x225:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1763333172.570576:0:24027:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x225:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333172.570823:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4960ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2420:x1848987613633152:12345-192.168.204.28@tcp:10:bash.0 Request processed in 436us (1085us total) trans 17179871510 rc 0/0 00000100:00100000:0.0:1763333172.570831:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1579 00002000:00010000:0.0:1763333172.570834:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/549 (0->18446744073709551615) 00002000:00100000:0.0:1763333172.570838:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4960ad80 with x1848987613633152 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333172.570843:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe4960ad80. 00000100:00100000:3.0:1763333172.570971:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4960a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:2420:x1848987613633280:12345-192.168.204.28@tcp:10:bash.0 Request processed in 578us (1036us total) trans 21474838814 rc 0/0 00000100:00100000:3.0:1763333172.570978:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1580 00002000:00010000:3.0:1763333172.570981:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/549 (0->18446744073709551615) 00002000:00100000:3.0:1763333172.570984:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4960a300 with x1848987613633280 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333172.570989:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe4960a300. 00000100:00100000:3.0:1763333172.572887:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.572988:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613633536 00000100:00100000:2.0:1763333172.572997:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613633536 00000100:00100000:2.0:1763333172.573056:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3116 00000100:00100000:2.0:1763333172.573068:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4960b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56837:x1848987613633536:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333172.573300:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4960b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56837:x1848987613633536:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 233us (419us total) trans 4294972142 rc 0/0 00000100:00100000:2.0:1763333172.573308:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3116 00000100:00100000:1.0:1763333172.578243:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333172.578689:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.578852:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613633792 00000100:00100000:2.0:1763333172.578867:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613633792 00000100:00100000:2.0:1763333172.578928:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3117 00000100:00100000:2.0:1763333172.578938:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:55917:x1848987613633792:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:2.0:1763333172.579251:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:55917:x1848987613633792:12345-192.168.204.28@tcp:35:bash.0 Request processed in 314us (1016us total) trans 4294972143 rc 0/0 00000100:00100000:2.0:1763333172.579260:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3117 00000100:00100000:0.0:1763333172.580107:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613634048 00000100:00100000:0.0:1763333172.580117:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613634048 00000100:00100000:0.0:1763333172.580172:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9106 00000100:00100000:0.0:1763333172.580181:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56837:x1848987613634048:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333172.580202:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333172.580224:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c55604 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369692f9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.580312:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c5560b lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333172.580325:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c555f6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692f2 expref: 230 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.580335:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c5560b lrc: 4/0,1 mode: --/CW res: [0x240000404:0x1a3:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333172.580405:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c555f6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692f2 expref: 230 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.580420:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c555f6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692f2 expref: 230 pid: 8606 timeout: 1376 lvb_type: 0 00000100:00100000:0.0:1763333172.580433:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7403b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627240192:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333172.580501:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff499ad9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763333172.591910:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333172.592165:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613634304 00000100:00100000:3.0:1763333172.592179:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613634304 00000100:00100000:3.0:1763333172.592248:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9107 00000100:00100000:3.0:1763333172.592259:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56838:x1848987613634304:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:3.0:1763333172.592326:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1763333172.592396:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c555b0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1a3:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692dd expref: 231 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.592419:0:8606:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c555f6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692f2 expref: 230 pid: 8606 timeout: 1376 lvb_type: 0 00010000:00010000:3.0:1763333172.592434:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55578 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692cf expref: 230 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.592449:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a3:0x0].0x0 (ffff92fe48355900) 00010000:00010000:3.0:1763333172.592454:0:8606:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c5560b lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1a3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.592463:0:8606:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c5560b lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1a3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.592470:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c5560b lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x1a3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.592492:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333172.592530:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55612 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333172.592540:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55612 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.592547:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55612 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.592559:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c55619 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333172.592565:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c55619 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.592570:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c55619 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.592654:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55620 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333172.592661:0:8606:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c5560b lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1a3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.592668:0:8606:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55620 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.592680:0:8606:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c5560b lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x1a3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.592689:0:8606:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55620 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333172.592793:0:6519:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.204.28@tcp) returned -22 from blocking AST (req@00000000128a6c32 x1848987627240192) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c555f6 lrc: 1/0,0 mode: --/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692f2 expref: 229 pid: 8606 timeout: 1376 lvb_type: 0 00010000:00010000:0.0:1763333172.592813:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c555f6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692f2 expref: 229 pid: 8606 timeout: 1376 lvb_type: 0 00000100:00100000:0.0:1763333172.592824:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7403b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627240192:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333172.592844:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a3:0x0].0x0 (ffff92fe48355900) 00010000:00010000:0.0:1763333172.592847:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55620 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333172.592853:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55620 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333172.592860:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c5560b lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1a3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333172.592867:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c5560b lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1a3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333172.592872:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c5560b lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1a3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6519 initiator: MDT1 00000004:00200000:0.0:1763333172.592887:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1a3:0x0]: returning size 5 00010000:00010000:0.0:1763333172.593014:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c55604 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1a3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692f9 expref: 230 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.593032:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c5560b lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1a3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692f9 expref: 229 pid: 6519 timeout: 1376 lvb_type: 0 00010000:00010000:0.0:1763333172.593040:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c5560b lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1a3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692f9 expref: 229 pid: 6519 timeout: 1376 lvb_type: 0 00010000:00010000:0.0:1763333172.593050:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdf600, rc 0) 00000100:00100000:0.0:1763333172.593115:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56837:x1848987613634048:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 12935us (14426us total) trans 4294972144 rc 0/0 00000100:00100000:0.0:1763333172.593124:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9106 00000100:00100000:3.0:1763333172.598266:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333172.598318:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.598641:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613634560 00000100:00100000:2.0:1763333172.598656:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613634560 00010000:00010000:2.0:1763333172.598705:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c5560b lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1a3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692f9 expref: 229 pid: 6519 timeout: 1376 lvb_type: 0 00000100:00100000:2.0:1763333172.598760:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2989 00000100:00100000:2.0:1763333172.598772:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:2418:x1848987613634560:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333172.598791:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333172.598798:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c5560b lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1a3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692f9 expref: 229 pid: 6519 timeout: 1376 lvb_type: 0 00010000:00010000:2.0:1763333172.598813:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c5560b lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1a3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692f9 expref: 229 pid: 6519 timeout: 1376 lvb_type: 0 00010000:00010000:2.0:1763333172.598837:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c5560b lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1a3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692f9 expref: 229 pid: 6519 timeout: 1376 lvb_type: 0 00010000:00010000:2.0:1763333172.598854:0:8423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a3:0x0].0x0 (ffff92fe48355900) 00010000:00010000:2.0:1763333172.598860:0:8423:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55620 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.598869:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55620 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.598876:0:8423:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55620 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.598905:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333172.598977:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:2418:x1848987613634560:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 208us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333172.598985:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2989 00010000:00010000:2.0:1763333172.599016:0:8606:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55620 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.599024:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55620 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00080000:2.0:1763333172.599328:0:8606:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x1a3:0x0] is inserted into orphan list, open count = 1 00010000:00010000:2.0:1763333172.599454:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55620 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.599462:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55620 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.599470:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55620 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.599476:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333172.599480:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55620 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.599488:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55620 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.599498:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a3:0x0].0x0 (ffff92fe48355900) 00010000:00010000:2.0:1763333172.599501:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763333172.599505:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55620 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.599511:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55620 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000100:00100000:1.0:1763333172.599604:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613634432 00000100:00100000:1.0:1763333172.599610:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613634432 00000100:00100000:1.0:1763333172.599644:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9108 00000100:00100000:1.0:1763333172.599652:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4960aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56837:x1848987613634432:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333172.599670:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333172.599688:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c5562e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969300 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.599757:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55635 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333172.599767:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55635 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333172.599776:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55635 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:1.0:1763333172.599800:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1a3:0x0]: returning size 5 00000004:00200000:1.0:1763333172.599804:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763333172.599819:0:6521:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55635 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333172.599841:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c5562e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969300 expref: 231 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.599856:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55635 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969300 expref: 230 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.599869:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a3:0x0].0x0 (ffff92fe48355900) 00010000:00010000:1.0:1763333172.599872:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1763333172.599874:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7fc00, rc 0) 00000100:00100000:1.0:1763333172.599919:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4960aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56837:x1848987613634432:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 267us (1664us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333172.599926:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9108 00010000:00010000:2.0:1763333172.601717:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55612 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.601733:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55612 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.601740:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55612 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.601747:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55612 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.601753:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333172.601757:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55612 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.601764:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55612 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.601780:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff80045000) 00010000:00010000:2.0:1763333172.601783:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333172.601789:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55612 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.601795:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55612 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000004:00010000:2.0:1763333172.601811:0:8606:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000064713d96 reply state 00000000f62c06e0 transno 4294972145 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c55619 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.601823:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c55619 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.601830:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045300) 00010000:00010000:2.0:1763333172.601832:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333172.601835:0:8606:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763333172.601958:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56838:x1848987613634304:12345-192.168.204.28@tcp:36:rm.0 Request processed in 9696us (10052us total) trans 4294972145 rc 0/0 00000100:00100000:2.0:1763333172.601967:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9107 00000100:00100000:1.0:1763333172.609816:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.609870:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613634816 00000100:00100000:2.0:1763333172.609882:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613634816 00000100:00100000:2.0:1763333172.609952:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9109 00000100:00100000:2.0:1763333172.609963:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56837:x1848987613634816:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333172.609984:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333172.610004:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5563c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969307 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.610108:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55643 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333172.610123:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55643 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a3:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.610134:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55643 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a3:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:2.0:1763333172.610147:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1a3:0x0]: returning size 5 00010000:00010000:2.0:1763333172.610269:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5563c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1a3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969307 expref: 233 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.610287:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55643 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1a3:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969307 expref: 232 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.610295:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a3:0x0].0x0 (ffff92fe48355900) 00010000:00010000:2.0:1763333172.610298:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763333172.610302:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5e00, rc 0) 00000100:00100000:2.0:1763333172.610411:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56837:x1848987613634816:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 448us (607us total) trans 4294972146 rc 0/0 00000100:00100000:2.0:1763333172.610417:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9109 00000100:00100000:2.0:1763333172.620461:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333172.620557:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613634944 00000100:00100000:3.0:1763333172.620569:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613634944 00000100:00100000:3.0:1763333172.622398:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9110 00000100:00100000:3.0:1763333172.622425:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56839:x1848987613634944:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333172.622459:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333172.622487:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c55651 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696930e expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.622577:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55658 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333172.622593:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55658 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.622606:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55658 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.622618:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5565f lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333172.622631:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5565f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.622637:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5565f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.622683:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55658 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.622690:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55658 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.622697:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55658 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.622704:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55658 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.622710:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333172.622716:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55658 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.622723:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55658 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.622738:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff80045900) 00010000:00010000:3.0:1763333172.622741:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333172.622745:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55658 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.622752:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55658 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.622766:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5565f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.622773:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5565f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.622779:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5565f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.622784:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333172.622787:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5565f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.622793:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5565f lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.622800:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045300) 00010000:00010000:3.0:1763333172.622803:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333172.622805:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5565f lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.622810:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5565f lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.622845:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c55651 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696930e expref: 233 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.622857:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff80045900) 00010000:00010000:3.0:1763333172.622860:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333172.622863:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c55651 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696930e expref: 233 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.622876:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a97200, rc 0) 00000100:00100000:3.0:1763333172.625152:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56839:x1848987613634944:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 2731us (4694us total) trans 0 rc 301/301 00000100:00100000:3.0:1763333172.625165:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9110 00000100:00100000:0.0:1763333172.625422:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333172.625764:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613635072 00000100:00100000:3.0:1763333172.625773:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613635072 00000100:00100000:3.0:1763333172.625814:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6367 00000100:00100000:3.0:1763333172.625823:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7403b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2420:x1848987613635072:12345-192.168.204.28@tcp:1:lfs.0 00010000:00010000:3.0:1763333172.625867:0:8407:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55666 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.625885:0:8407:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c555d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692e4 expref: 16 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.625893:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333172.625895:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333172.625899:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55666 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.625936:0:8407:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c555d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692e4 expref: 16 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.625961:0:8407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c555d3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692e4 expref: 16 pid: 28650 timeout: 1376 lvb_type: 0 00000100:00100000:3.0:1763333172.625977:0:8407:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77b16a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8407:1848987627240320:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333172.626052:0:8407:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7df5de40 going to sleep for 11 seconds 00000100:00100000:1.0:1763333172.630701:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333172.630748:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333172.631025:0:8407:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77b16a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8407:1848987627240320:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333172.631052:0:8407:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55666 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333172.631080:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613635328 00000100:00100000:3.0:1763333172.631085:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613635328 00000100:00100000:3.0:1763333172.631139:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9111 00000100:00100000:3.0:1763333172.631146:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56839:x1848987613635328:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333172.631167:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333172.631195:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c5566d lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969315 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.631260:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55674 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333172.631273:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55674 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.631282:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55674 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.631290:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c5567b lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333172.631297:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c5567b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.631302:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c5567b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.631336:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55674 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.631342:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55674 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.631371:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55674 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.631377:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55674 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.631382:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe44d75a00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333172.631386:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55674 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.631393:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55674 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.631403:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff80045f00) 00010000:00010000:3.0:1763333172.631406:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333172.631409:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55674 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.631415:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55674 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.631427:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c5567b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.631432:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c5567b lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.631438:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c5567b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.631443:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe44d75400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333172.631445:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c5567b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.631454:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c5567b lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.631461:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045300) 00010000:00010000:3.0:1763333172.631463:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333172.631466:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c5567b lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.631471:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c5567b lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.631497:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c5566d lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969315 expref: 233 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.631506:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff80045f00) 00010000:00010000:3.0:1763333172.631509:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333172.631512:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c5566d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969315 expref: 233 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.631536:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe44d75200, rc 0) 00000100:00100000:3.0:1763333172.631592:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56839:x1848987613635328:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 444us (842us total) trans 0 rc 301/301 00000100:00100000:3.0:1763333172.631600:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9111 00000100:00100000:2.0:1763333172.631760:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613635200 00000100:00100000:2.0:1763333172.631765:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613635200 00002000:00100000:2.0:1763333172.631799:0:28427:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x2c0000400:0x225:0x0] (0->4) req@ffff92ff77c6f800 x1848987613635200/t0(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:483/0 lens 496/0 e 0 to 0 dl 1763333183 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763333172.631809:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff77c6f800 with x1848987613635200 ext(0->4) 00010000:00010000:2.0:1763333172.631816:0:28427:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c555d3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692e4 expref: 17 pid: 28650 timeout: 1376 lvb_type: 0 00010000:00010000:2.0:1763333172.631829:0:28427:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c555d3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692e4 expref: 17 pid: 28650 timeout: 1376 lvb_type: 0 00002000:00010000:2.0:1763333172.631837:0:28427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92ff77c6f800 00000100:00100000:2.0:1763333172.631867:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 102 00000100:00100000:2.0:1763333172.631875:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2421:x1848987613635200:12345-192.168.204.28@tcp:4:bash.0 00000100:00100000:2.0:1763333172.633935:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2421:x1848987613635200:12345-192.168.204.28@tcp:4:bash.0 Request processed in 2048us (3234us total) trans 17179871511 rc 0/0 00000100:00100000:2.0:1763333172.637608:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 102 00002000:00100000:2.0:1763333172.637632:0:28427:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x2c0000400:0x225:0x0] (0->4) req@ffff92ff77c6f800 x1848987613635200/t17179871511(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:483/0 lens 496/448 e 0 to 0 dl 1763333183 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763333172.637645:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff77c6f800 with x1848987613635200 ext(0->4) 00010000:00010000:2.0:1763333172.637658:0:28427:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c555d3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692e4 expref: 19 pid: 28650 timeout: 1376 lvb_type: 0 00010000:00010000:2.0:1763333172.637680:0:28427:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c555d3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692e4 expref: 19 pid: 28650 timeout: 1376 lvb_type: 0 00002000:00010000:2.0:1763333172.637688:0:28427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92ff77c6f800 00000100:00100000:1.0:1763333172.638932:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.639098:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613635456 00000100:00100000:2.0:1763333172.639106:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613635456 00000100:00100000:2.0:1763333172.639160:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9112 00000100:00100000:2.0:1763333172.639170:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56839:x1848987613635456:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333172.639195:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333172.639228:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55682 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696931c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.639316:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55689 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333172.639332:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55689 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.639363:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55689 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:2.0:1763333172.639424:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1763333172.639432:0:6519:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1763333172.639479:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55682 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696931c expref: 234 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.639501:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55689 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696931c expref: 233 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.639511:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b90b00) 00010000:00010000:2.0:1763333172.639515:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1763333172.639527:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5c00, rc 0) 00000100:00100000:2.0:1763333172.639592:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56839:x1848987613635456:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 423us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333172.639599:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9112 00000100:00100000:3.0:1763333172.642881:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333172.642995:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613635584 00000100:00100000:1.0:1763333172.643007:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613635584 00000100:00100000:1.0:1763333172.643067:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9113 00000100:00100000:1.0:1763333172.643078:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56839:x1848987613635584:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333172.643098:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333172.643120:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55690 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969323 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.643199:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55697 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333172.643215:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55697 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.643228:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55697 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.643240:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5569e lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333172.643247:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5569e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.643253:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5569e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.643295:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55697 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.643302:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55697 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.643309:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55697 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.643315:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55697 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.643322:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333172.643326:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55697 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.643334:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55697 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.643381:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b90b00) 00010000:00010000:1.0:1763333172.643385:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333172.643392:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55697 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.643399:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55697 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.643413:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5569e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.643420:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5569e lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.643426:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5569e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.643431:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333172.643434:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5569e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.643440:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5569e lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.643446:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045300) 00010000:00010000:1.0:1763333172.643449:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333172.643453:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5569e lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.643458:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5569e lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.643486:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55690 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969323 expref: 234 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.643495:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b90b00) 00010000:00010000:1.0:1763333172.643497:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333172.643501:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55690 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969323 expref: 234 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.643510:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e600, rc 0) 00000100:00100000:1.0:1763333172.643599:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56839:x1848987613635584:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 522us (730us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333172.643608:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9113 00000100:00100000:2.0:1763333172.645156:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333172.645233:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613635712 00000100:00100000:1.0:1763333172.645242:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613635712 00010000:00010000:1.0:1763333172.645283:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c555d3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692e4 expref: 19 pid: 28650 timeout: 1376 lvb_type: 0 00000100:00100000:1.0:1763333172.645323:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2990 00000100:00100000:1.0:1763333172.645333:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2418:x1848987613635712:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333172.645377:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1763333172.645402:0:6504:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x225:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:1.0:1763333172.645405:0:6504:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x225:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1763333172.645410:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c555d3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692e4 expref: 19 pid: 28650 timeout: 1376 lvb_type: 0 00010000:00010000:1.0:1763333172.645424:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c555d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692e4 expref: 19 pid: 28650 timeout: 1376 lvb_type: 0 00010000:00010000:1.0:1763333172.645449:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c555d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692e4 expref: 19 pid: 28650 timeout: 1376 lvb_type: 0 00010000:00010000:1.0:1763333172.645467:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333172.645470:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333172.645475:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55666 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.645486:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55666 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.645529:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333172.645580:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2418:x1848987613635712:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 248us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333172.645588:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2990 00010000:00010000:3.0:1763333172.645663:0:8407:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55666 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.645673:0:8407:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55666 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.645700:0:8407:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55666 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.645708:0:8407:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55666 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.645716:0:8407:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55666 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.645723:0:8407:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333172.645727:0:8407:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55666 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.645735:0:8407:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55666 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.645747:0:8407:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55666 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.645756:0:8407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55666 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333172.645803:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7403b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2420:x1848987613635072:12345-192.168.204.28@tcp:1:lfs.0 Request processed in 19981us (20381us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333172.645812:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6367 00000100:00100000:3.0:1763333172.648545:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.648637:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613635968 00000100:00100000:2.0:1763333172.648649:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613635968 00000100:00100000:2.0:1763333172.648713:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9114 00000100:00100000:2.0:1763333172.648724:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56839:x1848987613635968:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333172.648755:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333172.648759:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763333172.648787:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55689 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696931c expref: 233 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.648807:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b90b00) 00010000:00010000:2.0:1763333172.648818:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333172.648836:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c556a5 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696932a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.649146:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c556ac lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333172.649160:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c556ac lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.649170:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c556ac lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.649180:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c556b3 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333172.649187:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c556b3 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.649194:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c556b3 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.650172:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c556ba lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1a4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333172.650184:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c556ba lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.650193:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c556ba lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:2.0:1763333172.650204:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1a4:0x0]: returning size 0 00010000:00010000:2.0:1763333172.650231:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c556ac lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.650238:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c556ac lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.650245:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c556ac lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.650252:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c556ac lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.650258:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333172.650262:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c556ac lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.650270:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c556ac lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.650281:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b90c00) 00010000:00010000:2.0:1763333172.650284:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333172.650288:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c556ac lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.650294:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c556ac lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:2.0:1763333172.650308:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002ad5685a reply state 00000000e5728152 transno 4294972147 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c556b3 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.650319:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c556b3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.650325:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045300) 00010000:00010000:2.0:1763333172.650327:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333172.650330:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763333172.650400:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c556a5 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696932a expref: 235 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.650425:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c556ba lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696932a expref: 234 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.650433:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a4:0x0].0x0 (ffff92fe43b90d00) 00010000:00010000:2.0:1763333172.650435:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333172.650438:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4600, rc 0) 00000100:00100000:2.0:1763333172.650523:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:56839:x1848987613635968:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1794us (1980us total) trans 4294972147 rc 0/0 00000100:00100000:2.0:1763333172.650533:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9114 00000100:00100000:3.0:1763333172.653233:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333172.653899:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333172.654332:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613636224 00000100:00100000:1.0:1763333172.654344:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613636224 00000100:00100000:2.0:1763333172.654427:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613636480 00000100:00100000:2.0:1763333172.654431:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613636480 00000100:00100000:2.0:1763333172.654492:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9115 00000100:00100000:2.0:1763333172.654503:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:56839:x1848987613636480:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333172.654538:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333172.654560:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c556c8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1a4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969331 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.654694:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c556cf lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333172.654710:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c556ba lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696932a expref: 236 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.654720:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c556cf lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1a4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.654756:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c556ba lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696932a expref: 236 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.654770:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c556ba lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696932a expref: 236 pid: 6519 timeout: 1376 lvb_type: 0 00000100:00100000:2.0:1763333172.654785:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe438a8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627240448:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333172.654864:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4869d480 going to sleep for 11 seconds 00000100:00100000:1.0:1763333172.655872:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9116 00000100:00100000:1.0:1763333172.655882:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56837:x1848987613636224:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:1.0:1763333172.655916:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333172.655939:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55635 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969300 expref: 237 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.655957:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a3:0x0].0x0 (ffff92fe48355900) 00010000:00010000:1.0:1763333172.655962:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333172.655983:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c556d6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333172.655993:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c556d6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.656001:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c556d6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000040:00080000:1.0:1763333172.656218:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1359, 88 off115016 00000004:00080000:1.0:1763333172.656226:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1276735876716ns, next at 1277223362238ns, rc = 0 00000040:00080000:1.0:1763333172.656253:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1360, 88 off115016 00000004:00080000:1.0:1763333172.656257:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1276735908394ns, next at 1276878902000ns, rc = 0 00000040:00080000:1.0:1763333172.656274:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1361, 88 off115104 00000004:00080000:1.0:1763333172.656279:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1276735930129ns, next at 1276878902000ns, rc = 0 00000040:00080000:1.0:1763333172.656288:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1360, 88 off115104 00000004:00080000:1.0:1763333172.656291:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1276735941864ns, next at 1277223362238ns, rc = 0 00000100:00100000:3.0:1763333172.659539:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.659716:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613636608 00000100:00100000:0.0:1763333172.659727:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613636608 00010000:00010000:0.0:1763333172.659768:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c556ba lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696932a expref: 238 pid: 6519 timeout: 1376 lvb_type: 0 00000100:00100000:0.0:1763333172.659802:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2991 00000100:00100000:0.0:1763333172.659811:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:2420:x1848987613636608:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333172.659827:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333172.659834:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c556ba lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696932a expref: 238 pid: 6519 timeout: 1376 lvb_type: 0 00010000:00010000:0.0:1763333172.659850:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c556ba lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696932a expref: 238 pid: 6519 timeout: 1376 lvb_type: 0 00010000:00010000:0.0:1763333172.659875:0:8423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a4:0x0].0x0 (ffff92fe43b90d00) 00010000:00010000:0.0:1763333172.659881:0:8423:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c556cf lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333172.659890:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c556cf lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333172.659896:0:8423:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c556cf lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1a4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333172.659916:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333172.659979:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:2420:x1848987613636608:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 168us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333172.659988:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2991 00010000:00010000:2.0:1763333172.660630:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c556ba lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696932a expref: 237 pid: 6519 timeout: 1376 lvb_type: 0 00000100:00100000:2.0:1763333172.660649:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe438a8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627240448:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333172.660671:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c556cf lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.660680:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c556cf lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.660685:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c556cf lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:2.0:1763333172.660710:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1a4:0x0]: returning size 0 00000004:00080000:2.0:1763333172.660899:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x227:0x0], index 0: 0 00000004:00080000:2.0:1763333172.660907:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x227:0x0], index 1: 0 00000004:00080000:2.0:1763333172.660912:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x228:0x0], index 1: 0 00000004:00080000:2.0:1763333172.660916:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x228:0x0], index 0: 0 00010000:00010000:2.0:1763333172.661023:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c556cf lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.661031:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c556cf lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1a4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.661041:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c556cf lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1a4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.661046:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333172.661051:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c556cf lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1a4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.661058:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c556cf lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1a4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.661070:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a4:0x0].0x0 (ffff92fe43b90d00) 00010000:00010000:2.0:1763333172.661072:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333172.661077:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c556cf lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1a4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.661083:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c556cf lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1a4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.661129:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c556c8 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1a4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969331 expref: 237 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.661139:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a4:0x0].0x0 (ffff92fe43b90d00) 00010000:00010000:2.0:1763333172.661142:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763333172.661145:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c556c8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1a4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969331 expref: 237 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.661160:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4a00, rc 0) 00000100:00100000:2.0:1763333172.661214:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56839:x1848987613636480:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 6713us (7316us total) trans 4294972149 rc 301/301 00000100:00100000:2.0:1763333172.661222:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9115 00000001:00080000:0.0:1763333172.662005:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972148 is committed 00000004:00080000:0.0:1763333172.662013:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 888 committed 00000004:00080000:0.0:1763333172.662030:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 891 committed 00000004:00080000:0.0:1763333172.662044:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 890 committed 00000004:00080000:0.0:1763333172.662046:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 887 committed 00000004:00010000:0.0:1763333172.662107:0:8606:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007130d243 reply state 0000000017b2df64 transno 4294972148 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c556d6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333172.662126:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c556d6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333172.662135:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a3:0x0].0x0 (ffff92fe48355900) 00010000:00010000:0.0:1763333172.662138:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1763333172.662141:0:8606:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1763333172.662205:0:8606:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1763333172.662217:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56837:x1848987613636224:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 6336us (8993us total) trans 4294972148 rc 0/0 00000100:00100000:0.0:1763333172.662225:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9116 00010000:00010000:0.0:1763333172.662247:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c556d6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333172.662254:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c556d6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333172.662259:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c556d6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333172.662268:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7ec00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333172.662271:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c556d6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333172.662278:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c556d6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333172.662287:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a3:0x0].0x0 (ffff92fe48355900) 00010000:00010000:0.0:1763333172.662290:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333172.662293:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c556d6 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333172.662299:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c556d6 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000100:00100000:3.0:1763333172.662862:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77b14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627240704:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333172.662912:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333172.662942:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763333172.662948:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627240576:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333172.662969:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333172.662996:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627240704 00000100:00100000:3.0:1763333172.663002:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627240704 00000100:00100000:3.0:1763333172.663037:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627240576 00000100:00100000:3.0:1763333172.663040:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627240576 00000100:00100000:3.0:1763333172.663060:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6368 00000100:00100000:3.0:1763333172.663068:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+18:3653:x1848987627240704:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1763333172.663204:0:8407:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x226:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333172.663208:0:8407:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x226:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763333172.663210:0:8407:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x226:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333172.663213:0:8407:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x226:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763333172.663215:0:8407:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x226:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333172.663249:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+19:3653:x1848987627240704:12345-0@lo:2:osp-syn-1-1.0 Request processed in 181us (336us total) trans 17179871512 rc 0/0 00000100:00100000:3.0:1763333172.663256:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6368 00000100:00100000:3.0:1763333172.663271:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6369 00000100:00100000:3.0:1763333172.663278:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+18:3653:x1848987627240576:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333172.663342:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+19:3653:x1848987627240576:12345-0@lo:2:osp-syn-1-1.0 Request processed in 65us (372us total) trans 17179871513 rc 0/0 00000100:00100000:3.0:1763333172.663379:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6369 00000004:00080000:3.0:1763333172.663426:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff77b17480/2, rc 0, transno 17179871513 00000100:00100000:3.0:1763333172.663432:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627240576:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763333172.663442:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff77b14700/2, rc 0, transno 17179871512 00000100:00100000:3.0:1763333172.663445:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77b14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627240704:0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1763333172.663839:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c55619 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.663849:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c55619 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.663856:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c55619 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.663861:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333172.663865:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c55619 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.663871:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c55619 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.663886:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045300) 00010000:00010000:2.0:1763333172.663890:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333172.663893:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c55619 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.663899:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c55619 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.663911:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c556b3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.663917:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c556b3 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.663922:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c556b3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.663926:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333172.663930:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c556b3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.663935:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c556b3 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.663941:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045300) 00010000:00010000:2.0:1763333172.663943:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333172.663945:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c556b3 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.663950:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c556b3 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000100:00100000:2.0:1763333172.663976:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff50065f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627240960:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333172.664011:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333172.664822:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1763333172.664830:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77c6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627240832:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333172.664857:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333172.665527:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627240960 00000100:00100000:1.0:1763333172.665535:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627240960 00000100:00100000:1.0:1763333172.665580:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627240832 00000100:00100000:1.0:1763333172.665583:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627240832 00000100:00100000:1.0:1763333172.665607:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6370 00000100:00100000:1.0:1763333172.665616:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+50:3655:x1848987627240960:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1763333172.665771:0:28650:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x226:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333172.665775:0:28650:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x226:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763333172.665777:0:28650:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x226:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333172.665779:0:28650:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x226:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763333172.665782:0:28650:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x226:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333172.665830:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+51:3655:x1848987627240960:12345-0@lo:2:osp-syn-0-1.0 Request processed in 214us (1817us total) trans 21474838815 rc 0/0 00000100:00100000:1.0:1763333172.665839:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6370 00000100:00100000:1.0:1763333172.665858:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6371 00000100:00100000:1.0:1763333172.665864:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+50:3655:x1848987627240832:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1763333172.665915:0:28650:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x225:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333172.665918:0:28650:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x225:0x0] updating lvb mtime from disk: 1763333172 -> 1763333172 00002000:00010000:1.0:1763333172.665920:0:28650:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x225:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333172.665922:0:28650:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x225:0x0] updating lvb ctime from disk: 1763333172 -> 1763333172 00002000:00010000:1.0:1763333172.665924:0:28650:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x225:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333172.665948:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+51:3655:x1848987627240832:12345-0@lo:2:osp-syn-0-1.0 Request processed in 84us (1090us total) trans 21474838816 rc 0/0 00000100:00100000:1.0:1763333172.665955:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6371 00000004:00080000:2.0:1763333172.666199:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff77c6d180/2, rc 0, transno 21474838816 00000100:00100000:2.0:1763333172.666206:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77c6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627240832:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1763333172.666216:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff50065f80/2, rc 0, transno 21474838815 00000100:00100000:2.0:1763333172.666219:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff50065f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627240960:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333172.669007:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.669612:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613636736 00000100:00100000:0.0:1763333172.669624:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613636736 00000100:00100000:0.0:1763333172.670471:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9117 00000100:00100000:0.0:1763333172.670484:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+225:56837:x1848987613636736:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333172.670509:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333172.670541:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c556e4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969338 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.670597:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c556e4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969338 expref: 226 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.670611:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c556e4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969338 expref: 226 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.670628:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a3:0x0].0x0 (ffff92fe48355900) 00010000:00010000:0.0:1763333172.670631:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333172.670635:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdfe00, rc 0) 00000100:00100000:0.0:1763333172.670688:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56837:x1848987613636736:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 207us (1691us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333172.670694:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9117 00000100:00100000:1.0:1763333172.670776:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333172.670806:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613636992 00000100:00100000:1.0:1763333172.670811:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613636992 00000100:00100000:1.0:1763333172.670850:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3118 00000100:00100000:1.0:1763333172.670858:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50065c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56839:x1848987613636992:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1763333172.671114:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50065c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56839:x1848987613636992:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 256us (337us total) trans 4294972150 rc 0/0 00000100:00100000:1.0:1763333172.671122:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3118 00000100:00100000:3.0:1763333172.673507:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.673615:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613637248 00000100:00100000:2.0:1763333172.673627:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613637248 00000100:00100000:2.0:1763333172.674454:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3119 00000100:00100000:2.0:1763333172.674470:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56839:x1848987613637248:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333172.675871:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56839:x1848987613637248:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 1396us (2364us total) trans 4294972151 rc 0/0 00000100:00100000:2.0:1763333172.675886:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3119 00000100:00100000:1.0:1763333172.677607:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.677789:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613637376 00000100:00100000:0.0:1763333172.677801:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613637376 00000100:00100000:0.0:1763333172.677866:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9118 00000100:00100000:0.0:1763333172.677876:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50065500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56837:x1848987613637376:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333172.677900:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333172.677921:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c556eb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696933f expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.677999:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c556f2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333172.678014:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c556f2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333172.678025:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c556f2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:0.0:1763333172.678068:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1a3:0x0]: returning size 5 00000004:00200000:0.0:1763333172.678073:0:8606:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763333172.678091:0:8606:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c556f2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333172.678118:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c556eb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696933f expref: 230 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.678139:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c556f2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696933f expref: 229 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.678150:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a3:0x0].0x0 (ffff92fe48355900) 00010000:00010000:0.0:1763333172.678155:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1763333172.678159:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdf200, rc 0) 00000100:00100000:0.0:1763333172.678236:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50065500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56837:x1848987613637376:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 361us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333172.678244:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9118 00000100:00100000:0.0:1763333172.682394:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.682748:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613637632 00000100:00100000:2.0:1763333172.682759:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613637632 00000100:00100000:2.0:1763333172.682829:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9119 00000100:00100000:2.0:1763333172.682839:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7403b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:55917:x1848987613637632:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333172.682870:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333172.682896:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c556f9 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969346 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.683047:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55700 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333172.683062:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55700 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.683073:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55700 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.683084:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55707 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333172.683089:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55707 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.683095:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55707 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.683152:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5570e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1a4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333172.683159:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5570e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.683167:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5570e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:2.0:1763333172.683178:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1a4:0x0]: returning size 0 00010000:00010000:2.0:1763333172.683272:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55700 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.683280:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55700 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.683287:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55700 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.683293:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55700 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.683299:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4a00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333172.683304:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55700 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.683311:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55700 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.683323:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b90d00) 00010000:00010000:2.0:1763333172.683326:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333172.683331:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55700 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.683337:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55700 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.683382:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55707 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.683393:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55707 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.683398:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55707 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.683404:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333172.683407:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55707 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.683412:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55707 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.683420:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b90c00) 00010000:00010000:2.0:1763333172.683423:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333172.683426:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55707 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.683431:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55707 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.683474:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c556f9 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969346 expref: 232 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.683490:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5570e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969346 expref: 231 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.683497:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a4:0x0].0x0 (ffff92fe43b90b00) 00010000:00010000:2.0:1763333172.683499:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333172.683502:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4600, rc 0) 00000100:00100000:2.0:1763333172.683568:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7403b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:55917:x1848987613637632:12345-192.168.204.28@tcp:101:bash.0 Request processed in 730us (1190us total) trans 4294972152 rc 0/0 00000100:00100000:2.0:1763333172.683576:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9119 00000100:00100000:3.0:1763333172.686301:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333172.686342:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333172.686583:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613637760 00000100:00100000:1.0:1763333172.686594:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613637760 00000100:00100000:1.0:1763333172.686653:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6372 00000100:00100000:1.0:1763333172.686662:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2420:x1848987613637760:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333172.686680:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333172.686701:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5571c lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696934d expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333172.686723:0:8404:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x225:0x0] initial LVB size: 5, mtime: 0x691a5434, atime: 0x0, ctime: 0x691a5434, blocks: 0x8 00010000:00010000:1.0:1763333172.686739:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333172.686741:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333172.686750:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5571c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696934d expref: 18 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333172.686764:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5571c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696934d expref: 18 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333172.686777:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e000, rc 0) 00000100:00100000:1.0:1763333172.686830:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2420:x1848987613637760:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 170us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333172.686837:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6372 00000100:00100000:0.0:1763333172.687825:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613637888 00000100:00100000:0.0:1763333172.687834:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613637888 00000100:00100000:1.0:1763333172.688915:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9120 00000100:00100000:1.0:1763333172.688927:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:55917:x1848987613637888:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333172.688954:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333172.688985:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55723 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1a4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969354 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.689028:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c5572a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1a4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333172.689045:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c5572a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.689057:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c5572a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.689192:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55723 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1a4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969354 expref: 233 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.689210:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c5572a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969354 expref: 232 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.689221:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a4:0x0].0x0 (ffff92fe43b90b00) 00010000:00010000:1.0:1763333172.689224:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763333172.689228:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f800, rc 0) 00000100:00100000:1.0:1763333172.689304:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:55917:x1848987613637888:12345-192.168.204.28@tcp:101:bash.0 Request processed in 379us (2961us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333172.689315:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9120 00000100:00100000:1.0:1763333172.708595:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.708687:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613638144 00000100:00100000:2.0:1763333172.708703:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613638144 00000100:00100000:2.0:1763333172.708784:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9121 00000100:00100000:2.0:1763333172.708796:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:55917:x1848987613638144:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:2.0:1763333172.708873:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333172.708903:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5570e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969346 expref: 232 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.708924:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a4:0x0].0x0 (ffff92fe43b90b00) 00010000:00010000:2.0:1763333172.708929:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333172.709162:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55731 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1a4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333172.709177:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55731 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.709187:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55731 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000001:00080000:2.0:1763333172.709243:0:6519:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294972153 00000004:00010000:2.0:1763333172.709268:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f4009ce6 reply state 0000000014afb358 transno 4294972154 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55731 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.709280:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55731 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.709286:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a4:0x0].0x0 (ffff92fe43b90b00) 00010000:00010000:2.0:1763333172.709289:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333172.709291:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763333172.709427:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:55917:x1848987613638144:12345-192.168.204.28@tcp:36:bash.0 Request processed in 633us (860us total) trans 4294972154 rc 0/0 00000100:00100000:2.0:1763333172.709434:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9121 00000020:00080000:2.0:1763333172.709439:0:6519:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763333172.711440:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.711573:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613638272 00000100:00100000:2.0:1763333172.711584:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613638272 00000100:00100000:2.0:1763333172.711635:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9122 00000100:00100000:2.0:1763333172.711644:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74038700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:55917:x1848987613638272:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333172.711666:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333172.711685:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55738 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1a4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696935b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.711736:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55738 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696935b expref: 235 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.711749:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55738 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696935b expref: 235 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.711764:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a4:0x0].0x0 (ffff92fe43b90b00) 00010000:00010000:2.0:1763333172.711767:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333172.711770:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4800, rc 0) 00000100:00100000:2.0:1763333172.711820:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74038700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:55917:x1848987613638272:12345-192.168.204.28@tcp:101:bash.0 Request processed in 176us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333172.711827:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9122 00000100:00100000:3.0:1763333172.713964:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.714068:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613638528 00000100:00100000:0.0:1763333172.714077:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613638528 00000100:00100000:0.0:1763333172.714128:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9123 00000100:00100000:0.0:1763333172.714137:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:55917:x1848987613638528:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333172.714154:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333172.714157:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763333172.714182:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55738 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1a4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696935b expref: 235 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.714202:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a4:0x0].0x0 (ffff92fe43b90b00) 00010000:00010000:0.0:1763333172.714210:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333172.714224:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c5573f lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1a4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969362 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.714271:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c55746 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333172.714287:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c55746 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a4:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333172.714296:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c55746 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a4:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000040:00080000:0.0:1763333172.714596:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1362, 88 off115192 00000004:00080000:0.0:1763333172.714605:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1276794256256ns, next at 1276878902000ns, rc = 0 00000040:00080000:0.0:1763333172.714637:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1361, 88 off115192 00000004:00080000:0.0:1763333172.714641:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1276794292246ns, next at 1277223362238ns, rc = 0 00000040:00080000:0.0:1763333172.714657:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1362, 88 off115280 00000004:00080000:0.0:1763333172.714661:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1276794311846ns, next at 1277223362238ns, rc = 0 00000040:00080000:0.0:1763333172.714669:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1363, 88 off115280 00000004:00080000:0.0:1763333172.714671:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1276794322396ns, next at 1276878902000ns, rc = 0 00000001:00080000:0.0:1763333172.716721:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972155 is committed 00000004:00080000:0.0:1763333172.716735:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 893 committed 00000004:00080000:0.0:1763333172.716750:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 890 committed 00010000:00010000:2.0:1763333172.716820:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55731 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.716833:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55731 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.716845:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55731 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.716851:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333172.716856:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55731 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.716864:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55731 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.716882:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a4:0x0].0x0 (ffff92fe43b90b00) 00010000:00010000:2.0:1763333172.716885:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333172.716890:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55731 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.716897:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55731 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000100:00100000:2.0:1763333172.717169:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff50066a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627241088:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333172.717242:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333172.717289:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1763333172.717296:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff50064e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627241216:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333172.717320:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333172.717373:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627241088 00000100:00100000:2.0:1763333172.717381:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627241088 00000100:00100000:2.0:1763333172.717425:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627241216 00000100:00100000:2.0:1763333172.717428:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627241216 00000100:00100000:2.0:1763333172.717452:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6373 00000100:00100000:2.0:1763333172.717461:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+52:3652:x1848987627241088:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333172.717660:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+53:3652:x1848987627241088:12345-0@lo:2:osp-syn-0-1.0 Request processed in 200us (418us total) trans 21474838817 rc 0/0 00000100:00100000:2.0:1763333172.717668:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6373 00000100:00100000:2.0:1763333172.717689:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6374 00000100:00100000:2.0:1763333172.717696:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+52:3652:x1848987627241216:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333172.717772:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+53:3652:x1848987627241216:12345-0@lo:2:osp-syn-0-1.0 Request processed in 77us (451us total) trans 21474838818 rc 0/0 00000100:00100000:2.0:1763333172.717778:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6374 00000004:00080000:2.0:1763333172.717831:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff50064e00/2, rc 0, transno 21474838818 00000100:00100000:2.0:1763333172.717836:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff50064e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627241216:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1763333172.717847:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff50066a00/2, rc 0, transno 21474838817 00000100:00100000:2.0:1763333172.717851:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff50066a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627241088:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1763333172.718102:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 889 committed 00000100:00100000:3.0:1763333172.718301:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff50067b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627241344:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333172.718337:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333172.718385:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763333172.718391:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff50064700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627241472:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333172.718413:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333172.718442:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627241344 00000100:00100000:3.0:1763333172.718447:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627241344 00000100:00100000:3.0:1763333172.718475:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627241472 00000100:00100000:3.0:1763333172.718478:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627241472 00000100:00100000:3.0:1763333172.718495:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6375 00000100:00100000:3.0:1763333172.718501:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+20:3654:x1848987627241344:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333172.718623:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+21:3654:x1848987627241344:12345-0@lo:2:osp-syn-1-1.0 Request processed in 122us (285us total) trans 17179871514 rc 0/0 00000100:00100000:3.0:1763333172.718631:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6375 00000100:00100000:3.0:1763333172.718647:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6376 00000100:00100000:3.0:1763333172.718654:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+20:3654:x1848987627241472:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333172.718723:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+21:3654:x1848987627241472:12345-0@lo:2:osp-syn-1-1.0 Request processed in 70us (308us total) trans 17179871515 rc 0/0 00000100:00100000:3.0:1763333172.718730:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6376 00000004:00080000:3.0:1763333172.718762:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff50064700/2, rc 0, transno 17179871515 00000100:00100000:3.0:1763333172.718767:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff50064700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627241472:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763333172.718776:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff50067b80/2, rc 0, transno 17179871514 00000100:00100000:3.0:1763333172.718779:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff50067b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627241344:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1763333172.718945:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 892 committed 00010000:00010000:3.0:1763333172.719222:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c55746 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969362 expref: 229 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.719235:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a4:0x0].0x0 (ffff92fe43b90b00) 00010000:00010000:3.0:1763333172.719239:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763333172.719258:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c5573f lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1a4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969362 expref: 229 pid: 6521 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1763333172.719276:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c55746 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a4:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969362 expref: 228 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.719308:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a4:0x0].0x0 (ffff92fe43b90b00) 00010000:00010000:3.0:1763333172.719310:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763333172.719312:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abde400, rc 0) 00000100:00100000:3.0:1763333172.719400:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:55917:x1848987613638528:12345-192.168.204.28@tcp:101:bash.0 Request processed in 5263us (5456us total) trans 4294972155 rc 0/0 00000100:00100000:3.0:1763333172.719408:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9123 00000100:00100000:2.0:1763333172.722683:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333172.722772:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613638656 00000100:00100000:1.0:1763333172.722786:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613638656 00000100:00100000:1.0:1763333172.722849:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6377 00000100:00100000:1.0:1763333172.722858:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:55917:x1848987613638656:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333172.722881:0:8407:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333172.722912:0:8407:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5574d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969369 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333172.722941:0:8407:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x227:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333172.722985:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333172.722988:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333172.723001:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5574d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969369 expref: 26 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.723017:0:8407:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5574d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969369 expref: 26 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.723040:0:8407:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f200, rc 0) 00000100:00100000:1.0:1763333172.723098:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+26:55917:x1848987613638656:12345-192.168.204.28@tcp:101:bash.0 Request processed in 240us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333172.723105:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6377 00000100:00100000:0.0:1763333172.725288:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.725714:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613638784 00000100:00100000:2.0:1763333172.725724:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613638784 00000100:00100000:2.0:1763333172.725790:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6378 00000100:00100000:2.0:1763333172.725800:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7403ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:55917:x1848987613638784:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333172.725818:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333172.725843:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55754 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969370 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763333172.725867:0:8404:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x227:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763333172.725890:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333172.725892:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333172.725900:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55754 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969370 expref: 19 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.725915:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55754 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969370 expref: 19 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.725928:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4c00, rc 0) 00000100:00100000:2.0:1763333172.725995:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7403ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:55917:x1848987613638784:12345-192.168.204.28@tcp:101:bash.0 Request processed in 196us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333172.726003:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6378 00000100:00100000:1.0:1763333172.728407:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333172.728440:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333172.728524:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613638912 00000100:00100000:3.0:1763333172.728534:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613638912 00002000:00010000:3.0:1763333172.728575:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/551 (0->18446744073709551615) 00002000:00100000:3.0:1763333172.728580:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff50064380 with x1848987613638912 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333172.728595:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff50064380. 00000100:00100000:3.0:1763333172.728627:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613639040 00000100:00100000:3.0:1763333172.728631:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613639040 00002000:00010000:3.0:1763333172.728645:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/551 (0->18446744073709551615) 00002000:00100000:3.0:1763333172.728648:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff50066d80 with x1848987613639040 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333172.728655:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff50066d80. 00000100:00100000:3.0:1763333172.728683:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1581 00000100:00100000:3.0:1763333172.728693:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50064380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+26:2421:x1848987613638912:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:3.0:1763333172.728904:0:24027:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x227:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333172.728908:0:24027:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x227:0x0] updating lvb mtime from disk: 0 -> 1763333173 00002000:00010000:3.0:1763333172.728911:0:24027:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x227:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333172.728914:0:24027:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x227:0x0] updating lvb ctime from disk: 0 -> 1763333173 00002000:00010000:3.0:1763333172.728916:0:24027:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x227:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333172.728991:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50064380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+27:2421:x1848987613638912:12345-192.168.204.28@tcp:10:bash.0 Request processed in 298us (591us total) trans 21474838819 rc 0/0 00000100:00100000:3.0:1763333172.729000:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1581 00002000:00010000:3.0:1763333172.729004:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/551 (0->18446744073709551615) 00002000:00100000:3.0:1763333172.729006:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff50064380 with x1848987613638912 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333172.729011:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff50064380. 00000100:00100000:3.0:1763333172.729029:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1582 00000100:00100000:3.0:1763333172.729036:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50066d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2421:x1848987613639040:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:3.0:1763333172.729126:0:24027:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x227:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333172.729129:0:24027:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x227:0x0] updating lvb mtime from disk: 0 -> 1763333173 00002000:00010000:3.0:1763333172.729131:0:24027:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x227:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333172.729134:0:24027:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x227:0x0] updating lvb ctime from disk: 0 -> 1763333173 00002000:00010000:3.0:1763333172.729137:0:24027:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x227:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333172.729160:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50066d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2421:x1848987613639040:12345-192.168.204.28@tcp:10:bash.0 Request processed in 123us (718us total) trans 17179871516 rc 0/0 00000100:00100000:3.0:1763333172.729167:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1582 00002000:00010000:3.0:1763333172.729170:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/551 (0->18446744073709551615) 00002000:00100000:3.0:1763333172.729172:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff50066d80 with x1848987613639040 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333172.729176:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff50066d80. 00000100:00100000:2.0:1763333172.732925:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.733048:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613639296 00000100:00100000:0.0:1763333172.733058:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613639296 00000100:00100000:0.0:1763333172.733111:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3120 00000100:00100000:0.0:1763333172.733121:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:55917:x1848987613639296:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:0.0:1763333172.733638:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:55917:x1848987613639296:12345-192.168.204.28@tcp:35:bash.0 Request processed in 517us (719us total) trans 4294972156 rc 0/0 00000100:00100000:0.0:1763333172.733647:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3120 00000100:00100000:0.0:1763333172.740168:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333172.740267:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613639424 00000100:00100000:3.0:1763333172.740279:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613639424 00000100:00100000:3.0:1763333172.740343:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9124 00000100:00100000:3.0:1763333172.740384:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56840:x1848987613639424:12345-192.168.204.28@tcp:101:rm.0 00010000:00010000:3.0:1763333172.740410:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333172.740433:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c5575b lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969377 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.740507:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c55762 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333172.740531:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c55762 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.740542:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c55762 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.740555:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c55769 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333172.740561:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c55769 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.740567:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c55769 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.740640:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55770 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1a4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333172.740649:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55770 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.740656:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55770 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:3.0:1763333172.740697:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1a4:0x0]: returning size 5 00000004:00200000:3.0:1763333172.740701:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763333172.740720:0:6521:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55770 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.740731:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55770 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.740739:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c55762 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.740746:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c55762 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.740751:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c55762 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.740758:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c55762 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.740764:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46e43c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333172.740768:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c55762 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.740775:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c55762 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.740786:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff80045800) 00010000:00010000:3.0:1763333172.740789:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333172.740795:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c55762 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.740801:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c55762 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.740815:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c55769 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.740820:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c55769 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.740824:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c55769 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.740828:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe44d75200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333172.740831:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c55769 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.740835:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c55769 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.740841:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045f00) 00010000:00010000:3.0:1763333172.740843:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333172.740845:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c55769 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.740849:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c55769 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.740879:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c5575b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969377 expref: 231 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.740897:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55770 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969377 expref: 230 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.740904:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a4:0x0].0x0 (ffff92fe43b90b00) 00010000:00010000:3.0:1763333172.740906:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333172.740909:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe44d75400, rc 0) 00000100:00100000:3.0:1763333172.740974:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56840:x1848987613639424:12345-192.168.204.28@tcp:101:rm.0 Request processed in 591us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333172.740981:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9124 00000100:00100000:1.0:1763333172.744452:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.744576:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613639680 00000100:00100000:2.0:1763333172.744589:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613639680 00000100:00100000:2.0:1763333172.744648:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9125 00000100:00100000:2.0:1763333172.744659:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56840:x1848987613639680:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:2.0:1763333172.744716:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1763333172.744742:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c55746 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1a4:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969362 expref: 230 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.744764:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55770 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969377 expref: 229 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.744778:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c5572a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1a4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969354 expref: 228 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.744788:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a4:0x0].0x0 (ffff92fe43b90b00) 00010000:00010000:2.0:1763333172.744799:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333172.744828:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55777 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333172.744841:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55777 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.744854:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55777 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.744868:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5577e lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333172.744874:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5577e lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.744881:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5577e lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.744991:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55785 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333172.745000:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55785 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.745008:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55785 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000040:00080000:2.0:1763333172.745260:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1364, 64 off115344 00000040:00080000:2.0:1763333172.745286:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1363, 64 off115344 00000040:00080000:2.0:1763333172.745294:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1364, 64 off115408 00000040:00080000:2.0:1763333172.745302:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1365, 64 off115408 00010000:00010000:2.0:1763333172.745406:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5578c lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1a4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333172.745416:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5578c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.745423:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5578c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.745435:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5578c lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1a4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.745441:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5578c lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1a4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.745446:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5578c lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1a4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.745466:0:8606:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763333172.745483:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55785 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.745488:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55785 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1a4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.745494:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55785 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1a4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.745499:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333172.745502:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55785 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1a4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.745509:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55785 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1a4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.745524:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a4:0x0].0x0 (ffff92fe43a31800) 00010000:00010000:2.0:1763333172.745526:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763333172.745530:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55785 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1a4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.745535:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55785 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1a4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.745647:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55777 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.745653:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55777 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.745659:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55777 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.745665:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55777 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.745669:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333172.745672:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55777 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.745677:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55777 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.745684:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b90600) 00010000:00010000:2.0:1763333172.745686:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333172.745688:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55777 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.745693:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55777 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000004:00010000:2.0:1763333172.745704:0:8606:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000064b5a205 reply state 000000008e97c1fe transno 4294972157 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5577e lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.745714:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5577e lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.745719:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b90500) 00010000:00010000:2.0:1763333172.745722:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333172.745725:0:8606:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763333172.745809:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56840:x1848987613639680:12345-192.168.204.28@tcp:36:rm.0 Request processed in 1149us (1363us total) trans 4294972157 rc 0/0 00000100:00100000:2.0:1763333172.745817:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9125 00010000:00010000:1.0:1763333172.746085:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333172.746093:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5578c lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1a4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.746100:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333172.746103:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5578c lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1a4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.746110:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5578c lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1a4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.746120:0:8422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a4:0x0].0x0 (ffff92fe43a31800) 00010000:00010000:1.0:1763333172.746123:0:8422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1763333172.746126:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5578c lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1a4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.746132:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5578c lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1a4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.746146:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333172.746148:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333172.746150:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763333172.762546:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333172.762657:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613639808 00000100:00100000:1.0:1763333172.762669:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613639808 00000100:00100000:1.0:1763333172.763022:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6379 00000100:00100000:1.0:1763333172.763036:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2418:x1848987613639808:12345-192.168.204.28@tcp:23:lfs.0 00000100:00100000:1.0:1763333172.763764:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2418:x1848987613639808:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 729us (1226us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333172.763775:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6379 00000100:00100000:0.0:1763333172.779143:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333172.779450:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613639936 00000100:00100000:3.0:1763333172.779461:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613639936 00000100:00100000:2.0:1763333172.780202:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9126 00000100:00100000:2.0:1763333172.780219:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74038a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56841:x1848987613639936:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333172.780245:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333172.780269:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55793 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696937e expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.780337:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5579a lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333172.780384:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5579a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.780395:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5579a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.780405:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c557a1 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333172.780411:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c557a1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.780417:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c557a1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.780455:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5579a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.780465:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5579a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.780471:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5579a lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.780477:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5579a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.780482:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333172.780486:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5579a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.780491:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5579a lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.780500:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31900) 00010000:00010000:2.0:1763333172.780503:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333172.780506:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5579a lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.780512:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5579a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.780531:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c557a1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.780537:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c557a1 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.780542:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c557a1 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.780546:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4a00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333172.780549:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c557a1 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.780554:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c557a1 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.780560:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b90500) 00010000:00010000:2.0:1763333172.780562:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333172.780564:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c557a1 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.780569:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c557a1 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.780593:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55793 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696937e expref: 230 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.780601:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31900) 00010000:00010000:2.0:1763333172.780603:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333172.780606:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55793 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696937e expref: 230 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.780617:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4400, rc 0) 00000100:00100000:2.0:1763333172.780679:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74038a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56841:x1848987613639936:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 466us (1547us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333172.780687:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9126 00000100:00100000:2.0:1763333172.783223:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333172.783864:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613640064 00000100:00100000:1.0:1763333172.783877:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613640064 00000100:00100000:1.0:1763333172.783941:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6380 00000100:00100000:1.0:1763333172.783960:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2421:x1848987613640064:12345-192.168.204.28@tcp:23:lfs.0 00000100:00100000:1.0:1763333172.784106:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2421:x1848987613640064:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 156us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333172.784113:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6380 00000100:00100000:0.0:1763333172.788490:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333172.788587:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613640192 00000100:00100000:3.0:1763333172.788597:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613640192 00000100:00100000:3.0:1763333172.788652:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9127 00000100:00100000:3.0:1763333172.788660:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7403a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56841:x1848987613640192:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333172.788678:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333172.788699:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c557a8 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969385 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.788761:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c557af lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333172.788773:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c557af lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.788783:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c557af lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.788792:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c557b6 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333172.788799:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c557b6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.788804:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c557b6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.788839:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c557af lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.788845:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c557af lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.788850:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c557af lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.788857:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c557af lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.788862:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe44d75a00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333172.788866:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c557af lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.788872:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c557af lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.788882:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff80045800) 00010000:00010000:3.0:1763333172.788884:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333172.788888:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c557af lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.788893:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c557af lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.788904:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c557b6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.788910:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c557b6 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.788915:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c557b6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.788919:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe44d75400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333172.788921:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c557b6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.788926:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c557b6 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.788931:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b90500) 00010000:00010000:3.0:1763333172.788933:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333172.788935:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c557b6 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.788939:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c557b6 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.788959:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c557a8 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969385 expref: 230 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.788968:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff80045800) 00010000:00010000:3.0:1763333172.788970:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333172.788973:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c557a8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969385 expref: 230 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.788983:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe44d75200, rc 0) 00000100:00100000:3.0:1763333172.789045:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7403a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56841:x1848987613640192:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 385us (565us total) trans 0 rc 301/301 00000100:00100000:3.0:1763333172.789053:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9127 00000100:00100000:2.0:1763333172.791086:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333172.791304:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613640320 00000100:00100000:3.0:1763333172.791314:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613640320 00000100:00100000:3.0:1763333172.791984:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1583 00000100:00100000:3.0:1763333172.791997:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2418:x1848987613640320:12345-192.168.204.28@tcp:3:lfs.0 00010000:00010000:3.0:1763333172.792042:0:28427:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c557bd lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.792056:0:28427:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333172.792058:0:28427:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333172.792064:0:28427:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c557bd lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.792075:0:28427:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c557bd lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.792179:0:28427:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c557bd lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.792188:0:28427:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c557bd lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.792195:0:28427:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c557bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.792201:0:28427:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46e42600 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333172.792205:0:28427:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c557bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.792217:0:28427:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c557bd lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.792232:0:28427:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c557bd lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.792239:0:28427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe46e42600/0xb32e3ef184c557bd lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333172.792309:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2418:x1848987613640320:12345-192.168.204.28@tcp:3:lfs.0 Request processed in 315us (1232us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1763333172.792315:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1583 00000100:00100000:1.0:1763333172.796958:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333172.796998:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333172.797164:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613640448 00000100:00100000:3.0:1763333172.797175:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613640448 00000100:00100000:3.0:1763333172.797237:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613640576 00000100:00100000:3.0:1763333172.797240:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613640576 00000100:00100000:3.0:1763333172.797270:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9128 00000100:00100000:3.0:1763333172.797279:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56837:x1848987613640448:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333172.797304:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333172.797331:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c557c4 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696938c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.797392:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c557cb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333172.797408:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c557cb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.797420:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c557cb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.797552:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46e43c00/0xb32e3ef184c557c4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696938c expref: 232 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.797569:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75200/0xb32e3ef184c557cb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696938c expref: 231 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.797577:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a3:0x0].0x0 (ffff92fe48355900) 00010000:00010000:3.0:1763333172.797580:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763333172.797584:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe44d75200, rc 0) 00000100:00100000:3.0:1763333172.797634:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56837:x1848987613640448:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 356us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333172.797640:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9128 00000100:00100000:3.0:1763333172.797657:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9129 00000100:00100000:3.0:1763333172.797662:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56841:x1848987613640576:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333172.797668:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333172.797678:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c557d2 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969393 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.797703:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c557d9 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333172.797711:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c557d9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333172.797717:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c557d9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:3.0:1763333172.797745:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1763333172.797750:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1763333172.797770:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c557d2 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969393 expref: 232 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.797780:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c557d9 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969393 expref: 231 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.797786:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff80045800) 00010000:00010000:3.0:1763333172.797788:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1763333172.797790:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe44d75a00, rc 0) 00000100:00100000:3.0:1763333172.797811:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56841:x1848987613640576:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 150us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333172.797816:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9129 00000100:00100000:1.0:1763333172.802220:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.802403:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613640704 00000100:00100000:2.0:1763333172.802413:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613640704 00000100:00100000:2.0:1763333172.802477:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9130 00000100:00100000:2.0:1763333172.802488:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56841:x1848987613640704:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333172.802511:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333172.802543:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c557e0 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696939a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.802615:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c557e7 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333172.802629:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c557e7 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.802639:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c557e7 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.802649:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c557ee lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333172.802656:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c557ee lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.802663:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c557ee lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.802704:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c557e7 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.802711:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c557e7 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.802717:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c557e7 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.802723:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c557e7 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.802734:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4a00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333172.802738:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c557e7 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.802745:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c557e7 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.802756:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff80045800) 00010000:00010000:2.0:1763333172.802759:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333172.802764:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c557e7 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.802769:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c557e7 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.802784:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c557ee lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.802790:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c557ee lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.802795:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c557ee lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.802799:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333172.802802:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c557ee lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.802807:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c557ee lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.802814:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b90500) 00010000:00010000:2.0:1763333172.802817:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333172.802820:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c557ee lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.802825:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c557ee lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.802852:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c557e0 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696939a expref: 232 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.802861:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff80045800) 00010000:00010000:2.0:1763333172.802863:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333172.802866:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c557e0 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696939a expref: 232 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.802874:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4400, rc 0) 00000100:00100000:2.0:1763333172.802938:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56841:x1848987613640704:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 452us (729us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333172.802946:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9130 00000100:00100000:0.0:1763333172.809455:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.809497:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333172.809591:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613640832 00000100:00100000:3.0:1763333172.809602:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613640832 00000100:00100000:2.0:1763333172.809637:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613641088 00000100:00100000:2.0:1763333172.809644:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613641088 00000100:00100000:3.0:1763333172.809673:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1584 00000100:00100000:3.0:1763333172.809685:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74038e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+27:2421:x1848987613640832:12345-192.168.204.28@tcp:4:lfs.0 00000100:00100000:2.0:1763333172.809688:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9131 00000100:00100000:2.0:1763333172.809703:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74039c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56841:x1848987613641088:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333172.809717:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333172.809720:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763333172.809724:0:28427:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c557f5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.809746:0:28427:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c55547 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692b3 expref: 27 pid: 17605 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333172.809749:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c557d9 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969393 expref: 231 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.809763:0:28427:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333172.809767:0:28427:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333172.809772:0:28427:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c557f5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.809779:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff80045800) 00010000:00010000:2.0:1763333172.809791:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333172.809808:0:28427:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c55547 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692b3 expref: 27 pid: 17605 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333172.809808:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c557fc lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369693a1 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.809835:0:28427:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c55547 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692b3 expref: 27 pid: 17605 timeout: 1376 lvb_type: 1 00000100:00100000:3.0:1763333172.809852:0:28427:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_012:lustre-OST0000_UUID:28427:1848987627241600:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333172.809924:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55803 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00000100:00100000:3.0:1763333172.809930:0:28427:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7df5d6c0 going to sleep for 11 seconds 00010000:00010000:2.0:1763333172.809938:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55803 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333172.809950:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55803 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333172.809962:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c5580a lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333172.809970:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c5580a lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333172.809977:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c5580a lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333172.811232:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55811 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333172.811249:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55811 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333172.811259:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55811 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:2.0:1763333172.811272:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1a6:0x0]: returning size 0 00010000:00010000:2.0:1763333172.811302:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55803 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333172.811310:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55803 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333172.811317:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55803 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333172.811323:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55803 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333172.811329:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333172.811503:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55803 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333172.811521:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55803 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333172.811535:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31900) 00010000:00010000:2.0:1763333172.811538:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333172.811545:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55803 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333172.811553:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55803 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000004:00010000:2.0:1763333172.811570:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005675f843 reply state 00000000c4bc5a16 transno 4294972158 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c5580a lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333172.811584:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c5580a lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333172.811590:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b90500) 00010000:00010000:2.0:1763333172.811593:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333172.811596:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763333172.811641:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c557fc lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693a1 expref: 233 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.811663:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55811 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693a1 expref: 232 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.811749:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a6:0x0].0x0 (ffff92fe43a31f00) 00010000:00010000:2.0:1763333172.811753:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333172.811756:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff4139a000, rc 0) 00000100:00100000:2.0:1763333172.812910:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74039c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56841:x1848987613641088:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 3205us (3406us total) trans 4294972158 rc 0/0 00000100:00100000:2.0:1763333172.812923:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9131 00000100:00100000:2.0:1763333172.814538:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333172.814552:0:28427:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_012:lustre-OST0000_UUID:28427:1848987627241600:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333172.814580:0:28427:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c557f5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333172.815938:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613641216 00000100:00100000:1.0:1763333172.815951:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613641216 00010000:00010000:1.0:1763333172.815996:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c55547 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692b3 expref: 28 pid: 17605 timeout: 1376 lvb_type: 1 00000100:00100000:1.0:1763333172.816042:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2992 00000100:00100000:1.0:1763333172.816053:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+28:2420:x1848987613641216:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333172.816068:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333172.816090:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c55547 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x226:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692b3 expref: 28 pid: 17605 timeout: 1376 lvb_type: 1 00010000:00010000:1.0:1763333172.816103:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c55547 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x226:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692b3 expref: 28 pid: 17605 timeout: 1376 lvb_type: 1 00010000:00010000:1.0:1763333172.816127:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c55547 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x226:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692b3 expref: 28 pid: 17605 timeout: 1376 lvb_type: 1 00010000:00010000:1.0:1763333172.816143:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333172.816146:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333172.816150:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c557f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.816160:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c557f5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.816190:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333172.816231:0:28427:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c557f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.816240:0:28427:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c557f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333172.816247:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+27:2420:x1848987613641216:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 196us (1718us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333172.816253:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2992 00000100:00100000:2.0:1763333172.816407:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:1.0:1763333172.816525:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763333172.816537:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613641472 00000100:00100000:1.0:1763333172.816541:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613641472 00000100:00100000:1.0:1763333172.816576:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9132 00000100:00100000:1.0:1763333172.816583:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56841:x1848987613641472:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333172.816606:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333172.816624:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5581f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369693a8 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.816728:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55826 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333172.816747:0:12741:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55811 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693a1 expref: 234 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.816755:0:12741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55826 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1a6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.816789:0:12741:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55811 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693a1 expref: 234 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.816808:0:12741:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55811 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693a1 expref: 234 pid: 12741 timeout: 1376 lvb_type: 0 00000100:00100000:1.0:1763333172.816823:0:12741:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e122a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627241728:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333172.816883:0:12741:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe46e0e180 going to sleep for 11 seconds 00000001:00080000:1.0:1763333172.819861:0:24714:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838820 is committed 00000001:00080000:1.0:1763333172.819884:0:24714:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838818 is committed 00002000:00010000:2.0:1763333172.820085:0:28427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x226:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:2.0:1763333172.820090:0:28427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x226:0x0] updating lvb mtime from disk: 0 -> 1763333173 00002000:00010000:2.0:1763333172.820092:0:28427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x226:0x0] updating lvb ctime from disk: 0 -> 1763333173 00002000:00010000:2.0:1763333172.820095:0:28427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x226:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1763333172.820108:0:28427:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c557f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.820119:0:28427:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c557f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.820128:0:28427:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c557f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.820136:0:28427:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333172.820142:0:28427:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c557f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.820151:0:28427:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c557f5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.820171:0:28427:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c557f5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.820178:0:28427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c557f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333172.820394:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74038e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+11:2421:x1848987613640832:12345-192.168.204.28@tcp:4:lfs.0 Request processed in 10705us (10942us total) trans 21474838820 rc 0/0 00000100:00100000:2.0:1763333172.820404:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1584 00000100:00100000:1.0:1763333172.824436:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.824506:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613641600 00000100:00100000:0.0:1763333172.824525:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613641600 00010000:00010000:0.0:1763333172.824568:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55811 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693a1 expref: 235 pid: 12741 timeout: 1376 lvb_type: 0 00000100:00100000:0.0:1763333172.824611:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2993 00000100:00100000:0.0:1763333172.824621:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e123800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:2421:x1848987613641600:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333172.824637:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333172.824644:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55811 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693a1 expref: 235 pid: 12741 timeout: 1376 lvb_type: 0 00010000:00010000:0.0:1763333172.824658:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55811 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693a1 expref: 235 pid: 12741 timeout: 1376 lvb_type: 0 00010000:00010000:0.0:1763333172.824681:0:8423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a6:0x0].0x0 (ffff92fe43a31f00) 00010000:00010000:0.0:1763333172.824688:0:8423:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55826 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333172.824699:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55826 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333172.824707:0:8423:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55826 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1a6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333172.824726:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333172.824790:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e123800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:2421:x1848987613641600:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 171us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333172.824798:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2993 00010000:00010000:2.0:1763333172.825074:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55811 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693a1 expref: 234 pid: 12741 timeout: 1376 lvb_type: 0 00000100:00100000:2.0:1763333172.825093:0:12741:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e122a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627241728:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333172.825116:0:12741:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55826 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333172.825125:0:12741:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55826 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333172.825130:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55826 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:2.0:1763333172.825160:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1a6:0x0]: returning size 0 00000004:00080000:2.0:1763333172.825381:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x229:0x0], index 1: 0 00000004:00080000:2.0:1763333172.825390:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x229:0x0], index 0: 0 00000004:00080000:2.0:1763333172.825395:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x22a:0x0], index 0: 0 00000004:00080000:2.0:1763333172.825399:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x22a:0x0], index 1: 0 00010000:00010000:2.0:1763333172.825510:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55826 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333172.825529:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55826 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1a6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333172.825536:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55826 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1a6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333172.825542:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fc00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333172.825546:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55826 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1a6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333172.825553:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55826 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1a6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333172.825564:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a6:0x0].0x0 (ffff92fe43a31f00) 00010000:00010000:2.0:1763333172.825567:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333172.825571:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55826 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1a6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333172.825576:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55826 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1a6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333172.825631:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5581f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1a6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693a8 expref: 234 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.825639:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a6:0x0].0x0 (ffff92fe43a31f00) 00010000:00010000:2.0:1763333172.825642:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763333172.825646:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5581f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1a6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693a8 expref: 234 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.825662:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7fe00, rc 0) 00000100:00100000:2.0:1763333172.825712:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56841:x1848987613641472:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 9129us (9306us total) trans 4294972159 rc 301/301 00000100:00100000:2.0:1763333172.825718:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9132 00000100:00100000:1.0:1763333172.831428:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.831551:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613641856 00000100:00100000:0.0:1763333172.831563:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613641856 00000100:00100000:0.0:1763333172.831618:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3121 00000100:00100000:0.0:1763333172.831627:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bd5c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56841:x1848987613641856:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333172.831907:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bd5c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:56841:x1848987613641856:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 281us (488us total) trans 4294972160 rc 0/0 00000100:00100000:0.0:1763333172.831915:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3121 00000100:00100000:1.0:1763333172.839456:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.839589:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613642112 00000100:00100000:2.0:1763333172.839599:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613642112 00000100:00100000:2.0:1763333172.839663:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3122 00000100:00100000:2.0:1763333172.839673:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:56841:x1848987613642112:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333172.839911:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:56841:x1848987613642112:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 238us (463us total) trans 4294972161 rc 0/0 00000100:00100000:2.0:1763333172.839919:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3122 00000100:00100000:1.0:1763333172.840117:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.840159:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613642368 00000100:00100000:2.0:1763333172.840163:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613642368 00000100:00100000:2.0:1763333172.840190:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9133 00000100:00100000:2.0:1763333172.840197:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:56837:x1848987613642368:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:2.0:1763333172.840228:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333172.840252:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c556f2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1a3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696933f expref: 235 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.840271:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a3:0x0].0x0 (ffff92fe48355900) 00010000:00010000:2.0:1763333172.840277:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333172.840331:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55834 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333172.840390:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55834 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333172.840403:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55834 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00010000:2.0:1763333172.840489:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000de551327 reply state 000000007d59028f transno 4294972162 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55834 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333172.840503:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55834 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333172.840509:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a3:0x0].0x0 (ffff92fe48355900) 00010000:00010000:2.0:1763333172.840511:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333172.840531:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763333172.840593:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56837:x1848987613642368:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 396us (476us total) trans 4294972162 rc 0/0 00000100:00100000:2.0:1763333172.840600:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9133 00000100:00100000:1.0:1763333172.845300:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.845389:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613642496 00000100:00100000:0.0:1763333172.845400:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613642496 00000100:00100000:0.0:1763333172.845451:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6381 00000100:00100000:0.0:1763333172.845461:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1370b1d7-8612-4b90-ab37-e53288bbf9fd+11:56837:x1848987613642496:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333172.845480:0:29010:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333172.845501:0:29010:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4abde400/0xb32e3ef184c5583b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369693af expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763333172.845533:0:29010:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x226:0x0] initial LVB size: 4096, mtime: 0x691a5435, atime: 0x0, ctime: 0x691a5435, blocks: 0x8 00010000:00010000:0.0:1763333172.845556:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333172.845559:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333172.845567:0:29010:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abde400/0xb32e3ef184c5583b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693af expref: 12 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.845584:0:29010:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abde400/0xb32e3ef184c5583b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693af expref: 12 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.845603:0:29010:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abde400, rc 0) 00000100:00100000:0.0:1763333172.845662:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:56837:x1848987613642496:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 202us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333172.845669:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6381 00000100:00100000:1.0:1763333172.849939:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.850037:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613642624 00000100:00100000:0.0:1763333172.850047:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613642624 00000100:00100000:0.0:1763333172.850103:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6382 00000100:00100000:0.0:1763333172.850114:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:56837:x1848987613642624:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333172.850132:0:8407:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333172.850153:0:8407:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c55842 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369693b6 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.850188:0:8407:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5554e lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692ba expref: 21 pid: 17605 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333172.850197:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333172.850199:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333172.850204:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c55842 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693b6 expref: 21 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.850241:0:8407:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5554e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692ba expref: 21 pid: 17605 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333172.850255:0:8407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5554e lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692ba expref: 21 pid: 17605 timeout: 1376 lvb_type: 1 00000100:00100000:0.0:1763333172.850276:0:8407:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff74038000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8407:1848987627241856:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333172.850728:0:8407:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff80206c00 going to sleep for 11 seconds 00000100:00100000:2.0:1763333172.852711:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333172.852811:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613642880 00000100:00100000:1.0:1763333172.852822:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613642880 00000100:00100000:1.0:1763333172.852897:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9134 00000100:00100000:1.0:1763333172.852909:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:55917:x1848987613642880:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333172.852937:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333172.852970:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55849 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369693bd expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.853134:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55850 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333172.853150:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55850 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.853162:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55850 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.853175:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55857 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333172.853183:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55857 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.853190:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55857 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.853259:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5585e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333172.853267:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5585e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.853274:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5585e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:1.0:1763333172.853284:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1a6:0x0]: returning size 0 00010000:00010000:1.0:1763333172.853420:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55850 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.853428:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55850 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.853433:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55850 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.853439:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55850 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.853444:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333172.853448:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55850 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.853456:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55850 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.853468:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff62250000) 00010000:00010000:1.0:1763333172.853471:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333172.853476:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55850 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.853483:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55850 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.853495:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55857 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.853501:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55857 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.853507:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55857 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.853521:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fc00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333172.853525:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55857 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.853531:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55857 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.853538:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b90500) 00010000:00010000:1.0:1763333172.853540:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333172.853543:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55857 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.853549:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55857 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.853588:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55849 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693bd expref: 239 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.853606:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5585e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693bd expref: 238 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.853614:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a6:0x0].0x0 (ffff92ff62250a00) 00010000:00010000:1.0:1763333172.853616:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333172.853618:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f000, rc 0) 00000100:00100000:1.0:1763333172.853690:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:55917:x1848987613642880:12345-192.168.204.28@tcp:101:bash.0 Request processed in 783us (986us total) trans 4294972163 rc 0/0 00000100:00100000:1.0:1763333172.853698:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9134 00000100:00100000:2.0:1763333172.854160:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333172.854240:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613643008 00000100:00100000:3.0:1763333172.854247:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613643008 00010000:00010000:3.0:1763333172.854278:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5554e lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692ba expref: 22 pid: 17605 timeout: 1376 lvb_type: 1 00000100:00100000:3.0:1763333172.854318:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2994 00000100:00100000:3.0:1763333172.854327:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff454eec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2419:x1848987613643008:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333172.854339:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333172.854388:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5554e lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x226:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692ba expref: 22 pid: 17605 timeout: 1376 lvb_type: 1 00010000:00010000:3.0:1763333172.854406:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5554e lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x226:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692ba expref: 22 pid: 17605 timeout: 1376 lvb_type: 1 00010000:00010000:3.0:1763333172.854429:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333172.854431:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333172.854438:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c55842 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x226:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693b6 expref: 22 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.854449:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c55842 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x226:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693b6 expref: 22 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.854490:0:8423:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c55842 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x226:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693b6 expref: 22 pid: 8407 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333172.854503:0:8423:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8423:1848987627241984:192.168.204.28@tcp:105: 00000100:00100000:3.0:1763333172.854579:0:8423:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7df5d6c0 going to sleep for 11 seconds 00010000:00010000:0.0:1763333172.854801:0:8407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5554e lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x226:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692ba expref: 22 pid: 17605 timeout: 1376 lvb_type: 1 00000100:00100000:0.0:1763333172.854814:0:8407:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff74038000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8407:1848987627241856:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333172.854836:0:8407:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c55842 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693b6 expref: 21 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.854846:0:8407:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdee00, rc 0) 00000100:00100000:0.0:1763333172.854888:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:56837:x1848987613642624:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 4776us (4958us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333172.854895:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6382 00000100:00100000:2.0:1763333172.861881:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.861920:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.861967:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333172.861978:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613643136 00000100:00100000:1.0:1763333172.861987:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613643136 00000100:00100000:0.0:1763333172.862025:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613643264 00000100:00100000:0.0:1763333172.862029:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613643264 00002000:00010000:1.0:1763333172.862034:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/550 (5->18446744073709551615) 00002000:00100000:1.0:1763333172.862039:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7569c000 with x1848987613643136 ext(5->18446744073709551615) 00002000:00010000:0.0:1763333172.862047:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/550 (0->18446744073709551615) 00002000:00100000:0.0:1763333172.862050:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7569ea00 with x1848987613643264 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333172.862051:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7569c000. 00002000:00010000:0.0:1763333172.862056:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff7569ea00. 00000100:00100000:1.0:1763333172.862086:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1585 00000100:00100000:0.0:1763333172.862095:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1586 00000100:00100000:1.0:1763333172.862099:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:2420:x1848987613643136:12345-192.168.204.28@tcp:10:lfs.0 00000100:00100000:0.0:1763333172.862101:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2420:x1848987613643264:12345-192.168.204.28@tcp:10:lfs.0 00002000:00010000:0.0:1763333172.862254:0:28427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x226:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333172.862257:0:28427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x226:0x0] updating lvb mtime from disk: 0 -> 1763333173 00002000:00010000:0.0:1763333172.862259:0:28427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x226:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333172.862262:0:28427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x226:0x0] updating lvb ctime from disk: 0 -> 1763333173 00002000:00010000:0.0:1763333172.862265:0:28427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x226:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333172.862314:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2420:x1848987613643264:12345-192.168.204.28@tcp:10:lfs.0 Request processed in 212us (392us total) trans 17179871517 rc 0/0 00000100:00100000:0.0:1763333172.862321:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1586 00002000:00010000:0.0:1763333172.862325:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/550 (0->18446744073709551615) 00002000:00100000:0.0:1763333172.862327:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7569ea00 with x1848987613643264 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333172.862331:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff7569ea00. 00002000:00010000:1.0:1763333172.862384:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x226:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:1.0:1763333172.862387:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x226:0x0] updating lvb mtime from disk: 1763333173 -> 1763333173 00002000:00010000:1.0:1763333172.862390:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x226:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333172.862392:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x226:0x0] updating lvb ctime from disk: 1763333173 -> 1763333173 00002000:00010000:1.0:1763333172.862394:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x226:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1763333172.862418:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2420:x1848987613643136:12345-192.168.204.28@tcp:10:lfs.0 Request processed in 323us (546us total) trans 21474838821 rc 0/0 00000100:00100000:1.0:1763333172.862427:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1585 00002000:00010000:1.0:1763333172.862430:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/550 (5->18446744073709551615) 00002000:00100000:1.0:1763333172.862432:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7569c000 with x1848987613643136 ext(5->18446744073709551615) 00002000:00010000:1.0:1763333172.862436:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7569c000. 00000100:00100000:3.0:1763333172.862438:0:8423:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8423:1848987627241984:192.168.204.28@tcp:105: 00010000:00010000:3.0:1763333172.862460:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333172.862483:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff454eec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2419:x1848987613643008:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 8156us (8323us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333172.862492:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2994 00000100:00100000:2.0:1763333172.862572:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613643392 00000100:00100000:2.0:1763333172.862577:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613643392 00000100:00100000:2.0:1763333172.862617:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9135 00000100:00100000:2.0:1763333172.862625:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:55917:x1848987613643392:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333172.862641:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333172.862660:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5586c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369693c4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.862693:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55873 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333172.862710:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55873 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.862722:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55873 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.862825:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5586c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1a6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693c4 expref: 240 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.862841:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55873 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693c4 expref: 239 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.862851:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a6:0x0].0x0 (ffff92ff62250a00) 00010000:00010000:2.0:1763333172.862854:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763333172.862857:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4400, rc 0) 00000100:00100000:2.0:1763333172.862893:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:55917:x1848987613643392:12345-192.168.204.28@tcp:101:bash.0 Request processed in 269us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333172.862900:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9135 00000100:00100000:2.0:1763333172.865805:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333172.865856:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613643648 00000100:00100000:1.0:1763333172.865865:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613643648 00000100:00100000:1.0:1763333172.865930:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9136 00000100:00100000:1.0:1763333172.865940:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56837:x1848987613643648:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:1.0:1763333172.866038:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c5587a lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333172.866056:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c5587a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.866068:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c5587a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00010000:1.0:1763333172.866188:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c533b5d0 reply state 00000000bb482697 transno 4294972164 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c5587a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.866202:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c5587a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.866210:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a3:0x0].0x0 (ffff92fe48355900) 00010000:00010000:1.0:1763333172.866213:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333172.866217:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763333172.866318:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56837:x1848987613643648:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 378us (522us total) trans 4294972164 rc 0/0 00000100:00100000:1.0:1763333172.866325:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9136 00000100:00100000:3.0:1763333172.866475:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.866754:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613643904 00000100:00100000:0.0:1763333172.866760:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613643904 00000100:00100000:0.0:1763333172.866791:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9137 00000100:00100000:0.0:1763333172.866799:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:55917:x1848987613643904:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:0.0:1763333172.866827:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333172.866848:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5585e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693bd expref: 241 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.866865:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a6:0x0].0x0 (ffff92ff62250a00) 00010000:00010000:0.0:1763333172.866869:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333172.866982:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55881 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333172.866992:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55881 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333172.866999:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55881 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000001:00080000:0.0:1763333172.867031:0:12741:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294972165 00000004:00010000:0.0:1763333172.867053:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000045385c01 reply state 0000000067113ea1 transno 4294972166 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55881 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333172.867064:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55881 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333172.867070:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a6:0x0].0x0 (ffff92ff62250a00) 00010000:00010000:0.0:1763333172.867072:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333172.867075:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763333172.867129:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:55917:x1848987613643904:12345-192.168.204.28@tcp:36:bash.0 Request processed in 331us (656us total) trans 4294972166 rc 0/0 00000100:00100000:0.0:1763333172.867136:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9137 00000020:00080000:0.0:1763333172.867141:0:12741:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763333172.869122:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.869605:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613644032 00000100:00100000:0.0:1763333172.869616:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613644032 00000100:00100000:0.0:1763333172.869667:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6383 00000100:00100000:0.0:1763333172.869675:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:56837:x1848987613644032:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333172.869693:0:8407:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333172.869710:0:8407:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c55888 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369693cb expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.869740:0:8407:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5571c lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696934d expref: 22 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333172.869748:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333172.869750:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333172.869755:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c55888 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693cb expref: 22 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.869786:0:8407:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5571c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696934d expref: 22 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333172.869805:0:8407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5571c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696934d expref: 22 pid: 8404 timeout: 1376 lvb_type: 1 00000100:00100000:0.0:1763333172.869819:0:8407:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff74038000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8407:1848987627242112:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333172.869896:0:8407:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe43aa63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763333172.870893:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.871000:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613644160 00000100:00100000:2.0:1763333172.871007:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613644160 00000100:00100000:2.0:1763333172.871053:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9138 00000100:00100000:2.0:1763333172.871061:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:55917:x1848987613644160:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333172.871084:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333172.871105:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5588f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369693d2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.871157:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5588f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693d2 expref: 244 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.871172:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5588f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693d2 expref: 244 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.871188:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a6:0x0].0x0 (ffff92ff62250a00) 00010000:00010000:2.0:1763333172.871191:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333172.871194:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4a00, rc 0) 00000100:00100000:2.0:1763333172.871243:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:55917:x1848987613644160:12345-192.168.204.28@tcp:101:bash.0 Request processed in 183us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333172.871250:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9138 00000100:00100000:2.0:1763333172.876668:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.876709:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333172.876802:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613644416 00000100:00100000:3.0:1763333172.876812:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613644416 00000100:00100000:3.0:1763333172.876879:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9139 00000100:00100000:3.0:1763333172.876890:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:55917:x1848987613644416:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333172.876914:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333172.876917:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763333172.876947:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5588f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1a6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693d2 expref: 244 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.876969:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a6:0x0].0x0 (ffff92ff62250a00) 00010000:00010000:3.0:1763333172.876976:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333172.876991:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55896 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369693d9 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.877045:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c5589d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333172.877060:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c5589d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.877073:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c5589d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000040:00080000:3.0:1763333172.877309:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1365, 88 off115496 00000004:00080000:3.0:1763333172.877317:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1276956968112ns, next at 1277223362238ns, rc = 0 00000040:00080000:3.0:1763333172.877345:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1366, 88 off115496 00000004:00080000:3.0:1763333172.877402:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1276957052888ns, next at 1276878902000ns, rc = 0 00000040:00080000:3.0:1763333172.877448:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1367, 88 off115584 00000004:00080000:3.0:1763333172.877453:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1276957104012ns, next at 1276878902000ns, rc = 0 00000040:00080000:3.0:1763333172.877475:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1366, 88 off115584 00000004:00080000:3.0:1763333172.877480:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1276957131082ns, next at 1277223362238ns, rc = 0 00000100:00100000:1.0:1763333172.878445:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613644544 00000100:00100000:1.0:1763333172.878455:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613644544 00010000:00010000:1.0:1763333172.878490:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5571c lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696934d expref: 23 pid: 8404 timeout: 1376 lvb_type: 1 00000100:00100000:1.0:1763333172.878538:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2995 00000100:00100000:1.0:1763333172.878548:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2421:x1848987613644544:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333172.878560:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333172.878580:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5571c lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x225:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696934d expref: 23 pid: 8404 timeout: 1376 lvb_type: 1 00010000:00010000:1.0:1763333172.878594:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5571c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x225:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696934d expref: 23 pid: 8404 timeout: 1376 lvb_type: 1 00010000:00010000:1.0:1763333172.878616:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333172.878618:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333172.878625:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c55888 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693cb expref: 23 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.878636:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c55888 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693cb expref: 23 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.878679:0:8423:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c55888 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693cb expref: 23 pid: 8407 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333172.878693:0:8423:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e121c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8423:1848987627242240:192.168.204.28@tcp:105: 00000100:00100000:1.0:1763333172.878777:0:8423:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe46e0e3c0 going to sleep for 11 seconds 00010000:00010000:0.0:1763333172.879810:0:8407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5571c lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x225:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696934d expref: 23 pid: 8404 timeout: 1376 lvb_type: 1 00000100:00100000:0.0:1763333172.879827:0:8407:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff74038000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8407:1848987627242112:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333172.879852:0:8407:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c55888 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693cb expref: 22 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.879862:0:8407:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdf200, rc 0) 00000100:00100000:0.0:1763333172.879910:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:56837:x1848987613644032:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 10235us (10797us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333172.879919:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6383 00000001:00080000:0.0:1763333172.886652:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972167 is committed 00000004:00080000:0.0:1763333172.886671:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 892 committed 00000004:00080000:0.0:1763333172.886683:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 895 committed 00000004:00080000:0.0:1763333172.886693:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 894 committed 00000004:00080000:0.0:1763333172.886696:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 891 committed 00000100:00100000:0.0:1763333172.886851:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77c6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627242624:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333172.886922:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333172.886965:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763333172.886971:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627242752:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333172.886996:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333172.887035:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627242624 00000100:00100000:0.0:1763333172.887043:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627242624 00000100:00100000:0.0:1763333172.887087:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627242752 00000100:00100000:0.0:1763333172.887091:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627242752 00000100:00100000:0.0:1763333172.887115:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6384 00000100:00100000:0.0:1763333172.887125:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50065c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+22:3654:x1848987627242624:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333172.887322:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50065c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+23:3654:x1848987627242624:12345-0@lo:2:osp-syn-1-1.0 Request processed in 197us (398us total) trans 17179871518 rc 0/0 00000100:00100000:0.0:1763333172.887331:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6384 00000100:00100000:0.0:1763333172.887385:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6385 00000100:00100000:0.0:1763333172.887393:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+22:3654:x1848987627242752:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333172.887463:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+23:3654:x1848987627242752:12345-0@lo:2:osp-syn-1-1.0 Request processed in 71us (465us total) trans 17179871519 rc 0/0 00000100:00100000:0.0:1763333172.887469:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6385 00000004:00080000:0.0:1763333172.887533:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff77c6ea00/2, rc 0, transno 17179871519 00000100:00100000:0.0:1763333172.887540:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627242752:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1763333172.887551:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff77c6ca80/2, rc 0, transno 17179871518 00000100:00100000:0.0:1763333172.887555:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77c6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627242624:0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1763333172.887626:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c5589d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693d9 expref: 234 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.887642:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a6:0x0].0x0 (ffff92ff62250a00) 00010000:00010000:0.0:1763333172.887646:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763333172.887663:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55896 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1a6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693d9 expref: 234 pid: 8606 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1763333172.887687:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c5589d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693d9 expref: 233 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.887715:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a6:0x0].0x0 (ffff92ff62250a00) 00010000:00010000:0.0:1763333172.887718:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763333172.887721:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a97800, rc 0) 00000100:00100000:0.0:1763333172.887769:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:55917:x1848987613644416:12345-192.168.204.28@tcp:101:bash.0 Request processed in 10882us (11113us total) trans 4294972167 rc 0/0 00000100:00100000:0.0:1763333172.887778:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9139 00010000:00010000:1.0:1763333172.887881:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5577e lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.887892:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5577e lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.887900:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5577e lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.887906:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333172.887910:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5577e lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.887918:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5577e lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.887929:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b90500) 00010000:00010000:1.0:1763333172.887932:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333172.887936:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5577e lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.887942:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5577e lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.887955:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c5580a lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.887961:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c5580a lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.887967:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c5580a lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.887971:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff4139a600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333172.887975:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c5580a lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.887980:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c5580a lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.887988:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b90500) 00010000:00010000:1.0:1763333172.887991:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333172.887994:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c5580a lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.888000:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c5580a lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.888018:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55834 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.888024:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55834 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.888031:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55834 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.888035:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff4139a000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333172.888038:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55834 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.888044:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55834 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.888052:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a3:0x0].0x0 (ffff92fe48355900) 00010000:00010000:1.0:1763333172.888054:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333172.888058:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55834 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.888067:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55834 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.888077:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c5587a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.888083:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c5587a lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.888087:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c5587a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.888092:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333172.888094:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c5587a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.888099:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c5587a lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.888106:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a3:0x0].0x0 (ffff92fe48355900) 00010000:00010000:1.0:1763333172.888109:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333172.888112:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c5587a lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.888117:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c5587a lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.888127:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55881 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.888133:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55881 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.888138:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55881 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.888143:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333172.888146:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55881 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.888151:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55881 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.888159:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a6:0x0].0x0 (ffff92ff62250a00) 00010000:00010000:1.0:1763333172.888161:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333172.888163:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55881 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333172.888168:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c55881 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000100:00100000:1.0:1763333172.888223:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4960b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627242496:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763333172.888265:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333172.888305:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1763333172.888312:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff74038000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627242368:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763333172.888333:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333172.888936:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627242496 00000100:00100000:3.0:1763333172.888945:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627242496 00000100:00100000:3.0:1763333172.889602:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627242368 00000100:00100000:3.0:1763333172.889608:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627242368 00000100:00100000:3.0:1763333172.889634:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6386 00000100:00100000:3.0:1763333172.889644:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+24:3653:x1848987627242496:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763333172.889673:0:28651:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:552 count 1 00002000:00010000:3.0:1763333172.889704:0:28651:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x228:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333172.889711:0:28651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c558a4 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.889725:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333172.889727:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333172.889732:0:28651:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c558a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.889745:0:28651:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c558a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.889755:0:28651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c558a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.889763:0:28651:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c558a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.889782:0:28651:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763333172.890012:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+25:3653:x1848987627242496:12345-0@lo:6:osp-syn-1-1.0 Request processed in 369us (1746us total) trans 17179871520 rc 0/0 00000100:00100000:3.0:1763333172.890021:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6386 00000100:00100000:3.0:1763333172.890038:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6387 00000100:00100000:3.0:1763333172.890045:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+24:3653:x1848987627242368:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763333172.890057:0:28651:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:551 count 1 00010000:00010000:3.0:1763333172.890069:0:28651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c558ab lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x227:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.890083:0:28651:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55754 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969370 expref: 21 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.890090:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333172.890091:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333172.890094:0:28651:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c558ab lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.890127:0:28651:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55754 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969370 expref: 21 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.890142:0:28651:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55754 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969370 expref: 21 pid: 8404 timeout: 1376 lvb_type: 0 00000100:00100000:3.0:1763333172.890156:0:28651:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28651:1848987627242880:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333172.890213:0:28651:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe448ea540 going to sleep for 11 seconds 00010000:00010000:3.0:1763333172.890240:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333172.890246:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c558a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.890254:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333172.890258:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c558a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.890271:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c558a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.890286:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c558a4 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.890292:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c558a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.890307:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333172.890309:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333172.890311:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763333172.890428:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627243008:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763333172.890459:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333172.890483:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763333172.890489:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627243136:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763333172.890527:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333172.890553:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627243008 00000100:00100000:3.0:1763333172.890557:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627243008 00000100:00100000:3.0:1763333172.890592:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627243136 00000100:00100000:3.0:1763333172.890596:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627243136 00000100:00100000:3.0:1763333172.890615:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6388 00000100:00100000:3.0:1763333172.890621:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+6:3652:x1848987627243008:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763333172.890635:0:28650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:551 count 1 00010000:00010000:3.0:1763333172.890650:0:28650:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96c00/0xb32e3ef184c558b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x227:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.890669:0:28650:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5574d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969369 expref: 12 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.890676:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333172.890677:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333172.890680:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96c00/0xb32e3ef184c558b2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.890702:0:28650:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5574d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969369 expref: 12 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.890711:0:28650:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5574d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969369 expref: 12 pid: 8407 timeout: 1376 lvb_type: 0 00000100:00100000:3.0:1763333172.890722:0:28650:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe434c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28650:1848987627243520:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333172.890746:0:28650:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff5119d780 going to sleep for 11 seconds 00000100:00100000:3.0:1763333172.890761:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6389 00000100:00100000:3.0:1763333172.890768:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7df39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3652:x1848987627243136:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763333172.890779:0:8611:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:552 count 1 00002000:00010000:3.0:1763333172.890796:0:8611:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x228:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333172.890801:0:8611:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96e00/0xb32e3ef184c558b9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.890809:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333172.890810:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333172.890813:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96e00/0xb32e3ef184c558b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.890823:0:8611:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96e00/0xb32e3ef184c558b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.890831:0:8611:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96e00/0xb32e3ef184c558b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.890837:0:8611:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96e00/0xb32e3ef184c558b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.890851:0:8611:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763333172.890997:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7df39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+7:3652:x1848987627243136:12345-0@lo:6:osp-syn-0-1.0 Request processed in 228us (482us total) trans 21474838822 rc 0/0 00000100:00100000:3.0:1763333172.891004:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6389 00000100:00100000:3.0:1763333172.891038:0:3652:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474838818 gen 2 00000004:00080000:3.0:1763333172.891043:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7400e300, transno 21474838759 00000004:00080000:3.0:1763333172.891050:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7400dc00, transno 21474838760 00000004:00080000:3.0:1763333172.891052:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7400d880, transno 21474838761 00000004:00080000:3.0:1763333172.891055:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7400df80, transno 21474838762 00000004:00080000:3.0:1763333172.891057:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe438ab480, transno 21474838763 00000004:00080000:3.0:1763333172.891059:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe438ab100, transno 21474838764 00000004:00080000:3.0:1763333172.891062:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4399a300, transno 21474838765 00000004:00080000:3.0:1763333172.891065:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe42f0df80, transno 21474838766 00000004:00080000:3.0:1763333172.891067:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44e05180, transno 21474838768 00000004:00080000:3.0:1763333172.891070:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44e04700, transno 21474838769 00000004:00080000:3.0:1763333172.891072:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44e06680, transno 21474838770 00000004:00080000:3.0:1763333172.891075:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44e04e00, transno 21474838771 00000004:00080000:3.0:1763333172.891077:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44e18700, transno 21474838773 00000004:00080000:3.0:1763333172.891080:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44e1b100, transno 21474838774 00000004:00080000:3.0:1763333172.891083:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44e18000, transno 21474838775 00000004:00080000:3.0:1763333172.891085:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44e19880, transno 21474838776 00000004:00080000:3.0:1763333172.891088:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff77a3ed80, transno 21474838778 00000004:00080000:3.0:1763333172.891090:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff77a3d180, transno 21474838779 00000004:00080000:3.0:1763333172.891092:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff77a3d500, transno 21474838780 00000004:00080000:3.0:1763333172.891094:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff77a3ea00, transno 21474838781 00000004:00080000:3.0:1763333172.891097:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44e07100, transno 21474838783 00000004:00080000:3.0:1763333172.891099:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44e06300, transno 21474838784 00000004:00080000:3.0:1763333172.891102:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44e05f80, transno 21474838785 00000004:00080000:3.0:1763333172.891104:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44e06a00, transno 21474838786 00000004:00080000:3.0:1763333172.891107:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff75664a80, transno 21474838788 00000004:00080000:3.0:1763333172.891110:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff75665180, transno 21474838789 00000004:00080000:3.0:1763333172.891112:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff75666680, transno 21474838790 00000004:00080000:3.0:1763333172.891114:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff75665c00, transno 21474838791 00000004:00080000:3.0:1763333172.891117:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7e00fb80, transno 21474838794 00000004:00080000:3.0:1763333172.891119:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46a6e300, transno 21474838795 00000004:00080000:3.0:1763333172.891122:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff74034e00, transno 21474838796 00000004:00080000:3.0:1763333172.891124:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff74034380, transno 21474838797 00000004:00080000:3.0:1763333172.891127:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff6bc10700, transno 21474838801 00000004:00080000:3.0:1763333172.891130:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff6bc11180, transno 21474838802 00000004:00080000:3.0:1763333172.891132:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff50065880, transno 21474838803 00000004:00080000:3.0:1763333172.891136:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff50065180, transno 21474838804 00000004:00080000:3.0:1763333172.891138:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7e00f100, transno 21474838805 00000004:00080000:3.0:1763333172.891140:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7e00e680, transno 21474838806 00000004:00080000:3.0:1763333172.891142:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7e00ca80, transno 21474838807 00000004:00080000:3.0:1763333172.891145:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7e00c700, transno 21474838808 00000004:00080000:3.0:1763333172.891147:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe438abb80, transno 21474838810 00000004:00080000:3.0:1763333172.891150:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe438a9880, transno 21474838811 00000004:00080000:3.0:1763333172.891152:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe438a9c00, transno 21474838812 00000004:00080000:3.0:1763333172.891155:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe438a9180, transno 21474838813 00000004:00080000:3.0:1763333172.891158:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff50065f80, transno 21474838815 00000004:00080000:3.0:1763333172.891160:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff77c6d180, transno 21474838816 00000004:00080000:3.0:1763333172.891162:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff50066a00, transno 21474838817 00000004:00080000:3.0:1763333172.891164:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff50064e00, transno 21474838818 00000100:00100000:3.0:1763333172.891171:0:3652:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff92fe472f7800 x1848987627243136/t21474838822(21474838822) o6->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1763333188 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1763333172.891181:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe472f7800/2, rc 0, transno 21474838822 00000100:00100000:3.0:1763333172.891186:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627243136:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1763333172.891434:0:8604:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 4 in progress, 3 in flight, 48 done 00000004:00080000:3.0:1763333172.891462:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4960b480/2, rc 0, transno 17179871520 00000100:00100000:3.0:1763333172.891467:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4960b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627242496:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1763333172.892027:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333172.892035:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96e00/0xb32e3ef184c558b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.892044:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96e00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333172.892048:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96e00/0xb32e3ef184c558b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.892056:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96e00/0xb32e3ef184c558b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.892072:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96e00/0xb32e3ef184c558b9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.892079:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96e00/0xb32e3ef184c558b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.892101:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333172.892103:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333172.892104:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763333172.892121:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627243392:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333172.892165:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333172.892203:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1763333172.892210:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627243264:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333172.892231:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333172.892260:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627243392 00000100:00100000:0.0:1763333172.892266:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627243392 00000100:00100000:0.0:1763333172.892298:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6390 00000100:00100000:0.0:1763333172.892305:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+7:3655:x1848987627243392:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333172.892465:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+8:3655:x1848987627243392:12345-0@lo:2:osp-syn-0-1.0 Request processed in 160us (300us total) trans 21474838823 rc 0/0 00000100:00100000:0.0:1763333172.892473:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6390 00000100:00100000:0.0:1763333172.892486:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627243264 00000100:00100000:0.0:1763333172.892490:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627243264 00000100:00100000:0.0:1763333172.892535:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6391 00000100:00100000:0.0:1763333172.892543:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+8:3655:x1848987627243264:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333172.892611:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+9:3655:x1848987627243264:12345-0@lo:2:osp-syn-0-1.0 Request processed in 69us (379us total) trans 21474838824 rc 0/0 00000100:00100000:0.0:1763333172.892617:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6391 00000004:00080000:0.0:1763333172.892658:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe472f7b80/2, rc 0, transno 21474838824 00000100:00100000:0.0:1763333172.892664:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627243264:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1763333172.892673:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe472f6d80/2, rc 0, transno 21474838823 00000100:00100000:0.0:1763333172.892677:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627243392:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333172.892981:0:8423:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e121c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8423:1848987627242240:192.168.204.28@tcp:105: 00010000:00010000:1.0:1763333172.893002:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333172.893031:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2421:x1848987613644544:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 14485us (16321us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333172.893040:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2995 00000100:00100000:1.0:1763333172.893104:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333172.893121:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613644672 00000100:00100000:1.0:1763333172.893125:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613644672 00000100:00100000:1.0:1763333172.893150:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6392 00000100:00100000:1.0:1763333172.893157:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2420:x1848987613644672:12345-192.168.204.28@tcp:2:lfs.0 00002000:00010000:1.0:1763333172.893243:0:29013:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x225:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1763333172.893247:0:29013:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x225:0x0] updating lvb mtime from disk: 1763333172 -> 1763333172 00002000:00010000:1.0:1763333172.893249:0:29013:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x225:0x0] updating lvb atime from disk: 0 -> 1763333172 00002000:00010000:1.0:1763333172.893251:0:29013:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x225:0x0] updating lvb ctime from disk: 1763333172 -> 1763333173 00002000:00010000:1.0:1763333172.893254:0:29013:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x225:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1763333172.893275:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2420:x1848987613644672:12345-192.168.204.28@tcp:2:lfs.0 Request processed in 118us (171us total) trans 17179871521 rc 0/0 00000100:00100000:1.0:1763333172.893281:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6392 00000100:00100000:1.0:1763333172.895621:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.895770:0:28651:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28651:1848987627242880:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333172.895799:0:28651:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c558ab lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333172.896392:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613644800 00000100:00100000:3.0:1763333172.896402:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613644800 00000100:00100000:3.0:1763333172.896453:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6393 00000100:00100000:3.0:1763333172.896462:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:55917:x1848987613644800:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333172.896478:0:29010:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333172.896499:0:29010:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c558c0 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369693e0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333172.896526:0:29010:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x229:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333172.896545:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333172.896547:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333172.896556:0:29010:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c558c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693e0 expref: 23 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.896569:0:29010:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c558c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693e0 expref: 23 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.896581:0:29010:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96000, rc 0) 00000100:00100000:3.0:1763333172.896625:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:55917:x1848987613644800:12345-192.168.204.28@tcp:101:bash.0 Request processed in 165us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333172.896632:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6393 00000100:00100000:2.0:1763333172.896790:0:28650:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe434c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28650:1848987627243520:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333172.896809:0:28650:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96c00/0xb32e3ef184c558b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333172.897625:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.897665:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.897697:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333172.897755:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613645056 00000100:00100000:1.0:1763333172.897761:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613645056 00010000:00010000:1.0:1763333172.897795:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5574d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969369 expref: 13 pid: 8407 timeout: 1376 lvb_type: 0 00000100:00100000:1.0:1763333172.897829:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613644928 00000100:00100000:1.0:1763333172.897833:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613644928 00000100:00100000:2.0:1763333172.897836:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613645312 00000100:00100000:2.0:1763333172.897843:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613645312 00010000:00010000:1.0:1763333172.897846:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55754 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969370 expref: 23 pid: 8404 timeout: 1376 lvb_type: 0 00000100:00100000:1.0:1763333172.897869:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2996 00000100:00100000:1.0:1763333172.897878:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2421:x1848987613645056:12345-192.168.204.28@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1763333172.897884:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3123 00000100:00100000:2.0:1763333172.897896:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56837:x1848987613645312:12345-192.168.204.28@tcp:35:lfs.0 00000004:00010000:2.0:1763333172.897954:0:35317:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x240000404:0x1a3:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55643 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1a3:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969307 expref: 228 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.897995:0:35317:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c558c7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35317 initiator: MDT0 00010000:00010000:2.0:1763333172.898010:0:35317:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c556e4 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969338 expref: 228 pid: 8606 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333172.898011:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2997 00010000:00010000:2.0:1763333172.898024:0:35317:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c558c7 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35317 initiator: MDT1 00000100:00100000:3.0:1763333172.898025:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2421:x1848987613644928:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333172.898040:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333172.898051:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55754 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x227:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969370 expref: 23 pid: 8404 timeout: 1376 lvb_type: 0 00010000:00010000:3.0:1763333172.898067:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55754 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x227:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969370 expref: 23 pid: 8404 timeout: 1376 lvb_type: 0 00010000:00010000:2.0:1763333172.898067:0:35317:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c556e4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969338 expref: 228 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.898092:0:35317:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c556e4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969338 expref: 228 pid: 8606 timeout: 1376 lvb_type: 0 00000100:00100000:2.0:1763333172.898106:0:35317:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7569f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:35317:1848987627243648:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333172.898148:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55754 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x227:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969370 expref: 23 pid: 8404 timeout: 1376 lvb_type: 0 00010000:00010000:3.0:1763333172.898163:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333172.898165:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333172.898168:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c558ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.898176:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c558ab lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333172.898178:0:35317:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4869d0c0 going to sleep for 11 seconds 00010000:00010000:3.0:1763333172.898202:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333172.898226:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2421:x1848987613644928:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 204us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333172.898232:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2997 00010000:00010000:3.0:1763333172.898257:0:28651:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c558ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.898265:0:28651:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c558ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.898274:0:28651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c558ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.898282:0:28651:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c558ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.898307:0:28651:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763333172.898377:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333172.898384:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c558ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.898393:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97200 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333172.898397:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c558ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.898406:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c558ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.898419:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c558ab lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.898426:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c558ab lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.898450:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333172.898452:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333172.898455:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763333172.898578:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+25:3653:x1848987627242368:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8532us (10242us total) trans 17179871522 rc 0/0 00000100:00100000:3.0:1763333172.898586:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6387 00010000:00010000:1.0:1763333172.898689:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333172.898697:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5574d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969369 expref: 13 pid: 8407 timeout: 1376 lvb_type: 0 00010000:00010000:1.0:1763333172.898712:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5574d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969369 expref: 13 pid: 8407 timeout: 1376 lvb_type: 0 00010000:00010000:1.0:1763333172.898727:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5574d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x227:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969369 expref: 13 pid: 8407 timeout: 1376 lvb_type: 0 00010000:00010000:1.0:1763333172.898736:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333172.898739:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333172.898742:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96c00/0xb32e3ef184c558b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.898750:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96c00/0xb32e3ef184c558b2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.898776:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333172.898814:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:2421:x1848987613645056:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 937us (1218us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333172.898821:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2996 00000004:00080000:2.0:1763333172.898840:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff74038000/2, rc 0, transno 17179871522 00000100:00100000:2.0:1763333172.898849:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff74038000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627242368:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1763333172.899005:0:28650:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96c00/0xb32e3ef184c558b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.899013:0:28650:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96c00/0xb32e3ef184c558b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.899022:0:28650:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96c00/0xb32e3ef184c558b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.899034:0:28650:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96c00/0xb32e3ef184c558b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.899789:0:28650:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763333172.899864:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333172.899871:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96c00/0xb32e3ef184c558b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.899879:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96c00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333172.899882:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96c00/0xb32e3ef184c558b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.899889:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96c00/0xb32e3ef184c558b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.899902:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96c00/0xb32e3ef184c558b2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.899909:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96c00/0xb32e3ef184c558b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.899922:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333172.899924:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333172.899925:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763333172.900367:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+9:3652:x1848987627243008:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9722us (9883us total) trans 21474838825 rc 0/0 00000100:00100000:0.0:1763333172.900377:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6388 00000004:00080000:3.0:1763333172.900638:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe472f4000/2, rc 0, transno 21474838825 00000100:00100000:3.0:1763333172.900645:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627243008:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763333172.902239:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.902380:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613645440 00000100:00100000:2.0:1763333172.902387:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.902389:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613645440 00000100:00100000:0.0:1763333172.902438:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6394 00000100:00100000:0.0:1763333172.902449:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:55917:x1848987613645440:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333172.902467:0:28650:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333172.902487:0:28650:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf400/0xb32e3ef184c558ce lrc: 2/0,0 mode: --/PW res: [0x280000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369693e7 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763333172.902509:0:28650:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x229:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333172.902542:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333172.902545:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333172.902553:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf400/0xb32e3ef184c558ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693e7 expref: 13 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.902569:0:28650:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf400/0xb32e3ef184c558ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693e7 expref: 13 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.902586:0:28650:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdf400, rc 0) 00000100:00100000:0.0:1763333172.902650:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:55917:x1848987613645440:12345-192.168.204.28@tcp:101:bash.0 Request processed in 203us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333172.902658:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6394 00000100:00100000:1.0:1763333172.902733:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613645568 00000100:00100000:1.0:1763333172.902738:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613645568 00010000:00010000:1.0:1763333172.902761:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c556e4 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969338 expref: 229 pid: 8606 timeout: 1376 lvb_type: 0 00000100:00100000:1.0:1763333172.902796:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2998 00000100:00100000:1.0:1763333172.902804:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:2421:x1848987613645568:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333172.902813:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333172.902819:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c556e4 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969338 expref: 229 pid: 8606 timeout: 1376 lvb_type: 0 00010000:00010000:1.0:1763333172.902830:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c556e4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969338 expref: 229 pid: 8606 timeout: 1376 lvb_type: 0 00010000:00010000:1.0:1763333172.902848:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a3:0x0].0x0 (ffff92fe48355900) 00010000:00010000:1.0:1763333172.902853:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c558c7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35317 initiator: MDT1 00010000:00010000:1.0:1763333172.902866:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c558c7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 35317 initiator: MDT1 00010000:00010000:1.0:1763333172.902873:0:6505:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c558c7 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 35317 initiator: MDT1 00010000:00010000:1.0:1763333172.902889:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333172.902924:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:2421:x1848987613645568:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 121us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333172.902931:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2998 00010000:00010000:3.0:1763333172.903526:0:35317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c556e4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969338 expref: 228 pid: 8606 timeout: 1376 lvb_type: 0 00000100:00100000:3.0:1763333172.903545:0:35317:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7569f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:35317:1848987627243648:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333172.903566:0:35317:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c558c7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35317 initiator: MDT1 00010000:00010000:3.0:1763333172.903584:0:35317:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c558c7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35317 initiator: MDT1 00010000:00010000:3.0:1763333172.903628:0:35317:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c558c7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35317 initiator: MDT1 00000040:00080000:3.0:1763333172.904081:0:35317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1367, 88 off115672 00000004:00080000:3.0:1763333172.904089:0:35317:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1276983739563ns, next at 1277223362238ns, rc = 0 00000040:00080000:3.0:1763333172.904130:0:35317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1368, 88 off115672 00000004:00080000:3.0:1763333172.904135:0:35317:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1276983786013ns, next at 1276878902000ns, rc = 0 00000040:00080000:3.0:1763333172.904166:0:35317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1369, 88 off115760 00000004:00080000:3.0:1763333172.904170:0:35317:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1276983821579ns, next at 1276878902000ns, rc = 0 00000040:00080000:3.0:1763333172.904180:0:35317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1368, 88 off115760 00000004:00080000:3.0:1763333172.904184:0:35317:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1276983834734ns, next at 1277223362238ns, rc = 0 00000100:00100000:3.0:1763333172.905289:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333172.905322:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.905710:0:28430:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613645696 00000100:00100000:2.0:1763333172.905720:0:28430:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613645696 00002000:00010000:2.0:1763333172.905762:0:28430:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/553 (0->18446744073709551615) 00002000:00100000:2.0:1763333172.905767:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe434c6d80 with x1848987613645696 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333172.905779:0:28430:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe434c6d80. 00000100:00100000:2.0:1763333172.905808:0:28430:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613645824 00000100:00100000:2.0:1763333172.905812:0:28430:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613645824 00002000:00010000:2.0:1763333172.905825:0:28430:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/553 (0->18446744073709551615) 00002000:00100000:2.0:1763333172.905828:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe434c6680 with x1848987613645824 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333172.905834:0:28430:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe434c6680. 00000100:00100000:2.0:1763333172.905853:0:28430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1587 00000100:00100000:2.0:1763333172.905862:0:28430:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2420:x1848987613645696:12345-192.168.204.28@tcp:10:bash.0 00000100:00100000:3.0:1763333172.906115:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1588 00000100:00100000:3.0:1763333172.906124:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2420:x1848987613645824:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:3.0:1763333172.906292:0:24027:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x229:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333172.906297:0:24027:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x229:0x0] updating lvb mtime from disk: 0 -> 1763333173 00002000:00010000:3.0:1763333172.906299:0:24027:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x229:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333172.906301:0:24027:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x229:0x0] updating lvb ctime from disk: 0 -> 1763333173 00002000:00010000:3.0:1763333172.906304:0:24027:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x229:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333172.906377:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2420:x1848987613645824:12345-192.168.204.28@tcp:10:bash.0 Request processed in 253us (1052us total) trans 21474838826 rc 0/0 00000100:00100000:3.0:1763333172.906385:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1588 00002000:00010000:3.0:1763333172.906388:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/553 (0->18446744073709551615) 00002000:00100000:3.0:1763333172.906391:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe434c6680 with x1848987613645824 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333172.906395:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe434c6680. 00002000:00010000:2.0:1763333172.906559:0:28430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x229:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333172.906562:0:28430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x229:0x0] updating lvb mtime from disk: 0 -> 1763333173 00002000:00010000:2.0:1763333172.906565:0:28430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x229:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333172.906567:0:28430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x229:0x0] updating lvb ctime from disk: 0 -> 1763333173 00002000:00010000:2.0:1763333172.906568:0:28430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x229:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333172.906792:0:28430:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2420:x1848987613645696:12345-192.168.204.28@tcp:10:bash.0 Request processed in 930us (1509us total) trans 17179871523 rc 0/0 00000100:00100000:2.0:1763333172.906800:0:28430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1587 00002000:00010000:2.0:1763333172.906803:0:28430:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/553 (0->18446744073709551615) 00002000:00100000:2.0:1763333172.906806:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe434c6d80 with x1848987613645696 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333172.906811:0:28430:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe434c6d80. 00000001:00080000:2.0:1763333172.908696:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972168 is committed 00000004:00080000:2.0:1763333172.908708:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 894 committed 00000004:00080000:2.0:1763333172.908834:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 897 committed 00000004:00080000:2.0:1763333172.908850:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 896 committed 00000004:00080000:2.0:1763333172.908853:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 893 committed 00000100:00100000:1.0:1763333172.908945:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e121180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627243904:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333172.908946:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e122d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627243776:0@lo:2:osp-syn-0-1.0 00000004:00010000:3.0:1763333172.909043:0:35317:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000837ce4be reply state 00000000b6d90808 transno 4294972168 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c558c7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35317 initiator: MDT1 00000100:00100000:1.0:1763333172.909054:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763333172.909071:0:35317:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c558c7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35317 initiator: MDT1 00010000:00010000:3.0:1763333172.909080:0:35317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a3:0x0].0x0 (ffff92fe48355900) 00010000:00010000:3.0:1763333172.909083:0:35317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1763333172.909087:0:35317:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763333172.909090:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627243904 00010000:00010000:3.0:1763333172.909094:0:35317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a3:0x0].0x0 (ffff92fe48355900) 00010000:00010000:3.0:1763333172.909096:0:35317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00000100:00100000:2.0:1763333172.909096:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627243904 00010000:00010000:3.0:1763333172.909101:0:35317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55643 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1a3:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969307 expref: 227 pid: 8606 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333172.909139:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6395 00000100:00100000:2.0:1763333172.909147:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+9:3653:x1848987627243904:12345-0@lo:2:osp-syn-0-1.0 00010000:00080000:3.0:1763333172.909204:0:35317:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1763333172.909207:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333172.909220:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56837:x1848987613645312:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 11326us (11521us total) trans 4294972168 rc 0/0 00000100:00100000:3.0:1763333172.909229:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3123 00000100:00100000:1.0:1763333172.909241:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627243776 00000100:00100000:1.0:1763333172.909246:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627243776 00010000:00010000:3.0:1763333172.909260:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c558c7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35317 initiator: MDT1 00010000:00010000:3.0:1763333172.909270:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c558c7 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35317 initiator: MDT1 00010000:00010000:3.0:1763333172.909276:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c558c7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35317 initiator: MDT1 00000100:00100000:1.0:1763333172.909281:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6396 00002000:00010000:2.0:1763333172.909282:0:28650:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x226:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1763333172.909286:0:28650:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x226:0x0] updating lvb mtime from disk: 1763333173 -> 1763333173 00010000:00010000:3.0:1763333172.909287:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4600 already unused, calling callback (ffffffffc17b3550) 00002000:00010000:2.0:1763333172.909289:0:28650:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x226:0x0] updating lvb atime from disk: 0 -> 0 00010000:00010000:3.0:1763333172.909292:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c558c7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35317 initiator: MDT1 00000100:00100000:1.0:1763333172.909293:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+11:3652:x1848987627243776:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:2.0:1763333172.909294:0:28650:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x226:0x0] updating lvb ctime from disk: 1763333173 -> 1763333173 00002000:00010000:2.0:1763333172.909299:0:28650:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x226:0x0] updating lvb blocks from disk: 8 -> 8 00010000:00010000:3.0:1763333172.909304:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c558c7 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35317 initiator: MDT1 00010000:00010000:3.0:1763333172.909314:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a3:0x0].0x0 (ffff92fe48355900) 00010000:00010000:3.0:1763333172.909316:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763333172.909320:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c558c7 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35317 initiator: MDT1 00010000:00010000:3.0:1763333172.909326:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c558c7 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35317 initiator: MDT1 00000100:00100000:2.0:1763333172.909334:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+11:3653:x1848987627243904:12345-0@lo:2:osp-syn-0-1.0 Request processed in 188us (283us total) trans 21474838827 rc 0/0 00000100:00100000:2.0:1763333172.909341:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6395 00002000:00010000:1.0:1763333172.909395:0:8611:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x225:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333172.909399:0:8611:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x225:0x0] updating lvb mtime from disk: 1763333172 -> 1763333172 00002000:00010000:1.0:1763333172.909401:0:8611:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x225:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333172.909404:0:8611:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x225:0x0] updating lvb ctime from disk: 1763333172 -> 1763333172 00002000:00010000:1.0:1763333172.909407:0:8611:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x225:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333172.909452:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+11:3652:x1848987627243776:12345-0@lo:2:osp-syn-0-1.0 Request processed in 162us (246us total) trans 21474838828 rc 0/0 00000100:00100000:1.0:1763333172.909460:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6396 00000004:00080000:1.0:1763333172.909528:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7e121180/2, rc 0, transno 21474838827 00000100:00100000:1.0:1763333172.909535:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e121180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627243904:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333172.909634:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e00df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627244032:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333172.909664:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333172.910239:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1763333172.910247:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e00ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627244160:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333172.910275:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333172.910304:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627244032 00000100:00100000:1.0:1763333172.910308:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627244032 00000100:00100000:1.0:1763333172.910334:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627244160 00000100:00100000:1.0:1763333172.910337:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627244160 00000100:00100000:1.0:1763333172.910374:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6397 00000100:00100000:1.0:1763333172.910382:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+26:3654:x1848987627244032:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1763333172.910462:0:8611:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x225:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1763333172.910466:0:8611:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x225:0x0] updating lvb mtime from disk: 1763333172 -> 1763333172 00002000:00010000:1.0:1763333172.910468:0:8611:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x225:0x0] updating lvb atime from disk: 1763333172 -> 1763333172 00002000:00010000:1.0:1763333172.910471:0:8611:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x225:0x0] updating lvb ctime from disk: 1763333173 -> 1763333173 00002000:00010000:1.0:1763333172.910473:0:8611:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x225:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1763333172.910491:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6398 00000100:00100000:1.0:1763333172.910507:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+27:3654:x1848987627244032:12345-0@lo:2:osp-syn-1-1.0 Request processed in 125us (840us total) trans 17179871524 rc 0/0 00000100:00100000:2.0:1763333172.910779:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+27:3654:x1848987627244160:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1763333172.910840:0:29010:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x226:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333172.910844:0:29010:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x226:0x0] updating lvb mtime from disk: 1763333173 -> 1763333173 00002000:00010000:2.0:1763333172.910846:0:29010:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x226:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333172.910848:0:29010:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x226:0x0] updating lvb ctime from disk: 1763333173 -> 1763333173 00002000:00010000:2.0:1763333172.910850:0:29010:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x226:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333172.910876:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+28:3654:x1848987627244160:12345-0@lo:2:osp-syn-1-1.0 Request processed in 102us (600us total) trans 17179871525 rc 0/0 00000100:00100000:1.0:1763333172.911395:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6397 00000004:00080000:1.0:1763333172.911441:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7e00ea00/2, rc 0, transno 17179871525 00000100:00100000:1.0:1763333172.911448:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e00ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627244160:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1763333172.911457:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7e00df80/2, rc 0, transno 17179871524 00000100:00100000:1.0:1763333172.911461:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e00df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627244032:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333172.913366:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6398 00000004:00080000:3.0:1763333172.913850:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7e122d80/2, rc 0, transno 21474838828 00000100:00100000:3.0:1763333172.913859:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e122d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627243776:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333172.914581:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.914672:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613645952 00000100:00100000:0.0:1763333172.914680:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613645952 00000100:00100000:0.0:1763333172.914744:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9140 00000100:00100000:0.0:1763333172.914756:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+226:56837:x1848987613645952:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333172.914783:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333172.914805:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c558d5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369693ee expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.914863:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c558d5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693ee expref: 227 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.914880:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf600/0xb32e3ef184c558d5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693ee expref: 227 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333172.914898:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a3:0x0].0x0 (ffff92fe48355900) 00010000:00010000:0.0:1763333172.914902:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333172.914905:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdf600, rc 0) 00000100:00100000:0.0:1763333172.914966:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56837:x1848987613645952:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 213us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333172.914975:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9140 00000100:00100000:2.0:1763333172.916066:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333172.916292:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613646208 00000100:00100000:3.0:1763333172.916300:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613646208 00000100:00100000:3.0:1763333172.916344:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3124 00000100:00100000:3.0:1763333172.916387:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:55917:x1848987613646208:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:3.0:1763333172.916787:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:55917:x1848987613646208:12345-192.168.204.28@tcp:35:bash.0 Request processed in 400us (725us total) trans 4294972169 rc 0/0 00000100:00100000:3.0:1763333172.916795:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3124 00000100:00100000:2.0:1763333172.923002:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333172.923070:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613646464 00000100:00100000:3.0:1763333172.923083:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613646464 00000100:00100000:3.0:1763333172.923147:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3125 00000100:00100000:3.0:1763333172.923157:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56837:x1848987613646464:12345-192.168.204.28@tcp:35:lfs.0 00000004:00080000:3.0:1763333172.923480:0:35317:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x1a3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1763333172.923557:0:35317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1369, 64 off115824 00000040:00080000:3.0:1763333172.923581:0:35317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1370, 64 off115824 00000004:00080000:3.0:1763333172.923587:0:35317:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1277003237463ns, next at 1278003234678ns, rc = 0 00000040:00080000:3.0:1763333172.923600:0:35317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1371, 64 off115888 00000040:00080000:3.0:1763333172.923612:0:35317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1370, 64 off115888 00010000:00010000:2.0:1763333172.923790:0:35317:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c558dc lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35317 initiator: MDT0 00010000:00010000:2.0:1763333172.923810:0:35317:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c558dc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 35317 initiator: MDT1 00010000:00010000:2.0:1763333172.923825:0:35317:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c558dc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 35317 initiator: MDT1 00010000:00010000:2.0:1763333172.923833:0:35317:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c558dc lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1a3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 35317 initiator: MDT1 00010000:00010000:2.0:1763333172.923840:0:35317:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c558dc lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1a3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 35317 initiator: MDT1 00010000:00010000:2.0:1763333172.923846:0:35317:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c558dc lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1a3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 35317 initiator: MDT1 00010000:00010000:2.0:1763333172.923870:0:35317:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763333172.924088:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56837:x1848987613646464:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 930us (1096us total) trans 4294972170 rc 0/0 00000100:00100000:2.0:1763333172.924096:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3125 00010000:00010000:3.0:1763333172.924963:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333172.924972:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c558dc lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1a3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 35317 initiator: MDT1 00010000:00010000:3.0:1763333172.924982:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4800 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333172.924986:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c558dc lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1a3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 35317 initiator: MDT1 00010000:00010000:3.0:1763333172.924996:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c558dc lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1a3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 35317 initiator: MDT1 00010000:00010000:3.0:1763333172.925019:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a3:0x0].0x0 (ffff92fe48355900) 00010000:00010000:3.0:1763333172.925022:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763333172.925028:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c558dc lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1a3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 35317 initiator: MDT1 00010000:00010000:3.0:1763333172.925035:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c558dc lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1a3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 35317 initiator: MDT1 00010000:00010000:3.0:1763333172.925047:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333172.925049:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333172.925051:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763333172.940138:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333172.940444:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613646592 00000100:00100000:3.0:1763333172.940455:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613646592 00000100:00100000:3.0:1763333172.940555:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9141 00000100:00100000:3.0:1763333172.940565:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56842:x1848987613646592:12345-192.168.204.28@tcp:101:rm.0 00010000:00010000:3.0:1763333172.940593:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333172.940617:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c558e3 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369693f5 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.940691:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c558ea lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333172.940705:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c558ea lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.940716:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c558ea lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.940728:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c558f1 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333172.940733:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c558f1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.940740:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c558f1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.940817:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c558f8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333172.940827:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c558f8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.940834:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c558f8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:3.0:1763333172.940873:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1a6:0x0]: returning size 5 00000004:00200000:3.0:1763333172.940878:0:8606:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763333172.940897:0:8606:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c558f8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.940909:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c558f8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.940918:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c558ea lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.940924:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c558ea lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.940931:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c558ea lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.940938:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c558ea lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.940943:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333172.940947:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c558ea lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.940954:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c558ea lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.940966:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6231ee00) 00010000:00010000:3.0:1763333172.940969:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333172.940974:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c558ea lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.940981:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c558ea lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.940993:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c558f1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.940999:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c558f1 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.941005:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c558f1 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.941010:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333172.941013:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c558f1 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.941019:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c558f1 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.941025:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6231e400) 00010000:00010000:3.0:1763333172.941028:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333172.941030:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c558f1 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.941036:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c558f1 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333172.941064:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c558e3 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693f5 expref: 231 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.941079:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c558f8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693f5 expref: 230 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.941086:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a6:0x0].0x0 (ffff92ff62250a00) 00010000:00010000:3.0:1763333172.941089:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333172.941091:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96400, rc 0) 00000100:00100000:3.0:1763333172.941149:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56842:x1848987613646592:12345-192.168.204.28@tcp:101:rm.0 Request processed in 585us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333172.941157:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9141 00000100:00100000:0.0:1763333172.946144:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.948376:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613646848 00000100:00100000:2.0:1763333172.948389:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613646848 00000100:00100000:2.0:1763333172.948533:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9142 00000100:00100000:2.0:1763333172.948544:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56837:x1848987613646848:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333172.948578:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333172.948601:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c558ff lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369693fc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.948829:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55906 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333172.948846:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55906 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x1a6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333172.948857:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55906 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x1a6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:2.0:1763333172.948868:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1a6:0x0]: returning size 5 00010000:00010000:2.0:1763333172.948999:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c558ff lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1a6:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693fc expref: 233 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.949018:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55906 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a6:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693fc expref: 232 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.949027:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a6:0x0].0x0 (ffff92ff62250a00) 00010000:00010000:2.0:1763333172.949030:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1763333172.949033:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5c00, rc 0) 00000100:00100000:2.0:1763333172.949113:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56837:x1848987613646848:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 571us (2981us total) trans 4294972171 rc 0/0 00000100:00100000:2.0:1763333172.949121:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9142 00000100:00100000:1.0:1763333172.954336:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333172.954506:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613647104 00000100:00100000:2.0:1763333172.954525:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613647104 00000100:00100000:2.0:1763333172.954593:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9143 00000100:00100000:2.0:1763333172.954605:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56842:x1848987613647104:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:2.0:1763333172.954666:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1763333172.954695:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c5589d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1a6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693d9 expref: 232 pid: 8606 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333172.954697:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:2.0:1763333172.954720:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c558f8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693f5 expref: 231 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.954735:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55873 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1a6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693c4 expref: 230 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.954747:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a6:0x0].0x0 (ffff92ff62250a00) 00010000:00010000:2.0:1763333172.954752:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333172.954763:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613647232 00000100:00100000:3.0:1763333172.954768:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613647232 00010000:00010000:2.0:1763333172.954784:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55914 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00000100:00100000:3.0:1763333172.954806:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9144 00000100:00100000:3.0:1763333172.954815:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56837:x1848987613647232:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333172.954829:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333172.954841:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5591b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969403 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.954910:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55922 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333172.954923:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55922 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.954932:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55922 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:3.0:1763333172.954971:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1a6:0x0]: returning size 5 00000004:00200000:3.0:1763333172.954975:0:6519:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763333172.954991:0:6519:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55922 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333172.955011:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5591b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969403 expref: 232 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.955022:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55922 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969403 expref: 231 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333172.955028:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a6:0x0].0x0 (ffff92ff62250a00) 00010000:00010000:3.0:1763333172.955031:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333172.955034:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96e00, rc 0) 00010000:00010000:2.0:1763333172.955071:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55914 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.955083:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55914 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000100:00100000:3.0:1763333172.955096:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56837:x1848987613647232:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 280us (399us total) trans 0 rc 0/0 00010000:00010000:2.0:1763333172.955099:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55929 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00000100:00100000:3.0:1763333172.955107:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9144 00010000:00010000:2.0:1763333172.955112:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55929 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.955121:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55929 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.955198:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55930 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333172.955209:0:8606:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55906 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x1a6:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693fc expref: 230 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.955217:0:8606:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55922 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969403 expref: 230 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.955225:0:8606:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55930 lrc: 5/0,1 mode: --/EX res: [0x240000404:0x1a6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.955256:0:8606:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55922 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969403 expref: 230 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.955269:0:8606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55922 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969403 expref: 230 pid: 6519 timeout: 1377 lvb_type: 0 00000100:00100000:2.0:1763333172.955281:0:8606:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7569f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627244288:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333172.955388:0:8606:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55906 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a6:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693fc expref: 230 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333172.955397:0:8606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55906 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1a6:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693fc expref: 230 pid: 6519 timeout: 1377 lvb_type: 0 00000100:00100000:2.0:1763333172.955406:0:8606:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7569d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627244416:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333172.955551:0:8606:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4869d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763333172.962158:0:8606:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7569f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627244288:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333172.964825:0:8606:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7569d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627244416:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333172.964837:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:2.0:1763333172.964859:0:8606:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55930 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000100:00100000:3.0:1763333172.964916:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613647616 00000100:00100000:3.0:1763333172.964924:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613647616 00000100:00100000:3.0:1763333172.964985:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3126 00000100:00100000:3.0:1763333172.964994:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bd5cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:44391:x1848987613647616:12345-192.168.204.28@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1763333172.967819:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bd5cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:44391:x1848987613647616:12345-192.168.204.28@tcp:35:ldlm_bl.0 Request processed in 2813us (2968us total) trans 4294972172 rc 0/0 00000100:00100000:3.0:1763333172.967835:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3126 00000100:00100000:2.0:1763333172.967881:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.968384:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613647360 00000100:00100000:0.0:1763333172.968394:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613647360 00010000:00010000:0.0:1763333172.968435:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55922 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969403 expref: 232 pid: 6519 timeout: 1377 lvb_type: 0 00000100:00100000:0.0:1763333172.968480:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2999 00000100:00100000:0.0:1763333172.968491:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:2420:x1848987613647360:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333172.968506:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333172.968521:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55922 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969403 expref: 232 pid: 6519 timeout: 1377 lvb_type: 0 00010000:00010000:0.0:1763333172.968536:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55922 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969403 expref: 232 pid: 6519 timeout: 1377 lvb_type: 0 00010000:00010000:0.0:1763333172.968561:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55922 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969403 expref: 232 pid: 6519 timeout: 1377 lvb_type: 0 00010000:00010000:0.0:1763333172.968578:0:8423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a6:0x0].0x0 (ffff92ff62250a00) 00010000:00010000:0.0:1763333172.968584:0:8423:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55930 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333172.968592:0:8423:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55930 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333172.968599:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333172.968662:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:2420:x1848987613647360:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 173us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333172.968669:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2999 00000100:00100000:2.0:1763333172.971627:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333172.972477:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613647744 00000100:00100000:1.0:1763333172.972489:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613647744 00010000:00010000:1.0:1763333172.972540:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55906 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1a6:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693fc expref: 231 pid: 6519 timeout: 1377 lvb_type: 0 00000100:00100000:1.0:1763333172.972573:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3000 00000100:00100000:1.0:1763333172.972583:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:2420:x1848987613647744:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333172.972601:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333172.972607:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55906 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1a6:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693fc expref: 231 pid: 6519 timeout: 1377 lvb_type: 0 00010000:00010000:1.0:1763333172.972621:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55906 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a6:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693fc expref: 231 pid: 6519 timeout: 1377 lvb_type: 0 00010000:00010000:1.0:1763333172.972642:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55906 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1a6:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693fc expref: 231 pid: 6519 timeout: 1377 lvb_type: 0 00010000:00010000:1.0:1763333172.972669:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a6:0x0].0x0 (ffff92ff62250a00) 00010000:00010000:1.0:1763333172.972674:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55930 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.972682:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55930 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.972688:0:6505:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55930 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1a6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.972723:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333172.972768:0:8606:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55930 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000100:00100000:1.0:1763333172.972775:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:2420:x1848987613647744:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 193us (1155us total) trans 0 rc 0/0 00010000:00010000:3.0:1763333172.972776:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55930 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000100:00100000:1.0:1763333172.972786:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3000 00000040:00080000:3.0:1763333172.973046:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1371, 64 off115952 00000040:00080000:3.0:1763333172.973067:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1372, 64 off115952 00000040:00080000:3.0:1763333172.973077:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1373, 64 off116016 00000040:00080000:2.0:1763333172.973612:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1372, 64 off116016 00010000:00010000:2.0:1763333172.973682:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55937 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333172.973694:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55937 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.973704:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55937 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.973712:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55937 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1a6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.973717:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55937 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1a6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.973723:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55937 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1a6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.973743:0:8606:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763333172.973764:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55930 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.973770:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55930 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1a6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.973775:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55930 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1a6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.973781:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333172.973786:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55930 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1a6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.973792:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55930 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1a6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.973801:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a6:0x0].0x0 (ffff92ff62250a00) 00010000:00010000:2.0:1763333172.973804:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763333172.973808:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55930 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1a6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.973813:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55930 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1a6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.973918:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55914 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.973925:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55914 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.973930:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55914 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.973935:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55914 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.973940:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333172.973943:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55914 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.973958:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55914 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.973971:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31800) 00010000:00010000:2.0:1763333172.973973:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333172.973977:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55914 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.973982:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55914 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000004:00010000:2.0:1763333172.973995:0:8606:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000099cc6659 reply state 00000000fbcf5560 transno 4294972173 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55929 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.974004:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55929 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333172.974010:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43a31b00) 00010000:00010000:2.0:1763333172.974012:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333172.974015:0:8606:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763333172.974078:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56842:x1848987613647104:12345-192.168.204.28@tcp:36:rm.0 Request processed in 19474us (19750us total) trans 4294972173 rc 0/0 00000100:00100000:2.0:1763333172.974086:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9143 00010000:00010000:1.0:1763333172.975244:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333172.975253:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55937 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1a6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.975262:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333172.975476:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55937 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1a6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.975486:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55937 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1a6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.975501:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a6:0x0].0x0 (ffff92ff62250a00) 00010000:00010000:1.0:1763333172.975503:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1763333172.975508:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55937 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1a6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.975521:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55937 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1a6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.975538:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333172.975540:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333172.975542:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763333172.981021:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333172.981094:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613648000 00000100:00100000:0.0:1763333172.981106:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613648000 00000100:00100000:1.0:1763333172.981848:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9145 00000100:00100000:1.0:1763333172.981861:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56837:x1848987613648000:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333172.981888:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333172.982195:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5593e lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696940a expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.982273:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55945 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333172.982287:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55945 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.982299:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55945 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.982309:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5594c lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333172.982316:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5594c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.982321:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5594c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.982383:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55945 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.982390:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55945 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.982395:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55945 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.982401:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55945 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.982406:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333172.982409:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55945 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.982416:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55945 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.982431:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff62250000) 00010000:00010000:1.0:1763333172.982434:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333172.982438:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55945 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.982444:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55945 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.982456:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5594c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.982461:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5594c lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.982467:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5594c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.982472:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333172.982474:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5594c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.982480:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5594c lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.982487:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43a31b00) 00010000:00010000:1.0:1763333172.982489:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333172.982492:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5594c lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.982497:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5594c lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333172.982534:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5593e lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696940a expref: 232 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.982545:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff62250000) 00010000:00010000:1.0:1763333172.982547:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763333172.982551:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5593e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696940a expref: 232 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333172.982563:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7ec00, rc 0) 00000100:00100000:1.0:1763333172.983602:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56837:x1848987613648000:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1739us (2585us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333172.983612:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9145 00000100:00100000:3.0:1763333172.999658:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333173.001934:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613648128 00000100:00100000:1.0:1763333173.001949:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613648128 00000100:00100000:1.0:1763333173.002020:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9146 00000100:00100000:1.0:1763333173.002030:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56843:x1848987613648128:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333173.002051:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333173.002075:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55953 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969411 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.002145:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5595a lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333173.002160:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5595a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333173.002172:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5595a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333173.002183:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55961 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333173.002196:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55961 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333173.002202:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55961 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333173.002249:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5595a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333173.002255:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5595a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333173.002261:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5595a lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333173.002267:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5595a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333173.002272:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333173.002276:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5595a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333173.002282:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5595a lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333173.002293:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff62250000) 00010000:00010000:1.0:1763333173.002296:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333173.002301:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5595a lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333173.002308:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5595a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333173.002321:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55961 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333173.002327:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55961 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333173.002331:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55961 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333173.002335:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333173.002337:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55961 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333173.002342:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55961 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333173.002377:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43a31b00) 00010000:00010000:1.0:1763333173.002380:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333173.002383:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55961 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333173.002388:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55961 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333173.002414:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55953 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969411 expref: 232 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.002424:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff62250000) 00010000:00010000:1.0:1763333173.002426:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333173.002430:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55953 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969411 expref: 232 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.002441:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7ec00, rc 0) 00000100:00100000:1.0:1763333173.002520:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56843:x1848987613648128:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 483us (2864us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333173.002528:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9146 00000100:00100000:2.0:1763333173.017766:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333173.017867:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613648256 00000100:00100000:3.0:1763333173.017879:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613648256 00000100:00100000:3.0:1763333173.017952:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9147 00000100:00100000:3.0:1763333173.017963:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56843:x1848987613648256:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333173.017986:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333173.018010:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55968 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969418 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.018080:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5596f lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333173.018102:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5596f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333173.018115:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5596f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333173.018129:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c55976 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333173.018137:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c55976 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333173.018144:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c55976 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333173.018203:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5596f lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333173.018212:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5596f lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333173.018219:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5596f lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333173.018226:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5596f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333173.018233:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333173.018237:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5596f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333173.018246:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5596f lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333173.018260:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6231ee00) 00010000:00010000:3.0:1763333173.018263:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333173.018267:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5596f lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333173.018273:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5596f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333173.018287:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c55976 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333173.018294:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c55976 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333173.018299:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c55976 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333173.018304:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333173.018308:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c55976 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333173.018314:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c55976 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333173.018321:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43a31b00) 00010000:00010000:3.0:1763333173.018324:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333173.018327:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c55976 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333173.018334:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c55976 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333173.018412:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55968 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969418 expref: 232 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.018424:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6231ee00) 00010000:00010000:3.0:1763333173.018427:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333173.018432:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55968 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969418 expref: 232 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.018448:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a97000, rc 0) 00000100:00100000:3.0:1763333173.018527:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56843:x1848987613648256:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 565us (773us total) trans 0 rc 301/301 00000100:00100000:3.0:1763333173.018536:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9147 00000100:00100000:3.0:1763333173.022126:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333173.022206:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613648384 00000100:00100000:0.0:1763333173.022216:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613648384 00000100:00100000:3.0:1763333173.022238:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333173.022280:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613648640 00000100:00100000:0.0:1763333173.022284:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613648640 00000100:00100000:3.0:1763333173.022483:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9148 00000100:00100000:2.0:1763333173.022555:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56843:x1848987613648384:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333173.022578:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333173.022604:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5597d lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696941f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.022669:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55984 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333173.022691:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55984 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.022704:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55984 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:2.0:1763333173.022753:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1763333173.022760:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1763333173.022799:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5597d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696941f expref: 234 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.022820:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55984 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696941f expref: 233 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.022829:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31800) 00010000:00010000:2.0:1763333173.022833:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1763333173.022836:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4a00, rc 0) 00000100:00100000:2.0:1763333173.022901:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56843:x1848987613648384:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 406us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333173.022910:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9148 00000100:00100000:2.0:1763333173.022941:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9149 00000100:00100000:2.0:1763333173.022952:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56844:x1848987613648640:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333173.022961:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333173.022970:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5598b lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969426 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.023019:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55992 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333173.024265:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55992 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.024279:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55992 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.024299:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55999 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333173.024308:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55999 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.024317:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55999 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.024375:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55992 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.024385:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55992 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.024392:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55992 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.024399:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55992 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.024405:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333173.024410:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55992 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.024417:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55992 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.024434:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31800) 00010000:00010000:2.0:1763333173.024437:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333173.024442:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55992 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.024448:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55992 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.024464:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55999 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.024470:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55999 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.024477:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55999 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.024484:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333173.024487:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55999 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.024493:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55999 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.024504:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43a31b00) 00010000:00010000:2.0:1763333173.024506:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333173.024521:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55999 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.024529:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55999 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.024568:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5598b lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969426 expref: 233 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.024581:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31800) 00010000:00010000:2.0:1763333173.024585:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763333173.024590:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c5598b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969426 expref: 233 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.024604:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4600, rc 0) 00000100:00100000:2.0:1763333173.024654:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56844:x1848987613648640:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1703us (2413us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333173.024664:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9149 00000100:00100000:3.0:1763333173.031714:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333173.033884:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613648896 00000100:00100000:1.0:1763333173.033898:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613648896 00000100:00100000:0.0:1763333173.035937:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9150 00000100:00100000:0.0:1763333173.035959:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56843:x1848987613648896:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333173.035982:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333173.035989:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763333173.036016:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55984 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696941f expref: 232 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.036036:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31800) 00010000:00010000:0.0:1763333173.036046:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333173.036064:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c559a0 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696942d expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.036787:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c559a7 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333173.036802:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c559a7 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.036812:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c559a7 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.036821:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c559ae lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333173.036828:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c559ae lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.036833:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c559ae lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.037179:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c559b5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333173.037188:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c559b5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.037194:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c559b5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:0.0:1763333173.037204:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1a8:0x0]: returning size 0 00010000:00010000:0.0:1763333173.037224:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c559a7 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.037230:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c559a7 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.037236:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c559a7 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.037242:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c559a7 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.037247:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdea00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333173.037250:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c559a7 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.037256:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c559a7 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.037264:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12800) 00010000:00010000:0.0:1763333173.037267:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333173.037270:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c559a7 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.037278:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c559a7 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000004:00010000:0.0:1763333173.037290:0:8606:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003a16ea78 reply state 00000000124044fc transno 4294972174 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c559ae lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.037299:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c559ae lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.037305:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43a31b00) 00010000:00010000:0.0:1763333173.037307:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333173.037309:0:8606:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763333173.037335:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c559a0 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696942d expref: 234 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.037373:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c559b5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696942d expref: 233 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.037381:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a8:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:0.0:1763333173.037383:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333173.037385:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feb400, rc 0) 00000100:00100000:0.0:1763333173.037469:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:56843:x1848987613648896:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1522us (5766us total) trans 4294972174 rc 0/0 00000100:00100000:0.0:1763333173.037477:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9150 00000100:00100000:2.0:1763333173.047389:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333173.047802:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613649152 00000100:00100000:0.0:1763333173.047811:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613649152 00000100:00100000:0.0:1763333173.047871:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9151 00000100:00100000:0.0:1763333173.047880:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:56843:x1848987613649152:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333173.047906:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333173.047926:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c559c3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969434 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.052335:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c559ca lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333173.052407:0:8606:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c559b5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696942d expref: 235 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.052416:0:8606:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c559ca lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.052462:0:8606:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c559b5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696942d expref: 235 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.052476:0:8606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c559b5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696942d expref: 235 pid: 8606 timeout: 1377 lvb_type: 0 00000100:00100000:2.0:1763333173.052491:0:8606:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe469a1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627244544:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333173.052598:0:8606:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4869d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763333173.052711:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333173.054107:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613649408 00000100:00100000:0.0:1763333173.054120:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613649408 00000100:00100000:0.0:1763333173.054192:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9152 00000100:00100000:0.0:1763333173.054202:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56845:x1848987613649408:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333173.054223:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333173.054245:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c559d1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696943b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.054339:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c559d8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333173.054386:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c559d8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333173.054400:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c559d8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:0.0:1763333173.054411:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1a8:0x0]: returning size 0 00010000:00010000:0.0:1763333173.054492:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c559d8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333173.054499:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c559d8 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333173.054505:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c559d8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333173.054519:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333173.054523:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c559d8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333173.054530:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c559d8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333173.054543:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a8:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:0.0:1763333173.054545:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1763333173.054549:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c559d8 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333173.054555:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c559d8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333173.054598:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c559d1 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1a8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696943b expref: 238 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.054606:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a8:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:0.0:1763333173.054608:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763333173.054611:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c559d1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1a8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696943b expref: 238 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.054620:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea800, rc 0) 00000100:00100000:0.0:1763333173.054669:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56845:x1848987613649408:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 470us (1959us total) trans 4294972175 rc 301/301 00000100:00100000:0.0:1763333173.054676:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9152 00000100:00100000:2.0:1763333173.059238:0:8606:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe469a1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627244544:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333173.059278:0:8606:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c559ca lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000100:00100000:1.0:1763333173.060635:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333173.061268:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613649664 00000100:00100000:3.0:1763333173.061278:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613649664 00000100:00100000:1.0:1763333173.062073:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.062161:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3127 00000100:00100000:2.0:1763333173.062185:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56845:x1848987613649664:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333173.062467:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56845:x1848987613649664:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 294us (1837us total) trans 4294972176 rc 0/0 00000100:00100000:2.0:1763333173.062476:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3127 00000100:00100000:0.0:1763333173.063004:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613649792 00000100:00100000:0.0:1763333173.063011:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613649792 00010000:00010000:0.0:1763333173.063044:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c559b5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696942d expref: 238 pid: 8606 timeout: 1377 lvb_type: 0 00000100:00100000:0.0:1763333173.063072:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3001 00000100:00100000:0.0:1763333173.063081:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff51e55450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:2420:x1848987613649792:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333173.063092:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333173.063099:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c559b5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696942d expref: 238 pid: 8606 timeout: 1377 lvb_type: 0 00010000:00010000:0.0:1763333173.063112:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c559b5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696942d expref: 238 pid: 8606 timeout: 1377 lvb_type: 0 00010000:00010000:0.0:1763333173.063139:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c559b5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696942d expref: 238 pid: 8606 timeout: 1377 lvb_type: 0 00010000:00010000:0.0:1763333173.063154:0:8423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a8:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:0.0:1763333173.063159:0:8423:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c559ca lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.063170:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c559ca lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.063177:0:8423:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c559ca lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.065087:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333173.065162:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff51e55450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:2420:x1848987613649792:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 2076us (3085us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333173.065174:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3001 00010000:00010000:2.0:1763333173.065955:0:8606:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c559ca lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.065967:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c559ca lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:2.0:1763333173.065996:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1a8:0x0]: returning size 0 00000004:00080000:2.0:1763333173.066198:0:8606:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x22b:0x0], index 0: 0 00000004:00080000:2.0:1763333173.066206:0:8606:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x22b:0x0], index 1: 0 00000004:00080000:2.0:1763333173.066212:0:8606:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x22c:0x0], index 1: 0 00000004:00080000:2.0:1763333173.066216:0:8606:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x22c:0x0], index 0: 0 00010000:00010000:2.0:1763333173.066329:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c559ca lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.066337:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c559ca lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.066344:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c559ca lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.066371:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333173.066377:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c559ca lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.066384:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c559ca lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.066399:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a8:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:2.0:1763333173.066402:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333173.066406:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c559ca lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.066412:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c559ca lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.066467:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c559c3 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1a8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969434 expref: 237 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.066477:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a8:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:2.0:1763333173.066479:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763333173.066482:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c559c3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1a8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969434 expref: 237 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.066497:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feaa00, rc 0) 00000100:00100000:2.0:1763333173.066567:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56843:x1848987613649152:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 18687us (19187us total) trans 4294972177 rc 301/301 00000100:00100000:2.0:1763333173.066575:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9151 00000100:00100000:1.0:1763333173.074651:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.074941:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613650048 00000100:00100000:2.0:1763333173.074952:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613650048 00000100:00100000:2.0:1763333173.075035:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9153 00000100:00100000:2.0:1763333173.075047:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56845:x1848987613650048:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333173.075076:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333173.075105:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c559ed lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969442 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.075192:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c559f4 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333173.075207:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c559f4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.075220:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c559f4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.075230:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c559fb lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333173.075237:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c559fb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.075244:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c559fb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.075405:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55a02 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333173.075414:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55a02 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.075421:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55a02 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.075537:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c559f4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.075544:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c559f4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.075551:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c559f4 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.075558:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c559f4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.075565:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333173.075569:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c559f4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.075577:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c559f4 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.075590:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31a00) 00010000:00010000:2.0:1763333173.075594:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333173.075599:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c559f4 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.075605:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c559f4 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.075617:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c559fb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.075623:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c559fb lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.075628:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c559fb lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.075634:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333173.075636:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c559fb lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.075645:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c559fb lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.075652:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43a31b00) 00010000:00010000:2.0:1763333173.075654:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333173.075657:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c559fb lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.075662:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c559fb lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.075704:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c559ed lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969442 expref: 239 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.075721:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55a02 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969442 expref: 238 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.075729:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a8:0x0].0x0 (ffff92fe43a31600) 00010000:00010000:2.0:1763333173.075731:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333173.075733:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5400, rc 0) 00000100:00100000:2.0:1763333173.075799:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56845:x1848987613650048:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 754us (1160us total) trans 4294972178 rc 0/0 00000100:00100000:2.0:1763333173.075807:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9153 00000100:00100000:3.0:1763333173.077142:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333173.077296:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613650304 00000100:00100000:0.0:1763333173.077305:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613650304 00000100:00100000:0.0:1763333173.077374:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3128 00000100:00100000:0.0:1763333173.077383:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56843:x1848987613650304:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333173.077632:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56843:x1848987613650304:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 249us (494us total) trans 4294972179 rc 0/0 00000100:00100000:0.0:1763333173.077640:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3128 00000100:00100000:3.0:1763333173.081090:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.081172:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613650560 00000100:00100000:2.0:1763333173.081183:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613650560 00000100:00100000:2.0:1763333173.081242:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3129 00000100:00100000:2.0:1763333173.081251:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56843:x1848987613650560:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333173.081480:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:56843:x1848987613650560:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 230us (399us total) trans 4294972180 rc 0/0 00000100:00100000:2.0:1763333173.081488:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3129 00000100:00100000:1.0:1763333173.082023:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333173.082059:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333173.082495:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613650688 00000100:00100000:3.0:1763333173.082503:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613650688 00000100:00100000:3.0:1763333173.082554:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613650816 00000100:00100000:3.0:1763333173.082558:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613650816 00000100:00100000:3.0:1763333173.085419:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6399 00000100:00100000:3.0:1763333173.085439:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2420:x1848987613650688:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333173.085458:0:28650:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333173.085483:0:28650:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c55a10 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969449 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333173.085615:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6400 00000100:00100000:1.0:1763333173.085626:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2420:x1848987613650816:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333173.085634:0:28651:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333173.085646:0:28651:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c55a17 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969450 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333173.085661:0:28651:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x22c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333173.085681:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333173.085682:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333173.085690:0:28651:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c55a17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969450 expref: 15 pid: 28651 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333173.085707:0:28651:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c55a17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969450 expref: 15 pid: 28651 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333173.085719:0:28651:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f000, rc 0) 00002000:00010000:3.0:1763333173.086112:0:28650:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x22c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333173.086129:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333173.086131:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333173.086137:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c55a10 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969449 expref: 24 pid: 28650 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333173.086151:0:28650:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c55a10 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969449 expref: 24 pid: 28650 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333173.086160:0:28650:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a97200, rc 0) 00000100:00100000:1.0:1763333173.086428:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2420:x1848987613650816:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 803us (4366us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333173.086441:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6400 00000100:00100000:3.0:1763333173.086685:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:2420:x1848987613650688:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1253us (4664us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333173.086691:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6399 00000100:00100000:1.0:1763333173.091139:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333173.091318:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613651072 00000100:00100000:0.0:1763333173.091331:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613651072 00000100:00100000:0.0:1763333173.091412:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9154 00000100:00100000:0.0:1763333173.091423:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:55917:x1848987613651072:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333173.091446:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333173.091449:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763333173.091476:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55a02 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969442 expref: 240 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.091497:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a8:0x0].0x0 (ffff92fe43a31600) 00010000:00010000:0.0:1763333173.091526:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333173.091543:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c55a1e lrc: 2/0,0 mode: --/CW res: [0x240000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969457 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.091655:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c55a25 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333173.091669:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c55a25 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1a8:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.091680:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c55a25 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1a8:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:0.0:1763333173.091695:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1a8:0x0]: returning size 0 00010000:00010000:0.0:1763333173.091818:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c55a1e lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969457 expref: 242 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.091839:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c55a25 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1a8:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969457 expref: 241 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.091847:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a8:0x0].0x0 (ffff92fe44e12800) 00010000:00010000:0.0:1763333173.091850:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:0.0:1763333173.091853:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea800, rc 0) 00000100:00100000:0.0:1763333173.091904:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:55917:x1848987613651072:12345-192.168.204.28@tcp:101:bash.0 Request processed in 483us (775us total) trans 4294972181 rc 0/0 00000100:00100000:0.0:1763333173.091912:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9154 00000100:00100000:2.0:1763333173.107271:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.107332:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333173.107458:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613651328 00000100:00100000:1.0:1763333173.107468:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613651328 00000100:00100000:1.0:1763333173.107548:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9155 00000100:00100000:1.0:1763333173.107559:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:55917:x1848987613651328:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333173.107588:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333173.107611:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55a33 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969465 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.107649:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c55a3a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333173.107663:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c55a3a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333173.107675:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c55a3a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333173.107796:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55a33 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969465 expref: 243 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.107814:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c55a3a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969465 expref: 242 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.107823:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a8:0x0].0x0 (ffff92fe44e12800) 00010000:00010000:1.0:1763333173.107826:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763333173.107830:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e800, rc 0) 00000100:00100000:1.0:1763333173.107888:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:55917:x1848987613651328:12345-192.168.204.28@tcp:101:bash.0 Request processed in 331us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333173.107897:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9155 00000100:00100000:0.0:1763333173.107980:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613651200 00000100:00100000:0.0:1763333173.107985:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613651200 00000100:00100000:0.0:1763333173.108030:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6401 00000100:00100000:0.0:1763333173.108038:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2419:x1848987613651200:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333173.108047:0:8611:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333173.108061:0:8611:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c55a41 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696945e expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763333173.108083:0:8611:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x22b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333173.108100:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333173.108103:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333173.108113:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c55a41 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696945e expref: 16 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333173.108126:0:8611:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c55a41 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696945e expref: 16 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333173.108143:0:8611:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feb400, rc 0) 00000100:00100000:0.0:1763333173.108170:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2419:x1848987613651200:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 133us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333173.108176:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6401 00000100:00100000:2.0:1763333173.115259:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333173.115380:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613651584 00000100:00100000:0.0:1763333173.115393:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613651584 00000100:00100000:0.0:1763333173.115465:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9156 00000100:00100000:0.0:1763333173.115476:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:55917:x1848987613651584:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:0.0:1763333173.115545:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333173.115577:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c55a25 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1a8:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969457 expref: 242 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.115599:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a8:0x0].0x0 (ffff92fe44e12800) 00010000:00010000:0.0:1763333173.115605:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333173.115789:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c55a48 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333173.115803:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c55a48 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.115812:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c55a48 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000001:00080000:0.0:1763333173.115857:0:12741:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294972182 00000004:00010000:0.0:1763333173.115881:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000eb468051 reply state 00000000bc005f64 transno 4294972183 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c55a48 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.115894:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c55a48 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.115902:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a8:0x0].0x0 (ffff92fe44e12800) 00010000:00010000:0.0:1763333173.115906:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333173.115908:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763333173.116007:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:55917:x1848987613651584:12345-192.168.204.28@tcp:36:bash.0 Request processed in 531us (760us total) trans 4294972183 rc 0/0 00000100:00100000:0.0:1763333173.116014:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9156 00000020:00080000:0.0:1763333173.116020:0:12741:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763333173.123145:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.123252:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613651712 00000100:00100000:2.0:1763333173.123264:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613651712 00000100:00100000:2.0:1763333173.123332:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9157 00000100:00100000:2.0:1763333173.123343:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:55917:x1848987613651712:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333173.123389:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333173.123411:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55a4f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696946c expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.123473:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55a4f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696946c expref: 245 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.123489:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55a4f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696946c expref: 245 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.123521:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a8:0x0].0x0 (ffff92fe44e12800) 00010000:00010000:2.0:1763333173.123525:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333173.123529:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4c00, rc 0) 00000100:00100000:2.0:1763333173.123594:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:55917:x1848987613651712:12345-192.168.204.28@tcp:101:bash.0 Request processed in 252us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333173.123602:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9157 00000100:00100000:3.0:1763333173.131270:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333173.132114:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333173.132338:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613652096 00000100:00100000:0.0:1763333173.132363:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613652096 00000100:00100000:0.0:1763333173.132445:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3130 00000100:00100000:0.0:1763333173.132458:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56845:x1848987613652096:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333173.132724:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56845:x1848987613652096:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 268us (1464us total) trans 4294972184 rc 0/0 00000100:00100000:0.0:1763333173.132731:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3130 00000100:00100000:2.0:1763333173.133880:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613652224 00000100:00100000:2.0:1763333173.133893:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613652224 00000100:00100000:1.0:1763333173.134143:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9158 00000100:00100000:1.0:1763333173.134155:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:55917:x1848987613652224:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333173.134178:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333173.134182:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763333173.134219:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55a4f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696946c expref: 246 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.134240:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a8:0x0].0x0 (ffff92fe44e12800) 00010000:00010000:1.0:1763333173.134246:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333173.134266:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55a56 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969473 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.134325:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55a5d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333173.134341:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55a5d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333173.134398:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55a5d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000040:00080000:1.0:1763333173.134648:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1374, 88 off116104 00000004:00080000:1.0:1763333173.134659:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1277214309796ns, next at 1278003234678ns, rc = 0 00000040:00080000:1.0:1763333173.134704:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1373, 88 off116104 00000004:00080000:1.0:1763333173.134711:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1277214362353ns, next at 1277223362238ns, rc = 0 00000040:00080000:1.0:1763333173.134728:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1374, 88 off116192 00000004:00080000:1.0:1763333173.134733:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1277214383848ns, next at 1277223362238ns, rc = 0 00000040:00080000:1.0:1763333173.134743:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1375, 88 off116192 00000004:00080000:1.0:1763333173.134746:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1277214397149ns, next at 1278003234678ns, rc = 0 00000100:00100000:3.0:1763333173.139403:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.139615:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613652480 00000100:00100000:2.0:1763333173.139629:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613652480 00000100:00100000:2.0:1763333173.139688:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9159 00000100:00100000:2.0:1763333173.139698:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:56845:x1848987613652480:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333173.139725:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333173.139751:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55a64 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696947a expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.139832:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55a6b lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333173.139846:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55a6b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.139858:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55a6b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.139868:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55a72 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333173.139876:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55a72 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.139881:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55a72 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.139990:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55a79 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333173.140000:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55a79 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.140007:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55a79 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:2.0:1763333173.140022:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1a8:0x0]: returning size 2 00010000:00010000:2.0:1763333173.140375:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55a79 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.140384:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55a79 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.140390:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55a79 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.140396:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333173.140401:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55a79 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.140407:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55a79 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.140419:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a8:0x0].0x0 (ffff92fe44e12800) 00010000:00010000:2.0:1763333173.140422:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1763333173.140426:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55a79 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.140432:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55a79 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.140450:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55a6b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.140455:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55a6b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.140461:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55a6b lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.140471:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55a6b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.140476:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333173.140478:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55a6b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.140485:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55a6b lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.140492:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31a00) 00010000:00010000:2.0:1763333173.140495:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333173.140499:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55a6b lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.140504:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55a6b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.140525:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55a72 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.140531:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55a72 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.140537:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55a72 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.140542:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333173.140545:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55a72 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.140550:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55a72 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.140561:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43a31b00) 00010000:00010000:2.0:1763333173.140564:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333173.140566:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55a72 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.140571:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55a72 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.140606:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55a64 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696947a expref: 250 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.140617:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31a00) 00010000:00010000:2.0:1763333173.140620:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763333173.140623:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55a64 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696947a expref: 250 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.140636:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4400, rc 0) 00000100:00100000:2.0:1763333173.140705:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:56845:x1848987613652480:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1007us (1313us total) trans 4294972186 rc 301/301 00000100:00100000:2.0:1763333173.140712:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9159 00000001:00080000:1.0:1763333173.142205:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972185 is committed 00000004:00080000:1.0:1763333173.142214:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 900 committed 00010000:00010000:2.0:1763333173.142850:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55929 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.142863:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55929 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.142870:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55929 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.142875:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333173.142880:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55929 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.142887:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55929 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.142902:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43a31b00) 00010000:00010000:2.0:1763333173.142904:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333173.142908:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55929 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.142913:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55929 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.142930:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c559ae lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.142936:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c559ae lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.142941:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c559ae lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.142945:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feba00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333173.142947:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c559ae lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00000100:00100000:0.0:1763333173.143303:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e00fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627244672:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763333173.143387:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333173.143417:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e00f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627245184:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333173.143434:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333173.143451:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1763333173.143456:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e00ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627244800:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763333173.143470:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333173.143481:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7569f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627245312:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333173.143495:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333173.143528:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e00d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627245056:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763333173.143547:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333173.143563:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1763333173.143567:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e00c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627244928:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763333173.143581:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333173.143605:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627244672 00000100:00100000:0.0:1763333173.143611:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627244672 00000100:00100000:0.0:1763333173.143651:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627245184 00000100:00100000:0.0:1763333173.143653:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627245184 00000100:00100000:0.0:1763333173.143664:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627244800 00000100:00100000:0.0:1763333173.143666:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627244800 00000100:00100000:0.0:1763333173.143676:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627245312 00000100:00100000:0.0:1763333173.143678:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627245312 00000100:00100000:0.0:1763333173.143687:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627245056 00000100:00100000:0.0:1763333173.143689:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627245056 00000100:00100000:0.0:1763333173.143696:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627244928 00000100:00100000:0.0:1763333173.143698:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627244928 00000100:00100000:0.0:1763333173.143708:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6402 00000100:00100000:0.0:1763333173.143715:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+16:3652:x1848987627244672:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1763333173.143737:0:28650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:549 count 1 00010000:00010000:0.0:1763333173.143760:0:28650:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c55a87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.143777:0:28650:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c555da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692eb expref: 15 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.143785:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333173.143787:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333173.143791:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c55a87 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.143815:0:28650:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c555da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692eb expref: 15 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.143832:0:28650:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c555da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692eb expref: 15 pid: 8404 timeout: 1377 lvb_type: 0 00000100:00100000:0.0:1763333173.143842:0:28650:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7403ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28650:1848987627245440:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333173.143894:0:28650:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe43aa63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763333173.143907:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6403 00000100:00100000:0.0:1763333173.143914:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+16:3652:x1848987627245184:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1763333173.144045:0:28651:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x22b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333173.144048:0:28651:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x22b:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763333173.144050:0:28651:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x22b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333173.144052:0:28651:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x22b:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763333173.144054:0:28651:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x22b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333173.144088:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+17:3652:x1848987627245184:12345-0@lo:2:osp-syn-0-1.0 Request processed in 174us (653us total) trans 21474838829 rc 0/0 00000100:00100000:0.0:1763333173.144094:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6403 00000100:00100000:0.0:1763333173.144110:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6404 00000100:00100000:0.0:1763333173.144116:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+16:3652:x1848987627244800:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1763333173.144124:0:28651:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:550 count 1 00010000:00010000:0.0:1763333173.144133:0:28651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c55a8e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.144144:0:28651:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abde400/0xb32e3ef184c5583b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693af expref: 15 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.144150:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333173.144151:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333173.144154:0:28651:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c55a8e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.144173:0:28651:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe4abde400/0xb32e3ef184c5583b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693af expref: 15 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.144182:0:28651:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abde400/0xb32e3ef184c5583b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693af expref: 15 pid: 29010 timeout: 1377 lvb_type: 0 00000100:00100000:0.0:1763333173.144191:0:28651:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28651:1848987627245568:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333173.144211:0:28651:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe43aa6900 going to sleep for 11 seconds 00000100:00100000:0.0:1763333173.144225:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6405 00000100:00100000:0.0:1763333173.144231:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+16:3652:x1848987627245312:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1763333173.144277:0:29013:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x22c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333173.144280:0:29013:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x22c:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763333173.144282:0:29013:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x22c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333173.144284:0:29013:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x22c:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763333173.144286:0:29013:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x22c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333173.144306:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+17:3652:x1848987627245312:12345-0@lo:2:osp-syn-0-1.0 Request processed in 76us (810us total) trans 21474838830 rc 0/0 00000100:00100000:0.0:1763333173.144311:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6405 00000100:00100000:0.0:1763333173.144321:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6406 00000100:00100000:0.0:1763333173.144327:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74039180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+16:3655:x1848987627245056:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1763333173.144335:0:29013:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:554 count 1 00002000:00010000:0.0:1763333173.144370:0:29013:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x22a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333173.144375:0:29013:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c55a95 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.144383:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333173.144384:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333173.144389:0:29013:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c55a95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.144399:0:29013:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c55a95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.144407:0:29013:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c55a95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.144414:0:29013:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c55a95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.144429:0:29013:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763333173.144571:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74039180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+17:3655:x1848987627245056:12345-0@lo:6:osp-syn-0-1.0 Request processed in 243us (1021us total) trans 21474838831 rc 0/0 00000100:00100000:0.0:1763333173.144576:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6406 00000100:00100000:0.0:1763333173.144586:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6407 00000100:00100000:0.0:1763333173.144591:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7403b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+16:3655:x1848987627244928:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1763333173.144599:0:29013:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:553 count 1 00010000:00010000:0.0:1763333173.144609:0:29013:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c55a9c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.144618:0:29013:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf400/0xb32e3ef184c558ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693e7 expref: 15 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.144629:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333173.144631:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333173.144633:0:29013:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c55a9c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.144647:0:29013:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf400/0xb32e3ef184c558ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693e7 expref: 15 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.144655:0:29013:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf400/0xb32e3ef184c558ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693e7 expref: 15 pid: 28650 timeout: 1377 lvb_type: 0 00000100:00100000:0.0:1763333173.144669:0:29013:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29013:1848987627245696:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333173.144689:0:29013:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe43aa66c0 going to sleep for 11 seconds 00000004:00080000:0.0:1763333173.144726:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7e00d880/2, rc 0, transno 21474838831 00000100:00100000:0.0:1763333173.144731:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e00d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627245056:0@lo:6:osp-syn-0-1.0 00000004:00080000:0.0:1763333173.144745:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7569f480/2, rc 0, transno 21474838830 00000100:00100000:0.0:1763333173.144748:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7569f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627245312:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1763333173.144755:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7e00f100/2, rc 0, transno 21474838829 00000100:00100000:0.0:1763333173.144758:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e00f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627245184:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1763333173.144831:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 896 committed 00000004:00080000:1.0:1763333173.144846:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 895 committed 00000004:00080000:1.0:1763333173.144849:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 899 committed 00000004:00080000:1.0:1763333173.144874:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 898 committed 00010000:00010000:1.0:1763333173.145049:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55a5d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a8:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969473 expref: 231 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.145059:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a8:0x0].0x0 (ffff92fe44e12800) 00010000:00010000:1.0:1763333173.145062:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763333173.145076:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55a56 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969473 expref: 231 pid: 8606 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763333173.145089:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55a5d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a8:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969473 expref: 230 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.145115:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a8:0x0].0x0 (ffff92fe44e12800) 00010000:00010000:1.0:1763333173.145117:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763333173.145119:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7fe00, rc 0) 00000100:00100000:1.0:1763333173.145146:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:55917:x1848987613652224:12345-192.168.204.28@tcp:101:bash.0 Request processed in 10995us (13036us total) trans 4294972185 rc 0/0 00000100:00100000:1.0:1763333173.145154:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9158 00010000:00010000:1.0:1763333173.145203:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333173.145209:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c55a95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.145222:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feaa00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333173.145226:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c55a95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.145234:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c55a95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.145246:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c55a95 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.145253:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c55a95 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.145268:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333173.145269:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333173.145271:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763333173.145741:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333173.145765:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613652736 00000100:00100000:3.0:1763333173.145771:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613652736 00000100:00100000:3.0:1763333173.145801:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3131 00000100:00100000:3.0:1763333173.145808:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56845:x1848987613652736:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333173.145939:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56845:x1848987613652736:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 131us (199us total) trans 4294972187 rc 0/0 00000100:00100000:3.0:1763333173.145945:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3131 00000100:00100000:0.0:1763333173.150106:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627246208:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763333173.150175:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333173.150210:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1763333173.150216:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77b15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627246080:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763333173.150235:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333173.150261:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627246208 00000100:00100000:0.0:1763333173.150267:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627246208 00000100:00100000:0.0:1763333173.150303:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627246080 00000100:00100000:0.0:1763333173.150305:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627246080 00000100:00100000:0.0:1763333173.150322:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6408 00000100:00100000:0.0:1763333173.150330:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+28:3653:x1848987627246208:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1763333173.150376:0:8406:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:554 count 1 00002000:00010000:0.0:1763333173.150411:0:8406:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x22a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333173.150418:0:8406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c55aa3 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.150434:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333173.150436:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333173.150442:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c55aa3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.150456:0:8406:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c55aa3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.150466:0:8406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c55aa3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.150473:0:8406:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c55aa3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.150491:0:8406:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763333173.150712:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+29:3653:x1848987627246208:12345-0@lo:6:osp-syn-1-1.0 Request processed in 381us (535us total) trans 17179871526 rc 0/0 00000100:00100000:0.0:1763333173.150719:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6408 00000100:00100000:0.0:1763333173.150737:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6409 00000100:00100000:0.0:1763333173.150743:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+28:3653:x1848987627246080:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1763333173.150752:0:8406:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:553 count 1 00010000:00010000:0.0:1763333173.150765:0:8406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe48190200/0xb32e3ef184c55aaa lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.150779:0:8406:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c558c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693e0 expref: 23 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.150786:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333173.150788:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333173.150791:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe48190200/0xb32e3ef184c55aaa lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.150816:0:8406:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c558c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693e0 expref: 23 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.150829:0:8406:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c558c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693e0 expref: 23 pid: 29010 timeout: 1377 lvb_type: 0 00000100:00100000:0.0:1763333173.150840:0:8406:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4684c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8406:1848987627246592:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333173.150896:0:8406:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe43aa6b40 going to sleep for 11 seconds 00010000:00010000:0.0:1763333173.150915:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333173.150921:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c55aa3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.150928:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdea00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333173.150932:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c55aa3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.150940:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c55aa3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.150955:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c55aa3 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.150961:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c55aa3 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.150978:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333173.150979:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333173.150981:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763333173.151008:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff77b16300/2, rc 0, transno 17179871526 00000100:00100000:0.0:1763333173.151014:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627246208:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763333173.151106:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627245824:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763333173.151136:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333173.151163:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627246336:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333173.151181:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333173.151195:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1763333173.151201:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627245952:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763333173.151217:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333173.151227:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77b14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627246464:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333173.151243:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333173.151265:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627245824 00000100:00100000:1.0:1763333173.151269:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627245824 00000100:00100000:1.0:1763333173.151291:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627246336 00000100:00100000:1.0:1763333173.151293:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627246336 00000100:00100000:1.0:1763333173.151301:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627245952 00000100:00100000:1.0:1763333173.151303:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627245952 00000100:00100000:1.0:1763333173.151310:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627246464 00000100:00100000:1.0:1763333173.151312:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627246464 00000100:00100000:1.0:1763333173.151321:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6410 00000100:00100000:1.0:1763333173.151327:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+32:3654:x1848987627245824:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763333173.151340:0:29010:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:549 count 1 00010000:00010000:1.0:1763333173.151374:0:29010:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55ab1 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.151388:0:29010:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c55888 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693cb expref: 23 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.151394:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333173.151396:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333173.151398:0:29010:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55ab1 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.151418:0:29010:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c55888 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693cb expref: 23 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.151426:0:29010:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c55888 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693cb expref: 23 pid: 8407 timeout: 1377 lvb_type: 0 00000100:00100000:1.0:1763333173.151434:0:29010:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42efb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:29010:1848987627246720:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333173.151462:0:29010:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe46e0e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763333173.152053:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333173.152071:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333173.152090:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613652992 00000100:00100000:1.0:1763333173.152095:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613652992 00010000:00010000:1.0:1763333173.152118:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abde400/0xb32e3ef184c5583b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693af expref: 16 pid: 29010 timeout: 1377 lvb_type: 0 00000100:00100000:1.0:1763333173.152139:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613653120 00000100:00100000:1.0:1763333173.152142:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613653120 00010000:00010000:1.0:1763333173.152151:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf400/0xb32e3ef184c558ce lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693e7 expref: 17 pid: 28650 timeout: 1377 lvb_type: 0 00000100:00100000:1.0:1763333173.152168:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3002 00000100:00100000:1.0:1763333173.152175:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2420:x1848987613652992:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333173.152185:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333173.152190:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe4abde400/0xb32e3ef184c5583b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693af expref: 17 pid: 29010 timeout: 1377 lvb_type: 0 00010000:00010000:1.0:1763333173.152201:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe4abde400/0xb32e3ef184c5583b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693af expref: 17 pid: 29010 timeout: 1377 lvb_type: 0 00010000:00010000:1.0:1763333173.152218:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333173.152220:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333173.152224:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c55a8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.152233:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c55a8e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.152253:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333173.152282:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2420:x1848987613652992:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 107us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333173.152289:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3002 00000100:00100000:1.0:1763333173.152305:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3003 00000100:00100000:1.0:1763333173.152312:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2420:x1848987613653120:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333173.152320:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333173.152324:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf400/0xb32e3ef184c558ce lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693e7 expref: 16 pid: 28650 timeout: 1377 lvb_type: 0 00010000:00010000:1.0:1763333173.152333:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf400/0xb32e3ef184c558ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693e7 expref: 16 pid: 28650 timeout: 1377 lvb_type: 0 00010000:00010000:1.0:1763333173.152344:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333173.152345:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333173.152377:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c55a9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.152386:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c55a9c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.152399:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333173.152418:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2420:x1848987613653120:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 107us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333173.152424:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3003 00000100:00100000:1.0:1763333173.152457:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333173.152496:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333173.152721:0:28650:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7403ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28650:1848987627245440:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333173.152744:0:28650:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c55a87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333173.152766:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613653376 00000100:00100000:3.0:1763333173.152770:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613653376 00000100:00100000:3.0:1763333173.152798:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3132 00000100:00100000:3.0:1763333173.152805:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bd5d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56845:x1848987613653376:12345-192.168.204.28@tcp:33:lfs.0 00000100:00100000:3.0:1763333173.152920:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bd5d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56845:x1848987613653376:12345-192.168.204.28@tcp:33:lfs.0 Request processed in 115us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333173.152927:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3132 00010000:00010000:2.0:1763333173.153044:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c559ae lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.153057:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43a31b00) 00010000:00010000:2.0:1763333173.153061:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333173.153065:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c559ae lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.153077:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c559ae lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.153102:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c55a48 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.153110:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c55a48 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.153115:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c55a48 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.153121:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333173.153124:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c55a48 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.153130:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c55a48 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.153138:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a8:0x0].0x0 (ffff92fe44e12800) 00010000:00010000:2.0:1763333173.153141:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333173.153144:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c55a48 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.153150:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c55a48 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000100:00100000:1.0:1763333173.153260:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333173.153693:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613652864 00000100:00100000:3.0:1763333173.153699:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613652864 00010000:00010000:3.0:1763333173.153720:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c555da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692eb expref: 16 pid: 8404 timeout: 1377 lvb_type: 0 00000100:00100000:1.0:1763333173.154076:0:29010:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42efb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:29010:1848987627246720:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333173.154096:0:29010:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55ab1 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333173.154609:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3004 00000100:00100000:3.0:1763333173.154619:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2418:x1848987613652864:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333173.154633:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333173.154638:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c555da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692eb expref: 16 pid: 8404 timeout: 1377 lvb_type: 0 00010000:00010000:3.0:1763333173.154649:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c555da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692eb expref: 16 pid: 8404 timeout: 1377 lvb_type: 0 00010000:00010000:3.0:1763333173.154666:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c555da lrc: 0/0,0 mode: --/PW res: [0x280000400:0x225:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369692eb expref: 16 pid: 8404 timeout: 1377 lvb_type: 0 00010000:00010000:3.0:1763333173.154679:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333173.154681:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333173.154684:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c55a87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.154693:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c55a87 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.154720:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333173.154757:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2418:x1848987613652864:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 140us (1497us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333173.154764:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3004 00010000:00010000:1.0:1763333173.154931:0:28650:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c55a87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.154941:0:28650:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c55a87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.154951:0:28650:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c55a87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.154959:0:28650:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c55a87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.155484:0:28650:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763333173.155773:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+17:3652:x1848987627244672:12345-0@lo:6:osp-syn-0-1.0 Request processed in 12056us (12385us total) trans 21474838832 rc 0/0 00000100:00100000:1.0:1763333173.155784:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6402 00000100:00100000:1.0:1763333173.155806:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613653248 00000100:00100000:1.0:1763333173.155811:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613653248 00000100:00100000:1.0:1763333173.155833:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6411 00000100:00100000:1.0:1763333173.155841:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+32:3654:x1848987627246336:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333173.155994:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+33:3654:x1848987627246336:12345-0@lo:2:osp-syn-1-1.0 Request processed in 154us (4811us total) trans 17179871527 rc 0/0 00000100:00100000:1.0:1763333173.156001:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6411 00000100:00100000:1.0:1763333173.156015:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6412 00000100:00100000:1.0:1763333173.156022:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+32:3654:x1848987627245952:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763333173.156037:0:28650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:550 count 1 00010000:00010000:1.0:1763333173.156056:0:28650:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55ab8 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.156073:0:28650:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c55842 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693b6 expref: 23 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.156081:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333173.156083:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333173.156086:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55ab8 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.156119:0:28650:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c55842 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693b6 expref: 23 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.156132:0:28650:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c55842 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693b6 expref: 23 pid: 8407 timeout: 1377 lvb_type: 0 00000100:00100000:1.0:1763333173.156146:0:28650:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42efb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28650:1848987627246848:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333173.156211:0:28650:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe46e0e180 going to sleep for 11 seconds 00000004:00080000:1.0:1763333173.156260:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff77b14380/2, rc 0, transno 17179871527 00000100:00100000:1.0:1763333173.156267:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627246336:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333173.156807:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6413 00000100:00100000:0.0:1763333173.156819:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+32:3654:x1848987627246464:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1763333173.156900:0:8404:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x22c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333173.156903:0:8404:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x22c:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763333173.156906:0:8404:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x22c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333173.156908:0:8404:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x22c:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763333173.156910:0:8404:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x22c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333173.156946:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+33:3654:x1848987627246464:12345-0@lo:2:osp-syn-1-1.0 Request processed in 132us (5702us total) trans 17179871528 rc 0/0 00000100:00100000:0.0:1763333173.156951:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6413 00000100:00100000:0.0:1763333173.156967:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6414 00000100:00100000:0.0:1763333173.156974:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:55917:x1848987613653248:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333173.156982:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333173.156993:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe48190400/0xb32e3ef184c55abf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969481 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.157009:0:8404:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c55a41 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696945e expref: 16 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333173.157016:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333173.157017:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333173.157021:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe48190400/0xb32e3ef184c55abf lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969481 expref: 16 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.157041:0:8404:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c55a41 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696945e expref: 16 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333173.157050:0:8404:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c55a41 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696945e expref: 16 pid: 8611 timeout: 1377 lvb_type: 1 00000100:00100000:0.0:1763333173.157059:0:8404:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4684c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8404:1848987627246976:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333173.157088:0:8404:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe43aa6a80 going to sleep for 11 seconds 00000004:00080000:0.0:1763333173.157130:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff77b14a80/2, rc 0, transno 17179871528 00000100:00100000:0.0:1763333173.157134:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77b14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627246464:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1763333173.157154:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7e00fb80/2, rc 0, transno 21474838832 00000100:00100000:0.0:1763333173.157158:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e00fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627244672:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1763333173.157180:0:28651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abde400/0xb32e3ef184c5583b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693af expref: 16 pid: 29010 timeout: 1377 lvb_type: 0 00000100:00100000:0.0:1763333173.157193:0:28651:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28651:1848987627245568:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333173.157210:0:28651:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c55a8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.157220:0:28651:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c55a8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.157227:0:28651:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c55a8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.157236:0:28651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c55a8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.157244:0:28651:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c55a8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.157691:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1763333173.157700:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c55a87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.157709:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea800 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333173.157715:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c55a87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.157724:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c55a87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.157740:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c55a87 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.157746:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c55a87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.157762:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333173.157765:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c55a8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.157770:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333173.157774:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c55a8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.157781:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c55a8e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.157790:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c55a8e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.157797:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333173.157799:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333173.157801:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333173.159054:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333173.159125:0:28651:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1763333173.159135:0:28651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c55a8e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333173.161305:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333173.161423:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:1.0:1763333173.161482:0:29013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf400/0xb32e3ef184c558ce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693e7 expref: 15 pid: 28650 timeout: 1377 lvb_type: 0 00000100:00100000:1.0:1763333173.161497:0:29013:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29013:1848987627245696:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333173.161528:0:29013:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c55a9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.161539:0:29013:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c55a9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.161545:0:29013:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c55a9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.161555:0:29013:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c55a9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.161562:0:29013:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c55a9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.161577:0:29013:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763333173.161748:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7403b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+18:3655:x1848987627244928:12345-0@lo:6:osp-syn-0-1.0 Request processed in 17155us (18163us total) trans 21474838834 rc 0/0 00000100:00100000:1.0:1763333173.161757:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6407 00010000:00010000:1.0:1763333173.161784:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333173.161790:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c55a9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.161802:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdfe00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333173.161806:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c55a9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.161814:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c55a9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.161831:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c55a9c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.161838:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c55a9c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.161853:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333173.161854:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333173.161856:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763333173.161883:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613653504 00000100:00100000:1.0:1763333173.161889:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613653504 00010000:00010000:1.0:1763333173.161916:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c558c0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693e0 expref: 24 pid: 29010 timeout: 1377 lvb_type: 0 00000100:00100000:1.0:1763333173.161935:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613653632 00000100:00100000:1.0:1763333173.161937:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613653632 00010000:00010000:1.0:1763333173.161946:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c55888 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693cb expref: 25 pid: 8407 timeout: 1377 lvb_type: 0 00000100:00100000:1.0:1763333173.161961:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3005 00000100:00100000:1.0:1763333173.161968:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:2420:x1848987613653504:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333173.161981:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333173.161985:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c558c0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x229:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693e0 expref: 25 pid: 29010 timeout: 1377 lvb_type: 0 00010000:00010000:1.0:1763333173.161994:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c558c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x229:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693e0 expref: 25 pid: 29010 timeout: 1377 lvb_type: 0 00010000:00010000:1.0:1763333173.162009:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333173.162011:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333173.162015:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe48190200/0xb32e3ef184c55aaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x229:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.162024:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe48190200/0xb32e3ef184c55aaa lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x229:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.162039:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333173.162068:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:2420:x1848987613653504:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 100us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333173.162074:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3005 00000100:00100000:1.0:1763333173.162085:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3006 00000100:00100000:1.0:1763333173.162090:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:2421:x1848987613653632:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333173.162096:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333173.162100:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c55888 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693cb expref: 24 pid: 8407 timeout: 1377 lvb_type: 0 00010000:00010000:1.0:1763333173.162108:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c55888 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693cb expref: 24 pid: 8407 timeout: 1377 lvb_type: 0 00010000:00010000:1.0:1763333173.162119:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c55888 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693cb expref: 24 pid: 8407 timeout: 1377 lvb_type: 0 00010000:00010000:1.0:1763333173.162128:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333173.162129:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333173.162133:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55ab1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.162139:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55ab1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.162151:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333173.162167:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2421:x1848987613653632:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 76us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333173.162172:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3006 00010000:00010000:1.0:1763333173.162189:0:29010:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55ab1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.162197:0:29010:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55ab1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.162204:0:29010:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55ab1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.162210:0:29010:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55ab1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.162227:0:29010:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763333173.162458:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+33:3654:x1848987627245824:12345-0@lo:6:osp-syn-1-1.0 Request processed in 11130us (11320us total) trans 17179871529 rc 0/0 00000100:00100000:1.0:1763333173.162465:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6410 00010000:00010000:1.0:1763333173.162569:0:8406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c558c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693e0 expref: 22 pid: 29010 timeout: 1377 lvb_type: 0 00000100:00100000:1.0:1763333173.162579:0:8406:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4684c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8406:1848987627246592:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333173.162592:0:8406:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe48190200/0xb32e3ef184c55aaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.162599:0:8406:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe48190200/0xb32e3ef184c55aaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.162605:0:8406:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe48190200/0xb32e3ef184c55aaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.162612:0:8406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe48190200/0xb32e3ef184c55aaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.162618:0:8406:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe48190200/0xb32e3ef184c55aaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.162628:0:8406:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1763333173.162712:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+33:3653:x1848987627246080:12345-0@lo:6:osp-syn-1-1.0 Request processed in 11970us (12475us total) trans 17179871530 rc 0/0 00000100:00100000:1.0:1763333173.162718:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6409 00010000:00010000:1.0:1763333173.162738:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1763333173.162743:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55ab1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.162751:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f800 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333173.162754:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55ab1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.162761:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55ab1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.162772:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55ab1 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.162778:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55ab1 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.162790:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333173.162793:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe48190200/0xb32e3ef184c55aaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.162799:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48190200 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333173.162801:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe48190200/0xb32e3ef184c55aaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.162807:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe48190200/0xb32e3ef184c55aaa lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.162815:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe48190200/0xb32e3ef184c55aaa lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.162821:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe48190200/0xb32e3ef184c55aaa lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.162829:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333173.162831:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333173.162832:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763333173.162852:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe472f7100/2, rc 0, transno 17179871529 00000100:00100000:1.0:1763333173.162856:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627245824:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1763333173.162876:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff77b15500/2, rc 0, transno 17179871530 00000100:00100000:1.0:1763333173.162879:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77b15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627246080:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1763333173.163069:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7e00c700/2, rc 0, transno 21474838834 00000100:00100000:3.0:1763333173.163075:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e00c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627244928:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763333173.163130:0:28650:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42efb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28650:1848987627246848:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333173.163145:0:28650:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55ab8 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.163229:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763333173.166936:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.167017:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613653760 00000100:00100000:2.0:1763333173.167027:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613653760 00010000:00010000:2.0:1763333173.167076:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c55842 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693b6 expref: 22 pid: 8407 timeout: 1377 lvb_type: 0 00000100:00100000:2.0:1763333173.167126:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3007 00000100:00100000:2.0:1763333173.167135:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2420:x1848987613653760:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333173.167153:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333173.167159:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c55842 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x226:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693b6 expref: 22 pid: 8407 timeout: 1377 lvb_type: 0 00010000:00010000:2.0:1763333173.167174:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c55842 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x226:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693b6 expref: 22 pid: 8407 timeout: 1377 lvb_type: 0 00010000:00010000:2.0:1763333173.167198:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c55842 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x226:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369693b6 expref: 22 pid: 8407 timeout: 1377 lvb_type: 0 00010000:00010000:2.0:1763333173.167217:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333173.167219:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333173.167224:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55ab8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.167233:0:6506:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55ab8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.167264:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333173.167311:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2420:x1848987613653760:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 176us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333173.167319:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3007 00010000:00010000:3.0:1763333173.167413:0:28650:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55ab8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.167422:0:28650:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55ab8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.167431:0:28650:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55ab8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.167439:0:28650:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55ab8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.167465:0:28650:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763333173.167720:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+33:3654:x1848987627245952:12345-0@lo:6:osp-syn-1-1.0 Request processed in 11697us (16500us total) trans 17179871531 rc 0/0 00000100:00100000:3.0:1763333173.167729:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6412 00000004:00080000:3.0:1763333173.167780:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe472f6a00/2, rc 0, transno 17179871531 00000100:00100000:3.0:1763333173.167787:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627245952:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1763333173.167909:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333173.167917:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55ab8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.167925:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e600 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333173.167928:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55ab8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.167937:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55ab8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.167949:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55ab8 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.167956:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55ab8 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.167974:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333173.167976:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333173.167977:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763333173.168058:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+17:3652:x1848987627244800:12345-0@lo:6:osp-syn-0-1.0 Request processed in 23940us (24584us total) trans 21474838833 rc 0/0 00000100:00100000:0.0:1763333173.168066:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6404 00000004:00080000:2.0:1763333173.168132:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7e00ca80/2, rc 0, transno 21474838833 00000100:00100000:2.0:1763333173.168138:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e00ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627244800:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763333173.171767:0:8404:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4684c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8404:1848987627246976:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333173.171813:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe48190400/0xb32e3ef184c55abf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969481 expref: 14 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.171840:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48190400, rc 0) 00000100:00100000:0.0:1763333173.171936:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:55917:x1848987613653248:12345-192.168.204.28@tcp:101:bash.0 Request processed in 14959us (19475us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333173.171946:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6414 00000100:00100000:3.0:1763333173.172792:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.174081:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613653888 00000100:00100000:2.0:1763333173.174094:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613653888 00010000:00010000:2.0:1763333173.174148:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c55a41 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696945e expref: 14 pid: 8611 timeout: 1377 lvb_type: 1 00000100:00100000:2.0:1763333173.174200:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3008 00000100:00100000:2.0:1763333173.174211:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff51e55c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2421:x1848987613653888:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333173.174228:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333173.174234:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c55a41 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696945e expref: 14 pid: 8611 timeout: 1377 lvb_type: 1 00010000:00010000:2.0:1763333173.174249:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c55a41 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696945e expref: 14 pid: 8611 timeout: 1377 lvb_type: 1 00010000:00010000:2.0:1763333173.174280:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c55a41 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696945e expref: 14 pid: 8611 timeout: 1377 lvb_type: 1 00010000:00010000:2.0:1763333173.174298:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333173.174301:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333173.174309:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe48190400/0xb32e3ef184c55abf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969481 expref: 13 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.174319:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe48190400/0xb32e3ef184c55abf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969481 expref: 13 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.174392:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff92fe48190400/0xb32e3ef184c55abf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969481 expref: 13 pid: 8404 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333173.174412:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe469a0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6505:1848987627247104:192.168.204.28@tcp:105: 00000100:00100000:2.0:1763333173.174499:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4869d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763333173.184804:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe469a0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6505:1848987627247104:192.168.204.28@tcp:105: 00010000:00010000:2.0:1763333173.184832:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333173.184885:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff51e55c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2421:x1848987613653888:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 10676us (12096us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333173.184896:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3008 00000100:00100000:0.0:1763333173.188935:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.189742:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613654016 00000100:00100000:2.0:1763333173.189756:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613654016 00000100:00100000:2.0:1763333173.189838:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6415 00000100:00100000:2.0:1763333173.189850:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:55917:x1848987613654016:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333173.189872:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333173.189899:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55ac6 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969488 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763333173.189927:0:8404:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x22b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763333173.189950:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333173.189953:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333173.189962:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55ac6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969488 expref: 22 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.189978:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55ac6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969488 expref: 22 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.189992:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4800, rc 0) 00000100:00100000:2.0:1763333173.190046:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:55917:x1848987613654016:12345-192.168.204.28@tcp:101:bash.0 Request processed in 198us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333173.190053:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6415 00000100:00100000:1.0:1763333173.190765:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.190847:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613654272 00000100:00100000:2.0:1763333173.190853:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613654272 00000100:00100000:2.0:1763333173.190898:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9160 00000100:00100000:2.0:1763333173.190907:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56846:x1848987613654272:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333173.190919:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333173.190941:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55acd lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696948f expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.191017:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55ad4 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333173.191030:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55ad4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.191040:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55ad4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.191052:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55adb lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333173.191058:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55adb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.191065:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55adb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.191174:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55ae2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333173.191184:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55ae2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.191191:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55ae2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:2.0:1763333173.191202:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1a8:0x0]: returning size 2 00010000:00010000:2.0:1763333173.191282:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55ad4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.191290:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55ad4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.191296:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55ad4 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.191303:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55ad4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.191309:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333173.191313:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55ad4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.191320:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55ad4 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.191332:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31100) 00010000:00010000:2.0:1763333173.191335:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333173.191339:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55ad4 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.191345:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55ad4 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.191381:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55adb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.191391:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55adb lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.191397:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55adb lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.191401:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333173.191404:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55adb lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.191410:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55adb lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.191417:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43a31c00) 00010000:00010000:2.0:1763333173.191419:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333173.191422:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55adb lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.191427:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55adb lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.191464:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55acd lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696948f expref: 232 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.191478:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55ae2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696948f expref: 231 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.191485:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a8:0x0].0x0 (ffff92fe44e12800) 00010000:00010000:2.0:1763333173.191487:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333173.191490:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4600, rc 0) 00000100:00100000:2.0:1763333173.191557:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56846:x1848987613654272:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 650us (794us total) trans 4294972188 rc 0/0 00000100:00100000:2.0:1763333173.191564:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9160 00000100:00100000:0.0:1763333173.199430:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333173.199465:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333173.199587:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613654400 00000100:00100000:1.0:1763333173.199598:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613654400 00000100:00100000:2.0:1763333173.199623:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613654528 00000100:00100000:2.0:1763333173.199629:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613654528 00002000:00010000:1.0:1763333173.199641:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/555 (0->18446744073709551615) 00002000:00100000:1.0:1763333173.199648:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4684e680 with x1848987613654400 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333173.199651:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/555 (0->18446744073709551615) 00002000:00100000:2.0:1763333173.199656:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4684d180 with x1848987613654528 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333173.199662:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe4684e680. 00002000:00010000:2.0:1763333173.199665:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe4684d180. 00000100:00100000:1.0:1763333173.199695:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1589 00000100:00100000:1.0:1763333173.199704:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2420:x1848987613654400:12345-192.168.204.28@tcp:10:bash.0 00000100:00100000:2.0:1763333173.199828:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1590 00000100:00100000:2.0:1763333173.199838:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2421:x1848987613654528:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:1.0:1763333173.199910:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x22b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333173.199914:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x22b:0x0] updating lvb mtime from disk: 0 -> 1763333173 00002000:00010000:1.0:1763333173.199917:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x22b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333173.199919:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x22b:0x0] updating lvb ctime from disk: 0 -> 1763333173 00002000:00010000:1.0:1763333173.199922:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x22b:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:2.0:1763333173.199949:0:28427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x22b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333173.199954:0:28427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x22b:0x0] updating lvb mtime from disk: 0 -> 1763333173 00002000:00010000:2.0:1763333173.199956:0:28427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x22b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333173.199959:0:28427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x22b:0x0] updating lvb ctime from disk: 0 -> 1763333173 00002000:00010000:2.0:1763333173.199961:0:28427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x22b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333173.199982:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2420:x1848987613654400:12345-192.168.204.28@tcp:10:bash.0 Request processed in 278us (566us total) trans 21474838835 rc 0/0 00000100:00100000:2.0:1763333173.199992:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2421:x1848987613654528:12345-192.168.204.28@tcp:10:bash.0 Request processed in 155us (524us total) trans 17179871532 rc 0/0 00000100:00100000:1.0:1763333173.199992:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1589 00002000:00010000:1.0:1763333173.199999:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/555 (0->18446744073709551615) 00000100:00100000:2.0:1763333173.200004:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1590 00002000:00100000:1.0:1763333173.200004:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4684e680 with x1848987613654400 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333173.200012:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/555 (0->18446744073709551615) 00002000:00010000:1.0:1763333173.200012:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe4684e680. 00002000:00100000:2.0:1763333173.200017:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4684d180 with x1848987613654528 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333173.200024:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe4684d180. 00000100:00100000:3.0:1763333173.202599:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333173.203466:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613654784 00000100:00100000:0.0:1763333173.203478:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613654784 00000100:00100000:0.0:1763333173.203559:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3133 00000100:00100000:0.0:1763333173.203571:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56846:x1848987613654784:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333173.203815:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56846:x1848987613654784:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 246us (1225us total) trans 4294972189 rc 0/0 00000100:00100000:0.0:1763333173.203823:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3133 00000100:00100000:1.0:1763333173.205894:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333173.205957:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613655040 00000100:00100000:0.0:1763333173.205968:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613655040 00000100:00100000:0.0:1763333173.206022:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3134 00000100:00100000:0.0:1763333173.206033:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:55917:x1848987613655040:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:0.0:1763333173.206306:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:55917:x1848987613655040:12345-192.168.204.28@tcp:35:bash.0 Request processed in 275us (421us total) trans 4294972190 rc 0/0 00000100:00100000:0.0:1763333173.206314:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3134 00000100:00100000:2.0:1763333173.218052:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333173.218227:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613655296 00000100:00100000:0.0:1763333173.218239:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613655296 00000100:00100000:0.0:1763333173.218307:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9161 00000100:00100000:0.0:1763333173.218318:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56846:x1848987613655296:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333173.218340:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333173.218405:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c55af0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969496 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.218525:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55af7 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333173.218541:0:12741:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55ae2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696948f expref: 234 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.218549:0:12741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55af7 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x1a8:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.218582:0:12741:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55ae2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696948f expref: 234 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.218594:0:12741:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55ae2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696948f expref: 234 pid: 8606 timeout: 1377 lvb_type: 0 00000100:00100000:0.0:1763333173.218608:0:12741:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4684e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627247232:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333173.218683:0:12741:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe43aa6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1763333173.224227:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.224397:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613655552 00000100:00100000:2.0:1763333173.224408:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613655552 00000100:00100000:2.0:1763333173.224464:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9162 00000100:00100000:2.0:1763333173.224474:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:56847:x1848987613655552:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:2.0:1763333173.224545:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1763333173.224573:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55a5d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1a8:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969473 expref: 235 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.224595:0:8606:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55ae2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696948f expref: 234 pid: 8606 timeout: 1377 lvb_type: 0 00010000:00010000:2.0:1763333173.224609:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c55a3a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969465 expref: 234 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.224619:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a8:0x0].0x0 (ffff92fe44e12800) 00010000:00010000:2.0:1763333173.224624:0:8606:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55af7 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1a8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.224634:0:8606:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55af7 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1a8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.224641:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55af7 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x1a8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.224662:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333173.224765:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55afe lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333173.224777:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55afe lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333173.224786:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55afe lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333173.224798:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55b05 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333173.224806:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55b05 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333173.224811:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55b05 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333173.224895:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55b0c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333173.224903:0:8606:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55af7 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1a8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.224910:0:8606:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55b0c lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333173.224924:0:8606:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55af7 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x1a8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.224932:0:8606:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55b0c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.225695:0:12741:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.204.28@tcp) returned -22 from blocking AST (req@000000008ca30097 x1848987627247232) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55ae2 lrc: 1/0,0 mode: --/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696948f expref: 233 pid: 8606 timeout: 1377 lvb_type: 0 00010000:00010000:0.0:1763333173.225711:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55ae2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696948f expref: 233 pid: 8606 timeout: 1377 lvb_type: 0 00000100:00100000:0.0:1763333173.225724:0:12741:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4684e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627247232:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333173.225746:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a8:0x0].0x0 (ffff92fe44e12800) 00010000:00010000:0.0:1763333173.225751:0:12741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55b0c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.225757:0:12741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55b0c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.225764:0:12741:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55af7 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1a8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.225771:0:12741:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55af7 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1a8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.225776:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55af7 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1a8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 12741 initiator: MDT1 00000004:00200000:0.0:1763333173.225796:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1a8:0x0]: returning size 5 00010000:00010000:0.0:1763333173.225910:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c55af0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1a8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969496 expref: 234 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.225927:0:12741:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55af7 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1a8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969496 expref: 233 pid: 12741 timeout: 1377 lvb_type: 0 00010000:00010000:0.0:1763333173.225936:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55af7 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1a8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969496 expref: 233 pid: 12741 timeout: 1377 lvb_type: 0 00010000:00010000:0.0:1763333173.225942:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48191400, rc 0) 00000100:00100000:0.0:1763333173.225990:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56846:x1848987613655296:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 7675us (7950us total) trans 4294972191 rc 0/0 00000100:00100000:0.0:1763333173.225997:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9161 00000100:00100000:3.0:1763333173.230242:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333173.231625:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613655680 00000100:00100000:0.0:1763333173.231641:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613655680 00000100:00100000:0.0:1763333173.231701:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9163 00000100:00100000:0.0:1763333173.231711:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56846:x1848987613655680:12345-192.168.204.28@tcp:101:lfs.0 00000100:00100000:2.0:1763333173.231727:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:0.0:1763333173.231737:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333173.231759:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c55b1a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696949d expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333173.231767:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613655808 00000100:00100000:3.0:1763333173.231773:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613655808 00010000:00010000:3.0:1763333173.231799:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55af7 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1a8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969496 expref: 235 pid: 12741 timeout: 1377 lvb_type: 0 00000100:00100000:0.0:1763333173.231846:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3009 00000100:00100000:0.0:1763333173.231856:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:2421:x1848987613655808:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333173.231869:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333173.231877:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55af7 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1a8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969496 expref: 235 pid: 12741 timeout: 1377 lvb_type: 0 00010000:00010000:0.0:1763333173.231891:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55af7 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1a8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969496 expref: 235 pid: 12741 timeout: 1377 lvb_type: 0 00010000:00010000:0.0:1763333173.231915:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55af7 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1a8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969496 expref: 235 pid: 12741 timeout: 1377 lvb_type: 0 00010000:00010000:0.0:1763333173.231931:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a8:0x0].0x0 (ffff92fe44e12800) 00010000:00010000:0.0:1763333173.231937:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55b0c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.231948:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55b0c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333173.231950:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55b21 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333173.231956:0:6506:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55b0c lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333173.231972:0:12741:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55b0c lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333173.231981:0:12741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55b21 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.231995:0:12741:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55b0c lrc: 5/0,1 mode: EX/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.232004:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333173.232005:0:12741:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55b21 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.232059:0:8606:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55b0c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8606 initiator: MDT1 00000100:00100000:0.0:1763333173.232060:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:2421:x1848987613655808:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 205us (333us total) trans 0 rc 0/0 00010000:00010000:2.0:1763333173.232066:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55b0c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8606 initiator: MDT1 00000100:00100000:0.0:1763333173.232068:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3009 00000004:00080000:2.0:1763333173.232382:0:8606:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x1a8:0x0] is inserted into orphan list, open count = 1 00010000:00010000:2.0:1763333173.232481:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55b0c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.232489:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55b0c lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.232499:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55b0c lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.232504:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333173.232516:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55b0c lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.232523:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55b0c lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.232532:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a8:0x0].0x0 (ffff92fe44e12800) 00010000:00010000:2.0:1763333173.232535:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763333173.232538:0:8606:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55b21 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.232544:0:8606:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55b21 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.232550:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55b21 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.232579:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55b0c lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.232587:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55b0c lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.232606:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55afe lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333173.232610:0:12741:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55b21 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.232615:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55afe lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333173.232624:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55b21 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.232627:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55afe lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.232641:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55afe lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.232647:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333173.232650:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55afe lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.232655:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55afe lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00000004:00200000:3.0:1763333173.232661:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1a8:0x0]: returning size 5 00010000:00010000:2.0:1763333173.232664:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44cd0100) 00000004:00200000:3.0:1763333173.232667:0:12741:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1763333173.232669:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333173.232674:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55afe lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.232680:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55afe lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000004:00010000:3.0:1763333173.232688:0:12741:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55b21 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00010000:2.0:1763333173.232699:0:8606:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000758a879d reply state 00000000c4677140 transno 4294972192 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55b05 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.232710:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55b05 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.232717:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe44cd0b00) 00010000:00010000:2.0:1763333173.232719:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333173.232723:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c55b1a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696949d expref: 235 pid: 12741 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333173.232724:0:8606:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763333173.232743:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55b21 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696949d expref: 234 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.232751:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a8:0x0].0x0 (ffff92fe44e12800) 00010000:00010000:3.0:1763333173.232754:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333173.232757:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7fc00, rc 0) 00000100:00100000:2.0:1763333173.232779:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:56847:x1848987613655552:12345-192.168.204.28@tcp:36:rm.0 Request processed in 8305us (8562us total) trans 4294972192 rc 0/0 00000100:00100000:2.0:1763333173.232788:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9162 00000100:00100000:3.0:1763333173.232811:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:56846:x1848987613655680:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1100us (2580us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333173.232820:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9163 00000100:00100000:2.0:1763333173.237979:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333173.238024:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613656064 00000100:00100000:3.0:1763333173.238035:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613656064 00000100:00100000:3.0:1763333173.238097:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9164 00000100:00100000:3.0:1763333173.238107:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:56846:x1848987613656064:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333173.238128:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333173.238150:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55b28 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369694a4 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.238267:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55b2f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333173.238282:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55b2f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a8:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.238294:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55b2f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a8:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:3.0:1763333173.238306:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1a8:0x0]: returning size 5 00010000:00010000:3.0:1763333173.238562:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55b28 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1a8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694a4 expref: 237 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.238580:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55b2f lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1a8:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694a4 expref: 236 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.238589:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a8:0x0].0x0 (ffff92fe44e12800) 00010000:00010000:3.0:1763333173.238593:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763333173.238596:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96e00, rc 0) 00000100:00100000:3.0:1763333173.238660:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56846:x1848987613656064:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 554us (690us total) trans 4294972193 rc 0/0 00000100:00100000:3.0:1763333173.238668:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9164 00000100:00100000:0.0:1763333173.243760:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.243840:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613656192 00000100:00100000:2.0:1763333173.243857:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613656192 00000100:00100000:2.0:1763333173.243927:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6416 00000100:00100000:2.0:1763333173.243937:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2421:x1848987613656192:12345-192.168.204.28@tcp:1:lfs.0 00010000:00010000:2.0:1763333173.243985:0:8404:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55b3d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.244004:0:8404:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe48190400/0xb32e3ef184c55abf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969481 expref: 14 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.244012:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333173.244015:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333173.244019:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55b3d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.244051:0:8404:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe48190400/0xb32e3ef184c55abf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969481 expref: 14 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.244064:0:8404:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe48190400/0xb32e3ef184c55abf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969481 expref: 14 pid: 8404 timeout: 1377 lvb_type: 0 00000100:00100000:2.0:1763333173.244078:0:8404:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe469a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8404:1848987627247360:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333173.244158:0:8404:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4869d480 going to sleep for 11 seconds 00000100:00100000:1.0:1763333173.253972:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333173.254063:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333173.254094:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613656448 00000100:00100000:1.0:1763333173.254104:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613656448 00000100:00100000:1.0:1763333173.254152:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9165 00000100:00100000:1.0:1763333173.254162:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56848:x1848987613656448:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333173.254188:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333173.254211:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55b44 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369694ab expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.254280:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55b4b lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333173.254292:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55b4b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.254302:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55b4b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.254311:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55b52 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333173.254319:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55b52 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.254324:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55b52 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.254390:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55b4b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.254397:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55b4b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.254402:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55b4b lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.254407:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55b4b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.254412:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333173.254415:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55b4b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.254426:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55b4b lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.254436:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44cd0800) 00010000:00010000:1.0:1763333173.254439:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333173.254444:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55b4b lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.254449:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55b4b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.254461:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55b52 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.254467:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55b52 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.254472:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55b52 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.254476:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333173.254479:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55b52 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.254485:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55b52 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.254491:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe44cd0b00) 00010000:00010000:1.0:1763333173.254494:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333173.254496:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55b52 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.254501:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55b52 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.254564:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55b44 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694ab expref: 237 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.254574:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44cd0800) 00010000:00010000:1.0:1763333173.254577:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333173.254580:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55b44 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694ab expref: 237 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.254593:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7ec00, rc 0) 00000100:00100000:0.0:1763333173.254613:0:8404:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe469a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8404:1848987627247360:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333173.254638:0:8404:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55b3d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333173.254651:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56848:x1848987613656448:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 491us (588us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333173.254658:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9165 00000100:00100000:3.0:1763333173.254757:0:28430:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613656320 00000100:00100000:3.0:1763333173.254762:0:28430:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613656320 00002000:00100000:3.0:1763333173.254793:0:28430:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x280000400:0x22b:0x0] (0->4) req@ffff92fe42ef8e00 x1848987613656320/t0(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:484/0 lens 496/0 e 0 to 0 dl 1763333184 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763333173.254803:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe42ef8e00 with x1848987613656320 ext(0->4) 00010000:00010000:3.0:1763333173.254809:0:28430:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff92fe48190400/0xb32e3ef184c55abf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969481 expref: 15 pid: 8404 timeout: 1377 lvb_type: 0 00010000:00010000:3.0:1763333173.254822:0:28430:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff92fe48190400/0xb32e3ef184c55abf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969481 expref: 15 pid: 8404 timeout: 1377 lvb_type: 0 00002000:00010000:3.0:1763333173.254829:0:28430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff92fe42ef8e00 00000100:00100000:3.0:1763333173.254860:0:28430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 103 00000100:00100000:3.0:1763333173.254867:0:28430:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2421:x1848987613656320:12345-192.168.204.28@tcp:4:bash.0 00000100:00100000:3.0:1763333173.255685:0:28430:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2421:x1848987613656320:12345-192.168.204.28@tcp:4:bash.0 Request processed in 815us (1721us total) trans 21474838836 rc 0/0 00000100:00100000:3.0:1763333173.255694:0:28430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 103 00002000:00100000:3.0:1763333173.255701:0:28430:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x280000400:0x22b:0x0] (0->4) req@ffff92fe42ef8e00 x1848987613656320/t21474838836(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:484/0 lens 496/448 e 0 to 0 dl 1763333184 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763333173.255711:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe42ef8e00 with x1848987613656320 ext(0->4) 00010000:00010000:3.0:1763333173.255717:0:28430:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff92fe48190400/0xb32e3ef184c55abf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969481 expref: 17 pid: 8404 timeout: 1377 lvb_type: 0 00010000:00010000:3.0:1763333173.255730:0:28430:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff92fe48190400/0xb32e3ef184c55abf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969481 expref: 17 pid: 8404 timeout: 1377 lvb_type: 0 00002000:00010000:3.0:1763333173.255737:0:28430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff92fe42ef8e00 00000100:00100000:3.0:1763333173.259695:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.260026:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613656576 00000100:00100000:2.0:1763333173.260038:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613656576 00000100:00100000:2.0:1763333173.260105:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9166 00000100:00100000:2.0:1763333173.260116:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56848:x1848987613656576:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333173.260138:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333173.260162:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55b59 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369694b2 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.260233:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55b60 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333173.260247:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55b60 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.260258:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55b60 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.260268:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55b67 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333173.260275:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55b67 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.260281:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55b67 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.260322:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55b60 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.260329:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55b60 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.260335:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55b60 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.260341:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55b60 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.260368:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333173.260373:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55b60 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.260381:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55b60 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.260394:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31100) 00010000:00010000:2.0:1763333173.260396:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333173.260401:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55b60 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.260407:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55b60 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.260420:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55b67 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.260426:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55b67 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.260432:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55b67 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.260437:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4a00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333173.260440:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55b67 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.260445:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55b67 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.260451:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe44cd0b00) 00010000:00010000:2.0:1763333173.260454:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333173.260456:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55b67 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.260461:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55b67 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.260488:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55b59 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694b2 expref: 237 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.260497:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31100) 00010000:00010000:2.0:1763333173.260499:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333173.260503:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55b59 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694b2 expref: 237 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.260527:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5e00, rc 0) 00000100:00100000:2.0:1763333173.260589:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56848:x1848987613656576:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 475us (904us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333173.260597:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9166 00000100:00100000:0.0:1763333173.281864:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333173.281909:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333173.281999:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613656832 00000100:00100000:1.0:1763333173.282011:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613656832 00010000:00010000:1.0:1763333173.282049:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe48190400/0xb32e3ef184c55abf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969481 expref: 17 pid: 8404 timeout: 1377 lvb_type: 0 00000100:00100000:1.0:1763333173.282092:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3010 00000100:00100000:1.0:1763333173.282103:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2420:x1848987613656832:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333173.282120:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1763333173.282139:0:6506:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x22b:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:1.0:1763333173.282143:0:6506:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x22b:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1763333173.282149:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe48190400/0xb32e3ef184c55abf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969481 expref: 17 pid: 8404 timeout: 1377 lvb_type: 0 00010000:00010000:1.0:1763333173.282162:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe48190400/0xb32e3ef184c55abf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969481 expref: 17 pid: 8404 timeout: 1377 lvb_type: 0 00010000:00010000:1.0:1763333173.282187:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe48190400/0xb32e3ef184c55abf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969481 expref: 17 pid: 8404 timeout: 1377 lvb_type: 0 00010000:00010000:1.0:1763333173.282207:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333173.282209:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333173.282214:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55b3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.282225:0:6506:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55b3d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.282259:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333173.282312:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2420:x1848987613656832:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 210us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333173.282320:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3010 00010000:00010000:3.0:1763333173.282735:0:8404:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55b3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.282745:0:8404:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55b3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.282766:0:8404:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55b3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.282774:0:8404:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55b3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.282782:0:8404:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55b3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.282789:0:8404:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333173.282794:0:8404:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55b3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.282803:0:8404:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55b3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.282817:0:8404:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55b3d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.282824:0:8404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55b3d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333173.283026:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2421:x1848987613656192:12345-192.168.204.28@tcp:1:lfs.0 Request processed in 39088us (39278us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333173.283035:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6416 00000100:00100000:2.0:1763333173.284136:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613656704 00000100:00100000:2.0:1763333173.284146:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613656704 00000100:00100000:2.0:1763333173.284202:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9167 00000100:00100000:2.0:1763333173.284213:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56848:x1848987613656704:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333173.284232:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333173.284253:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55b6e lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369694b9 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.284309:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55b75 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333173.284322:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55b75 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.284332:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55b75 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:2.0:1763333173.284397:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1763333173.284403:0:8606:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1763333173.284434:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55b6e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694b9 expref: 238 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.284451:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55b75 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694b9 expref: 237 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.284459:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31100) 00010000:00010000:2.0:1763333173.284462:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1763333173.284466:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4a00, rc 0) 00000100:00100000:2.0:1763333173.284518:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56848:x1848987613656704:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 295us (2652us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333173.284525:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9167 00000100:00100000:0.0:1763333173.287436:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333173.287577:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613657088 00000100:00100000:3.0:1763333173.287589:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613657088 00000100:00100000:3.0:1763333173.287656:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9168 00000100:00100000:3.0:1763333173.287667:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56846:x1848987613657088:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:3.0:1763333173.287719:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333173.287747:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55b21 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696949d expref: 237 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.287766:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a8:0x0].0x0 (ffff92fe44e12800) 00010000:00010000:3.0:1763333173.287771:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333173.287802:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55b7c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333173.287815:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55b7c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.287824:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55b7c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000040:00080000:3.0:1763333173.288068:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1376, 88 off116280 00000004:00080000:3.0:1763333173.288078:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1277367728000ns, next at 1278003234678ns, rc = 0 00000040:00080000:3.0:1763333173.288121:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1375, 88 off116280 00000004:00080000:3.0:1763333173.288126:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1277367777047ns, next at 1277223362238ns, rc = 0 00000040:00080000:3.0:1763333173.288139:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1376, 88 off116368 00000004:00080000:3.0:1763333173.288144:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1277367794792ns, next at 1277223362238ns, rc = 0 00000040:00080000:3.0:1763333173.288153:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1377, 88 off116368 00000004:00080000:3.0:1763333173.288156:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1277367807279ns, next at 1278003234678ns, rc = 0 00000100:00100000:1.0:1763333173.289963:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.290048:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613657216 00000100:00100000:2.0:1763333173.290058:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613657216 00000100:00100000:2.0:1763333173.290120:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9169 00000100:00100000:2.0:1763333173.290130:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56848:x1848987613657216:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333173.290150:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333173.290172:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55b83 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369694c0 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.290239:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55b8a lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333173.290254:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55b8a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.290264:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55b8a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.290274:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55b91 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333173.290280:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55b91 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.290285:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55b91 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.290320:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55b8a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.290326:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55b8a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.290332:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55b8a lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.290338:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55b8a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.290343:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333173.290382:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55b8a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.290390:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55b8a lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.290402:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31100) 00010000:00010000:2.0:1763333173.290405:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333173.290411:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55b8a lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.290417:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55b8a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.290432:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55b91 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.290438:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55b91 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.290443:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55b91 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.290447:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333173.290450:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55b91 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.290455:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55b91 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.290462:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe44cd0b00) 00010000:00010000:2.0:1763333173.290465:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333173.290468:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55b91 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.290473:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55b91 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.290499:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55b83 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694c0 expref: 239 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.290518:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31100) 00010000:00010000:2.0:1763333173.290520:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333173.290524:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55b83 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694c0 expref: 239 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.290537:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5400, rc 0) 00000100:00100000:2.0:1763333173.290596:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56848:x1848987613657216:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 467us (643us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333173.290603:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9169 00000001:00080000:1.0:1763333173.291776:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972194 is committed 00000004:00080000:1.0:1763333173.291786:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 902 committed 00000004:00080000:1.0:1763333173.291800:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 898 committed 00000004:00080000:1.0:1763333173.291813:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 897 committed 00000004:00080000:1.0:1763333173.291815:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 901 committed 00000100:00100000:3.0:1763333173.291952:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe434c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627247616:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333173.292004:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333173.292038:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763333173.292044:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe434c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627247488:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333173.292065:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333173.292092:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627247616 00000100:00100000:3.0:1763333173.292098:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627247616 00000100:00100000:3.0:1763333173.292129:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627247488 00000100:00100000:3.0:1763333173.292132:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627247488 00000100:00100000:3.0:1763333173.292150:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6417 00000100:00100000:3.0:1763333173.292157:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+34:3653:x1848987627247616:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1763333173.292286:0:8404:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x22c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333173.292289:0:8404:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x22c:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763333173.292291:0:8404:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x22c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333173.292293:0:8404:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x22c:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763333173.292295:0:8404:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x22c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333173.292329:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+35:3653:x1848987627247616:12345-0@lo:2:osp-syn-1-1.0 Request processed in 171us (323us total) trans 17179871533 rc 0/0 00000100:00100000:3.0:1763333173.292336:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6417 00000100:00100000:3.0:1763333173.292381:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6418 00000100:00100000:3.0:1763333173.292388:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7403ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+34:3653:x1848987627247488:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1763333173.292435:0:8404:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x22b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333173.292438:0:8404:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x22b:0x0] updating lvb mtime from disk: 1763333173 -> 1763333173 00002000:00010000:3.0:1763333173.292441:0:8404:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x22b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333173.292444:0:8404:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x22b:0x0] updating lvb ctime from disk: 1763333173 -> 1763333173 00002000:00010000:3.0:1763333173.292446:0:8404:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x22b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333173.292468:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7403ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+35:3653:x1848987627247488:12345-0@lo:2:osp-syn-1-1.0 Request processed in 81us (402us total) trans 17179871534 rc 0/0 00000100:00100000:3.0:1763333173.292474:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6418 00000004:00080000:3.0:1763333173.292518:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe434c7100/2, rc 0, transno 17179871534 00000100:00100000:3.0:1763333173.292524:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe434c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627247488:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763333173.292534:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe434c5180/2, rc 0, transno 17179871533 00000100:00100000:3.0:1763333173.292537:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe434c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627247616:0@lo:2:osp-syn-1-1.0 00000004:00010000:3.0:1763333173.292578:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000aeae1c8f reply state 000000005480e276 transno 4294972194 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55b7c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.292595:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55b7c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.292603:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a8:0x0].0x0 (ffff92fe44e12800) 00010000:00010000:3.0:1763333173.292605:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1763333173.292609:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1763333173.292671:0:12741:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1763333173.292682:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56846:x1848987613657088:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 5017us (5256us total) trans 4294972194 rc 0/0 00000100:00100000:3.0:1763333173.292690:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9168 00010000:00010000:2.0:1763333173.292773:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55b05 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.292783:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55b05 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.292790:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55b05 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.292795:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333173.292799:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55b05 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.292806:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55b05 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.292816:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe44cd0b00) 00010000:00010000:2.0:1763333173.292819:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333173.292822:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55b05 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.292828:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55b05 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.292854:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55b7c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.292865:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55b7c lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.292870:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55b7c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.292875:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333173.292877:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55b7c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.292883:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55b7c lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.292890:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a8:0x0].0x0 (ffff92fe44e12800) 00010000:00010000:2.0:1763333173.292893:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333173.292895:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55b7c lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.292900:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55b7c lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000100:00100000:2.0:1763333173.293161:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4684d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627247872:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333173.293194:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333173.293226:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1763333173.293232:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4684ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627247744:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333173.293253:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333173.293278:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627247872 00000100:00100000:2.0:1763333173.293283:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627247872 00000100:00100000:2.0:1763333173.293310:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627247744 00000100:00100000:2.0:1763333173.293314:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627247744 00000100:00100000:2.0:1763333173.293335:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6419 00000100:00100000:2.0:1763333173.293343:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+18:3655:x1848987627247872:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:2.0:1763333173.293462:0:28650:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x22c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333173.293465:0:28650:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x22c:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1763333173.293467:0:28650:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x22c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333173.293469:0:28650:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x22c:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1763333173.293471:0:28650:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x22c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333173.293502:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+19:3655:x1848987627247872:12345-0@lo:2:osp-syn-0-1.0 Request processed in 160us (307us total) trans 21474838837 rc 0/0 00000100:00100000:2.0:1763333173.293520:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6419 00000100:00100000:2.0:1763333173.293535:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6420 00000100:00100000:2.0:1763333173.293542:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+18:3655:x1848987627247744:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333173.293609:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+19:3655:x1848987627247744:12345-0@lo:2:osp-syn-0-1.0 Request processed in 67us (354us total) trans 21474838838 rc 0/0 00000100:00100000:2.0:1763333173.293615:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6420 00000004:00080000:2.0:1763333173.293648:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4684ce00/2, rc 0, transno 21474838838 00000100:00100000:2.0:1763333173.293653:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4684ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627247744:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1763333173.293660:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4684d500/2, rc 0, transno 21474838837 00000100:00100000:2.0:1763333173.293664:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4684d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627247872:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333173.299646:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333173.299735:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613657600 00000100:00100000:3.0:1763333173.299747:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613657600 00000100:00100000:3.0:1763333173.299813:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9170 00000100:00100000:3.0:1763333173.299824:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+227:56846:x1848987613657600:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333173.299849:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333173.299872:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55b98 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369694ce expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.299929:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55b98 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694ce expref: 228 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.299945:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55b98 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694ce expref: 228 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.299980:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a8:0x0].0x0 (ffff92fe44e12800) 00010000:00010000:3.0:1763333173.299983:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763333173.299987:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96c00, rc 0) 00000100:00100000:3.0:1763333173.300270:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+228:56846:x1848987613657600:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 447us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333173.300279:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9170 00000100:00100000:0.0:1763333173.304751:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333173.305970:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333173.307589:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613657472 00000100:00100000:3.0:1763333173.307602:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613657472 00000100:00100000:1.0:1763333173.308009:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613657728 00000100:00100000:1.0:1763333173.308015:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613657728 00000100:00100000:3.0:1763333173.308109:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9171 00000100:00100000:3.0:1763333173.308123:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56848:x1848987613657472:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333173.308147:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333173.308151:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763333173.308181:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55b75 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694b9 expref: 229 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.308202:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31100) 00010000:00010000:3.0:1763333173.308213:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333173.308231:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55b9f lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369694c7 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.308400:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c55ba6 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333173.308415:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c55ba6 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.308424:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c55ba6 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.308437:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55bad lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333173.308443:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55bad lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.308448:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55bad lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.308930:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55bb4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1a9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333173.308942:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55bb4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.308962:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55bb4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:3.0:1763333173.308974:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1a9:0x0]: returning size 0 00010000:00010000:3.0:1763333173.308998:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c55ba6 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.309005:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c55ba6 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.309011:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c55ba6 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.309017:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c55ba6 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.309023:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333173.309027:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c55ba6 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.309034:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c55ba6 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.309043:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6231eb00) 00010000:00010000:3.0:1763333173.309046:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333173.309050:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c55ba6 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.309056:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c55ba6 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000004:00010000:3.0:1763333173.309067:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a1c285e8 reply state 0000000062a563ef transno 4294972195 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55bad lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.309077:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55bad lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.309083:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6231e900) 00010000:00010000:3.0:1763333173.309085:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763333173.309089:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763333173.309118:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55b9f lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694c7 expref: 231 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.309135:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55bb4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694c7 expref: 230 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.309142:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a9:0x0].0x0 (ffff92ff6231e300) 00010000:00010000:3.0:1763333173.309145:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333173.309147:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96000, rc 0) 00000100:00100000:3.0:1763333173.309233:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56848:x1848987613657472:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1112us (4489us total) trans 4294972195 rc 0/0 00000100:00100000:3.0:1763333173.309241:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9171 00000100:00100000:3.0:1763333173.309268:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9172 00000100:00100000:3.0:1763333173.309278:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56846:x1848987613657728:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333173.309290:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333173.309301:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55bc2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369694d5 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.309344:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c55bc9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333173.309381:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c55bc9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.309389:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c55bc9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:3.0:1763333173.309412:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1a8:0x0]: returning size 5 00000004:00200000:3.0:1763333173.309416:0:12741:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763333173.309427:0:12741:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c55bc9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.309445:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55bc2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694d5 expref: 232 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.309458:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c55bc9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694d5 expref: 231 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.309470:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a8:0x0].0x0 (ffff92fe44e12800) 00010000:00010000:3.0:1763333173.309472:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1763333173.309475:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff4139a600, rc 0) 00000100:00100000:3.0:1763333173.309501:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56846:x1848987613657728:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 225us (3535us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333173.309520:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9172 00000100:00100000:0.0:1763333173.313761:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333173.313894:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613657984 00000100:00100000:3.0:1763333173.313906:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613657984 00000100:00100000:3.0:1763333173.313966:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9173 00000100:00100000:3.0:1763333173.313976:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56848:x1848987613657984:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333173.314002:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333173.314021:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c55bd0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1a9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369694dc expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.314129:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55bd7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333173.314143:0:12741:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55bb4 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694c7 expref: 232 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.314152:0:12741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55bd7 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1a9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.314186:0:12741:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55bb4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694c7 expref: 232 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.314199:0:12741:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55bb4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694c7 expref: 232 pid: 12741 timeout: 1377 lvb_type: 0 00000100:00100000:3.0:1763333173.314216:0:12741:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e123b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627248000:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333173.314302:0:12741:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff58cbfa80 going to sleep for 11 seconds 00000100:00100000:2.0:1763333173.323087:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.323141:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333173.323240:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613658112 00000100:00100000:1.0:1763333173.323249:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613658112 00000100:00100000:1.0:1763333173.323316:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6421 00000100:00100000:1.0:1763333173.323327:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2421:x1848987613658112:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333173.323369:0:8406:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333173.323391:0:8406:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55bde lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369694e3 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333173.323413:0:8406:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x22b:0x0] initial LVB size: 5, mtime: 0x691a5435, atime: 0x0, ctime: 0x691a5435, blocks: 0x8 00010000:00010000:1.0:1763333173.323436:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333173.323439:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333173.323451:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55bde lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694e3 expref: 16 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333173.323468:0:8406:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55bde lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694e3 expref: 16 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333173.323483:0:8406:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f600, rc 0) 00000100:00100000:1.0:1763333173.323551:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2421:x1848987613658112:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 225us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333173.323559:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6421 00000100:00100000:3.0:1763333173.323710:0:12741:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e123b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627248000:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333173.323739:0:12741:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55bd7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000100:00100000:0.0:1763333173.323809:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613658240 00000100:00100000:0.0:1763333173.323814:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613658240 00010000:00010000:0.0:1763333173.323840:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55bb4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694c7 expref: 233 pid: 12741 timeout: 1377 lvb_type: 0 00000100:00100000:0.0:1763333173.323874:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3011 00000100:00100000:0.0:1763333173.323882:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:2421:x1848987613658240:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333173.323895:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333173.323902:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55bb4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694c7 expref: 233 pid: 12741 timeout: 1377 lvb_type: 0 00010000:00010000:0.0:1763333173.323914:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55bb4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694c7 expref: 233 pid: 12741 timeout: 1377 lvb_type: 0 00010000:00010000:0.0:1763333173.323940:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55bb4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694c7 expref: 233 pid: 12741 timeout: 1377 lvb_type: 0 00010000:00010000:0.0:1763333173.323955:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a9:0x0].0x0 (ffff92ff6231e300) 00010000:00010000:0.0:1763333173.323961:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55bd7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.323969:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55bd7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.323977:0:6505:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55bd7 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1a9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.324005:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333173.324028:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:2421:x1848987613658240:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 147us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333173.324035:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3011 00010000:00010000:3.0:1763333173.324239:0:12741:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55bd7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.324248:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55bd7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:3.0:1763333173.324270:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1a9:0x0]: returning size 0 00000004:00080000:3.0:1763333173.324479:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x22d:0x0], index 1: 0 00000004:00080000:3.0:1763333173.324487:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x22d:0x0], index 0: 0 00000004:00080000:3.0:1763333173.324493:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x22e:0x0], index 0: 0 00000004:00080000:3.0:1763333173.324496:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x22e:0x0], index 1: 0 00010000:00010000:3.0:1763333173.324613:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55bd7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.324621:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55bd7 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1a9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.324628:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55bd7 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1a9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.324634:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe44d75a00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333173.324638:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55bd7 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1a9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.324650:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55bd7 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1a9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.324659:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a9:0x0].0x0 (ffff92ff6231e300) 00010000:00010000:3.0:1763333173.324662:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763333173.324666:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55bd7 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1a9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.324673:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55bd7 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1a9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.324715:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c55bd0 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1a9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694dc expref: 232 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.324725:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a9:0x0].0x0 (ffff92ff6231e300) 00010000:00010000:3.0:1763333173.324728:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763333173.324731:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c55bd0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1a9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694dc expref: 232 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.324745:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff4139a800, rc 0) 00000100:00100000:3.0:1763333173.324783:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56848:x1848987613657984:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 10808us (11032us total) trans 4294972196 rc 301/301 00000100:00100000:3.0:1763333173.324792:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9173 00000100:00100000:2.0:1763333173.333721:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333173.333813:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613658496 00000100:00100000:0.0:1763333173.333826:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613658496 00000100:00100000:0.0:1763333173.333894:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3135 00000100:00100000:0.0:1763333173.333907:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56848:x1848987613658496:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333173.334260:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56848:x1848987613658496:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 355us (548us total) trans 4294972197 rc 0/0 00000100:00100000:0.0:1763333173.334269:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3135 00000100:00100000:0.0:1763333173.337012:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333173.337194:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613658752 00000100:00100000:3.0:1763333173.337210:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613658752 00000100:00100000:3.0:1763333173.337735:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3136 00000100:00100000:3.0:1763333173.337748:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56848:x1848987613658752:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333173.338046:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56848:x1848987613658752:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 298us (1045us total) trans 4294972198 rc 0/0 00000100:00100000:3.0:1763333173.338056:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3136 00000100:00100000:1.0:1763333173.342715:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333173.343070:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613659008 00000100:00100000:3.0:1763333173.343083:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613659008 00000100:00100000:3.0:1763333173.343156:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9174 00000100:00100000:3.0:1763333173.343168:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:55917:x1848987613659008:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333173.343200:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333173.343228:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55bec lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369694ea expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.344512:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55bf3 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333173.344531:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55bf3 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.344543:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55bf3 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.344554:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55bfa lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333173.344565:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55bfa lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.344570:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55bfa lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.344663:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55c01 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1a9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333173.344671:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55c01 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.344680:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55c01 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:1.0:1763333173.344695:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1a9:0x0]: returning size 0 00010000:00010000:1.0:1763333173.344806:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55bf3 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.344813:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55bf3 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.344819:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55bf3 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.344825:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55bf3 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.344831:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333173.344835:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55bf3 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.344842:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55bf3 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.344859:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6231e300) 00010000:00010000:1.0:1763333173.344862:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333173.344866:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55bf3 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.344873:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55bf3 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.344885:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55bfa lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.344891:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55bfa lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.344897:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55bfa lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.344902:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333173.344905:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55bfa lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.344911:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55bfa lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.344918:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6231e900) 00010000:00010000:1.0:1763333173.344920:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333173.344923:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55bfa lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.344928:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55bfa lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.345077:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55bec lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694ea expref: 236 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.345102:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55c01 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694ea expref: 235 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.345110:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a9:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333173.345113:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333173.345116:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e600, rc 0) 00000100:00100000:1.0:1763333173.345270:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:55917:x1848987613659008:12345-192.168.204.28@tcp:101:bash.0 Request processed in 2104us (2566us total) trans 4294972199 rc 0/0 00000100:00100000:1.0:1763333173.345281:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9174 00000100:00100000:2.0:1763333173.349168:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333173.350166:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613659136 00000100:00100000:1.0:1763333173.350180:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613659136 00000100:00100000:1.0:1763333173.350851:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9175 00000100:00100000:1.0:1763333173.350867:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:55917:x1848987613659136:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333173.350895:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333173.350922:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55c0f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1a9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369694f1 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.351060:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55c16 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1a9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333173.351079:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55c16 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.351092:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55c16 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.351244:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55c0f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1a9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694f1 expref: 237 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.351271:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55c16 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694f1 expref: 236 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.351281:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a9:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333173.351284:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763333173.351288:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f800, rc 0) 00000100:00100000:1.0:1763333173.351403:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:55917:x1848987613659136:12345-192.168.204.28@tcp:101:bash.0 Request processed in 539us (2247us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333173.351412:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9175 00000100:00100000:0.0:1763333173.356645:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.356847:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613659392 00000100:00100000:2.0:1763333173.356860:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613659392 00000100:00100000:2.0:1763333173.356938:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9176 00000100:00100000:2.0:1763333173.356961:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:55917:x1848987613659392:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:2.0:1763333173.357034:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333173.357063:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55c01 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694ea expref: 236 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.357083:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a9:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:2.0:1763333173.357089:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333173.357313:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55c1d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1a9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333173.357329:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55c1d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.357339:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55c1d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000001:00080000:2.0:1763333173.357418:0:8606:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294972200 00000004:00010000:2.0:1763333173.357443:0:8606:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000070123fbc reply state 000000001ff7966f transno 4294972201 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55c1d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.357455:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55c1d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.357461:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a9:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:2.0:1763333173.357464:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333173.357467:0:8606:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763333173.357579:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:55917:x1848987613659392:12345-192.168.204.28@tcp:36:bash.0 Request processed in 630us (944us total) trans 4294972201 rc 0/0 00000100:00100000:2.0:1763333173.357586:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9176 00000020:00080000:2.0:1763333173.357592:0:8606:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763333173.359654:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.359986:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613659520 00000100:00100000:2.0:1763333173.359996:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613659520 00000100:00100000:0.0:1763333173.360467:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.360584:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9177 00000100:00100000:2.0:1763333173.360595:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:55917:x1848987613659520:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333173.360623:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1763333173.360635:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613659648 00000100:00100000:3.0:1763333173.360640:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613659648 00010000:00010000:2.0:1763333173.360646:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55c24 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1a9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369694f8 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333173.360680:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6422 00000100:00100000:3.0:1763333173.360687:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2421:x1848987613659648:12345-192.168.204.28@tcp:23:lfs.0 00010000:00010000:2.0:1763333173.360704:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55c24 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694f8 expref: 239 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.360718:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55c24 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694f8 expref: 239 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.360735:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a9:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:2.0:1763333173.360738:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333173.360742:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5c00, rc 0) 00000100:00100000:2.0:1763333173.360785:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:55917:x1848987613659520:12345-192.168.204.28@tcp:101:bash.0 Request processed in 192us (1141us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333173.360791:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9177 00000100:00100000:3.0:1763333173.360867:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2421:x1848987613659648:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 179us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333173.360875:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6422 00000100:00100000:0.0:1763333173.362822:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333173.362873:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333173.362961:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613659776 00000100:00100000:1.0:1763333173.362971:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613659776 00000100:00100000:1.0:1763333173.363023:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6423 00000100:00100000:1.0:1763333173.363032:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2419:x1848987613659776:12345-192.168.204.28@tcp:23:lfs.0 00000100:00100000:1.0:1763333173.363145:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2419:x1848987613659776:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 113us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333173.363153:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6423 00000100:00100000:2.0:1763333173.364581:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613660032 00000100:00100000:2.0:1763333173.364590:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613660032 00000100:00100000:2.0:1763333173.364636:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9178 00000100:00100000:2.0:1763333173.364645:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:55917:x1848987613660032:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333173.364662:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333173.364665:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763333173.364690:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55c24 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1a9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694f8 expref: 239 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.364709:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a9:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:2.0:1763333173.364715:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333173.364726:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c55c2b lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1a9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369694ff expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.364772:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55c32 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333173.364788:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55c32 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.364799:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55c32 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000040:00080000:2.0:1763333173.365047:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1377, 88 off116456 00000004:00080000:2.0:1763333173.365055:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1277444706052ns, next at 1277223362238ns, rc = 0 00000040:00080000:2.0:1763333173.365094:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1378, 88 off116456 00000004:00080000:2.0:1763333173.365099:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1277444750234ns, next at 1278003234678ns, rc = 0 00000040:00080000:2.0:1763333173.365132:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1379, 88 off116544 00000004:00080000:2.0:1763333173.365136:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1277444786946ns, next at 1278003234678ns, rc = 0 00000040:00080000:2.0:1763333173.365145:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1378, 88 off116544 00000004:00080000:2.0:1763333173.365148:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1277444799419ns, next at 1277223362238ns, rc = 0 00000100:00100000:2.0:1763333173.367402:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333173.367609:0:28430:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613660160 00000100:00100000:3.0:1763333173.367620:0:28430:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613660160 00000100:00100000:3.0:1763333173.367692:0:28430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1591 00000100:00100000:3.0:1763333173.367703:0:28430:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2420:x1848987613660160:12345-192.168.204.28@tcp:3:lfs.0 00010000:00010000:3.0:1763333173.367738:0:28430:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe44d75400/0xb32e3ef184c55c39 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.367752:0:28430:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333173.367755:0:28430:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333173.367761:0:28430:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe44d75400/0xb32e3ef184c55c39 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.367776:0:28430:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe44d75400/0xb32e3ef184c55c39 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.367882:0:28430:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe44d75400/0xb32e3ef184c55c39 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.367892:0:28430:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe44d75400/0xb32e3ef184c55c39 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.367900:0:28430:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe44d75400/0xb32e3ef184c55c39 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.367907:0:28430:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe44d75400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333173.367912:0:28430:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe44d75400/0xb32e3ef184c55c39 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.367921:0:28430:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe44d75400/0xb32e3ef184c55c39 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.367937:0:28430:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe44d75400/0xb32e3ef184c55c39 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.367946:0:28430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe44d75400/0xb32e3ef184c55c39 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1763333173.368667:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972202 is committed 00000004:00080000:1.0:1763333173.368676:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 900 committed 00000004:00080000:1.0:1763333173.368692:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 904 committed 00000004:00080000:1.0:1763333173.368700:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 903 committed 00000004:00080000:1.0:1763333173.368702:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 899 committed 00000100:00100000:1.0:1763333173.368800:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7dcfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627248256:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333173.368800:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7dcfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627248512:0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1763333173.368861:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55bad lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.368871:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55bad lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.368878:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55bad lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.368883:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333173.368888:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55bad lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.368895:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55bad lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.368908:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6231e900) 00010000:00010000:2.0:1763333173.368912:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333173.368917:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55bad lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.368923:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55bad lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.368947:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55c1d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00000100:00100000:3.0:1763333173.369093:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627248384:0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1763333173.369175:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55c1d lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00000100:00100000:0.0:1763333173.369178:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1763333173.369182:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55c1d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.369187:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333173.369190:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55c1d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.369196:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55c1d lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.369204:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a9:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:2.0:1763333173.369206:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333173.369209:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55c1d lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.369218:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55c1d lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000100:00100000:0.0:1763333173.369234:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627248512 00000100:00100000:0.0:1763333173.369242:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627248512 00000100:00100000:2.0:1763333173.369285:0:28430:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2420:x1848987613660160:12345-192.168.204.28@tcp:3:lfs.0 Request processed in 1581us (1889us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1763333173.369286:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6424 00000100:00100000:2.0:1763333173.369293:0:28430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1591 00000100:00100000:0.0:1763333173.369294:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+35:3654:x1848987627248512:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1763333173.369378:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55c32 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694ff expref: 231 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.369387:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a9:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:2.0:1763333173.369389:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763333173.369402:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c55c2b lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1a9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694ff expref: 231 pid: 8606 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1763333173.369414:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55c32 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694ff expref: 230 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.369440:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a9:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:2.0:1763333173.369442:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763333173.369444:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4c00, rc 0) 00000100:00100000:2.0:1763333173.369475:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:55917:x1848987613660032:12345-192.168.204.28@tcp:101:bash.0 Request processed in 4831us (6601us total) trans 4294972202 rc 0/0 00000100:00100000:0.0:1763333173.369479:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+36:3654:x1848987627248512:12345-0@lo:2:osp-syn-1-1.0 Request processed in 186us (301us total) trans 17179871535 rc 0/0 00000100:00100000:2.0:1763333173.369482:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9178 00000100:00100000:0.0:1763333173.369484:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6424 00000004:00080000:0.0:1763333173.369533:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7dcfea00/2, rc 0, transno 17179871535 00000100:00100000:0.0:1763333173.369540:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7dcfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627248512:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333173.369648:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333173.369742:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333173.369772:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627248128:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333173.369793:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333173.369933:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627248384 00000100:00100000:3.0:1763333173.369939:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627248384 00000100:00100000:2.0:1763333173.370484:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627248256 00000100:00100000:2.0:1763333173.370490:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627248256 00000100:00100000:2.0:1763333173.372380:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627248128 00000100:00100000:2.0:1763333173.372394:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627248128 00000100:00100000:1.0:1763333173.373462:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6425 00000100:00100000:1.0:1763333173.373482:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+36:3652:x1848987627248256:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333173.373739:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+37:3652:x1848987627248256:12345-0@lo:2:osp-syn-1-1.0 Request processed in 264us (3995us total) trans 17179871536 rc 0/0 00000100:00100000:1.0:1763333173.373747:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6425 00000100:00100000:1.0:1763333173.373770:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6426 00000100:00100000:1.0:1763333173.373778:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7df3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+20:3653:x1848987627248384:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333173.373884:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7df3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+21:3653:x1848987627248384:12345-0@lo:2:osp-syn-0-1.0 Request processed in 106us (4235us total) trans 21474838839 rc 0/0 00000100:00100000:1.0:1763333173.373890:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6426 00000100:00100000:1.0:1763333173.374015:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6427 00000100:00100000:1.0:1763333173.374022:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+20:3652:x1848987627248128:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333173.374092:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+21:3652:x1848987627248128:12345-0@lo:2:osp-syn-0-1.0 Request processed in 70us (4297us total) trans 21474838840 rc 0/0 00000100:00100000:1.0:1763333173.374099:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6427 00000004:00080000:1.0:1763333173.374146:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7dcfc380/2, rc 0, transno 17179871536 00000100:00100000:1.0:1763333173.374153:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7dcfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627248256:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1763333173.374165:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe472f1c00/2, rc 0, transno 21474838840 00000100:00100000:1.0:1763333173.374169:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627248128:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1763333173.374755:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe472f0e00/2, rc 0, transno 21474838839 00000100:00100000:3.0:1763333173.374761:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627248384:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333173.374809:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333173.374827:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613660288 00000100:00100000:3.0:1763333173.374831:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613660288 00000100:00100000:3.0:1763333173.374862:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6428 00000100:00100000:3.0:1763333173.374870:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:55917:x1848987613660288:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333173.374882:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333173.374902:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55c40 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969506 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333173.374920:0:8404:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x22d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333173.374939:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333173.374941:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333173.374962:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55c40 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969506 expref: 24 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.374979:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55c40 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969506 expref: 24 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.374991:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe44d75a00, rc 0) 00000100:00100000:3.0:1763333173.375033:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:55917:x1848987613660288:12345-192.168.204.28@tcp:101:bash.0 Request processed in 163us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333173.375040:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6428 00000100:00100000:0.0:1763333173.385106:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333173.385209:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333173.385284:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613660416 00000100:00100000:3.0:1763333173.385294:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613660416 00000100:00100000:3.0:1763333173.385426:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6429 00000100:00100000:3.0:1763333173.385437:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:55917:x1848987613660416:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333173.385456:0:28650:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333173.385479:0:28650:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c55c47 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696950d expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333173.385513:0:28650:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x22d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333173.385535:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333173.385538:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333173.385547:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c55c47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696950d expref: 17 pid: 28650 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333173.385554:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613660544 00000100:00100000:2.0:1763333173.385559:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613660544 00010000:00010000:3.0:1763333173.385562:0:28650:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c55c47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696950d expref: 17 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.385574:0:28650:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff4139a800, rc 0) 00000100:00100000:2.0:1763333173.385591:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9179 00000100:00100000:2.0:1763333173.385597:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56846:x1848987613660544:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333173.385613:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333173.385627:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c55c4e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969514 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333173.385634:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:55917:x1848987613660416:12345-192.168.204.28@tcp:101:bash.0 Request processed in 200us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333173.385640:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6429 00010000:00010000:2.0:1763333173.385658:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55c55 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333173.385672:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55c55 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.385683:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55c55 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.385803:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c55c4e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969514 expref: 232 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.385818:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4600/0xb32e3ef184c55c55 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969514 expref: 231 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.385826:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a8:0x0].0x0 (ffff92fe44e12800) 00010000:00010000:2.0:1763333173.385828:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763333173.385832:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4600, rc 0) 00000100:00100000:2.0:1763333173.385873:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56846:x1848987613660544:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 274us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333173.385882:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9179 00000100:00100000:0.0:1763333173.387985:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333173.388026:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333173.388560:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613660672 00000100:00100000:3.0:1763333173.388572:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613660672 00002000:00010000:3.0:1763333173.388621:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/557 (0->18446744073709551615) 00002000:00100000:3.0:1763333173.388627:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe472f3100 with x1848987613660672 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333173.388642:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe472f3100. 00000100:00100000:3.0:1763333173.388676:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613660800 00000100:00100000:3.0:1763333173.388682:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613660800 00002000:00010000:3.0:1763333173.388698:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/557 (0->18446744073709551615) 00002000:00100000:3.0:1763333173.388701:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe472f2680 with x1848987613660800 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333173.388708:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe472f2680. 00000100:00100000:0.0:1763333173.388714:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1592 00000100:00100000:0.0:1763333173.388727:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:2420:x1848987613660672:12345-192.168.204.28@tcp:10:bash.0 00000100:00100000:3.0:1763333173.388918:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1593 00000100:00100000:3.0:1763333173.388926:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2421:x1848987613660800:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:0.0:1763333173.388930:0:28427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x22d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333173.388934:0:28427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x22d:0x0] updating lvb mtime from disk: 0 -> 1763333173 00002000:00010000:0.0:1763333173.388936:0:28427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x22d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333173.388938:0:28427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x22d:0x0] updating lvb ctime from disk: 0 -> 1763333173 00002000:00010000:0.0:1763333173.388940:0:28427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x22d:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1763333173.389037:0:24027:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x22d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333173.389041:0:24027:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x22d:0x0] updating lvb mtime from disk: 0 -> 1763333173 00002000:00010000:3.0:1763333173.389043:0:24027:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x22d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333173.389045:0:24027:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x22d:0x0] updating lvb ctime from disk: 0 -> 1763333173 00002000:00010000:3.0:1763333173.389051:0:24027:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x22d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333173.389327:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:2420:x1848987613660672:12345-192.168.204.28@tcp:10:bash.0 Request processed in 524us (1271us total) trans 17179871537 rc 0/0 00000100:00100000:0.0:1763333173.389339:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1592 00002000:00010000:0.0:1763333173.389344:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/557 (0->18446744073709551615) 00002000:00100000:0.0:1763333173.389367:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe472f3100 with x1848987613660672 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333173.389374:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe472f3100. 00000100:00100000:3.0:1763333173.390415:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2421:x1848987613660800:12345-192.168.204.28@tcp:10:bash.0 Request processed in 1484us (2382us total) trans 21474838841 rc 0/0 00000100:00100000:3.0:1763333173.390427:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1593 00002000:00010000:3.0:1763333173.390432:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/557 (0->18446744073709551615) 00002000:00100000:3.0:1763333173.390436:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe472f2680 with x1848987613660800 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333173.390443:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe472f2680. 00000100:00100000:0.0:1763333173.391956:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333173.392025:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613660928 00000100:00100000:3.0:1763333173.392035:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613660928 00000100:00100000:3.0:1763333173.392089:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1594 00000100:00100000:3.0:1763333173.392097:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:2421:x1848987613660928:12345-192.168.204.28@tcp:4:lfs.0 00010000:00010000:3.0:1763333173.392129:0:24027:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55c5c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.392146:0:24027:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c55a10 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969449 expref: 25 pid: 28650 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333173.392154:0:24027:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333173.392157:0:24027:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333173.392160:0:24027:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55c5c lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.392201:0:24027:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c55a10 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969449 expref: 25 pid: 28650 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333173.392217:0:24027:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c55a10 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969449 expref: 25 pid: 28650 timeout: 1377 lvb_type: 1 00000100:00100000:3.0:1763333173.392233:0:24027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e121c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:24027:1848987627248640:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333173.392318:0:24027:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff58cbfa80 going to sleep for 11 seconds 00000100:00100000:3.0:1763333173.398708:0:24027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e121c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:24027:1848987627248640:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333173.398747:0:24027:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55c5c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333173.398862:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333173.398992:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613661056 00000100:00100000:0.0:1763333173.399000:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613661056 00010000:00010000:0.0:1763333173.399036:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c55a10 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969449 expref: 26 pid: 28650 timeout: 1377 lvb_type: 1 00000100:00100000:0.0:1763333173.399073:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3012 00000100:00100000:0.0:1763333173.399081:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+26:2419:x1848987613661056:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333173.399095:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333173.399114:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c55a10 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x22c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969449 expref: 26 pid: 28650 timeout: 1377 lvb_type: 1 00010000:00010000:0.0:1763333173.399125:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c55a10 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x22c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969449 expref: 26 pid: 28650 timeout: 1377 lvb_type: 1 00010000:00010000:0.0:1763333173.399147:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c55a10 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x22c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969449 expref: 26 pid: 28650 timeout: 1377 lvb_type: 1 00010000:00010000:0.0:1763333173.399162:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333173.399164:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333173.399169:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55c5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.399183:0:6506:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55c5c lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.399210:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333173.399235:0:24027:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55c5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.399242:0:24027:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55c5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333173.399273:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:2419:x1848987613661056:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 192us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333173.399280:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3012 00000100:00100000:0.0:1763333173.409633:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333173.410025:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613661312 00000100:00100000:3.0:1763333173.410035:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613661312 00000100:00100000:3.0:1763333173.410171:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3137 00000100:00100000:3.0:1763333173.410182:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:55917:x1848987613661312:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:3.0:1763333173.410528:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:55917:x1848987613661312:12345-192.168.204.28@tcp:35:bash.0 Request processed in 347us (903us total) trans 4294972203 rc 0/0 00000100:00100000:3.0:1763333173.410537:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3137 00000001:00080000:1.0:1763333173.413886:0:26035:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871538 is committed 00000001:00080000:1.0:1763333173.413907:0:26035:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871536 is committed 00002000:00010000:0.0:1763333173.417895:0:24027:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x22c:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:0.0:1763333173.417904:0:24027:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x22c:0x0] updating lvb mtime from disk: 0 -> 1763333173 00002000:00010000:0.0:1763333173.417907:0:24027:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x22c:0x0] updating lvb ctime from disk: 0 -> 1763333173 00002000:00010000:0.0:1763333173.417909:0:24027:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x22c:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1763333173.417920:0:24027:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55c5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.417932:0:24027:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55c5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.417941:0:24027:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55c5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.417947:0:24027:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe44d75400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333173.417951:0:24027:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55c5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.417960:0:24027:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55c5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.417988:0:24027:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55c5c lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.417996:0:24027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55c5c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333173.418289:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2421:x1848987613660928:12345-192.168.204.28@tcp:4:lfs.0 Request processed in 26181us (26328us total) trans 17179871538 rc 0/0 00000100:00100000:0.0:1763333173.418300:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1594 00000100:00100000:0.0:1763333173.424574:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.424687:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613661440 00000100:00100000:2.0:1763333173.424698:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613661440 00000100:00100000:2.0:1763333173.424760:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9180 00000100:00100000:2.0:1763333173.424770:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56849:x1848987613661440:12345-192.168.204.28@tcp:101:rm.0 00010000:00010000:2.0:1763333173.424804:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333173.424830:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55c63 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696951b expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.424897:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c55c6a lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333173.424911:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c55c6a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.424921:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c55c6a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.424933:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55c71 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333173.424940:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55c71 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.424946:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55c71 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.425023:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55c78 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1a9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333173.425031:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55c78 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.425037:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55c78 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:2.0:1763333173.425075:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1a9:0x0]: returning size 5 00000004:00200000:2.0:1763333173.425079:0:8606:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763333173.425099:0:8606:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55c78 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.425109:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55c78 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.425118:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c55c6a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.425124:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c55c6a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.425130:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c55c6a lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.425137:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c55c6a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.425144:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333173.425148:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c55c6a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.425537:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c55c6a lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.425551:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff61a46b00) 00010000:00010000:2.0:1763333173.425554:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333173.425558:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c55c6a lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.425565:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c55c6a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.425580:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55c71 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.425587:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55c71 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.425594:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55c71 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.425599:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333173.425602:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55c71 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.425607:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55c71 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.425613:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff61a46700) 00010000:00010000:2.0:1763333173.425616:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333173.425618:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55c71 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.425623:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55c71 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.425654:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55c63 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696951b expref: 234 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.425668:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55c78 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696951b expref: 233 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.425674:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a9:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:2.0:1763333173.425676:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333173.425678:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5400, rc 0) 00000100:00100000:2.0:1763333173.425751:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56849:x1848987613661440:12345-192.168.204.28@tcp:101:rm.0 Request processed in 982us (1188us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333173.425759:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9180 00000100:00100000:2.0:1763333173.445164:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.445209:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333173.445884:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613661696 00000100:00100000:0.0:1763333173.445898:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613661696 00000100:00100000:0.0:1763333173.445961:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613661952 00000100:00100000:0.0:1763333173.445964:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613661952 00000100:00100000:0.0:1763333173.445994:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9181 00000100:00100000:0.0:1763333173.446004:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:56849:x1848987613661696:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:0.0:1763333173.446062:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1763333173.446089:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55c32 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1a9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694ff expref: 234 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.446114:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55c78 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696951b expref: 233 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.446128:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55c16 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1a9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694f1 expref: 232 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.446138:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a9:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:0.0:1763333173.446164:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333173.446194:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55c7f lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333173.446207:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55c7f lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.446217:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55c7f lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.446229:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c55c86 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333173.446235:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c55c86 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.446241:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c55c86 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.446329:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c55c8d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333173.446338:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c55c8d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.446345:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c55c8d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000040:00080000:0.0:1763333173.446636:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1379, 64 off116608 00000004:00080000:0.0:1763333173.446644:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1277526294605ns, next at 1278526292086ns, rc = 0 00000040:00080000:0.0:1763333173.446667:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1380, 64 off116608 00000040:00080000:0.0:1763333173.446678:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1381, 64 off116672 00000040:00080000:0.0:1763333173.446689:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1380, 64 off116672 00010000:00010000:0.0:1763333173.446747:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55c94 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1a9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333173.446757:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55c94 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.446766:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55c94 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.446773:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55c94 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1a9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.446779:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55c94 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1a9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.446785:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55c94 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1a9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.446807:0:6521:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763333173.446827:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c55c8d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.446834:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c55c8d lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1a9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.446841:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c55c8d lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1a9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.446847:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48190c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333173.446851:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c55c8d lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1a9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.446859:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c55c8d lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1a9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.446870:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a9:0x0].0x0 (ffff92fe44e12700) 00010000:00010000:0.0:1763333173.446873:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1763333173.446878:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c55c8d lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1a9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.446885:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c55c8d lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1a9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.447026:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55c7f lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.447034:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55c7f lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.447039:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55c7f lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.447044:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55c7f lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.447049:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48190400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333173.447051:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55c7f lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.447057:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55c7f lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.447065:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12b00) 00010000:00010000:0.0:1763333173.447068:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333173.447071:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55c7f lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.447075:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55c7f lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000004:00010000:0.0:1763333173.447090:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000a1cfa5e reply state 00000000d331fe7a transno 4294972204 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c55c86 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.447104:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c55c86 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.447109:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe44e12300) 00010000:00010000:0.0:1763333173.447112:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333173.447114:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763333173.447211:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56849:x1848987613661696:12345-192.168.204.28@tcp:36:rm.0 Request processed in 1206us (2057us total) trans 4294972204 rc 0/0 00000100:00100000:0.0:1763333173.447221:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9181 00000100:00100000:0.0:1763333173.447250:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9182 00000100:00100000:0.0:1763333173.447260:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56846:x1848987613661952:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:0.0:1763333173.447294:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333173.447310:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c55bc9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1a8:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694d5 expref: 232 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.447323:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a8:0x0].0x0 (ffff92fe44e12800) 00010000:00010000:0.0:1763333173.447327:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333173.447406:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c55c9b lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333173.447416:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c55c9b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.447423:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c55c9b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00010000:0.0:1763333173.447486:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006b15382b reply state 00000000d27f6d00 transno 4294972205 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c55c9b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.447512:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c55c9b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.447520:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a8:0x0].0x0 (ffff92fe44e12800) 00010000:00010000:0.0:1763333173.447523:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333173.447525:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763333173.447568:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56846:x1848987613661952:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 310us (2357us total) trans 4294972205 rc 0/0 00000100:00100000:0.0:1763333173.447575:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9182 00010000:00010000:0.0:1763333173.447600:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333173.447607:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55c94 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1a9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.447613:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48191400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333173.447616:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55c94 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1a9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.447623:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55c94 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1a9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.447632:0:8422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a9:0x0].0x0 (ffff92fe44e12700) 00010000:00010000:0.0:1763333173.447634:0:8422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763333173.447637:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55c94 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1a9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.447644:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55c94 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1a9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.447657:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333173.447659:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333173.447661:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763333173.459992:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.460107:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613662080 00000100:00100000:2.0:1763333173.460119:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613662080 00000100:00100000:2.0:1763333173.460174:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6430 00000100:00100000:2.0:1763333173.460184:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:56846:x1848987613662080:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333173.460204:0:29010:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333173.460227:0:29010:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55ca2 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969522 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763333173.460254:0:29010:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x22c:0x0] initial LVB size: 4096, mtime: 0x691a5435, atime: 0x0, ctime: 0x691a5435, blocks: 0x8 00010000:00010000:2.0:1763333173.460277:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333173.460280:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333173.460287:0:29010:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55ca2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969522 expref: 14 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.460304:0:29010:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55ca2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969522 expref: 14 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.460317:0:29010:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5c00, rc 0) 00000100:00100000:2.0:1763333173.460397:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:56846:x1848987613662080:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 214us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333173.460404:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6430 00000100:00100000:1.0:1763333173.467877:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333173.467964:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613662208 00000100:00100000:3.0:1763333173.467975:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613662208 00000100:00100000:2.0:1763333173.468637:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6431 00000100:00100000:2.0:1763333173.468652:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:56846:x1848987613662208:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333173.468671:0:29010:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333173.468690:0:29010:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55ca9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969529 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.468724:0:29010:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c55a17 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969450 expref: 19 pid: 28651 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333173.468732:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333173.468735:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333173.468739:0:29010:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55ca9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969529 expref: 19 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.468773:0:29010:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c55a17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969450 expref: 19 pid: 28651 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333173.468785:0:29010:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c55a17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969450 expref: 19 pid: 28651 timeout: 1377 lvb_type: 1 00000100:00100000:2.0:1763333173.468800:0:29010:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe469a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:29010:1848987627248768:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333173.468884:0:29010:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7dfd8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1763333173.473133:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.473263:0:29010:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe469a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:29010:1848987627248768:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333173.473300:0:29010:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55ca9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969529 expref: 19 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.473322:0:29010:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5e00, rc 0) 00000100:00100000:2.0:1763333173.473404:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:56846:x1848987613662208:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 4756us (5534us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333173.473413:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6431 00000100:00100000:1.0:1763333173.473520:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613662336 00000100:00100000:1.0:1763333173.473528:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613662336 00010000:00010000:1.0:1763333173.473561:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c55a17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969450 expref: 19 pid: 28651 timeout: 1377 lvb_type: 1 00000100:00100000:1.0:1763333173.473601:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3013 00000100:00100000:1.0:1763333173.473610:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2421:x1848987613662336:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333173.473624:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333173.473644:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c55a17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969450 expref: 19 pid: 28651 timeout: 1377 lvb_type: 1 00010000:00010000:1.0:1763333173.473658:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c55a17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969450 expref: 19 pid: 28651 timeout: 1377 lvb_type: 1 00010000:00010000:1.0:1763333173.473683:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c55a17 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969450 expref: 19 pid: 28651 timeout: 1377 lvb_type: 1 00010000:00010000:1.0:1763333173.473698:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333173.473700:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333173.473707:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55ca9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969529 expref: 18 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.473718:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55ca9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969529 expref: 18 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.473752:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55ca9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969529 expref: 18 pid: 29010 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333173.473773:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7dcfce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6505:1848987627248896:192.168.204.28@tcp:105: 00000100:00100000:1.0:1763333173.473827:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe46e0e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763333173.477524:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333173.479651:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7dcfce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6505:1848987627248896:192.168.204.28@tcp:105: 00010000:00010000:0.0:1763333173.479685:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333173.479781:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2421:x1848987613662336:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 6170us (6656us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333173.479794:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3013 00000100:00100000:1.0:1763333173.480843:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.482187:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613662464 00000100:00100000:2.0:1763333173.482199:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613662464 00002000:00010000:2.0:1763333173.482259:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/556 (5->18446744073709551615) 00002000:00100000:2.0:1763333173.482266:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7dcfca80 with x1848987613662464 ext(5->18446744073709551615) 00002000:00010000:2.0:1763333173.482278:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff7dcfca80. 00000100:00100000:2.0:1763333173.482318:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1595 00000100:00100000:2.0:1763333173.482329:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2420:x1848987613662464:12345-192.168.204.28@tcp:10:lfs.0 00002000:00010000:2.0:1763333173.482690:0:24027:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x22c:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:2.0:1763333173.482695:0:24027:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x22c:0x0] updating lvb mtime from disk: 1763333173 -> 1763333173 00002000:00010000:2.0:1763333173.482698:0:24027:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x22c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333173.482701:0:24027:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x22c:0x0] updating lvb ctime from disk: 1763333173 -> 1763333173 00002000:00010000:2.0:1763333173.482704:0:24027:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x22c:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1763333173.482765:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2420:x1848987613662464:12345-192.168.204.28@tcp:10:lfs.0 Request processed in 437us (5260us total) trans 17179871539 rc 0/0 00000100:00100000:2.0:1763333173.482774:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1595 00002000:00010000:2.0:1763333173.482778:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/556 (5->18446744073709551615) 00002000:00100000:2.0:1763333173.482781:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7dcfca80 with x1848987613662464 ext(5->18446744073709551615) 00002000:00010000:2.0:1763333173.482786:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff7dcfca80. 00000100:00100000:1.0:1763333173.484110:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333173.484576:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613662592 00000100:00100000:3.0:1763333173.484586:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613662592 00002000:00010000:3.0:1763333173.484623:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/556 (0->18446744073709551615) 00002000:00100000:3.0:1763333173.484628:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7dcfe680 with x1848987613662592 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333173.484638:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7dcfe680. 00000100:00100000:3.0:1763333173.484676:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1596 00000100:00100000:3.0:1763333173.484685:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2421:x1848987613662592:12345-192.168.204.28@tcp:10:lfs.0 00000100:00100000:0.0:1763333173.484698:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613662720 00000100:00100000:0.0:1763333173.484703:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613662720 00000100:00100000:0.0:1763333173.484740:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9183 00000100:00100000:0.0:1763333173.484746:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56850:x1848987613662720:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333173.484764:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333173.484786:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c55cb0 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969530 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.484860:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55cb7 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00002000:00010000:3.0:1763333173.484875:0:28427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x22c:0x0] updating lvb size from disk: 0 -> 0 00010000:00010000:0.0:1763333173.484875:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55cb7 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00002000:00010000:3.0:1763333173.484878:0:28427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x22c:0x0] updating lvb mtime from disk: 0 -> 1763333173 00002000:00010000:3.0:1763333173.484881:0:28427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x22c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333173.484883:0:28427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x22c:0x0] updating lvb ctime from disk: 0 -> 1763333173 00002000:00010000:3.0:1763333173.484885:0:28427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x22c:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:0.0:1763333173.484889:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55cb7 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.484899:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c55cbe lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333173.484905:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c55cbe lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.484910:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c55cbe lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000100:00100000:3.0:1763333173.484940:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2421:x1848987613662592:12345-192.168.204.28@tcp:10:lfs.0 Request processed in 255us (4101us total) trans 21474838842 rc 0/0 00000100:00100000:3.0:1763333173.484947:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1596 00002000:00010000:3.0:1763333173.484950:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/556 (0->18446744073709551615) 00002000:00100000:3.0:1763333173.484953:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7dcfe680 with x1848987613662592 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333173.484958:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7dcfe680. 00010000:00010000:0.0:1763333173.486092:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55cb7 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.486105:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55cb7 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.486113:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55cb7 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.486120:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55cb7 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.486126:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48191400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333173.486131:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55cb7 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.486138:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55cb7 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.486153:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12700) 00010000:00010000:0.0:1763333173.486156:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333173.486161:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55cb7 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.486167:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55cb7 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.486185:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c55cbe lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.486191:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c55cbe lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.486197:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c55cbe lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.486203:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48191600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333173.486206:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c55cbe lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.486211:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c55cbe lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.486219:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe44e12300) 00010000:00010000:0.0:1763333173.486221:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333173.486224:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c55cbe lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.486229:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c55cbe lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.486268:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c55cb0 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969530 expref: 234 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.486280:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12700) 00010000:00010000:0.0:1763333173.486282:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333173.486286:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c55cb0 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969530 expref: 234 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.486301:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48190c00, rc 0) 00000100:00100000:0.0:1763333173.486381:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56850:x1848987613662720:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1633us (2278us total) trans 0 rc 301/301 00000100:00100000:0.0:1763333173.486388:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9183 00000100:00100000:1.0:1763333173.490055:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333173.490672:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613662848 00000100:00100000:0.0:1763333173.490683:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613662848 00000100:00100000:0.0:1763333173.490754:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9184 00000100:00100000:0.0:1763333173.490764:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56850:x1848987613662848:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333173.490785:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333173.490809:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c55cc5 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969537 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.490880:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55ccc lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333173.490893:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55ccc lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.490904:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55ccc lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.490913:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c55cd3 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333173.490920:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c55cd3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.490926:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c55cd3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.491723:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55ccc lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.491735:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55ccc lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.491742:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55ccc lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.491749:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55ccc lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.491755:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48190400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333173.491759:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55ccc lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.491768:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55ccc lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.491783:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12b00) 00010000:00010000:0.0:1763333173.491786:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333173.491790:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55ccc lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.491797:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55ccc lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.491813:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c55cd3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.491820:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c55cd3 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.491825:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c55cd3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.491830:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abde400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333173.491833:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c55cd3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.491838:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c55cd3 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.491844:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe44e12300) 00010000:00010000:0.0:1763333173.491847:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333173.491850:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c55cd3 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.491856:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c55cd3 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.491892:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c55cc5 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969537 expref: 234 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.491903:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12b00) 00010000:00010000:0.0:1763333173.491905:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333173.491909:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c55cc5 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969537 expref: 234 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.491923:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48190e00, rc 0) 00000100:00100000:0.0:1763333173.492012:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56850:x1848987613662848:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1249us (1965us total) trans 0 rc 301/301 00000100:00100000:0.0:1763333173.492020:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9184 00000100:00100000:1.0:1763333173.495940:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333173.496085:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613663104 00000100:00100000:0.0:1763333173.496100:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613663104 00000100:00100000:0.0:1763333173.496181:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9185 00000100:00100000:0.0:1763333173.496191:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56846:x1848987613663104:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:0.0:1763333173.496290:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c55cda lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333173.496312:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c55cda lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.496326:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c55cda lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00010000:0.0:1763333173.496482:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ad585f94 reply state 000000008aea21c7 transno 4294972206 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c55cda lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.496498:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c55cda lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.496519:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a8:0x0].0x0 (ffff92fe44e12800) 00010000:00010000:0.0:1763333173.496522:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333173.496526:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763333173.496621:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:56846:x1848987613663104:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 430us (691us total) trans 4294972206 rc 0/0 00000100:00100000:0.0:1763333173.496629:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9185 00000100:00100000:3.0:1763333173.503791:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333173.503867:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333173.504296:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613663232 00000100:00100000:0.0:1763333173.504309:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613663232 00000100:00100000:0.0:1763333173.504405:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9186 00000100:00100000:0.0:1763333173.504415:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:56850:x1848987613663232:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333173.504437:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333173.504459:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c55ce1 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696953e expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.504553:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c55ce8 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333173.504571:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c55ce8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.504586:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c55ce8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:0.0:1763333173.504647:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1763333173.504653:0:8606:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763333173.504695:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c55ce1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696953e expref: 237 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.504715:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c55ce8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696953e expref: 236 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.504725:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12b00) 00010000:00010000:0.0:1763333173.504728:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1763333173.504732:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdfe00, rc 0) 00000100:00100000:0.0:1763333173.504803:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56850:x1848987613663232:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 390us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333173.504810:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9186 00000100:00100000:1.0:1763333173.505723:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613663360 00000100:00100000:1.0:1763333173.505731:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613663360 00000100:00100000:1.0:1763333173.505787:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6432 00000100:00100000:1.0:1763333173.505797:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2418:x1848987613663360:12345-192.168.204.28@tcp:2:lfs.0 00002000:00010000:1.0:1763333173.505925:0:29010:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x22b:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1763333173.505928:0:29010:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x22b:0x0] updating lvb mtime from disk: 1763333173 -> 1763333173 00002000:00010000:1.0:1763333173.505931:0:29010:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x22b:0x0] updating lvb atime from disk: 0 -> 1763333173 00002000:00010000:1.0:1763333173.505933:0:29010:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x22b:0x0] updating lvb ctime from disk: 1763333173 -> 1763333173 00002000:00010000:1.0:1763333173.505936:0:29010:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x22b:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1763333173.505986:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2418:x1848987613663360:12345-192.168.204.28@tcp:2:lfs.0 Request processed in 190us (2118us total) trans 21474838843 rc 0/0 00000100:00100000:1.0:1763333173.505994:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6432 00000100:00100000:3.0:1763333173.512123:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.512234:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613663488 00000100:00100000:2.0:1763333173.512244:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613663488 00000100:00100000:2.0:1763333173.512313:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9187 00000100:00100000:2.0:1763333173.512325:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56850:x1848987613663488:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333173.512393:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333173.512413:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c55cef lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969545 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.512482:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55cf6 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333173.512495:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55cf6 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.512517:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55cf6 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.512527:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55cfd lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333173.512533:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55cfd lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.512540:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55cfd lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.512580:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55cf6 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.512588:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55cf6 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.512595:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55cf6 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.512602:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55cf6 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.512608:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4a00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333173.512612:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55cf6 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.512624:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55cf6 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.512635:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12b00) 00010000:00010000:2.0:1763333173.512638:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333173.512643:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55cf6 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.512649:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55cf6 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.512663:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55cfd lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.512669:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55cfd lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.512676:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55cfd lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.512682:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333173.512684:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55cfd lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.512689:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55cfd lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.512696:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe44e12300) 00010000:00010000:2.0:1763333173.512699:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333173.512701:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55cfd lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.512706:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55cfd lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.512735:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c55cef lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969545 expref: 237 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.512744:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12b00) 00010000:00010000:2.0:1763333173.512746:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333173.512749:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c55cef lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969545 expref: 237 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.512758:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4000, rc 0) 00000100:00100000:2.0:1763333173.516640:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56850:x1848987613663488:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 4301us (4511us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333173.516657:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9187 00000100:00100000:1.0:1763333173.519385:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333173.519471:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613663744 00000100:00100000:3.0:1763333173.519482:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613663744 00000100:00100000:3.0:1763333173.519554:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3138 00000100:00100000:3.0:1763333173.519565:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bd5d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56846:x1848987613663744:12345-192.168.204.28@tcp:35:lfs.0 00000004:00010000:3.0:1763333173.519629:0:35317:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x240000404:0x1a8:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55b2f lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1a8:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694a4 expref: 236 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.519681:0:35317:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55d04 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 35317 initiator: MDT0 00010000:00010000:3.0:1763333173.519694:0:35317:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55b98 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694ce expref: 236 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.519704:0:35317:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55d04 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 35317 initiator: MDT1 00010000:00010000:3.0:1763333173.519738:0:35317:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55b98 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694ce expref: 236 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.519752:0:35317:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55b98 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694ce expref: 236 pid: 12741 timeout: 1377 lvb_type: 0 00000100:00100000:3.0:1763333173.519766:0:35317:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e122300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:35317:1848987627249024:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333173.519849:0:35317:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff58cbff00 going to sleep for 11 seconds 00000100:00100000:1.0:1763333173.526083:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333173.526138:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333173.526209:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613664128 00000100:00100000:0.0:1763333173.526220:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613664128 00010000:00010000:0.0:1763333173.526267:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55b98 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694ce expref: 237 pid: 12741 timeout: 1377 lvb_type: 0 00000100:00100000:3.0:1763333173.526269:0:35317:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e122300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:35317:1848987627249024:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333173.526296:0:35317:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55d04 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 35317 initiator: MDT1 00000100:00100000:0.0:1763333173.526306:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3014 00000100:00100000:0.0:1763333173.526316:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:2419:x1848987613664128:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333173.526332:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333173.526339:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55b98 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694ce expref: 237 pid: 12741 timeout: 1377 lvb_type: 0 00010000:00010000:0.0:1763333173.526372:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55b98 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694ce expref: 237 pid: 12741 timeout: 1377 lvb_type: 0 00010000:00010000:0.0:1763333173.526395:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55b98 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694ce expref: 237 pid: 12741 timeout: 1377 lvb_type: 0 00010000:00010000:0.0:1763333173.526415:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a8:0x0].0x0 (ffff92fe44e12800) 00010000:00010000:0.0:1763333173.526420:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55d04 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 35317 initiator: MDT1 00010000:00010000:0.0:1763333173.526430:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55d04 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 35317 initiator: MDT1 00010000:00010000:0.0:1763333173.526437:0:6505:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55d04 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 35317 initiator: MDT1 00010000:00010000:0.0:1763333173.526457:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333173.526537:0:35317:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55d04 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 35317 initiator: MDT1 00010000:00010000:3.0:1763333173.526544:0:35317:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55d04 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 35317 initiator: MDT1 00000040:00080000:3.0:1763333173.526810:0:35317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1382, 88 off116760 00000004:00080000:3.0:1763333173.526819:0:35317:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1277606469165ns, next at 1278003234678ns, rc = 0 00000040:00080000:3.0:1763333173.526856:0:35317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1381, 88 off116760 00000004:00080000:3.0:1763333173.526861:0:35317:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1277606512370ns, next at 1278526292086ns, rc = 0 00000100:00100000:2.0:1763333173.526861:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613664000 00000100:00100000:2.0:1763333173.526866:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613664000 00000040:00080000:3.0:1763333173.526881:0:35317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1382, 88 off116848 00000004:00080000:3.0:1763333173.526885:0:35317:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1277606535799ns, next at 1278526292086ns, rc = 0 00000040:00080000:3.0:1763333173.526894:0:35317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1383, 88 off116848 00000004:00080000:3.0:1763333173.526898:0:35317:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1277606549172ns, next at 1278003234678ns, rc = 0 00000100:00100000:2.0:1763333173.526901:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9188 00000100:00100000:2.0:1763333173.526908:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56850:x1848987613664000:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333173.526924:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333173.526926:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763333173.526944:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c55ce8 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696953e expref: 238 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.526956:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12b00) 00010000:00010000:2.0:1763333173.526965:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333173.526983:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c55d0b lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696954c expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.527077:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55d12 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333173.527087:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55d12 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.527095:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55d12 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.527104:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55d19 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333173.527110:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55d19 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.527115:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55d19 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000100:00100000:1.0:1763333173.527304:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:2419:x1848987613664128:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 986us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333173.527317:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3014 00010000:00010000:2.0:1763333173.529134:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55d20 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333173.529154:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55d20 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.529164:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55d20 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:2.0:1763333173.529177:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ab:0x0]: returning size 0 00010000:00010000:2.0:1763333173.529207:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55d12 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.529214:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55d12 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.529220:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55d12 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.529228:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55d12 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.529234:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333173.529239:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55d12 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.529246:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55d12 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.529258:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff61a46a00) 00010000:00010000:2.0:1763333173.529261:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333173.529266:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55d12 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.529273:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55d12 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000004:00010000:2.0:1763333173.529289:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000baacd58f reply state 00000000b6b42cb4 transno 4294972208 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55d19 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.529300:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55d19 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.529306:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe44e12300) 00010000:00010000:2.0:1763333173.529309:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333173.529312:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763333173.529344:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c55d0b lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696954c expref: 239 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.529512:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55d20 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696954c expref: 238 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.529521:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ab:0x0].0x0 (ffff92ff61a46900) 00010000:00010000:2.0:1763333173.529524:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333173.529527:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5400, rc 0) 00000100:00100000:2.0:1763333173.529594:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56850:x1848987613664000:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 2685us (3520us total) trans 4294972208 rc 0/0 00000100:00100000:2.0:1763333173.529604:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9188 00000001:00080000:3.0:1763333173.536370:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972207 is committed 00000004:00080000:3.0:1763333173.536388:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 906 committed 00010000:00010000:0.0:1763333173.536400:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c55c86 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00000004:00080000:3.0:1763333173.536412:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 903 committed 00010000:00010000:0.0:1763333173.536414:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c55c86 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.536421:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c55c86 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00000004:00080000:3.0:1763333173.536423:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 902 committed 00000004:00080000:3.0:1763333173.536426:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 905 committed 00010000:00010000:0.0:1763333173.536429:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48190200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333173.536434:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c55c86 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00000004:00080000:3.0:1763333173.536438:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 901 committed 00010000:00010000:0.0:1763333173.536442:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c55c86 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.536458:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe44e12300) 00010000:00010000:0.0:1763333173.536462:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333173.536467:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c55c86 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.536476:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c55c86 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000004:00010000:3.0:1763333173.536493:0:35317:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000035d09700 reply state 00000000e0c4c1d7 transno 4294972207 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55d04 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 35317 initiator: MDT1 00010000:00010000:0.0:1763333173.536497:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c55c9b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.536513:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c55c9b lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.536518:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c55c9b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333173.536547:0:35317:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55d04 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 35317 initiator: MDT1 00010000:00010000:3.0:1763333173.536554:0:35317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a8:0x0].0x0 (ffff92fe44e12800) 00010000:00010000:3.0:1763333173.536557:0:35317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1763333173.536560:0:35317:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763333173.536569:0:35317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a8:0x0].0x0 (ffff92fe44e12800) 00010000:00010000:3.0:1763333173.536571:0:35317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763333173.536578:0:35317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55b2f lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1a8:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694a4 expref: 232 pid: 12741 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333173.536663:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7dcfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627249152:0@lo:6:osp-syn-0-1.0 00010000:00080000:3.0:1763333173.536689:0:35317:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1763333173.536700:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bd5d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56846:x1848987613663744:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 17137us (17355us total) trans 4294972207 rc 0/0 00000100:00100000:3.0:1763333173.536711:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3138 00000100:00100000:1.0:1763333173.536713:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333173.536748:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1763333173.536754:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77b17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627249536:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333173.536773:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333173.536810:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7dcfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627249280:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763333173.536814:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627249152 00000100:00100000:3.0:1763333173.536821:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627249152 00000100:00100000:1.0:1763333173.536831:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333173.536846:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763333173.536851:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77b16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627249408:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333173.536852:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627249536 00000100:00100000:3.0:1763333173.536855:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627249536 00000100:00100000:1.0:1763333173.536870:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333173.536871:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627249280 00000100:00100000:3.0:1763333173.536873:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627249280 00000100:00100000:3.0:1763333173.536886:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627249408 00000100:00100000:3.0:1763333173.536889:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627249408 00000100:00100000:1.0:1763333173.536899:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6433 00000100:00100000:3.0:1763333173.536904:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6434 00000100:00100000:3.0:1763333173.536908:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+24:3655:x1848987627249536:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333173.536908:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+24:3655:x1848987627249152:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1763333173.536931:0:8611:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:557 count 1 00010000:00010000:1.0:1763333173.536953:0:8611:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55d2e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.536969:0:8611:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c55c47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696950d expref: 19 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.536977:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333173.536979:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333173.536982:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55d2e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.537007:0:8611:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c55c47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696950d expref: 19 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.537021:0:8611:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c55c47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696950d expref: 19 pid: 28650 timeout: 1377 lvb_type: 0 00000100:00100000:1.0:1763333173.537031:0:8611:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7569f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8611:1848987627249664:192.168.204.28@tcp:104: 00002000:00010000:3.0:1763333173.537036:0:29010:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x22c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333173.537038:0:29010:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x22c:0x0] updating lvb mtime from disk: 1763333173 -> 1763333173 00002000:00010000:3.0:1763333173.537041:0:29010:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x22c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333173.537043:0:29010:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x22c:0x0] updating lvb ctime from disk: 1763333173 -> 1763333173 00002000:00010000:3.0:1763333173.537046:0:29010:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x22c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333173.537069:0:8611:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe46e0e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763333173.537077:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+25:3655:x1848987627249536:12345-0@lo:2:osp-syn-0-1.0 Request processed in 168us (303us total) trans 21474838844 rc 0/0 00000100:00100000:3.0:1763333173.537084:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6434 00010000:00010000:2.0:1763333173.537153:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55d04 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35317 initiator: MDT1 00010000:00010000:2.0:1763333173.537161:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55d04 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 35317 initiator: MDT1 00010000:00010000:2.0:1763333173.537166:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55d04 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 35317 initiator: MDT1 00010000:00010000:2.0:1763333173.537171:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff4139a000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333173.537174:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55d04 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 35317 initiator: MDT1 00010000:00010000:2.0:1763333173.537180:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55d04 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 35317 initiator: MDT1 00010000:00010000:2.0:1763333173.537189:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a8:0x0].0x0 (ffff92fe44e12800) 00010000:00010000:2.0:1763333173.537191:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333173.537195:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55d04 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 35317 initiator: MDT1 00010000:00010000:2.0:1763333173.537199:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55d04 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 35317 initiator: MDT1 00010000:00010000:0.0:1763333173.537246:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48191800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333173.537249:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c55c9b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.537255:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c55c9b lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.537264:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a8:0x0].0x0 (ffff92fe44e12800) 00010000:00010000:0.0:1763333173.537267:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333173.537269:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c55c9b lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.537275:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c55c9b lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.537286:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c55cda lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.537292:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c55cda lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.537297:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c55cda lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.537302:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333173.537305:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c55cda lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.537310:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c55cda lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.537316:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a8:0x0].0x0 (ffff92fe44e12800) 00010000:00010000:0.0:1763333173.537319:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333173.537322:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c55cda lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.537326:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c55cda lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000100:00100000:1.0:1763333173.537402:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6435 00000100:00100000:1.0:1763333173.537412:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+24:3652:x1848987627249280:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1763333173.537424:0:8407:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:558 count 1 00002000:00010000:1.0:1763333173.537443:0:8407:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x22e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333173.537449:0:8407:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c55d35 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.537457:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333173.537458:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333173.537462:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c55d35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.537472:0:8407:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c55d35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.537480:0:8407:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c55d35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.537486:0:8407:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c55d35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.537519:0:8407:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763333173.537702:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+25:3652:x1848987627249280:12345-0@lo:6:osp-syn-0-1.0 Request processed in 291us (867us total) trans 21474838845 rc 0/0 00000100:00100000:1.0:1763333173.537710:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6435 00000100:00100000:1.0:1763333173.537725:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6436 00000100:00100000:1.0:1763333173.537731:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+24:3652:x1848987627249408:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1763333173.537785:0:8407:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x22b:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1763333173.537789:0:8407:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x22b:0x0] updating lvb mtime from disk: 1763333173 -> 1763333173 00002000:00010000:1.0:1763333173.537791:0:8407:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x22b:0x0] updating lvb atime from disk: 1763333173 -> 1763333173 00002000:00010000:1.0:1763333173.537793:0:8407:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x22b:0x0] updating lvb ctime from disk: 1763333173 -> 1763333173 00002000:00010000:1.0:1763333173.537795:0:8407:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x22b:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1763333173.537820:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+25:3652:x1848987627249408:12345-0@lo:2:osp-syn-0-1.0 Request processed in 90us (949us total) trans 21474838846 rc 0/0 00000100:00100000:1.0:1763333173.537827:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6436 00010000:00010000:1.0:1763333173.537852:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333173.537859:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c55d35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.537866:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e800 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333173.537870:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c55d35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.537877:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c55d35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.537896:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c55d35 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.537902:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c55d35 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.537917:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333173.537919:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333173.537921:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763333173.537953:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff77b16d80/2, rc 0, transno 21474838846 00000100:00100000:1.0:1763333173.537961:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77b16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627249408:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1763333173.537970:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7dcfce00/2, rc 0, transno 21474838845 00000100:00100000:1.0:1763333173.537974:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7dcfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627249280:0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1763333173.537993:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff77b17b80/2, rc 0, transno 21474838844 00000100:00100000:1.0:1763333173.537997:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77b17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627249536:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333173.538251:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42ef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627250048:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333173.538282:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333173.538302:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1763333173.538308:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42ef9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627249920:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763333173.538328:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333173.538378:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627250048 00000100:00100000:1.0:1763333173.538383:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627250048 00000100:00100000:1.0:1763333173.538410:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627249920 00000100:00100000:1.0:1763333173.538413:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627249920 00000100:00100000:1.0:1763333173.538432:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6437 00000100:00100000:1.0:1763333173.538439:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+6:3653:x1848987627250048:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1763333173.538536:0:29013:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x22b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333173.538539:0:29013:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x22b:0x0] updating lvb mtime from disk: 1763333173 -> 1763333173 00002000:00010000:1.0:1763333173.538542:0:29013:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x22b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333173.538544:0:29013:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x22b:0x0] updating lvb ctime from disk: 1763333173 -> 1763333173 00002000:00010000:1.0:1763333173.538547:0:29013:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x22b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333173.538578:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+7:3653:x1848987627250048:12345-0@lo:2:osp-syn-1-1.0 Request processed in 138us (294us total) trans 17179871540 rc 0/0 00000100:00100000:1.0:1763333173.538585:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6437 00000100:00100000:1.0:1763333173.538599:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6438 00000100:00100000:1.0:1763333173.538606:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+6:3653:x1848987627249920:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763333173.538618:0:29013:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:558 count 1 00002000:00010000:1.0:1763333173.538635:0:29013:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x22e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333173.538641:0:29013:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55d3c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.538649:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333173.538651:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333173.538655:0:29013:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55d3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.538664:0:29013:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55d3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.538672:0:29013:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55d3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.538679:0:29013:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55d3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.538695:0:29013:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763333173.538818:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+7:3653:x1848987627249920:12345-0@lo:6:osp-syn-1-1.0 Request processed in 212us (488us total) trans 17179871541 rc 0/0 00000100:00100000:1.0:1763333173.538824:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6438 00010000:00010000:1.0:1763333173.538841:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333173.538846:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55d3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.538854:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7ec00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333173.538857:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55d3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.538864:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55d3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.538875:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55d3c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.538882:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55d3c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.538894:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333173.538896:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333173.538897:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763333173.538916:0:3653:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179871536 gen 2 00000004:00080000:1.0:1763333173.538921:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe49609c00, transno 17179871497 00000004:00080000:1.0:1763333173.538928:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe49608700, transno 17179871498 00000004:00080000:1.0:1763333173.538931:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe49608000, transno 17179871499 00000004:00080000:1.0:1763333173.538934:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff77a3dc00, transno 17179871500 00000004:00080000:1.0:1763333173.538937:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff6bc13100, transno 17179871501 00000004:00080000:1.0:1763333173.538939:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff6bc11c00, transno 17179871502 00000004:00080000:1.0:1763333173.538942:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff6bc12300, transno 17179871503 00000004:00080000:1.0:1763333173.538944:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff6bc10a80, transno 17179871504 00000004:00080000:1.0:1763333173.538947:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff75667b80, transno 17179871506 00000004:00080000:1.0:1763333173.538949:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff75667480, transno 17179871507 00000004:00080000:1.0:1763333173.538952:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff75667100, transno 17179871508 00000004:00080000:1.0:1763333173.538954:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff75664700, transno 17179871509 00000004:00080000:1.0:1763333173.538957:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff77b14700, transno 17179871512 00000004:00080000:1.0:1763333173.538960:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff77b17480, transno 17179871513 00000004:00080000:1.0:1763333173.538962:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff50067b80, transno 17179871514 00000004:00080000:1.0:1763333173.538965:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff50064700, transno 17179871515 00000004:00080000:1.0:1763333173.538968:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff77c6ca80, transno 17179871518 00000004:00080000:1.0:1763333173.538970:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff77c6ea00, transno 17179871519 00000004:00080000:1.0:1763333173.538973:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4960b480, transno 17179871520 00000004:00080000:1.0:1763333173.538976:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff74038000, transno 17179871522 00000004:00080000:1.0:1763333173.538978:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7e00df80, transno 17179871524 00000004:00080000:1.0:1763333173.538981:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7e00ea00, transno 17179871525 00000004:00080000:1.0:1763333173.538983:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff77b16300, transno 17179871526 00000004:00080000:1.0:1763333173.538986:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff77b14380, transno 17179871527 00000004:00080000:1.0:1763333173.538989:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff77b14a80, transno 17179871528 00000004:00080000:1.0:1763333173.538991:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe472f7100, transno 17179871529 00000004:00080000:1.0:1763333173.538994:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff77b15500, transno 17179871530 00000004:00080000:1.0:1763333173.538996:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe472f6a00, transno 17179871531 00000004:00080000:1.0:1763333173.538999:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe434c5180, transno 17179871533 00000004:00080000:1.0:1763333173.539002:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe434c7100, transno 17179871534 00000004:00080000:1.0:1763333173.539004:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7dcfea00, transno 17179871535 00000004:00080000:1.0:1763333173.539007:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7dcfc380, transno 17179871536 00000100:00100000:1.0:1763333173.539015:0:3653:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff92fe42ef9180 x1848987627249920/t17179871541(17179871541) o6->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1763333189 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1763333173.539023:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe42ef9180/2, rc 0, transno 17179871541 00000100:00100000:1.0:1763333173.539028:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42ef9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627249920:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1763333173.539040:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe42ef9c00/2, rc 0, transno 17179871540 00000100:00100000:1.0:1763333173.539044:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42ef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627250048:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1763333173.539265:0:9836:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 4 in progress, 2 in flight, 32 done 00000100:00100000:1.0:1763333173.539283:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42ef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627249792:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763333173.539310:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333173.539339:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1763333173.539344:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42ef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627250176:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333173.539378:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333173.539399:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627249792 00000100:00100000:1.0:1763333173.539402:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627249792 00000100:00100000:1.0:1763333173.539422:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627250176 00000100:00100000:1.0:1763333173.539424:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627250176 00000100:00100000:1.0:1763333173.539438:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6439 00000100:00100000:1.0:1763333173.539443:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+8:3655:x1848987627249792:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763333173.539456:0:28650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:557 count 1 00010000:00010000:1.0:1763333173.539468:0:28650:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55d43 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x22d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.539482:0:28650:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55c40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x22d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969506 expref: 14 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.539488:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333173.539490:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333173.539493:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55d43 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x22d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.539526:0:28650:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55c40 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x22d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969506 expref: 14 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.539538:0:28650:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55c40 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x22d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969506 expref: 14 pid: 8404 timeout: 1377 lvb_type: 0 00000100:00100000:1.0:1763333173.539548:0:28650:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe49609c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28650:1848987627250304:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333173.539599:0:28650:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe46e0e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763333173.539685:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333173.539751:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6440 00000100:00100000:1.0:1763333173.539758:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+8:3655:x1848987627250176:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1763333173.539832:0:8407:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x22c:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1763333173.539835:0:8407:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x22c:0x0] updating lvb mtime from disk: 1763333173 -> 1763333173 00002000:00010000:1.0:1763333173.539838:0:8407:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x22c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333173.539840:0:8407:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x22c:0x0] updating lvb ctime from disk: 1763333173 -> 1763333173 00002000:00010000:1.0:1763333173.539843:0:8407:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x22c:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1763333173.539872:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+9:3655:x1848987627250176:12345-0@lo:2:osp-syn-1-1.0 Request processed in 115us (493us total) trans 17179871542 rc 0/0 00000100:00100000:1.0:1763333173.539880:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6440 00000004:00080000:1.0:1763333173.539910:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe42ef9500/2, rc 0, transno 17179871542 00000100:00100000:1.0:1763333173.539915:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42ef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627250176:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333173.540058:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613664384 00000100:00100000:2.0:1763333173.540063:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613664384 00000100:00100000:2.0:1763333173.540104:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9189 00000100:00100000:2.0:1763333173.540112:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56850:x1848987613664384:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333173.540125:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333173.540138:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55d4a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969553 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.540237:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55d51 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333173.540250:0:12741:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55d20 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696954c expref: 230 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.540258:0:12741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55d51 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.540280:0:12741:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55d20 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696954c expref: 230 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.540289:0:12741:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55d20 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696954c expref: 230 pid: 12741 timeout: 1377 lvb_type: 0 00000100:00100000:2.0:1763333173.540298:0:12741:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe469a0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627250432:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333173.540422:0:12741:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4869d780 going to sleep for 11 seconds 00000100:00100000:1.0:1763333173.543621:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333173.543703:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333173.543754:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333173.543779:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613664640 00000100:00100000:1.0:1763333173.543788:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613664640 00010000:00010000:1.0:1763333173.543828:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c55c47 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696950d expref: 20 pid: 28650 timeout: 1377 lvb_type: 0 00000100:00100000:1.0:1763333173.543858:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613664768 00000100:00100000:1.0:1763333173.543861:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613664768 00010000:00010000:1.0:1763333173.543878:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55c40 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x22d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969506 expref: 15 pid: 8404 timeout: 1377 lvb_type: 0 00000100:00100000:1.0:1763333173.543900:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3015 00000100:00100000:1.0:1763333173.543909:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff51e55850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2420:x1848987613664640:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333173.543925:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333173.543931:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c55c47 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696950d expref: 20 pid: 28650 timeout: 1377 lvb_type: 0 00010000:00010000:1.0:1763333173.543945:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c55c47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696950d expref: 20 pid: 28650 timeout: 1377 lvb_type: 0 00010000:00010000:1.0:1763333173.543983:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333173.543985:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333173.543991:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55d2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.544002:0:6506:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55d2e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.544025:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333173.544073:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff51e55850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2420:x1848987613664640:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 164us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333173.544081:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3015 00000100:00100000:1.0:1763333173.544126:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3016 00000100:00100000:1.0:1763333173.544134:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4960b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2421:x1848987613664768:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333173.544145:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333173.544150:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55c40 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x22d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969506 expref: 15 pid: 8404 timeout: 1377 lvb_type: 0 00010000:00010000:1.0:1763333173.544161:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55c40 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x22d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969506 expref: 15 pid: 8404 timeout: 1377 lvb_type: 0 00010000:00010000:1.0:1763333173.544175:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333173.544177:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333173.544181:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55d43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x22d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.544189:0:6506:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55d43 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x22d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.544201:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333173.544221:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4960b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2421:x1848987613664768:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 87us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333173.544227:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3016 00010000:00010000:1.0:1763333173.544271:0:28650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55c40 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x22d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969506 expref: 14 pid: 8404 timeout: 1377 lvb_type: 0 00000100:00100000:1.0:1763333173.544286:0:28650:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe49609c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28650:1848987627250304:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333173.544308:0:28650:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55d43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.544319:0:28650:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55d43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.544327:0:28650:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55d43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.544337:0:28650:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55d43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.544373:0:28650:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55d43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.544390:0:28650:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763333173.544634:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+9:3655:x1848987627249792:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5189us (5321us total) trans 17179871543 rc 0/0 00000100:00100000:1.0:1763333173.544643:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6439 00000004:00080000:1.0:1763333173.544678:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe42ef8700/2, rc 0, transno 17179871543 00000100:00100000:1.0:1763333173.544684:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42ef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627249792:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763333173.544988:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613664512 00000100:00100000:0.0:1763333173.544995:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613664512 00000100:00100000:0.0:1763333173.545037:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9190 00000100:00100000:0.0:1763333173.545046:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56846:x1848987613664512:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333173.545066:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333173.545084:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c55d58 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696955a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.545136:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c55d58 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696955a expref: 232 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.545150:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abde400/0xb32e3ef184c55d58 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696955a expref: 232 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.545168:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a8:0x0].0x0 (ffff92fe44e12800) 00010000:00010000:0.0:1763333173.545172:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333173.545175:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abde400, rc 0) 00000100:00100000:0.0:1763333173.545198:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56846:x1848987613664512:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 154us (1592us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333173.545204:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9190 00010000:00010000:2.0:1763333173.546599:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333173.546612:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55d43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.546621:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333173.546626:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55d43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.546632:0:8611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c55c47 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696950d expref: 19 pid: 28650 timeout: 1377 lvb_type: 0 00010000:00010000:2.0:1763333173.546640:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55d43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333173.546648:0:8611:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7569f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8611:1848987627249664:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333173.546657:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55d43 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.546663:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55d43 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.546668:0:8611:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55d2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.546678:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333173.546680:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333173.546681:0:8611:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55d2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.546681:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333173.546688:0:8611:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55d2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.546696:0:8611:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55d2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.546702:0:8611:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55d2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.546727:0:8611:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763333173.546958:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333173.546964:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55d2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.546972:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fe00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333173.546974:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55d2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.546980:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55d2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.546991:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55d2e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.546997:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55d2e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.547011:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333173.547013:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333173.547015:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763333173.547177:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+25:3655:x1848987627249152:12345-0@lo:6:osp-syn-0-1.0 Request processed in 10269us (10461us total) trans 21474838847 rc 0/0 00000100:00100000:2.0:1763333173.547188:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6433 00000004:00080000:0.0:1763333173.547295:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7dcfed80/2, rc 0, transno 21474838847 00000100:00100000:0.0:1763333173.547301:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7dcfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627249152:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763333173.550403:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333173.550931:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613664896 00000100:00100000:3.0:1763333173.550942:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613664896 00010000:00010000:3.0:1763333173.550992:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55d20 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696954c expref: 232 pid: 12741 timeout: 1377 lvb_type: 0 00000100:00100000:3.0:1763333173.551035:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3017 00000100:00100000:3.0:1763333173.551044:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:2421:x1848987613664896:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333173.551060:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333173.551067:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55d20 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696954c expref: 232 pid: 12741 timeout: 1377 lvb_type: 0 00010000:00010000:3.0:1763333173.551082:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55d20 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696954c expref: 232 pid: 12741 timeout: 1377 lvb_type: 0 00010000:00010000:3.0:1763333173.551114:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ab:0x0].0x0 (ffff92ff61a46900) 00010000:00010000:3.0:1763333173.551119:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55d51 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.551130:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55d51 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.551138:0:6505:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55d51 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.551158:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333173.552383:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55d20 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696954c expref: 232 pid: 12741 timeout: 1377 lvb_type: 0 00000100:00100000:0.0:1763333173.552410:0:12741:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe469a0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627250432:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333173.552446:0:12741:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55d51 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.552454:0:12741:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55d51 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.552461:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55d51 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:0.0:1763333173.552487:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ab:0x0]: returning size 0 00000004:00080000:0.0:1763333173.552701:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x22f:0x0], index 0: 0 00000004:00080000:0.0:1763333173.552710:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x22f:0x0], index 1: 0 00000004:00080000:0.0:1763333173.552715:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x230:0x0], index 1: 0 00000004:00080000:0.0:1763333173.552719:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x230:0x0], index 0: 0 00010000:00010000:0.0:1763333173.552848:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55d51 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.552857:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55d51 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.552865:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55d51 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.552871:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333173.552875:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55d51 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.552883:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55d51 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.552901:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ab:0x0].0x0 (ffff92ff61a46900) 00010000:00010000:0.0:1763333173.552904:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333173.552908:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55d51 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.552914:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55d51 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.552966:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55d4a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1ab:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969553 expref: 232 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.552977:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ab:0x0].0x0 (ffff92ff61a46900) 00010000:00010000:0.0:1763333173.552979:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763333173.552983:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55d4a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1ab:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969553 expref: 232 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.552998:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4400, rc 0) 00000100:00100000:3.0:1763333173.554166:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:2421:x1848987613664896:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 3115us (3764us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333173.554179:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3017 00000100:00100000:0.0:1763333173.554619:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56850:x1848987613664384:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 14505us (14930us total) trans 4294972209 rc 301/301 00000100:00100000:0.0:1763333173.554628:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9189 00000100:00100000:1.0:1763333173.557268:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333173.557317:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613665152 00000100:00100000:3.0:1763333173.557328:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613665152 00000100:00100000:1.0:1763333173.557459:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3139 00000100:00100000:1.0:1763333173.557470:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56846:x1848987613665152:12345-192.168.204.28@tcp:35:lfs.0 00000004:00080000:1.0:1763333173.557796:0:35317:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x1a8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1763333173.557863:0:35317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1384, 64 off116912 00000040:00080000:1.0:1763333173.557885:0:35317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1383, 64 off116912 00000040:00080000:1.0:1763333173.557893:0:35317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1384, 64 off116976 00000040:00080000:1.0:1763333173.557900:0:35317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1385, 64 off116976 00010000:00010000:1.0:1763333173.557965:0:35317:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c55d66 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35317 initiator: MDT0 00010000:00010000:1.0:1763333173.557983:0:35317:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c55d66 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 35317 initiator: MDT1 00010000:00010000:1.0:1763333173.557994:0:35317:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c55d66 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1a8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 35317 initiator: MDT1 00010000:00010000:1.0:1763333173.558003:0:35317:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c55d66 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1a8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 35317 initiator: MDT1 00010000:00010000:1.0:1763333173.558009:0:35317:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c55d66 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1a8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 35317 initiator: MDT1 00010000:00010000:1.0:1763333173.558015:0:35317:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c55d66 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1a8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 35317 initiator: MDT1 00000100:00100000:3.0:1763333173.559788:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333173.559841:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613665408 00000100:00100000:0.0:1763333173.559852:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613665408 00010000:00010000:1.0:1763333173.559868:0:35317:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763333173.559910:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3140 00000100:00100000:0.0:1763333173.559920:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56850:x1848987613665408:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1763333173.560137:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56846:x1848987613665152:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 2668us (2880us total) trans 4294972210 rc 0/0 00000100:00100000:0.0:1763333173.560137:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56850:x1848987613665408:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 217us (356us total) trans 4294972211 rc 0/0 00000100:00100000:0.0:1763333173.560145:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3140 00010000:00010000:2.0:1763333173.560234:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333173.560242:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c55d66 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1a8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 35317 initiator: MDT1 00010000:00010000:2.0:1763333173.560251:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e800 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333173.560255:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c55d66 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1a8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 35317 initiator: MDT1 00010000:00010000:2.0:1763333173.560264:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c55d66 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1a8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 35317 initiator: MDT1 00010000:00010000:2.0:1763333173.560280:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1a8:0x0].0x0 (ffff92fe44e12800) 00010000:00010000:2.0:1763333173.560284:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1763333173.560289:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c55d66 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1a8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 35317 initiator: MDT1 00010000:00010000:2.0:1763333173.560294:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c55d66 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1a8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 35317 initiator: MDT1 00010000:00010000:2.0:1763333173.560304:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333173.560306:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333173.560308:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763333173.560387:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3139 00000100:00100000:3.0:1763333173.564952:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333173.565013:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613665664 00000100:00100000:3.0:1763333173.565017:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333173.565027:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613665664 00000100:00100000:0.0:1763333173.565097:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9191 00000100:00100000:0.0:1763333173.565107:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56846:x1848987613665664:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333173.565134:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333173.565158:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c55d6d lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969561 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.565236:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c55d74 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333173.565249:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c55d74 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.565261:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c55d74 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.565271:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c55d7b lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333173.565278:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c55d7b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.565284:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c55d7b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.565434:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c55d82 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333173.565443:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c55d82 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.565450:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c55d82 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:0.0:1763333173.565460:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ab:0x0]: returning size 0 00010000:00010000:0.0:1763333173.565559:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c55d74 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.565566:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c55d74 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.565572:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c55d74 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.565578:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c55d74 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.565584:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333173.565588:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c55d74 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.565595:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c55d74 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.565606:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12700) 00010000:00010000:0.0:1763333173.565609:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333173.565613:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c55d74 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.565619:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c55d74 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.565632:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c55d7b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.565637:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c55d7b lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.565646:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c55d7b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.565650:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdee00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333173.565653:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c55d7b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.565658:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c55d7b lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.565664:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe44e12300) 00010000:00010000:0.0:1763333173.565666:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333173.565668:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c55d7b lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.565673:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c55d7b lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.565707:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c55d6d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969561 expref: 235 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.565725:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c55d82 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969561 expref: 234 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.565731:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ab:0x0].0x0 (ffff92fe44e12f00) 00010000:00010000:0.0:1763333173.565734:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333173.565737:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdea00, rc 0) 00000100:00100000:0.0:1763333173.565815:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:56846:x1848987613665664:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 709us (875us total) trans 4294972212 rc 0/0 00000100:00100000:0.0:1763333173.565822:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9191 00000100:00100000:2.0:1763333173.565905:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613665920 00000100:00100000:2.0:1763333173.565911:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613665920 00000100:00100000:2.0:1763333173.565951:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3141 00000100:00100000:2.0:1763333173.565959:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:56850:x1848987613665920:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333173.566078:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:56850:x1848987613665920:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 119us (1060us total) trans 4294972213 rc 0/0 00000100:00100000:2.0:1763333173.566085:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3141 00000100:00100000:1.0:1763333173.570783:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333173.570827:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.570861:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613666048 00000100:00100000:2.0:1763333173.570872:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613666048 00000100:00100000:3.0:1763333173.570905:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613666176 00000100:00100000:3.0:1763333173.570910:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613666176 00000100:00100000:2.0:1763333173.570933:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6441 00000100:00100000:2.0:1763333173.570987:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2421:x1848987613666048:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333173.571011:0:8611:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1763333173.571013:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6442 00000100:00100000:3.0:1763333173.571020:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2420:x1848987613666176:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333173.571028:0:28650:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333173.571036:0:8611:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c55d90 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969568 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.571039:0:28650:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff4139a600/0xb32e3ef184c55d97 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696956f expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333173.571062:0:28650:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x230:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:2.0:1763333173.571062:0:8611:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x230:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333173.571082:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333173.571082:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333173.571084:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333173.571085:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333173.571093:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff4139a600/0xb32e3ef184c55d97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696956f expref: 20 pid: 28650 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333173.571093:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c55d90 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969568 expref: 15 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333173.571112:0:28650:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92ff4139a600/0xb32e3ef184c55d97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696956f expref: 20 pid: 28650 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333173.571112:0:8611:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c55d90 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969568 expref: 15 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333173.571128:0:28650:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff4139a600, rc 0) 00010000:00010000:2.0:1763333173.571128:0:8611:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feaa00, rc 0) 00000100:00100000:3.0:1763333173.571186:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2420:x1848987613666176:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 165us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333173.571193:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6442 00000100:00100000:2.0:1763333173.571220:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2421:x1848987613666048:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 236us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333173.571226:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6441 00000100:00100000:3.0:1763333173.571810:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333173.571853:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613666432 00000100:00100000:0.0:1763333173.571859:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613666432 00000100:00100000:0.0:1763333173.571907:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9192 00000100:00100000:0.0:1763333173.571916:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:55917:x1848987613666432:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333173.571937:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333173.571939:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763333173.571965:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c55d82 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969561 expref: 235 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.571982:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ab:0x0].0x0 (ffff92fe44e12f00) 00010000:00010000:0.0:1763333173.571994:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333173.572006:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c55d9e lrc: 2/0,0 mode: --/CW res: [0x240000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969576 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.572122:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c55da5 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333173.572136:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c55da5 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1ab:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.572147:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c55da5 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1ab:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:0.0:1763333173.572163:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ab:0x0]: returning size 0 00010000:00010000:0.0:1763333173.572288:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c55d9e lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969576 expref: 237 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.572304:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c55da5 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1ab:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969576 expref: 236 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.572311:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ab:0x0].0x0 (ffff92fe44e12c00) 00010000:00010000:0.0:1763333173.572315:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:0.0:1763333173.572317:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48191800, rc 0) 00000100:00100000:0.0:1763333173.572390:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:55917:x1848987613666432:12345-192.168.204.28@tcp:101:bash.0 Request processed in 474us (580us total) trans 4294972214 rc 0/0 00000100:00100000:0.0:1763333173.572396:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9192 00000100:00100000:1.0:1763333173.573627:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333173.573849:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613666560 00000100:00100000:0.0:1763333173.573856:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613666560 00000100:00100000:0.0:1763333173.573916:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9193 00000100:00100000:0.0:1763333173.573926:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56846:x1848987613666560:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333173.573944:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333173.573963:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c55db3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696957d expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.574009:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c55db3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696957d expref: 237 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.574023:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c55db3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696957d expref: 237 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.574041:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ab:0x0].0x0 (ffff92fe44e12c00) 00010000:00010000:0.0:1763333173.574044:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333173.574047:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48190200, rc 0) 00000100:00100000:0.0:1763333173.582794:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56846:x1848987613666560:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 8853us (9156us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333173.582810:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9193 00000100:00100000:2.0:1763333173.584199:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333173.584257:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613666688 00000100:00100000:3.0:1763333173.584267:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613666688 00000100:00100000:3.0:1763333173.584328:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9194 00000100:00100000:3.0:1763333173.584337:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:55917:x1848987613666688:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333173.584380:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333173.584463:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c55dba lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969584 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.584513:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55dc1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333173.584528:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55dc1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333173.584540:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55dc1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333173.584677:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c55dba lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969584 expref: 239 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.584698:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55dc1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969584 expref: 238 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.584708:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ab:0x0].0x0 (ffff92fe44e12c00) 00010000:00010000:3.0:1763333173.584711:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763333173.584715:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff4139a000, rc 0) 00000100:00100000:3.0:1763333173.584786:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:55917:x1848987613666688:12345-192.168.204.28@tcp:101:bash.0 Request processed in 450us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333173.584794:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9194 00000100:00100000:1.0:1763333173.587195:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333173.587271:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613666944 00000100:00100000:0.0:1763333173.587281:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613666944 00000100:00100000:0.0:1763333173.587340:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3142 00000100:00100000:0.0:1763333173.587552:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56846:x1848987613666944:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333173.587845:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56846:x1848987613666944:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 494us (660us total) trans 4294972215 rc 0/0 00000100:00100000:0.0:1763333173.587853:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3142 00000100:00100000:1.0:1763333173.587934:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333173.588060:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613667200 00000100:00100000:0.0:1763333173.588065:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613667200 00000100:00100000:0.0:1763333173.588103:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9195 00000100:00100000:0.0:1763333173.588111:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:55917:x1848987613667200:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:0.0:1763333173.588138:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333173.588166:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c55da5 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1ab:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969576 expref: 239 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.588527:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ab:0x0].0x0 (ffff92fe44e12c00) 00010000:00010000:0.0:1763333173.588533:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333173.588680:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c55dc8 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333173.588695:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c55dc8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.588705:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c55dc8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000001:00080000:0.0:1763333173.588751:0:8606:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294972216 00000004:00010000:0.0:1763333173.588775:0:8606:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000024d91816 reply state 000000006afce6e4 transno 4294972217 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c55dc8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.588786:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c55dc8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.588797:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ab:0x0].0x0 (ffff92fe44e12c00) 00010000:00010000:0.0:1763333173.588799:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333173.588802:0:8606:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763333173.588863:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:55917:x1848987613667200:12345-192.168.204.28@tcp:36:bash.0 Request processed in 752us (927us total) trans 4294972217 rc 0/0 00000100:00100000:0.0:1763333173.588871:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9195 00000020:00080000:0.0:1763333173.588876:0:8606:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763333173.590480:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333173.590517:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.590607:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613667456 00000100:00100000:2.0:1763333173.590617:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613667456 00000100:00100000:2.0:1763333173.590668:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613667712 00000100:00100000:2.0:1763333173.590672:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613667712 00000100:00100000:2.0:1763333173.590713:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9196 00000100:00100000:2.0:1763333173.590723:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:55917:x1848987613667456:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333173.590754:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333173.590758:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763333173.590787:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c55db3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696957d expref: 242 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.590808:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ab:0x0].0x0 (ffff92fe44e12c00) 00010000:00010000:2.0:1763333173.590813:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333173.590830:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c55dcf lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696958b expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.590882:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55dd6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333173.590901:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55dd6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00000100:00100000:3.0:1763333173.590906:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9197 00010000:00010000:2.0:1763333173.590910:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55dd6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000100:00100000:3.0:1763333173.590916:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:56846:x1848987613667712:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333173.590924:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333173.590935:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55ddd lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969592 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.591012:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55de4 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333173.591021:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55de4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333173.591029:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55de4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333173.591043:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55deb lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333173.591049:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55deb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333173.591054:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55deb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000040:00080000:2.0:1763333173.591141:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1386, 88 off117064 00000004:00080000:2.0:1763333173.591151:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1277670801216ns, next at 1278003234678ns, rc = 0 00000040:00080000:2.0:1763333173.591195:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1385, 88 off117064 00000004:00080000:2.0:1763333173.591200:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1277670851061ns, next at 1278526292086ns, rc = 0 00000040:00080000:2.0:1763333173.591254:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1386, 88 off117152 00000004:00080000:2.0:1763333173.591259:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1277670910078ns, next at 1278526292086ns, rc = 0 00000040:00080000:2.0:1763333173.591279:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1387, 88 off117152 00000004:00080000:2.0:1763333173.591282:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1277670933446ns, next at 1278003234678ns, rc = 0 00010000:00010000:2.0:1763333173.591380:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c55df2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333173.591390:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c55df2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.591398:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c55df2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:2.0:1763333173.591409:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ab:0x0]: returning size 2 00010000:00010000:2.0:1763333173.591465:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c55df2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.591472:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c55df2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.591478:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c55df2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.591485:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333173.591488:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c55df2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.591495:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c55df2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.591515:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ab:0x0].0x0 (ffff92fe44e12c00) 00010000:00010000:2.0:1763333173.591518:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1763333173.591522:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c55df2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.591530:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c55df2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.591545:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55de4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.591551:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55de4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.591556:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55de4 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.591561:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55de4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.591567:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe44d75400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333173.591569:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55de4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.591574:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55de4 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.591584:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff80045e00) 00010000:00010000:2.0:1763333173.591587:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333173.591589:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55de4 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.591594:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55de4 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.591603:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55deb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.591608:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55deb lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.591612:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55deb lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.591617:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333173.591620:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55deb lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.591625:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55deb lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.591631:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe44e12300) 00010000:00010000:2.0:1763333173.591633:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333173.591635:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55deb lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.591640:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55deb lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.591672:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55ddd lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969592 expref: 244 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.591681:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff80045e00) 00010000:00010000:2.0:1763333173.591684:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763333173.591687:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55ddd lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969592 expref: 244 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.591699:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe44d75a00, rc 0) 00000100:00100000:2.0:1763333173.591758:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:56846:x1848987613667712:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 843us (1240us total) trans 4294972219 rc 301/301 00000100:00100000:2.0:1763333173.591765:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9197 00000100:00100000:3.0:1763333173.594335:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000001:00080000:2.0:1763333173.595228:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972219 is committed 00000004:00080000:2.0:1763333173.595241:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 908 committed 00000004:00080000:2.0:1763333173.595257:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 905 committed 00000004:00080000:2.0:1763333173.595267:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 904 committed 00000004:00080000:2.0:1763333173.595270:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 907 committed 00010000:00010000:2.0:1763333173.595487:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55dd6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696958b expref: 232 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.595515:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ab:0x0].0x0 (ffff92fe44e12c00) 00010000:00010000:2.0:1763333173.595519:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763333173.595536:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c55dcf lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696958b expref: 232 pid: 12741 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1763333173.595559:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55dd6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696958b expref: 231 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.595597:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ab:0x0].0x0 (ffff92fe44e12c00) 00010000:00010000:2.0:1763333173.595600:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763333173.595603:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feba00, rc 0) 00000100:00100000:2.0:1763333173.595682:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:55917:x1848987613667456:12345-192.168.204.28@tcp:101:bash.0 Request processed in 4958us (5207us total) trans 4294972218 rc 0/0 00000100:00100000:2.0:1763333173.595693:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9196 00000100:00100000:1.0:1763333173.595845:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe469a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627250944:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333173.595904:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333173.595949:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7dcff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627251456:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333173.595971:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333173.595997:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1763333173.596004:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe469a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627250560:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763333173.596024:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333173.596042:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77b14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627251072:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763333173.596060:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333173.596087:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe469a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627250688:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763333173.596109:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333173.596127:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77b15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627251200:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763333173.596146:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333173.596163:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1763333173.596170:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe469a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627250816:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333173.596189:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333173.596205:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7dcfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627251328:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333173.596224:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333173.596256:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627250944 00000100:00100000:1.0:1763333173.596264:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627250944 00000100:00100000:1.0:1763333173.596308:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627251456 00000100:00100000:1.0:1763333173.596312:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627251456 00000100:00100000:1.0:1763333173.596328:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627250560 00000100:00100000:1.0:1763333173.596330:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627250560 00000100:00100000:1.0:1763333173.596339:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627251072 00000100:00100000:1.0:1763333173.596341:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627251072 00000100:00100000:1.0:1763333173.596394:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627250688 00000100:00100000:1.0:1763333173.596398:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627250688 00000100:00100000:1.0:1763333173.596408:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627251200 00000100:00100000:1.0:1763333173.596411:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627251200 00000100:00100000:1.0:1763333173.596418:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627250816 00000100:00100000:1.0:1763333173.596421:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627250816 00000100:00100000:1.0:1763333173.596430:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627251328 00000100:00100000:1.0:1763333173.596432:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627251328 00000100:00100000:1.0:1763333173.596445:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6443 00000100:00100000:1.0:1763333173.596452:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+12:3654:x1848987627250944:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1763333173.596624:0:8611:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x230:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333173.596629:0:8611:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x230:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763333173.596631:0:8611:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x230:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333173.596634:0:8611:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x230:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763333173.596637:0:8611:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x230:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333173.596675:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+13:3654:x1848987627250944:12345-0@lo:2:osp-syn-1-1.0 Request processed in 222us (770us total) trans 17179871544 rc 0/0 00000100:00100000:1.0:1763333173.596682:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6443 00000100:00100000:1.0:1763333173.596699:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6444 00000100:00100000:1.0:1763333173.596706:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+28:3654:x1848987627251456:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1763333173.596778:0:8611:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x230:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333173.596782:0:8611:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x230:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763333173.596784:0:8611:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x230:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333173.596786:0:8611:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x230:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763333173.596788:0:8611:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x230:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333173.596814:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+29:3654:x1848987627251456:12345-0@lo:2:osp-syn-0-1.0 Request processed in 109us (842us total) trans 21474838848 rc 0/0 00000100:00100000:1.0:1763333173.596821:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6444 00000100:00100000:1.0:1763333173.596833:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6445 00000100:00100000:1.0:1763333173.596840:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+12:3654:x1848987627250560:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763333173.596857:0:8611:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:555 count 1 00010000:00010000:1.0:1763333173.596876:0:8611:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55e00 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.596894:0:8611:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55ac6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969488 expref: 14 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.596903:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333173.596906:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333173.596910:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55e00 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.596942:0:8611:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55ac6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969488 expref: 14 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.596956:0:8611:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55ac6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969488 expref: 14 pid: 8404 timeout: 1377 lvb_type: 0 00000100:00100000:1.0:1763333173.596967:0:8611:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe434c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8611:1848987627251584:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333173.597021:0:8611:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe46e0e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763333173.597043:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6446 00000100:00100000:1.0:1763333173.597051:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+28:3654:x1848987627251072:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1763333173.597062:0:28600:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:555 count 1 00010000:00010000:1.0:1763333173.597073:0:28600:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55e07 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.597085:0:28600:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55bde lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694e3 expref: 19 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333173.597095:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333173.597097:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333173.597099:0:28600:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55e07 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.597118:0:28600:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55bde lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694e3 expref: 19 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333173.597126:0:28600:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55bde lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694e3 expref: 19 pid: 8406 timeout: 1377 lvb_type: 1 00000100:00100000:1.0:1763333173.597135:0:28600:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe434c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28600:1848987627251712:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333173.597159:0:28600:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe46e0e180 going to sleep for 11 seconds 00000100:00100000:1.0:1763333173.597176:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6447 00000100:00100000:1.0:1763333173.597183:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+12:3652:x1848987627250688:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763333173.597196:0:17605:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:556 count 1 00010000:00010000:1.0:1763333173.597206:0:17605:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c55e0e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.597217:0:17605:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55ca2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969522 expref: 14 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.597223:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333173.597225:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333173.597228:0:17605:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c55e0e lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.597253:0:17605:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55ca2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969522 expref: 14 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.597263:0:17605:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55ca2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969522 expref: 14 pid: 29010 timeout: 1377 lvb_type: 0 00000100:00100000:1.0:1763333173.597273:0:17605:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe434c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17605:1848987627251840:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333173.597297:0:17605:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe46e0e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763333173.597315:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6448 00000100:00100000:1.0:1763333173.597323:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+28:3652:x1848987627251200:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1763333173.597333:0:8404:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:556 count 1 00010000:00010000:1.0:1763333173.597346:0:8404:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55e15 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.597392:0:8404:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55ca9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969529 expref: 19 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.597398:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333173.597399:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333173.597402:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55e15 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.597421:0:8404:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55ca9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969529 expref: 19 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.597430:0:8404:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55ca9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969529 expref: 19 pid: 29010 timeout: 1377 lvb_type: 0 00000100:00100000:1.0:1763333173.597439:0:8404:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe434c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8404:1848987627251968:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333173.597461:0:8404:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7412bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1763333173.597481:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6449 00000100:00100000:1.0:1763333173.597488:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+12:3652:x1848987627250816:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333173.597609:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+13:3652:x1848987627250816:12345-0@lo:2:osp-syn-1-1.0 Request processed in 120us (1418us total) trans 17179871545 rc 0/0 00000100:00100000:1.0:1763333173.597616:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6449 00000100:00100000:1.0:1763333173.597632:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6450 00000100:00100000:1.0:1763333173.597639:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+28:3652:x1848987627251328:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333173.597708:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+29:3652:x1848987627251328:12345-0@lo:2:osp-syn-0-1.0 Request processed in 69us (1482us total) trans 21474838849 rc 0/0 00000100:00100000:1.0:1763333173.597714:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6450 00000004:00080000:1.0:1763333173.597755:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe469a3b80/2, rc 0, transno 17179871545 00000100:00100000:1.0:1763333173.597762:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe469a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627250816:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1763333173.597774:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7dcfc700/2, rc 0, transno 21474838849 00000100:00100000:1.0:1763333173.597778:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7dcfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627251328:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1763333173.597800:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe469a1180/2, rc 0, transno 17179871544 00000100:00100000:1.0:1763333173.597804:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe469a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627250944:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1763333173.597813:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7dcff100/2, rc 0, transno 21474838848 00000100:00100000:1.0:1763333173.597816:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7dcff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627251456:0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1763333173.598079:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55d19 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.598089:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55d19 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.598096:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55d19 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.598102:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4a00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333173.598107:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55d19 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.598115:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55d19 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.598129:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe44e12300) 00010000:00010000:3.0:1763333173.598133:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333173.598137:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55d19 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.598143:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55d19 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.598171:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c55dc8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333173.598177:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c55dc8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333173.598182:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c55dc8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333173.598186:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48190e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333173.598189:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c55dc8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333173.598194:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c55dc8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333173.598201:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ab:0x0].0x0 (ffff92fe44e12c00) 00010000:00010000:3.0:1763333173.598203:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333173.598205:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c55dc8 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333173.598211:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c55dc8 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000100:00100000:0.0:1763333173.598738:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613667968 00000100:00100000:0.0:1763333173.598748:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613667968 00000100:00100000:0.0:1763333173.598816:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3143 00000100:00100000:0.0:1763333173.598825:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56846:x1848987613667968:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333173.599032:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56846:x1848987613667968:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 207us (4704us total) trans 4294972220 rc 0/0 00000100:00100000:0.0:1763333173.599040:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3143 00000100:00100000:3.0:1763333173.602700:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333173.602823:0:8611:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe434c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8611:1848987627251584:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333173.602855:0:8611:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55e00 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333173.602935:0:28600:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe434c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28600:1848987627251712:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333173.602949:0:28600:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55e07 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333173.603788:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613668096 00000100:00100000:0.0:1763333173.603798:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613668096 00010000:00010000:1.0:1763333173.603884:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55ac6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969488 expref: 15 pid: 8404 timeout: 1377 lvb_type: 0 00000100:00100000:1.0:1763333173.603927:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3018 00000100:00100000:1.0:1763333173.603937:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75667100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2419:x1848987613668096:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333173.603954:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333173.603960:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55ac6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x22b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969488 expref: 15 pid: 8404 timeout: 1377 lvb_type: 0 00010000:00010000:1.0:1763333173.603971:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55ac6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x22b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969488 expref: 15 pid: 8404 timeout: 1377 lvb_type: 0 00010000:00010000:1.0:1763333173.603995:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55ac6 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x22b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969488 expref: 15 pid: 8404 timeout: 1377 lvb_type: 0 00010000:00010000:1.0:1763333173.604011:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333173.604014:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333173.604018:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55e00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.604029:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55e00 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.604062:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333173.604682:0:8611:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55e00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.604693:0:8611:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55e00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.604702:0:8611:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55e00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.604711:0:8611:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55e00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.604731:0:8611:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763333173.604991:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+13:3654:x1848987627250560:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8149us (8963us total) trans 17179871546 rc 0/0 00000100:00100000:2.0:1763333173.605002:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6445 00010000:00010000:2.0:1763333173.605046:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333173.605053:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55e00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.605067:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fc00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333173.605072:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55e00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.605082:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55e00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.605098:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55e00 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.605106:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c55e00 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.605127:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333173.605129:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333173.605131:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763333173.605167:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe469a0700/2, rc 0, transno 17179871546 00000100:00100000:2.0:1763333173.605174:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe469a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627250560:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763333173.605441:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75667100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2419:x1848987613668096:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 1503us (2747us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333173.605452:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3018 00000100:00100000:1.0:1763333173.605627:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333173.605724:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333173.605741:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613668224 00000100:00100000:1.0:1763333173.605746:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613668224 00010000:00010000:1.0:1763333173.605769:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55bde lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694e3 expref: 20 pid: 8406 timeout: 1377 lvb_type: 1 00000100:00100000:1.0:1763333173.605791:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613668352 00000100:00100000:1.0:1763333173.605794:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613668352 00010000:00010000:1.0:1763333173.605805:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55ca9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969529 expref: 21 pid: 29010 timeout: 1377 lvb_type: 0 00000100:00100000:1.0:1763333173.605826:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3019 00000100:00100000:1.0:1763333173.605834:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2419:x1848987613668224:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333173.605849:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333173.605855:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55bde lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694e3 expref: 21 pid: 8406 timeout: 1377 lvb_type: 1 00010000:00010000:1.0:1763333173.605867:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55bde lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694e3 expref: 21 pid: 8406 timeout: 1377 lvb_type: 1 00010000:00010000:1.0:1763333173.605885:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c55bde lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369694e3 expref: 21 pid: 8406 timeout: 1377 lvb_type: 1 00010000:00010000:1.0:1763333173.605899:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333173.605902:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333173.605906:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55e07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.605916:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55e07 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.605938:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333173.605971:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2419:x1848987613668224:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 138us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333173.605978:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3019 00000100:00100000:1.0:1763333173.605992:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3020 00000100:00100000:1.0:1763333173.606000:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2420:x1848987613668352:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333173.606008:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333173.606013:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55ca9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969529 expref: 19 pid: 29010 timeout: 1377 lvb_type: 0 00010000:00010000:1.0:1763333173.606023:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55ca9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969529 expref: 19 pid: 29010 timeout: 1377 lvb_type: 0 00010000:00010000:1.0:1763333173.606037:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333173.606039:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333173.606042:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55e15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.606050:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55e15 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.606068:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333173.606086:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2420:x1848987613668352:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 87us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333173.606093:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3020 00000100:00100000:1.0:1763333173.606163:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333173.606207:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333173.606234:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333173.606268:0:17605:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe434c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17605:1848987627251840:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333173.606287:0:17605:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c55e0e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333173.606305:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613668480 00000100:00100000:1.0:1763333173.606309:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613668480 00010000:00010000:1.0:1763333173.606324:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55ca2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969522 expref: 14 pid: 29010 timeout: 1377 lvb_type: 0 00000100:00100000:1.0:1763333173.606344:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3021 00000100:00100000:1.0:1763333173.606385:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74039180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2421:x1848987613668480:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333173.606394:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333173.606399:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55ca2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x22c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969522 expref: 14 pid: 29010 timeout: 1377 lvb_type: 0 00010000:00010000:1.0:1763333173.606409:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55ca2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x22c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969522 expref: 14 pid: 29010 timeout: 1377 lvb_type: 0 00010000:00010000:1.0:1763333173.606431:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55ca2 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x22c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969522 expref: 14 pid: 29010 timeout: 1377 lvb_type: 0 00010000:00010000:1.0:1763333173.606440:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333173.606442:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333173.606445:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c55e0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.606453:0:6506:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c55e0e lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.606469:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333173.606491:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74039180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2421:x1848987613668480:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 108us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333173.606510:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3021 00010000:00010000:1.0:1763333173.606530:0:17605:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c55e0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.606538:0:17605:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c55e0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.606548:0:17605:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c55e0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.606556:0:17605:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c55e0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.606575:0:17605:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763333173.606831:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+13:3652:x1848987627250688:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9647us (10720us total) trans 17179871547 rc 0/0 00000100:00100000:1.0:1763333173.606839:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6447 00000100:00100000:1.0:1763333173.606853:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613668608 00000100:00100000:1.0:1763333173.606856:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613668608 00000100:00100000:1.0:1763333173.606887:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6451 00000100:00100000:1.0:1763333173.606894:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74038000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:55917:x1848987613668608:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333173.606906:0:17605:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333173.606922:0:17605:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55e1c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969599 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333173.606940:0:17605:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x22f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333173.606952:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333173.606954:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333173.606960:0:17605:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55e1c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969599 expref: 20 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.606972:0:17605:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55e1c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969599 expref: 20 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.606982:0:17605:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e600, rc 0) 00000100:00100000:1.0:1763333173.607002:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74038000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:55917:x1848987613668608:12345-192.168.204.28@tcp:101:bash.0 Request processed in 108us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333173.607008:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6451 00000004:00080000:1.0:1763333173.607041:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe469a1f80/2, rc 0, transno 17179871547 00000100:00100000:1.0:1763333173.607047:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe469a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627250688:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1763333173.607852:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333173.607860:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c55e0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.607869:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333173.607874:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c55e0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.607889:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c55e0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.607902:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c55e0e lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.607909:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c55e0e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.607928:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333173.607930:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333173.607932:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333173.607957:0:8404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55ca9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969529 expref: 19 pid: 29010 timeout: 1377 lvb_type: 0 00000100:00100000:2.0:1763333173.607967:0:8404:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe434c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8404:1848987627251968:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333173.607981:0:8404:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55e15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.607990:0:8404:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55e15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.607996:0:8404:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55e15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.608004:0:8404:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55e15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.608012:0:8404:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55e15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.608036:0:8404:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763333173.608211:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+29:3652:x1848987627251200:12345-0@lo:6:osp-syn-0-1.0 Request processed in 10888us (12063us total) trans 21474838850 rc 0/0 00000100:00100000:2.0:1763333173.608218:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6448 00010000:00010000:2.0:1763333173.608244:0:28600:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55e07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.608253:0:28600:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55e07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.608261:0:28600:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55e07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.608269:0:28600:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55e07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.608294:0:28600:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1763333173.608479:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+29:3654:x1848987627251072:12345-0@lo:6:osp-syn-0-1.0 Request processed in 11428us (12416us total) trans 21474838851 rc 0/0 00000100:00100000:2.0:1763333173.608486:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6446 00000004:00080000:2.0:1763333173.608528:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff77b14a80/2, rc 0, transno 21474838851 00000100:00100000:2.0:1763333173.608537:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77b14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627251072:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763333173.608561:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613668736 00000100:00100000:2.0:1763333173.608567:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613668736 00000100:00100000:2.0:1763333173.608597:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3144 00000100:00100000:2.0:1763333173.608604:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bd5dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56846:x1848987613668736:12345-192.168.204.28@tcp:33:lfs.0 00000100:00100000:2.0:1763333173.608735:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bd5dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56846:x1848987613668736:12345-192.168.204.28@tcp:33:lfs.0 Request processed in 130us (2499us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333173.608741:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3144 00010000:00010000:0.0:1763333173.608986:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1763333173.608994:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55e15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.609001:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7ec00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333173.609004:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55e15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.609011:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55e15 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.609027:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55e15 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.609034:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c55e15 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.609048:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333173.609052:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55e07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.609058:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f800 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333173.609060:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55e07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.609067:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55e07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.609076:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55e07 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.609082:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c55e07 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.609093:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333173.609095:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333173.609096:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333173.609382:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763333173.609764:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff77b15500/2, rc 0, transno 21474838850 00000100:00100000:1.0:1763333173.609772:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77b15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627251200:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763333173.612674:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.613960:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613668864 00000100:00100000:2.0:1763333173.613975:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613668864 00000100:00100000:0.0:1763333173.614672:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6452 00000100:00100000:0.0:1763333173.614690:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7403b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:55917:x1848987613668864:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333173.614712:0:28600:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333173.614738:0:28600:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c55e23 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369695a0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763333173.614765:0:28600:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x22f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333173.614790:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333173.614792:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333173.614802:0:28600:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c55e23 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695a0 expref: 14 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.614821:0:28600:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c55e23 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695a0 expref: 14 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.614835:0:28600:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48191800, rc 0) 00000100:00100000:0.0:1763333173.615245:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7403b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:55917:x1848987613668864:12345-192.168.204.28@tcp:101:bash.0 Request processed in 561us (2578us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333173.615254:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6452 00000100:00100000:1.0:1763333173.618652:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333173.618667:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333173.619256:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613669376 00000100:00100000:0.0:1763333173.619268:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613669376 00000100:00100000:0.0:1763333173.619335:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9198 00000100:00100000:0.0:1763333173.619370:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56851:x1848987613669376:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333173.619394:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333173.619419:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55e2a lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369695a7 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.619510:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c55e31 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333173.619525:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c55e31 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.619538:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c55e31 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.619552:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c55e38 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333173.619559:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c55e38 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.619565:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c55e38 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.619688:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55e3f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333173.619699:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55e3f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.619705:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55e3f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:0.0:1763333173.619716:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ab:0x0]: returning size 2 00010000:00010000:0.0:1763333173.619805:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c55e31 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.619813:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c55e31 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.619819:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c55e31 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.619826:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c55e31 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.619834:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48190c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333173.619838:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c55e31 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.619847:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c55e31 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.619860:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12200) 00010000:00010000:0.0:1763333173.619864:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333173.619869:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c55e31 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.619877:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c55e31 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.619892:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c55e38 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.619898:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c55e38 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.619905:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c55e38 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.619910:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48191600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333173.619913:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c55e38 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.619920:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c55e38 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.619928:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe44e12100) 00010000:00010000:0.0:1763333173.619931:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333173.619934:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c55e38 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.619940:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c55e38 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.619982:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55e2a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695a7 expref: 233 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.619998:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55e3f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695a7 expref: 232 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.620005:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ab:0x0].0x0 (ffff92fe44e12c00) 00010000:00010000:0.0:1763333173.620008:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333173.620011:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48191400, rc 0) 00000100:00100000:0.0:1763333173.620088:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56851:x1848987613669376:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 743us (1419us total) trans 4294972221 rc 0/0 00000100:00100000:0.0:1763333173.620096:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9198 00000100:00100000:1.0:1763333173.620418:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.620714:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613668992 00000100:00100000:2.0:1763333173.620722:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613668992 00002000:00010000:2.0:1763333173.620761:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/559 (0->18446744073709551615) 00002000:00100000:2.0:1763333173.620767:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7403ad80 with x1848987613668992 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333173.620777:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7403ad80. 00000100:00100000:2.0:1763333173.620809:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1597 00000100:00100000:2.0:1763333173.620818:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7403ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2421:x1848987613668992:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:2.0:1763333173.621008:0:24027:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x22f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333173.621013:0:24027:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x22f:0x0] updating lvb mtime from disk: 0 -> 1763333173 00002000:00010000:2.0:1763333173.621016:0:24027:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x22f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333173.621018:0:24027:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x22f:0x0] updating lvb ctime from disk: 0 -> 1763333173 00002000:00010000:2.0:1763333173.621021:0:24027:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x22f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333173.621060:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7403ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2421:x1848987613668992:12345-192.168.204.28@tcp:10:bash.0 Request processed in 242us (2421us total) trans 21474838852 rc 0/0 00000100:00100000:2.0:1763333173.621068:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1597 00002000:00010000:2.0:1763333173.621072:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/559 (0->18446744073709551615) 00002000:00100000:2.0:1763333173.621075:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7403ad80 with x1848987613668992 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333173.621080:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7403ad80. 00000100:00100000:2.0:1763333173.621333:0:28430:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613669120 00000100:00100000:2.0:1763333173.621339:0:28430:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613669120 00002000:00010000:2.0:1763333173.621423:0:28430:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/559 (0->18446744073709551615) 00002000:00100000:2.0:1763333173.621427:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe434c7480 with x1848987613669120 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333173.621435:0:28430:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe434c7480. 00000100:00100000:2.0:1763333173.622091:0:28430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1598 00000100:00100000:2.0:1763333173.622102:0:28430:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2420:x1848987613669120:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:2.0:1763333173.622244:0:28430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x22f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333173.622247:0:28430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x22f:0x0] updating lvb mtime from disk: 0 -> 1763333173 00002000:00010000:2.0:1763333173.622249:0:28430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x22f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333173.622251:0:28430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x22f:0x0] updating lvb ctime from disk: 0 -> 1763333173 00002000:00010000:2.0:1763333173.622254:0:28430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x22f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333173.622310:0:28430:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2420:x1848987613669120:12345-192.168.204.28@tcp:10:bash.0 Request processed in 211us (1894us total) trans 17179871548 rc 0/0 00000100:00100000:2.0:1763333173.622318:0:28430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1598 00002000:00010000:2.0:1763333173.622322:0:28430:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/559 (0->18446744073709551615) 00002000:00100000:2.0:1763333173.622325:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe434c7480 with x1848987613669120 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333173.622330:0:28430:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe434c7480. 00000100:00100000:3.0:1763333173.624404:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333173.624517:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613669632 00000100:00100000:0.0:1763333173.624527:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613669632 00000100:00100000:0.0:1763333173.624691:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3145 00000100:00100000:0.0:1763333173.624702:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56851:x1848987613669632:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333173.625034:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56851:x1848987613669632:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 332us (637us total) trans 4294972222 rc 0/0 00000100:00100000:0.0:1763333173.625043:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3145 00000100:00100000:3.0:1763333173.625735:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333173.625799:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613669888 00000100:00100000:0.0:1763333173.625807:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613669888 00000100:00100000:1.0:1763333173.626429:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3146 00000100:00100000:1.0:1763333173.626443:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:55917:x1848987613669888:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:1.0:1763333173.626752:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:55917:x1848987613669888:12345-192.168.204.28@tcp:35:bash.0 Request processed in 313us (1019us total) trans 4294972223 rc 0/0 00000100:00100000:1.0:1763333173.626761:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3146 00000100:00100000:3.0:1763333173.638052:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333173.638101:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.638209:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613670144 00000100:00100000:2.0:1763333173.638219:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613670144 00000100:00100000:2.0:1763333173.638277:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613670400 00000100:00100000:2.0:1763333173.638282:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613670400 00000100:00100000:2.0:1763333173.638314:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9199 00000100:00100000:2.0:1763333173.638324:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:56851:x1848987613670144:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333173.638381:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333173.638407:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c55e4d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369695ae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.638651:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c55e54 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333173.638669:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55e3f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695a7 expref: 236 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.638679:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c55e54 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.638719:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55e3f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695a7 expref: 236 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.638735:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55e3f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695a7 expref: 236 pid: 12741 timeout: 1377 lvb_type: 0 00000100:00100000:2.0:1763333173.638750:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe49609c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627252096:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333173.638831:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4869d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763333173.638854:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9200 00000100:00100000:2.0:1763333173.638864:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56852:x1848987613670400:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:2.0:1763333173.638893:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1763333173.638915:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55dd6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696958b expref: 236 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.638934:0:8606:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55e3f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695a7 expref: 235 pid: 12741 timeout: 1377 lvb_type: 0 00010000:00010000:2.0:1763333173.638949:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c55dc1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969584 expref: 235 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.638962:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ab:0x0].0x0 (ffff92fe44e12c00) 00010000:00010000:2.0:1763333173.638967:0:8606:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c55e54 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.638976:0:8606:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c55e54 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.638984:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c55e54 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.639000:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333173.639020:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c55e5b lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333173.639029:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c55e5b lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.639037:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c55e5b lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.639051:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c55e62 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333173.639058:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c55e62 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.639064:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c55e62 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.639157:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55e69 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333173.639166:0:8606:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c55e54 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.639174:0:8606:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55e69 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.639185:0:8606:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c55e54 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.639194:0:8606:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55e69 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.642156:0:6519:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.204.28@tcp) returned -22 from blocking AST (req@000000006b3b6116 x1848987627252096) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55e3f lrc: 1/0,0 mode: --/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695a7 expref: 234 pid: 12741 timeout: 1377 lvb_type: 0 00010000:00010000:0.0:1763333173.642189:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55e3f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695a7 expref: 234 pid: 12741 timeout: 1377 lvb_type: 0 00000100:00100000:0.0:1763333173.642207:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe49609c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627252096:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333173.642231:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ab:0x0].0x0 (ffff92fe44e12c00) 00010000:00010000:0.0:1763333173.642236:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55e69 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.642244:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55e69 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.642253:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c55e54 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333173.642261:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c55e54 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333173.642266:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c55e54 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6519 initiator: MDT1 00000004:00200000:0.0:1763333173.642289:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ab:0x0]: returning size 5 00010000:00010000:0.0:1763333173.642462:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c55e4d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1ab:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695ae expref: 235 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.642481:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c55e54 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695ae expref: 234 pid: 6519 timeout: 1377 lvb_type: 0 00010000:00010000:0.0:1763333173.642489:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c55e54 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695ae expref: 234 pid: 6519 timeout: 1377 lvb_type: 0 00010000:00010000:0.0:1763333173.642512:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea800, rc 0) 00000100:00100000:0.0:1763333173.642571:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:56851:x1848987613670144:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 4248us (4529us total) trans 4294972224 rc 0/0 00000100:00100000:0.0:1763333173.642650:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9199 00000100:00100000:1.0:1763333173.645171:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.646363:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613670528 00000100:00100000:2.0:1763333173.646375:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613670528 00000100:00100000:2.0:1763333173.646435:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9201 00000100:00100000:2.0:1763333173.646446:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:56851:x1848987613670528:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333173.646470:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1763333173.646473:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:2.0:1763333173.646491:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55e77 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369695b5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.646618:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55e7e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333173.646632:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55e69 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.646640:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55e7e lrc: 4/1,0 mode: --/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.646659:0:6519:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55e69 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.646670:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55e7e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000100:00100000:0.0:1763333173.648026:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613670656 00000100:00100000:0.0:1763333173.648035:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613670656 00010000:00010000:0.0:1763333173.648073:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c55e54 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695ae expref: 236 pid: 6519 timeout: 1377 lvb_type: 0 00000100:00100000:0.0:1763333173.648115:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3022 00000100:00100000:0.0:1763333173.648126:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff51e54c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:2419:x1848987613670656:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333173.648141:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333173.648147:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c55e54 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695ae expref: 236 pid: 6519 timeout: 1377 lvb_type: 0 00010000:00010000:0.0:1763333173.648160:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c55e54 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695ae expref: 236 pid: 6519 timeout: 1377 lvb_type: 0 00010000:00010000:0.0:1763333173.648183:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c55e54 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695ae expref: 236 pid: 6519 timeout: 1377 lvb_type: 0 00010000:00010000:0.0:1763333173.648200:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ab:0x0].0x0 (ffff92fe44e12c00) 00010000:00010000:0.0:1763333173.648204:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55e69 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.648211:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55e69 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.648218:0:6505:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55e69 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.648225:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55e7e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333173.648231:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55e7e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333173.648235:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55e7e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333173.648254:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333173.648317:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff51e54c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:2419:x1848987613670656:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 193us (1843us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333173.648324:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3022 00010000:00010000:2.0:1763333173.648698:0:8606:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55e69 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.648709:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55e69 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8606 initiator: MDT1 00000004:00080000:2.0:1763333173.649030:0:8606:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x1ab:0x0] is inserted into orphan list, open count = 1 00010000:00010000:2.0:1763333173.649121:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55e69 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.649130:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55e69 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.649137:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55e69 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.649144:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe44d75a00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333173.649147:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55e69 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.649155:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55e69 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.649165:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ab:0x0].0x0 (ffff92fe44e12c00) 00010000:00010000:2.0:1763333173.649169:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763333173.649171:0:8606:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55e7e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.649180:0:8606:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55e7e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.649187:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55e7e lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333173.650441:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55e7e lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333173.650455:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55e7e lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:1.0:1763333173.650508:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ab:0x0]: returning size 5 00000004:00200000:1.0:1763333173.650513:0:6519:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763333173.650535:0:6519:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55e7e lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333173.650581:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55e77 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695b5 expref: 236 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.650607:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55e7e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695b5 expref: 235 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.650619:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ab:0x0].0x0 (ffff92fe44e12c00) 00010000:00010000:1.0:1763333173.650622:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333173.650626:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feba00, rc 0) 00010000:00010000:2.0:1763333173.651506:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55e69 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.651518:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55e69 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.651539:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c55e5b lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.651548:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c55e5b lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.651554:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c55e5b lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.651562:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c55e5b lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.651568:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feb400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333173.651572:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c55e5b lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.651580:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c55e5b lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.651595:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff621ac900) 00010000:00010000:2.0:1763333173.651598:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333173.651602:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c55e5b lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.651608:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c55e5b lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000004:00010000:2.0:1763333173.651625:0:8606:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f493442b reply state 000000001867ab57 transno 4294972225 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c55e62 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.651639:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c55e62 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.651648:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff621ac000) 00010000:00010000:2.0:1763333173.651651:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333173.651655:0:8606:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763333173.651847:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56851:x1848987613670528:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 5399us (6685us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333173.651856:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9201 00000100:00100000:2.0:1763333173.652479:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:56852:x1848987613670400:12345-192.168.204.28@tcp:36:rm.0 Request processed in 13614us (14375us total) trans 4294972225 rc 0/0 00000100:00100000:2.0:1763333173.652487:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9200 00000100:00100000:3.0:1763333173.665840:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.665965:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613670912 00000100:00100000:2.0:1763333173.665981:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613670912 00000100:00100000:2.0:1763333173.666054:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9202 00000100:00100000:2.0:1763333173.666066:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:56851:x1848987613670912:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333173.666094:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333173.666121:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c55e85 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369695bc expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.666249:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c55e8c lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333173.666266:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c55e8c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333173.666278:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c55e8c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:2.0:1763333173.666292:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ab:0x0]: returning size 5 00010000:00010000:2.0:1763333173.666451:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c55e85 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1ab:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695bc expref: 238 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.666477:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c55e8c lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695bc expref: 237 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.666487:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ab:0x0].0x0 (ffff92fe44e12c00) 00010000:00010000:2.0:1763333173.666490:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763333173.666494:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea800, rc 0) 00000100:00100000:2.0:1763333173.666574:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56851:x1848987613670912:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 509us (746us total) trans 4294972226 rc 0/0 00000100:00100000:2.0:1763333173.666582:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9202 00000100:00100000:1.0:1763333173.678246:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.678547:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613671040 00000100:00100000:2.0:1763333173.678558:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613671040 00000100:00100000:2.0:1763333173.678625:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6453 00000100:00100000:2.0:1763333173.678636:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2421:x1848987613671040:12345-192.168.204.28@tcp:1:lfs.0 00010000:00010000:2.0:1763333173.678684:0:8611:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c55e9a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.678704:0:8611:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55e1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969599 expref: 20 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.678712:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333173.678715:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333173.678719:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c55e9a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.678757:0:8611:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55e1c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969599 expref: 20 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.678778:0:8611:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55e1c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969599 expref: 20 pid: 17605 timeout: 1377 lvb_type: 0 00000100:00100000:2.0:1763333173.678793:0:8611:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4960b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8611:1848987627252224:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333173.678873:0:8611:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff5119d780 going to sleep for 11 seconds 00000100:00100000:1.0:1763333173.679089:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.679197:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613671168 00000100:00100000:2.0:1763333173.679202:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613671168 00000100:00100000:2.0:1763333173.679248:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9203 00000100:00100000:2.0:1763333173.679256:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56853:x1848987613671168:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333173.679274:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333173.679294:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c55ea1 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369695c3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.679382:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55ea8 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333173.679396:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55ea8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.679407:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55ea8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.679418:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55eaf lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333173.679425:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55eaf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.679432:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55eaf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.679475:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55ea8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.679483:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55ea8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.679489:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55ea8 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.679495:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55ea8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.679509:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe44d75400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333173.679513:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55ea8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.679519:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55ea8 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.679530:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff621ac900) 00010000:00010000:2.0:1763333173.679533:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333173.679538:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55ea8 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.679543:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55ea8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.679557:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55eaf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.679563:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55eaf lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.679568:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55eaf lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.679573:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe44d75a00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333173.679575:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55eaf lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.679580:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55eaf lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.679586:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff621ac000) 00010000:00010000:2.0:1763333173.679588:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333173.679591:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55eaf lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.679597:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55eaf lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.679627:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c55ea1 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695c3 expref: 238 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.679636:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff621ac900) 00010000:00010000:2.0:1763333173.679639:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333173.679642:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c55ea1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695c3 expref: 238 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.679656:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea200, rc 0) 00000100:00100000:2.0:1763333173.679689:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56853:x1848987613671168:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 434us (600us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333173.679698:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9203 00000100:00100000:3.0:1763333173.681863:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333173.681952:0:28430:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613671296 00000100:00100000:1.0:1763333173.681962:0:28430:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613671296 00002000:00100000:1.0:1763333173.682018:0:28430:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x280000400:0x22f:0x0] (0->4) req@ffff92ff75666680 x1848987613671296/t0(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:484/0 lens 496/0 e 0 to 0 dl 1763333184 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763333173.682031:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff75666680 with x1848987613671296 ext(0->4) 00010000:00010000:1.0:1763333173.682041:0:28430:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55e1c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969599 expref: 21 pid: 17605 timeout: 1377 lvb_type: 0 00010000:00010000:1.0:1763333173.682056:0:28430:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55e1c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969599 expref: 21 pid: 17605 timeout: 1377 lvb_type: 0 00002000:00010000:1.0:1763333173.682063:0:28430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff92ff75666680 00000100:00100000:1.0:1763333173.682100:0:28430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 104 00000100:00100000:1.0:1763333173.682111:0:28430:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75666680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2420:x1848987613671296:12345-192.168.204.28@tcp:4:bash.0 00000100:00100000:2.0:1763333173.682770:0:8611:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4960b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8611:1848987627252224:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333173.682800:0:8611:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c55e9a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333173.685010:0:28430:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75666680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2420:x1848987613671296:12345-192.168.204.28@tcp:4:bash.0 Request processed in 2891us (3149us total) trans 21474838853 rc 0/0 00000100:00100000:1.0:1763333173.685030:0:28430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 104 00002000:00100000:1.0:1763333173.685042:0:28430:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x280000400:0x22f:0x0] (0->4) req@ffff92ff75666680 x1848987613671296/t21474838853(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:484/0 lens 496/448 e 0 to 0 dl 1763333184 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763333173.685054:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff75666680 with x1848987613671296 ext(0->4) 00010000:00010000:1.0:1763333173.685063:0:28430:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55e1c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969599 expref: 23 pid: 17605 timeout: 1377 lvb_type: 0 00010000:00010000:1.0:1763333173.685079:0:28430:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55e1c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969599 expref: 23 pid: 17605 timeout: 1377 lvb_type: 0 00002000:00010000:1.0:1763333173.685087:0:28430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff92ff75666680 00000100:00100000:1.0:1763333173.689283:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.690767:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613671424 00000100:00100000:2.0:1763333173.690790:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613671424 00010000:00010000:2.0:1763333173.690843:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55e1c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969599 expref: 23 pid: 17605 timeout: 1377 lvb_type: 0 00000100:00100000:2.0:1763333173.690887:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3023 00000100:00100000:2.0:1763333173.690898:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2418:x1848987613671424:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333173.690915:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1763333173.690934:0:28428:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x22f:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:2.0:1763333173.690938:0:28428:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x22f:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1763333173.690944:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55e1c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969599 expref: 23 pid: 17605 timeout: 1377 lvb_type: 0 00010000:00010000:2.0:1763333173.690968:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55e1c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969599 expref: 23 pid: 17605 timeout: 1377 lvb_type: 0 00010000:00010000:2.0:1763333173.690992:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c55e1c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969599 expref: 23 pid: 17605 timeout: 1377 lvb_type: 0 00010000:00010000:2.0:1763333173.691009:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333173.691011:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333173.691015:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c55e9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333173.691321:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333173.691563:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613671552 00000100:00100000:0.0:1763333173.691570:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613671552 00000100:00100000:0.0:1763333173.691622:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9204 00000100:00100000:0.0:1763333173.691631:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56853:x1848987613671552:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333173.691653:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333173.691679:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55eb6 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369695ca expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.691746:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55ebd lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333173.691759:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55ebd lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.691771:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55ebd lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.691783:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c55ec4 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333173.691790:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c55ec4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.691796:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c55ec4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.691845:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55ebd lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.691853:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55ebd lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.691859:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55ebd lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.691865:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55ebd lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.691870:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48190400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333173.691875:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55ebd lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.691883:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55ebd lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.691894:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12200) 00010000:00010000:0.0:1763333173.691898:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333173.691903:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55ebd lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.691911:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55ebd lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.691925:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c55ec4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.691932:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c55ec4 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.691939:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c55ec4 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.691944:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48191600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333173.691947:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c55ec4 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.691967:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c55ec4 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.691974:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff621ac000) 00010000:00010000:0.0:1763333173.691977:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333173.691980:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c55ec4 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.691985:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c55ec4 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.692009:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55eb6 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695ca expref: 238 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.692019:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12200) 00010000:00010000:0.0:1763333173.692021:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333173.692023:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55eb6 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695ca expref: 238 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.692039:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48191400, rc 0) 00000100:00100000:0.0:1763333173.692110:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56853:x1848987613671552:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 480us (789us total) trans 0 rc 301/301 00000100:00100000:0.0:1763333173.692118:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9204 00010000:00010000:2.0:1763333173.692255:0:28428:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c55e9a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.692300:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333173.692324:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2418:x1848987613671424:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 1428us (3053us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333173.692332:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3023 00010000:00010000:1.0:1763333173.692646:0:8611:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c55e9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.692657:0:8611:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c55e9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.692682:0:8611:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c55e9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.692691:0:8611:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c55e9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.692699:0:8611:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c55e9a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.692707:0:8611:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feb400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333173.692712:0:8611:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c55e9a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.692719:0:8611:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c55e9a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.692733:0:8611:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c55e9a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.692742:0:8611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c55e9a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333173.692808:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2421:x1848987613671040:12345-192.168.204.28@tcp:1:lfs.0 Request processed in 14173us (14570us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333173.692817:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6453 00000100:00100000:1.0:1763333173.713167:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333173.713225:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333173.713321:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613671680 00000100:00100000:0.0:1763333173.713333:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613671680 00000100:00100000:0.0:1763333173.713442:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613671936 00000100:00100000:0.0:1763333173.713446:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613671936 00000100:00100000:0.0:1763333173.713480:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9205 00000100:00100000:0.0:1763333173.713491:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56853:x1848987613671680:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333173.713523:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333173.713549:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55ecb lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369695d1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.713616:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c55ed2 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333173.713630:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c55ed2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.713643:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c55ed2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:0.0:1763333173.713694:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1763333173.713701:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763333173.713739:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55ecb lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695d1 expref: 240 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.713757:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c55ed2 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695d1 expref: 239 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.713765:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12200) 00010000:00010000:0.0:1763333173.713768:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1763333173.713772:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48191600, rc 0) 00000100:00100000:0.0:1763333173.713827:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56853:x1848987613671680:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 338us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333173.713834:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9205 00000100:00100000:0.0:1763333173.713855:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9206 00000100:00100000:0.0:1763333173.713863:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56851:x1848987613671936:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:0.0:1763333173.713888:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333173.713906:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55e7e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695b5 expref: 238 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.713919:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ab:0x0].0x0 (ffff92fe44e12c00) 00010000:00010000:0.0:1763333173.713923:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333173.713943:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55ed9 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333173.713968:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55ed9 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.713976:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55ed9 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000040:00080000:0.0:1763333173.714222:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1388, 88 off117240 00000004:00080000:0.0:1763333173.714232:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1277793882283ns, next at 1278003234678ns, rc = 0 00000040:00080000:0.0:1763333173.714270:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1387, 88 off117240 00000004:00080000:0.0:1763333173.714276:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1277793926553ns, next at 1278526292086ns, rc = 0 00000040:00080000:0.0:1763333173.714293:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1388, 88 off117328 00000004:00080000:0.0:1763333173.714297:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1277793948178ns, next at 1278526292086ns, rc = 0 00000040:00080000:0.0:1763333173.714307:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1389, 88 off117328 00000004:00080000:0.0:1763333173.714311:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1277793962287ns, next at 1278003234678ns, rc = 0 00000001:00080000:2.0:1763333173.717187:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972227 is committed 00000004:00080000:2.0:1763333173.717202:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 910 committed 00000004:00080000:2.0:1763333173.717215:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 907 committed 00000004:00080000:2.0:1763333173.717235:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 906 committed 00000004:00080000:2.0:1763333173.717238:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 909 committed 00000100:00100000:3.0:1763333173.717451:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff75667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627252480:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333173.717532:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333173.717587:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763333173.717596:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff75665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627252352:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333173.717621:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1763333173.717713:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c55e62 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333173.717727:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c55e62 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333173.717735:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c55e62 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333173.717742:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333173.717748:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c55e62 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333173.717758:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c55e62 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333173.717775:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff621ac000) 00010000:00010000:1.0:1763333173.717778:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333173.717783:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c55e62 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333173.717789:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c55e62 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000100:00100000:1.0:1763333173.717824:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627252480 00000100:00100000:1.0:1763333173.717832:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627252480 00000100:00100000:1.0:1763333173.717883:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627252352 00000100:00100000:1.0:1763333173.717887:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627252352 00000100:00100000:1.0:1763333173.717907:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6454 00000100:00100000:1.0:1763333173.717915:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+14:3652:x1848987627252480:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1763333173.718172:0:8611:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x230:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333173.718176:0:8611:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x230:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763333173.718178:0:8611:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x230:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333173.718181:0:8611:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x230:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763333173.718183:0:8611:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x230:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333173.718222:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+15:3652:x1848987627252480:12345-0@lo:2:osp-syn-1-1.0 Request processed in 306us (690us total) trans 17179871549 rc 0/0 00000100:00100000:1.0:1763333173.718230:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6454 00000100:00100000:1.0:1763333173.718248:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6455 00000100:00100000:1.0:1763333173.718255:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+14:3654:x1848987627252352:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1763333173.718310:0:8611:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x22f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333173.718313:0:8611:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x22f:0x0] updating lvb mtime from disk: 1763333173 -> 1763333173 00002000:00010000:1.0:1763333173.718316:0:8611:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x22f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333173.718319:0:8611:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x22f:0x0] updating lvb ctime from disk: 1763333173 -> 1763333173 00002000:00010000:1.0:1763333173.718322:0:8611:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x22f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333173.718377:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+15:3654:x1848987627252352:12345-0@lo:2:osp-syn-1-1.0 Request processed in 95us (728us total) trans 17179871550 rc 0/0 00000100:00100000:1.0:1763333173.718384:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6455 00000004:00080000:3.0:1763333173.718478:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff75667100/2, rc 0, transno 17179871549 00000100:00100000:3.0:1763333173.718485:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff75667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627252480:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763333173.718518:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff75665c00/2, rc 0, transno 17179871550 00000100:00100000:3.0:1763333173.718523:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff75665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627252352:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333173.719216:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1763333173.719230:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627252736:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333173.719270:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333173.719302:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627252736 00000100:00100000:0.0:1763333173.719308:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627252736 00000100:00100000:0.0:1763333173.719345:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6456 00000100:00100000:0.0:1763333173.719379:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+29:3655:x1848987627252736:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1763333173.719483:0:28651:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x230:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333173.719487:0:28651:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x230:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763333173.719489:0:28651:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x230:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333173.719492:0:28651:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x230:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763333173.719495:0:28651:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x230:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333173.719541:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+30:3655:x1848987627252736:12345-0@lo:2:osp-syn-0-1.0 Request processed in 164us (270us total) trans 21474838854 rc 0/0 00000100:00100000:0.0:1763333173.719549:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6456 00000004:00080000:0.0:1763333173.719582:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe472f2300/2, rc 0, transno 21474838854 00000100:00100000:0.0:1763333173.719587:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627252736:0@lo:2:osp-syn-0-1.0 00000004:00010000:0.0:1763333173.719628:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000eba0753a reply state 00000000563eea2b transno 4294972227 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55ed9 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.719649:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55ed9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.719660:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ab:0x0].0x0 (ffff92fe44e12c00) 00010000:00010000:0.0:1763333173.719663:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1763333173.719667:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1763333173.719757:0:6521:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1763333173.719774:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56851:x1848987613671936:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 5910us (6547us total) trans 4294972227 rc 0/0 00000100:00100000:0.0:1763333173.719782:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9206 00010000:00010000:0.0:1763333173.719806:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55ed9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.719814:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55ed9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.719822:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55ed9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.719829:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48190400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333173.719834:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55ed9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.719843:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55ed9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.719855:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ab:0x0].0x0 (ffff92fe44e12c00) 00010000:00010000:0.0:1763333173.719858:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333173.719862:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55ed9 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.719869:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c55ed9 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000100:00100000:3.0:1763333173.720105:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627252608:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333173.720139:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333173.722486:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.722612:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613672064 00000100:00100000:2.0:1763333173.722623:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613672064 00000100:00100000:2.0:1763333173.722687:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9207 00000100:00100000:2.0:1763333173.722697:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50049500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56851:x1848987613672064:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333173.722719:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333173.722739:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55ee0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369695d8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.722794:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55ee0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695d8 expref: 230 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.722808:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55ee0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695d8 expref: 230 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.722827:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ab:0x0].0x0 (ffff92fe44e12c00) 00010000:00010000:2.0:1763333173.722830:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333173.722834:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe44d75a00, rc 0) 00000100:00100000:2.0:1763333173.722884:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50049500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56851:x1848987613672064:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 188us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333173.722893:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9207 00000100:00100000:0.0:1763333173.723436:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627252608 00000100:00100000:0.0:1763333173.723445:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627252608 00000100:00100000:0.0:1763333173.723480:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6457 00000100:00100000:0.0:1763333173.723487:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+30:3653:x1848987627252608:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333173.723671:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+31:3653:x1848987627252608:12345-0@lo:2:osp-syn-0-1.0 Request processed in 184us (3531us total) trans 21474838855 rc 0/0 00000100:00100000:0.0:1763333173.723678:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6457 00000004:00080000:3.0:1763333173.723841:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe472f3b80/2, rc 0, transno 21474838855 00000100:00100000:3.0:1763333173.723848:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627252608:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333173.727730:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333173.729215:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613672192 00000100:00100000:1.0:1763333173.729229:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613672192 00000100:00100000:1.0:1763333173.729294:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9208 00000100:00100000:1.0:1763333173.729304:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56853:x1848987613672192:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333173.729329:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333173.729374:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55ee7 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369695df expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.729451:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c55eee lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333173.729467:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c55eee lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.729479:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c55eee lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.729493:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55ef5 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333173.729511:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55ef5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.729517:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55ef5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.729566:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c55eee lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.729573:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c55eee lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.729578:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c55eee lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.729584:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c55eee lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.729591:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333173.729595:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c55eee lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.729603:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c55eee lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.729616:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12200) 00010000:00010000:1.0:1763333173.729620:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333173.729626:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c55eee lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.729632:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c55eee lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.729645:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55ef5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.729651:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55ef5 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.729657:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55ef5 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.729663:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333173.729666:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55ef5 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.729672:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55ef5 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.729678:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff42c64a00) 00010000:00010000:1.0:1763333173.729681:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333173.729683:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55ef5 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.729689:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55ef5 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.729719:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55ee7 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695df expref: 231 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.729731:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12200) 00010000:00010000:1.0:1763333173.729733:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333173.729738:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55ee7 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695df expref: 231 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.729747:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7fe00, rc 0) 00000100:00100000:1.0:1763333173.729825:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56853:x1848987613672192:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 520us (2104us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333173.729833:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9208 00000100:00100000:3.0:1763333173.731765:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.731854:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613672320 00000100:00100000:2.0:1763333173.731863:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613672320 00000100:00100000:2.0:1763333173.731920:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9209 00000100:00100000:2.0:1763333173.731930:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56851:x1848987613672320:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333173.732075:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333173.732097:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55efc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369695e6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.732163:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c55f03 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333173.732178:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c55f03 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.732190:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c55f03 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:2.0:1763333173.732233:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ab:0x0]: returning size 5 00000004:00200000:2.0:1763333173.732237:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763333173.732255:0:6521:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c55f03 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.732280:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55efc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695e6 expref: 232 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.732299:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c55f03 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695e6 expref: 231 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.732308:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ab:0x0].0x0 (ffff92fe44e12c00) 00010000:00010000:2.0:1763333173.732312:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1763333173.732315:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea000, rc 0) 00000100:00100000:2.0:1763333173.732489:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56851:x1848987613672320:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 560us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333173.732506:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9209 00000100:00100000:3.0:1763333173.739050:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.739135:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613672576 00000100:00100000:2.0:1763333173.739146:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613672576 00000100:00100000:2.0:1763333173.739214:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9210 00000100:00100000:2.0:1763333173.739225:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56853:x1848987613672576:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333173.739248:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333173.739252:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763333173.739279:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c55ed2 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695d1 expref: 231 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.739301:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12200) 00010000:00010000:2.0:1763333173.739313:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333173.739334:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55f0a lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369695ed expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.739512:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c55f11 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333173.739526:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c55f11 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.739536:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c55f11 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.739547:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c55f18 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333173.739557:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c55f18 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.739563:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c55f18 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.739989:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55f1f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ac:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333173.739999:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55f1f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.740006:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55f1f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:2.0:1763333173.740014:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ac:0x0]: returning size 0 00010000:00010000:2.0:1763333173.740035:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c55f11 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.740041:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c55f11 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.740047:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c55f11 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.740053:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c55f11 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.740057:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feb400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333173.740061:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c55f11 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.740067:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c55f11 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.740078:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31c00) 00010000:00010000:2.0:1763333173.740080:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333173.740083:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c55f11 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.740089:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c55f11 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000004:00010000:2.0:1763333173.740098:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e3192c3f reply state 0000000030731ad5 transno 4294972228 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c55f18 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.740106:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c55f18 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.740111:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43a31a00) 00010000:00010000:2.0:1763333173.740113:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333173.740116:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763333173.740140:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c55f0a lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695ed expref: 233 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.740155:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55f1f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695ed expref: 232 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.740161:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ac:0x0].0x0 (ffff92fe43a31b00) 00010000:00010000:2.0:1763333173.740163:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333173.740165:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe44d75400, rc 0) 00000100:00100000:2.0:1763333173.740241:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56853:x1848987613672576:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1017us (1202us total) trans 4294972228 rc 0/0 00000100:00100000:2.0:1763333173.740247:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9210 00000100:00100000:0.0:1763333173.748482:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.748602:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613672704 00000100:00100000:2.0:1763333173.748618:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613672704 00000100:00100000:2.0:1763333173.748675:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6458 00000100:00100000:2.0:1763333173.748685:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2421:x1848987613672704:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333173.748704:0:28651:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333173.748725:0:28651:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c55f2d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369695f4 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763333173.748748:0:28651:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x22f:0x0] initial LVB size: 5, mtime: 0x691a5435, atime: 0x0, ctime: 0x691a5435, blocks: 0x8 00010000:00010000:2.0:1763333173.748768:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333173.748770:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333173.748781:0:28651:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c55f2d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695f4 expref: 22 pid: 28651 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333173.748796:0:28651:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c55f2d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695f4 expref: 22 pid: 28651 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333173.748808:0:28651:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feba00, rc 0) 00000100:00100000:2.0:1763333173.748869:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2421:x1848987613672704:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 185us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333173.748877:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6458 00000100:00100000:3.0:1763333173.752140:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333173.755076:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613672960 00000100:00100000:1.0:1763333173.755093:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613672960 00000100:00100000:1.0:1763333173.755183:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9211 00000100:00100000:1.0:1763333173.755194:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56853:x1848987613672960:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333173.755224:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333173.755247:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55f34 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369695fb expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.755427:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55f3b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333173.755444:0:12741:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55f1f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695ed expref: 234 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.755453:0:12741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55f3b lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1ac:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.755489:0:12741:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55f1f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695ed expref: 234 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.755515:0:12741:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55f1f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695ed expref: 234 pid: 6521 timeout: 1377 lvb_type: 0 00000100:00100000:1.0:1763333173.755530:0:12741:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff50049180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627252864:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333173.755620:0:12741:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7412b000 going to sleep for 11 seconds 00000100:00100000:1.0:1763333173.761232:0:12741:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff50049180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627252864:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333173.761266:0:12741:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55f3b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ac:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000100:00100000:3.0:1763333173.768991:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.769073:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613673088 00000100:00100000:2.0:1763333173.769085:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613673088 00010000:00010000:2.0:1763333173.769127:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55f1f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695ed expref: 235 pid: 6521 timeout: 1377 lvb_type: 0 00000100:00100000:2.0:1763333173.769170:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3024 00000100:00100000:2.0:1763333173.769181:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:2420:x1848987613673088:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333173.769204:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333173.769211:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55f1f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695ed expref: 235 pid: 6521 timeout: 1377 lvb_type: 0 00010000:00010000:2.0:1763333173.769226:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55f1f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695ed expref: 235 pid: 6521 timeout: 1377 lvb_type: 0 00010000:00010000:2.0:1763333173.769250:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55f1f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695ed expref: 235 pid: 6521 timeout: 1377 lvb_type: 0 00010000:00010000:2.0:1763333173.769271:0:28428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ac:0x0].0x0 (ffff92fe43a31b00) 00010000:00010000:2.0:1763333173.769277:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55f3b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ac:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.769286:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55f3b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ac:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.769294:0:28428:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55f3b lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1ac:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.769337:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333173.769452:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:2420:x1848987613673088:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 272us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333173.769460:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3024 00010000:00010000:1.0:1763333173.769546:0:12741:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55f3b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ac:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.769556:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55f3b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ac:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:1.0:1763333173.769580:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ac:0x0]: returning size 0 00000100:00100000:3.0:1763333173.769805:0:9837:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff6bc10e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9837:1848987627252992:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1763333173.769807:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x231:0x0], index 1: 0 00000004:00080000:1.0:1763333173.769813:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x231:0x0], index 0: 0 00000004:00080000:1.0:1763333173.769818:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x232:0x0], index 0: 0 00000004:00080000:1.0:1763333173.769822:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x232:0x0], index 1: 0 00000100:00100000:3.0:1763333173.769849:0:9837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333173.769888:0:9837:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff58cbff00 going to sleep for 11 seconds 00000100:00100000:3.0:1763333173.769907:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627252992 00000100:00100000:3.0:1763333173.769911:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627252992 00010000:00010000:1.0:1763333173.769938:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55f3b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ac:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00000100:00100000:3.0:1763333173.769942:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6459 00010000:00010000:1.0:1763333173.769948:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55f3b lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1ac:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00000100:00100000:3.0:1763333173.769949:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+15:9837:x1848987627252992:12345-0@lo:5:osp-pre-1-1.0 00010000:00010000:1.0:1763333173.769955:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55f3b lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1ac:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.769960:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333173.769964:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55f3b lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1ac:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.769971:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55f3b lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1ac:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.769980:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ac:0x0].0x0 (ffff92fe43a31b00) 00010000:00010000:1.0:1763333173.769983:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763333173.769987:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55f3b lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1ac:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00002000:00080000:3.0:1763333173.769990:0:28600:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 578 00010000:00010000:1.0:1763333173.769993:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c55f3b lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1ac:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333173.770044:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55f34 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1ac:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695fb expref: 234 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.770053:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ac:0x0].0x0 (ffff92fe43a31b00) 00010000:00010000:1.0:1763333173.770055:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763333173.770059:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c55f34 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1ac:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695fb expref: 234 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.770073:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7fe00, rc 0) 00000100:00100000:1.0:1763333173.770106:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56853:x1848987613672960:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 14915us (17977us total) trans 4294972229 rc 301/301 00000100:00100000:1.0:1763333173.770115:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9211 00000100:00100000:2.0:1763333173.770445:0:8605:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4960b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8605:1848987627253120:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1763333173.770475:0:8605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333173.770488:0:8605:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4869d780 going to sleep for 11 seconds 00000100:00100000:0.0:1763333173.770545:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627253120 00000100:00100000:0.0:1763333173.770550:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627253120 00000100:00100000:0.0:1763333173.770585:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6460 00000100:00100000:0.0:1763333173.770592:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+31:8605:x1848987627253120:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1763333173.770617:0:28651:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 578 00000100:00100000:0.0:1763333173.772055:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+32:8605:x1848987627253120:12345-0@lo:5:osp-pre-0-1.0 Request processed in 1458us (1573us total) trans 21474838856 rc 0/0 00000100:00100000:0.0:1763333173.772066:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6460 00000100:00100000:2.0:1763333173.774492:0:8605:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4960b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8605:1848987627253120:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1763333173.774523:0:8605:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x232:0x0]-[0x280000400:0x261:0x0] 00000100:00100000:3.0:1763333173.783551:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333173.783621:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613673344 00000100:00100000:0.0:1763333173.783635:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613673344 00000100:00100000:1.0:1763333173.783691:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+16:9837:x1848987627252992:12345-0@lo:5:osp-pre-1-1.0 Request processed in 13736us (13835us total) trans 17179871551 rc 0/0 00000100:00100000:1.0:1763333173.783706:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6459 00000100:00100000:0.0:1763333173.783718:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3147 00000100:00100000:0.0:1763333173.783728:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56853:x1848987613673344:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333173.783820:0:9837:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff6bc10e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9837:1848987627252992:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1763333173.783839:0:9837:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x232:0x0]-[0x2c0000400:0x261:0x0] 00000100:00100000:0.0:1763333173.784369:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:56853:x1848987613673344:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 640us (831us total) trans 4294972230 rc 0/0 00000100:00100000:0.0:1763333173.784378:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3147 00000100:00100000:0.0:1763333173.796101:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.796195:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613673600 00000100:00100000:2.0:1763333173.796205:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613673600 00000100:00100000:2.0:1763333173.796269:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3148 00000100:00100000:2.0:1763333173.796281:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:56853:x1848987613673600:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333173.796560:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:56853:x1848987613673600:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 281us (469us total) trans 4294972231 rc 0/0 00000100:00100000:2.0:1763333173.796569:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3148 00000100:00100000:3.0:1763333173.810805:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333173.811670:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613673856 00000100:00100000:1.0:1763333173.811683:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613673856 00000100:00100000:2.0:1763333173.812013:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9212 00000100:00100000:2.0:1763333173.812025:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:55917:x1848987613673856:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333173.812050:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333173.812076:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c55f49 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969602 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.812246:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55f50 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333173.812264:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55f50 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.812276:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55f50 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.812290:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55f57 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333173.812297:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55f57 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.812303:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55f57 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.812410:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55f5e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ac:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333173.812419:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55f5e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.812427:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55f5e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:2.0:1763333173.812438:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ac:0x0]: returning size 0 00010000:00010000:2.0:1763333173.812532:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55f50 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.812540:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55f50 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.812547:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55f50 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.812553:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55f50 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.812559:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe44d75400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333173.812563:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55f50 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.812571:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55f50 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.812584:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31e00) 00010000:00010000:2.0:1763333173.812587:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333173.812591:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55f50 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.812601:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c55f50 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.812616:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55f57 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.812621:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55f57 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.812626:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55f57 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.812632:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333173.812634:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55f57 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.812639:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55f57 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.812645:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43a31a00) 00010000:00010000:2.0:1763333173.812648:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333173.812651:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55f57 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.812655:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55f57 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.812696:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c55f49 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969602 expref: 238 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.812715:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55f5e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969602 expref: 237 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.812728:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ac:0x0].0x0 (ffff92fe43a31700) 00010000:00010000:2.0:1763333173.812730:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333173.812733:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5c00, rc 0) 00000100:00100000:2.0:1763333173.812817:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:55917:x1848987613673856:12345-192.168.204.28@tcp:101:bash.0 Request processed in 794us (2023us total) trans 4294972232 rc 0/0 00000100:00100000:2.0:1763333173.812824:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9212 00000100:00100000:3.0:1763333173.815475:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.815703:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613673984 00000100:00100000:2.0:1763333173.815715:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613673984 00000100:00100000:2.0:1763333173.816039:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9213 00000100:00100000:2.0:1763333173.816050:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:55917:x1848987613673984:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333173.816076:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333173.816098:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55f6c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969609 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.816135:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55f73 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333173.816149:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55f73 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ac:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.816159:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55f73 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ac:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.816280:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c55f6c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ac:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969609 expref: 239 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.816302:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55f73 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ac:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969609 expref: 238 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.816317:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ac:0x0].0x0 (ffff92fe43a31700) 00010000:00010000:2.0:1763333173.816321:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763333173.816324:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4a00, rc 0) 00000100:00100000:2.0:1763333173.818143:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:55917:x1848987613673984:12345-192.168.204.28@tcp:101:bash.0 Request processed in 2083us (2665us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333173.818157:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9213 00000100:00100000:0.0:1763333173.830392:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333173.830566:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613674112 00000100:00100000:1.0:1763333173.830577:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613674112 00000100:00100000:1.0:1763333173.830639:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6461 00000100:00100000:1.0:1763333173.830650:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7df3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2419:x1848987613674112:12345-192.168.204.28@tcp:23:lfs.0 00000100:00100000:1.0:1763333173.830782:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7df3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2419:x1848987613674112:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 134us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333173.830790:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6461 00000100:00100000:1.0:1763333173.833020:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.835823:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613674368 00000100:00100000:2.0:1763333173.835838:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613674368 00000100:00100000:3.0:1763333173.838455:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9214 00000100:00100000:3.0:1763333173.838478:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:55917:x1848987613674368:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:3.0:1763333173.838549:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333173.838581:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c55f5e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969602 expref: 238 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.838605:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ac:0x0].0x0 (ffff92fe43a31700) 00010000:00010000:3.0:1763333173.838611:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333173.838821:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55f7a lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333173.838836:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55f7a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.838845:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55f7a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000001:00080000:3.0:1763333173.838892:0:12741:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294972233 00000004:00010000:3.0:1763333173.838918:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007b17b5cd reply state 00000000c33daa62 transno 4294972234 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55f7a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.838931:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55f7a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.838939:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ac:0x0].0x0 (ffff92fe43a31700) 00010000:00010000:3.0:1763333173.838942:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763333173.838945:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763333173.839075:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:55917:x1848987613674368:12345-192.168.204.28@tcp:36:bash.0 Request processed in 606us (6062us total) trans 4294972234 rc 0/0 00000100:00100000:3.0:1763333173.839084:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9214 00000020:00080000:3.0:1763333173.839090:0:12741:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763333173.844479:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:2.0:1763333173.846144:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763333173.846444:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613674496 00000100:00100000:0.0:1763333173.846460:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613674496 00000100:00100000:0.0:1763333173.846550:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6462 00000100:00100000:0.0:1763333173.846563:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5004a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2418:x1848987613674496:12345-192.168.204.28@tcp:23:lfs.0 00000100:00100000:0.0:1763333173.846707:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5004a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2418:x1848987613674496:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 147us (2237us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333173.846715:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6462 00000100:00100000:0.0:1763333173.850538:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333173.850596:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613674624 00000100:00100000:3.0:1763333173.850607:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613674624 00000100:00100000:3.0:1763333173.850665:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9215 00000100:00100000:3.0:1763333173.850674:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:55917:x1848987613674624:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333173.850699:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333173.850723:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55f81 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969610 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.850783:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55f81 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1ac:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969610 expref: 241 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.850799:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55f81 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1ac:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969610 expref: 241 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.850817:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ac:0x0].0x0 (ffff92fe43a31700) 00010000:00010000:3.0:1763333173.850821:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763333173.850824:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a97000, rc 0) 00000100:00100000:3.0:1763333173.850884:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:55917:x1848987613674624:12345-192.168.204.28@tcp:101:bash.0 Request processed in 210us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333173.850892:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9215 00000100:00100000:2.0:1763333173.853732:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333173.853845:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613674880 00000100:00100000:0.0:1763333173.853856:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613674880 00000100:00100000:0.0:1763333173.853923:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9216 00000100:00100000:0.0:1763333173.853936:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:55917:x1848987613674880:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333173.853957:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333173.853961:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763333173.853990:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55f81 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1ac:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969610 expref: 241 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.854008:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ac:0x0].0x0 (ffff92fe43a31700) 00010000:00010000:0.0:1763333173.854014:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333173.854027:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c55f88 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969617 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.854079:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55f8f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ac:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333173.854095:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55f8f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ac:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.854105:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55f8f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ac:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000040:00080000:0.0:1763333173.854381:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1389, 88 off117416 00000004:00080000:0.0:1763333173.854390:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1277934040380ns, next at 1278526292086ns, rc = 0 00000040:00080000:0.0:1763333173.854438:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1390, 88 off117416 00000004:00080000:0.0:1763333173.854442:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1277934093588ns, next at 1278003234678ns, rc = 0 00000040:00080000:0.0:1763333173.854459:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1391, 88 off117504 00000004:00080000:0.0:1763333173.854463:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1277934114233ns, next at 1278003234678ns, rc = 0 00000040:00080000:0.0:1763333173.854474:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1390, 88 off117504 00000004:00080000:0.0:1763333173.854478:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1277934128586ns, next at 1278526292086ns, rc = 0 00000100:00100000:0.0:1763333173.863929:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333173.864029:0:28430:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613675008 00000100:00100000:1.0:1763333173.864041:0:28430:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613675008 00000100:00100000:1.0:1763333173.864125:0:28430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1599 00000100:00100000:1.0:1763333173.864136:0:28430:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2418:x1848987613675008:12345-192.168.204.28@tcp:3:lfs.0 00010000:00010000:1.0:1763333173.864176:0:28430:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55f96 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.864194:0:28430:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333173.864196:0:28430:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333173.864202:0:28430:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55f96 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.864215:0:28430:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55f96 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.864327:0:28430:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55f96 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.864336:0:28430:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55f96 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.864344:0:28430:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55f96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.864386:0:28430:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333173.864391:0:28430:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55f96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.864400:0:28430:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55f96 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.864425:0:28430:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55f96 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.864434:0:28430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55f96 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333173.864527:0:28430:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2418:x1848987613675008:12345-192.168.204.28@tcp:3:lfs.0 Request processed in 392us (612us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1763333173.864536:0:28430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1599 00000001:00080000:2.0:1763333173.866046:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972235 is committed 00000004:00080000:2.0:1763333173.866058:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 909 committed 00010000:00010000:0.0:1763333173.866168:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c55f18 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.866181:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c55f18 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.866188:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c55f18 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.866195:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333173.866200:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c55f18 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.866207:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c55f18 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.866225:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43a31a00) 00010000:00010000:0.0:1763333173.866228:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333173.866234:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c55f18 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.866240:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c55f18 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333173.866267:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55f7a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.866275:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55f7a lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.866282:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55f7a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.866288:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333173.866290:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55f7a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.866297:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55f7a lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.866305:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ac:0x0].0x0 (ffff92fe43a31700) 00010000:00010000:0.0:1763333173.866308:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333173.866311:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55f7a lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333173.866316:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55f7a lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000004:00080000:2.0:1763333173.866566:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 912 committed 00000004:00080000:2.0:1763333173.866578:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 911 committed 00000004:00080000:2.0:1763333173.866582:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 908 committed 00000100:00100000:3.0:1763333173.866710:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763333173.866730:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe438aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627253248:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333173.866801:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333173.866845:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763333173.866853:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe438a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627253376:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333173.866875:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333173.866902:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627253248 00000100:00100000:3.0:1763333173.866910:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627253248 00000100:00100000:3.0:1763333173.866948:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627253376 00000100:00100000:3.0:1763333173.866951:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627253376 00000100:00100000:3.0:1763333173.866969:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6463 00000100:00100000:3.0:1763333173.866976:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+17:3654:x1848987627253248:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333173.867178:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+18:3654:x1848987627253248:12345-0@lo:2:osp-syn-1-1.0 Request processed in 202us (376us total) trans 17179871552 rc 0/0 00000100:00100000:3.0:1763333173.867185:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6463 00000100:00100000:3.0:1763333173.867203:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6464 00000100:00100000:3.0:1763333173.867208:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+17:3653:x1848987627253376:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333173.867293:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+18:3653:x1848987627253376:12345-0@lo:2:osp-syn-1-1.0 Request processed in 84us (416us total) trans 17179871553 rc 0/0 00000100:00100000:3.0:1763333173.867299:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6464 00000004:00080000:3.0:1763333173.867343:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe438aa300/2, rc 0, transno 17179871552 00000100:00100000:3.0:1763333173.867374:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe438aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627253248:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763333173.867396:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe438a8a80/2, rc 0, transno 17179871553 00000100:00100000:3.0:1763333173.867400:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe438a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627253376:0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1763333173.867903:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55f8f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1ac:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969617 expref: 233 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.867921:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ac:0x0].0x0 (ffff92fe43a31700) 00010000:00010000:0.0:1763333173.867925:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763333173.867944:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c55f88 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1ac:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969617 expref: 233 pid: 6521 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1763333173.867966:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55f8f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1ac:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969617 expref: 232 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.868003:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ac:0x0].0x0 (ffff92fe43a31700) 00010000:00010000:0.0:1763333173.868008:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763333173.868011:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48191400, rc 0) 00000100:00100000:0.0:1763333173.868064:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:55917:x1848987613674880:12345-192.168.204.28@tcp:101:bash.0 Request processed in 14133us (14347us total) trans 4294972235 rc 0/0 00000100:00100000:0.0:1763333173.868072:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9216 00000100:00100000:1.0:1763333173.868444:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff5004bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627253632:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333173.868481:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333173.868531:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627253632 00000100:00100000:1.0:1763333173.868537:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627253632 00000100:00100000:1.0:1763333173.868577:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6465 00000100:00100000:1.0:1763333173.868584:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5004b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+32:3654:x1848987627253632:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333173.868732:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5004b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+33:3654:x1848987627253632:12345-0@lo:2:osp-syn-0-1.0 Request processed in 148us (249us total) trans 21474838857 rc 0/0 00000100:00100000:1.0:1763333173.868739:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6465 00000004:00080000:1.0:1763333173.868775:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff5004bb80/2, rc 0, transno 21474838857 00000100:00100000:1.0:1763333173.868780:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff5004bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627253632:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333173.869328:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff5004b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627253504:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333173.869392:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333173.871253:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627253504 00000100:00100000:1.0:1763333173.871267:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627253504 00000100:00100000:1.0:1763333173.871340:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6466 00000100:00100000:1.0:1763333173.871380:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+33:3653:x1848987627253504:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333173.871640:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+34:3653:x1848987627253504:12345-0@lo:2:osp-syn-0-1.0 Request processed in 291us (2245us total) trans 21474838858 rc 0/0 00000100:00100000:1.0:1763333173.871649:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6466 00000004:00080000:2.0:1763333173.871881:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff5004b480/2, rc 0, transno 21474838858 00000100:00100000:2.0:1763333173.871889:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff5004b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627253504:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333173.872555:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.872658:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613675136 00000100:00100000:2.0:1763333173.872665:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613675136 00000100:00100000:2.0:1763333173.872714:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9217 00000100:00100000:2.0:1763333173.872722:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56851:x1848987613675136:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333173.872739:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333173.872760:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55f9d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696961e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.872802:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55fa4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333173.872819:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55fa4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.872833:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55fa4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.872954:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55f9d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696961e expref: 234 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.872973:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4c00/0xb32e3ef184c55fa4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696961e expref: 233 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.873125:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ab:0x0].0x0 (ffff92fe44e12c00) 00010000:00010000:2.0:1763333173.873130:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763333173.873135:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4c00, rc 0) 00000100:00100000:2.0:1763333173.873653:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56851:x1848987613675136:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 929us (1100us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333173.873661:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9217 00000100:00100000:2.0:1763333173.876858:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333173.877537:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613675264 00000100:00100000:3.0:1763333173.877548:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613675264 00000100:00100000:3.0:1763333173.877615:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6467 00000100:00100000:3.0:1763333173.877627:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:55917:x1848987613675264:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333173.877646:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333173.877670:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c55fab lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969625 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333173.877699:0:8404:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x231:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333173.877725:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333173.877728:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333173.877737:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c55fab lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969625 expref: 16 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.877752:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c55fab lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969625 expref: 16 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.877765:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a97200, rc 0) 00000100:00100000:3.0:1763333173.877829:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:55917:x1848987613675264:12345-192.168.204.28@tcp:101:bash.0 Request processed in 205us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333173.877836:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6467 00000100:00100000:2.0:1763333173.890478:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.890551:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333173.890647:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613675392 00000100:00100000:3.0:1763333173.890661:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613675392 00000100:00100000:3.0:1763333173.890757:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1600 00000100:00100000:3.0:1763333173.890767:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2421:x1848987613675392:12345-192.168.204.28@tcp:4:lfs.0 00010000:00010000:3.0:1763333173.890805:0:24027:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55fb2 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.890824:0:24027:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c55d90 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969568 expref: 16 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333173.890833:0:24027:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333173.890835:0:24027:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333173.890839:0:24027:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55fb2 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.890876:0:24027:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c55d90 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969568 expref: 16 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333173.890891:0:24027:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c55d90 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969568 expref: 16 pid: 8611 timeout: 1377 lvb_type: 1 00000100:00100000:3.0:1763333173.890907:0:24027:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe438aa680 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:24027:1848987627253760:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333173.890999:0:24027:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff6b0c2480 going to sleep for 11 seconds 00000100:00100000:1.0:1763333173.891236:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613675520 00000100:00100000:1.0:1763333173.891241:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613675520 00000100:00100000:1.0:1763333173.891279:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6468 00000100:00100000:1.0:1763333173.891286:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:55917:x1848987613675520:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333173.891297:0:28651:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333173.891314:0:28651:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55fb9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696962c expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333173.891335:0:28651:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x231:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333173.891385:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333173.891387:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333173.891395:0:28651:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55fb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696962c expref: 23 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.891409:0:28651:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55fb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696962c expref: 23 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.891421:0:28651:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e000, rc 0) 00000100:00100000:1.0:1763333173.891454:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:55917:x1848987613675520:12345-192.168.204.28@tcp:101:bash.0 Request processed in 168us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333173.891462:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6468 00000100:00100000:0.0:1763333173.897076:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333173.897466:0:24027:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe438aa680 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:24027:1848987627253760:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333173.897507:0:24027:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55fb2 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333173.897594:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613675648 00000100:00100000:2.0:1763333173.897602:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613675648 00010000:00010000:2.0:1763333173.897652:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c55d90 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969568 expref: 17 pid: 8611 timeout: 1377 lvb_type: 1 00000100:00100000:2.0:1763333173.897706:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3025 00000100:00100000:2.0:1763333173.897716:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2418:x1848987613675648:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333173.897734:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333173.897758:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c55d90 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x230:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969568 expref: 17 pid: 8611 timeout: 1377 lvb_type: 1 00010000:00010000:2.0:1763333173.897770:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c55d90 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x230:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969568 expref: 17 pid: 8611 timeout: 1377 lvb_type: 1 00010000:00010000:2.0:1763333173.897796:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c55d90 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x230:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969568 expref: 17 pid: 8611 timeout: 1377 lvb_type: 1 00010000:00010000:2.0:1763333173.897811:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333173.897813:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333173.897818:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55fb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.897827:0:28428:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55fb2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333173.897961:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333173.897995:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333173.898208:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613675904 00000100:00100000:3.0:1763333173.898213:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613675904 00002000:00010000:3.0:1763333173.898242:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/561 (0->18446744073709551615) 00002000:00100000:3.0:1763333173.898245:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe469a0e00 with x1848987613675904 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333173.898258:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe469a0e00. 00010000:00010000:2.0:1763333173.898330:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333173.898423:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2418:x1848987613675648:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 707us (1356us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333173.898431:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3025 00010000:00010000:1.0:1763333173.898702:0:24027:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55fb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333173.898712:0:24027:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55fb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333173.900948:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613675776 00000100:00100000:3.0:1763333173.900967:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613675776 00002000:00010000:3.0:1763333173.901019:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/561 (0->18446744073709551615) 00002000:00100000:3.0:1763333173.901024:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff74038000 with x1848987613675776 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333173.901041:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff74038000. 00000100:00100000:0.0:1763333173.901944:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1601 00000100:00100000:0.0:1763333173.901970:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2421:x1848987613675904:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:0.0:1763333173.902168:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x231:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333173.902172:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x231:0x0] updating lvb mtime from disk: 0 -> 1763333174 00002000:00010000:0.0:1763333173.902175:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x231:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333173.902177:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x231:0x0] updating lvb ctime from disk: 0 -> 1763333174 00002000:00010000:0.0:1763333173.902180:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x231:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333173.902248:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:2421:x1848987613675904:12345-192.168.204.28@tcp:10:bash.0 Request processed in 288us (4288us total) trans 21474838859 rc 0/0 00000100:00100000:0.0:1763333173.902258:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1601 00002000:00010000:0.0:1763333173.902263:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/561 (0->18446744073709551615) 00002000:00100000:0.0:1763333173.902266:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe469a0e00 with x1848987613675904 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333173.902271:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe469a0e00. 00000100:00100000:0.0:1763333173.902294:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1602 00000100:00100000:0.0:1763333173.902303:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74038000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2421:x1848987613675776:12345-192.168.204.28@tcp:10:bash.0 00000001:00080000:1.0:1763333173.911223:0:26035:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871554 is committed 00000001:00080000:1.0:1763333173.911241:0:26035:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871553 is committed 00002000:00010000:1.0:1763333173.914264:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x231:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333173.914277:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x231:0x0] updating lvb mtime from disk: 0 -> 1763333174 00002000:00010000:1.0:1763333173.914280:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x231:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333173.914283:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x231:0x0] updating lvb ctime from disk: 0 -> 1763333174 00002000:00010000:1.0:1763333173.914286:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x231:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333173.914402:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74038000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2421:x1848987613675776:12345-192.168.204.28@tcp:10:bash.0 Request processed in 12093us (16399us total) trans 17179871555 rc 0/0 00000100:00100000:1.0:1763333173.914416:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1602 00002000:00010000:1.0:1763333173.914423:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/561 (0->18446744073709551615) 00002000:00100000:1.0:1763333173.914428:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff74038000 with x1848987613675776 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333173.914436:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff74038000. 00002000:00010000:3.0:1763333173.914471:0:24027:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x230:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:3.0:1763333173.914476:0:24027:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x230:0x0] updating lvb mtime from disk: 0 -> 1763333174 00002000:00010000:3.0:1763333173.914479:0:24027:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x230:0x0] updating lvb ctime from disk: 0 -> 1763333174 00002000:00010000:3.0:1763333173.914481:0:24027:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x230:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1763333173.914503:0:24027:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55fb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.914516:0:24027:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55fb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.914525:0:24027:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55fb2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.914534:0:24027:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333173.914538:0:24027:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55fb2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.914547:0:24027:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55fb2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.914567:0:24027:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55fb2 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.914575:0:24027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55fb2 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333173.914622:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2421:x1848987613675392:12345-192.168.204.28@tcp:4:lfs.0 Request processed in 23856us (24158us total) trans 17179871554 rc 0/0 00000100:00100000:3.0:1763333173.914634:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1600 00000100:00100000:0.0:1763333173.923478:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333173.923589:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613676160 00000100:00100000:1.0:1763333173.923601:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613676160 00000100:00100000:1.0:1763333173.923663:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3149 00000100:00100000:1.0:1763333173.923673:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7403b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:55917:x1848987613676160:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:1.0:1763333173.924905:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7403b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:55917:x1848987613676160:12345-192.168.204.28@tcp:35:bash.0 Request processed in 1226us (1430us total) trans 4294972236 rc 0/0 00000100:00100000:1.0:1763333173.924921:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3149 00000100:00100000:0.0:1763333173.936220:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.936326:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613676288 00000100:00100000:2.0:1763333173.936336:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613676288 00000100:00100000:2.0:1763333173.936433:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9218 00000100:00100000:2.0:1763333173.936441:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:56854:x1848987613676288:12345-192.168.204.28@tcp:101:rm.0 00010000:00010000:2.0:1763333173.936462:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333173.936485:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c55fc0 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969633 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.936576:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55fc7 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333173.936592:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55fc7 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.936605:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55fc7 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.936615:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55fce lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333173.936621:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55fce lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.936626:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55fce lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.936696:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55fd5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333173.936703:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55fd5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ac:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.936708:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55fd5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ac:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:2.0:1763333173.936747:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ac:0x0]: returning size 5 00000004:00200000:2.0:1763333173.936751:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763333173.936769:0:6521:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55fd5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ac:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.936779:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55fd5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.936788:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55fc7 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.936793:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55fc7 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.936798:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55fc7 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.936804:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55fc7 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.936809:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333173.936813:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55fc7 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.936820:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55fc7 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.936831:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31e00) 00010000:00010000:2.0:1763333173.936835:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333173.936839:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55fc7 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.936845:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c55fc7 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.936859:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55fce lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.936865:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55fce lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.936871:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55fce lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.936875:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333173.936877:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55fce lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.936882:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55fce lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.936888:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43a31900) 00010000:00010000:2.0:1763333173.936890:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333173.936892:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55fce lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.936898:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c55fce lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333173.936931:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c55fc0 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969633 expref: 236 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.936945:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55fd5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969633 expref: 235 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.936952:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ac:0x0].0x0 (ffff92fe43a31700) 00010000:00010000:2.0:1763333173.936955:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333173.936957:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5e00, rc 0) 00000100:00100000:2.0:1763333173.937024:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:56854:x1848987613676288:12345-192.168.204.28@tcp:101:rm.0 Request processed in 583us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333173.937032:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9218 00000100:00100000:0.0:1763333173.940395:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333173.940596:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613676544 00000100:00100000:3.0:1763333173.940609:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613676544 00000100:00100000:3.0:1763333173.940675:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9219 00000100:00100000:3.0:1763333173.940686:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4399a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:56851:x1848987613676544:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:3.0:1763333173.940750:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333173.940779:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c55f03 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ab:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695e6 expref: 235 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.940805:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ab:0x0].0x0 (ffff92fe44e12c00) 00010000:00010000:3.0:1763333173.940810:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333173.940902:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55fdc lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333173.940918:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55fdc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.940930:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55fdc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00010000:3.0:1763333173.941080:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e17a9370 reply state 000000007079de5f transno 4294972237 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55fdc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.941095:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55fdc lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.941103:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ab:0x0].0x0 (ffff92fe44e12c00) 00010000:00010000:3.0:1763333173.941106:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763333173.941109:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763333173.943048:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4399a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56851:x1848987613676544:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 2352us (2693us total) trans 4294972237 rc 0/0 00000100:00100000:3.0:1763333173.943061:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9219 00000100:00100000:0.0:1763333173.944152:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333173.944800:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613676800 00000100:00100000:3.0:1763333173.944813:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613676800 00000100:00100000:3.0:1763333173.944880:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9220 00000100:00100000:3.0:1763333173.944893:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56854:x1848987613676800:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:3.0:1763333173.944966:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1763333173.945001:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c55f8f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1ac:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969617 expref: 236 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.945022:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c55fd5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969633 expref: 235 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.945035:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c55f73 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ac:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969609 expref: 234 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.945045:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ac:0x0].0x0 (ffff92fe43a31700) 00010000:00010000:3.0:1763333173.945056:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333173.945088:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55fe3 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333173.945103:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55fe3 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.945114:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55fe3 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.945125:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c55fea lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333173.945133:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c55fea lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.945140:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c55fea lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.945238:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55ff1 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ac:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333173.945248:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55ff1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ac:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.945256:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55ff1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ac:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000040:00080000:3.0:1763333173.945584:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1391, 64 off117568 00000040:00080000:3.0:1763333173.945615:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1392, 64 off117568 00000004:00080000:3.0:1763333173.945623:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1278025273283ns, next at 1279025269818ns, rc = 0 00000040:00080000:3.0:1763333173.945636:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1393, 64 off117632 00000040:00080000:3.0:1763333173.945645:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1392, 64 off117632 00010000:00010000:3.0:1763333173.945703:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55ff8 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333173.945714:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55ff8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ac:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.945722:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55ff8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ac:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.945730:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55ff8 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1ac:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.945737:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55ff8 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1ac:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.945744:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55ff8 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1ac:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.945774:0:12741:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763333173.945797:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55ff1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ac:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.945803:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55ff1 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1ac:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.945809:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55ff1 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1ac:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.945815:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333173.945819:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55ff1 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1ac:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.945821:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333173.945826:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55ff1 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1ac:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.945828:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55ff8 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1ac:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.945834:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333173.945835:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ac:0x0].0x0 (ffff92ff80045900) 00010000:00010000:3.0:1763333173.945838:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1763333173.945841:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55ff1 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1ac:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.945847:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55ff8 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1ac:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.945853:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55ff8 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1ac:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.945861:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ac:0x0].0x0 (ffff92ff80045900) 00010000:00010000:2.0:1763333173.945863:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1763333173.945866:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55ff8 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1ac:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.945870:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c55ff8 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1ac:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333173.945882:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333173.945884:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333173.945886:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333173.946578:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c55ff1 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1ac:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.946731:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55fe3 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.946740:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55fe3 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.946746:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55fe3 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.946758:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55fe3 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.946763:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333173.946767:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55fe3 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.946773:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55fe3 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.946785:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff80045300) 00010000:00010000:3.0:1763333173.946787:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333173.946791:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55fe3 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.946796:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c55fe3 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000004:00010000:3.0:1763333173.946808:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000015f829a8 reply state 0000000018b8199a transno 4294972238 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c55fea lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.946819:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c55fea lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.946826:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045000) 00010000:00010000:3.0:1763333173.946829:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763333173.946832:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763333173.947209:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:56854:x1848987613676800:12345-192.168.204.28@tcp:36:rm.0 Request processed in 2315us (3059us total) trans 4294972238 rc 0/0 00000100:00100000:3.0:1763333173.947220:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9220 00000100:00100000:1.0:1763333173.951112:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333173.951326:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613676928 00000100:00100000:3.0:1763333173.951339:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613676928 00000100:00100000:3.0:1763333173.951444:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6469 00000100:00100000:3.0:1763333173.951455:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50049c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:56851:x1848987613676928:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333173.951474:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333173.951505:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55fff lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696963a expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333173.951529:0:8404:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x230:0x0] initial LVB size: 4096, mtime: 0x691a5436, atime: 0x0, ctime: 0x691a5436, blocks: 0x8 00010000:00010000:3.0:1763333173.951552:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333173.951554:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333173.951563:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55fff lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696963a expref: 15 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.951580:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55fff lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696963a expref: 15 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.951594:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96e00, rc 0) 00000100:00100000:3.0:1763333173.951646:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50049c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:56851:x1848987613676928:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 193us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333173.951654:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6469 00000100:00100000:2.0:1763333173.956027:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333173.956108:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613677056 00000100:00100000:0.0:1763333173.956118:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613677056 00000100:00100000:0.0:1763333173.956173:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6470 00000100:00100000:0.0:1763333173.956181:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:56851:x1848987613677056:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333173.956198:0:28651:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333173.956218:0:28651:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe48190e00/0xb32e3ef184c56006 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969641 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.956246:0:28651:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff4139a600/0xb32e3ef184c55d97 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696956f expref: 25 pid: 28650 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333173.956254:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333173.956256:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333173.956261:0:28651:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe48190e00/0xb32e3ef184c56006 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969641 expref: 25 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.956290:0:28651:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92ff4139a600/0xb32e3ef184c55d97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696956f expref: 25 pid: 28650 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333173.956302:0:28651:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92ff4139a600/0xb32e3ef184c55d97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696956f expref: 25 pid: 28650 timeout: 1378 lvb_type: 1 00000100:00100000:0.0:1763333173.956315:0:28651:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe43998380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28651:1848987627253888:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333173.956412:0:28651:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe43aa6900 going to sleep for 11 seconds 00000100:00100000:1.0:1763333173.965242:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.965475:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613677184 00000100:00100000:2.0:1763333173.965485:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613677184 00010000:00010000:2.0:1763333173.965536:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92ff4139a600/0xb32e3ef184c55d97 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696956f expref: 26 pid: 28650 timeout: 1378 lvb_type: 1 00000100:00100000:2.0:1763333173.965583:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3026 00000100:00100000:2.0:1763333173.965595:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50049f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+26:2421:x1848987613677184:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333173.965613:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333173.965638:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92ff4139a600/0xb32e3ef184c55d97 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x230:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696956f expref: 26 pid: 28650 timeout: 1378 lvb_type: 1 00010000:00010000:2.0:1763333173.965653:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92ff4139a600/0xb32e3ef184c55d97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x230:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696956f expref: 26 pid: 28650 timeout: 1378 lvb_type: 1 00010000:00010000:2.0:1763333173.965681:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333173.965684:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333173.965690:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe48190e00/0xb32e3ef184c56006 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x230:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969641 expref: 26 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.965702:0:28428:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe48190e00/0xb32e3ef184c56006 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x230:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969641 expref: 26 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.965743:0:28428:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff92fe48190e00/0xb32e3ef184c56006 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x230:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969641 expref: 26 pid: 28651 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333173.965760:0:28428:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77b17480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:28428:1848987627254016:192.168.204.28@tcp:105: 00000100:00100000:2.0:1763333173.965854:0:28428:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4869d780 going to sleep for 11 seconds 00010000:00010000:0.0:1763333173.967386:0:28651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff4139a600/0xb32e3ef184c55d97 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x230:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696956f expref: 26 pid: 28650 timeout: 1378 lvb_type: 1 00000100:00100000:0.0:1763333173.967410:0:28651:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe43998380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28651:1848987627253888:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333173.967438:0:28651:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe48190e00/0xb32e3ef184c56006 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969641 expref: 25 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.967453:0:28651:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48190e00, rc 0) 00000100:00100000:0.0:1763333173.967512:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:56851:x1848987613677056:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 11330us (11495us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333173.967523:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6470 00000100:00100000:2.0:1763333173.971142:0:28428:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77b17480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:28428:1848987627254016:192.168.204.28@tcp:105: 00010000:00010000:2.0:1763333173.971170:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333173.973541:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50049f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:2421:x1848987613677184:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 7935us (8296us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333173.973557:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3026 00000100:00100000:1.0:1763333173.974106:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333173.974260:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333173.975687:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613677440 00000100:00100000:0.0:1763333173.975703:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613677440 00002000:00010000:0.0:1763333173.975770:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/560 (0->18446744073709551615) 00002000:00100000:0.0:1763333173.975776:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff50048a80 with x1848987613677440 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333173.975791:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff50048a80. 00000100:00100000:0.0:1763333173.975816:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613677312 00000100:00100000:0.0:1763333173.975819:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613677312 00002000:00010000:0.0:1763333173.975833:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/560 (5->18446744073709551615) 00002000:00100000:0.0:1763333173.975836:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff50049880 with x1848987613677312 ext(5->18446744073709551615) 00002000:00010000:0.0:1763333173.975843:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff50049880. 00000100:00100000:0.0:1763333173.975867:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1603 00000100:00100000:0.0:1763333173.975877:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50048a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:2420:x1848987613677440:12345-192.168.204.28@tcp:10:lfs.0 00002000:00010000:0.0:1763333173.976108:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x230:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333173.976111:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x230:0x0] updating lvb mtime from disk: 0 -> 1763333174 00002000:00010000:0.0:1763333173.976114:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x230:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333173.976116:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x230:0x0] updating lvb ctime from disk: 0 -> 1763333174 00002000:00010000:0.0:1763333173.976118:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x230:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333173.976179:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50048a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:2420:x1848987613677440:12345-192.168.204.28@tcp:10:lfs.0 Request processed in 304us (2076us total) trans 21474838860 rc 0/0 00000100:00100000:0.0:1763333173.976186:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1603 00002000:00010000:0.0:1763333173.976190:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/560 (0->18446744073709551615) 00002000:00100000:0.0:1763333173.976192:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff50048a80 with x1848987613677440 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333173.976196:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff50048a80. 00000100:00100000:0.0:1763333173.976215:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1604 00000100:00100000:0.0:1763333173.976223:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50049880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2420:x1848987613677312:12345-192.168.204.28@tcp:10:lfs.0 00002000:00010000:0.0:1763333173.976528:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x230:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:0.0:1763333173.976532:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x230:0x0] updating lvb mtime from disk: 1763333174 -> 1763333174 00002000:00010000:0.0:1763333173.976534:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x230:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333173.976536:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x230:0x0] updating lvb ctime from disk: 1763333174 -> 1763333174 00002000:00010000:0.0:1763333173.976539:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x230:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1763333173.976560:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50049880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2420:x1848987613677312:12345-192.168.204.28@tcp:10:lfs.0 Request processed in 338us (2301us total) trans 17179871556 rc 0/0 00000100:00100000:0.0:1763333173.976566:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1604 00002000:00010000:0.0:1763333173.976569:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/560 (5->18446744073709551615) 00002000:00100000:0.0:1763333173.976572:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff50049880 with x1848987613677312 ext(5->18446744073709551615) 00002000:00010000:0.0:1763333173.976577:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff50049880. 00000100:00100000:1.0:1763333173.978326:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333173.978422:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613677568 00000100:00100000:3.0:1763333173.978430:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613677568 00000100:00100000:3.0:1763333173.978468:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9221 00000100:00100000:3.0:1763333173.978475:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5004aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:56855:x1848987613677568:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333173.978507:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333173.978532:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c5600d lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969648 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.978602:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56014 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333173.978615:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56014 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.978625:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56014 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.978635:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5601b lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333173.978641:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5601b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.978647:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5601b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.978686:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56014 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.978691:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56014 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.978697:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56014 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.978703:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56014 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.978709:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333173.978713:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56014 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.978724:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56014 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.978735:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff80045300) 00010000:00010000:3.0:1763333173.978738:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333173.978741:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56014 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.978747:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56014 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.978758:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5601b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.978763:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5601b lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.978770:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5601b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.978774:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333173.978776:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5601b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.978781:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5601b lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.978786:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045000) 00010000:00010000:3.0:1763333173.978788:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333173.978790:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5601b lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.978795:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5601b lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.978819:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c5600d lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969648 expref: 236 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.978828:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff80045300) 00010000:00010000:3.0:1763333173.978830:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333173.978834:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c5600d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969648 expref: 236 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.978847:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96400, rc 0) 00000100:00100000:3.0:1763333173.978899:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5004aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:56855:x1848987613677568:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 424us (580us total) trans 0 rc 301/301 00000100:00100000:3.0:1763333173.978906:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9221 00000100:00100000:1.0:1763333173.983117:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333173.983913:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.984193:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613677696 00000100:00100000:2.0:1763333173.984206:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613677696 00000100:00100000:3.0:1763333173.984277:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613677952 00000100:00100000:3.0:1763333173.984282:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613677952 00000100:00100000:3.0:1763333173.984331:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9222 00000100:00100000:3.0:1763333173.984341:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5004a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56855:x1848987613677696:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333173.984384:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333173.984411:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c56022 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696964f expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.984484:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56029 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333173.984511:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56029 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.984525:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56029 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.984542:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c56030 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333173.984550:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c56030 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.984558:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c56030 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.984602:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56029 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.984610:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56029 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.984617:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56029 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.984626:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56029 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.984632:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff4139a000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333173.984637:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56029 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.984645:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56029 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.984658:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff80045900) 00010000:00010000:3.0:1763333173.984662:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333173.984667:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56029 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.984674:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56029 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.984691:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c56030 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.984697:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c56030 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.984703:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c56030 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.984709:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff4139a800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333173.984712:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c56030 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.984718:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c56030 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.984726:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045000) 00010000:00010000:3.0:1763333173.984729:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333173.984732:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c56030 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.984738:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c56030 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333173.984766:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c56022 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696964f expref: 237 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.984777:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff80045900) 00010000:00010000:3.0:1763333173.984780:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333173.984784:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c56022 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696964f expref: 237 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333173.984802:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff4139a600, rc 0) 00000100:00100000:1.0:1763333173.984961:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9223 00000100:00100000:1.0:1763333173.984973:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50048700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56851:x1848987613677952:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:1.0:1763333173.985023:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56037 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333173.985035:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56037 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333173.985043:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56037 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00010000:1.0:1763333173.985157:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000fb948ab reply state 000000001e642afe transno 4294972239 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56037 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333173.985170:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56037 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333173.985176:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ab:0x0].0x0 (ffff92fe44e12c00) 00010000:00010000:1.0:1763333173.985179:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333173.985181:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763333173.987010:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5004a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56855:x1848987613677696:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 2660us (3891us total) trans 0 rc 301/301 00000100:00100000:3.0:1763333173.987023:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9222 00000100:00100000:1.0:1763333173.988073:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50048700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56851:x1848987613677952:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 3095us (4154us total) trans 4294972239 rc 0/0 00000100:00100000:1.0:1763333173.988084:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9223 00000100:00100000:1.0:1763333173.995258:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333173.995463:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613678080 00000100:00100000:0.0:1763333173.995476:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613678080 00000100:00100000:0.0:1763333173.995573:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9224 00000100:00100000:0.0:1763333173.995584:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5004b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56855:x1848987613678080:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333173.995615:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333173.995642:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c5603e lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969656 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.995723:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56045 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333173.995739:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56045 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333173.995754:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56045 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:0.0:1763333173.995810:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1763333173.995817:0:8606:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763333173.995861:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c5603e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969656 expref: 239 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.995885:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56045 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969656 expref: 238 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.995895:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44400) 00010000:00010000:0.0:1763333173.995899:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1763333173.995903:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48191600, rc 0) 00000100:00100000:0.0:1763333173.995976:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5004b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56855:x1848987613678080:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 393us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333173.995983:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9224 00000100:00100000:3.0:1763333173.996123:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333173.996385:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613678208 00000100:00100000:0.0:1763333173.996391:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613678208 00000100:00100000:0.0:1763333173.996427:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6471 00000100:00100000:0.0:1763333173.996436:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:56851:x1848987613678208:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333173.996448:0:28651:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333173.996462:0:28651:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe48191400/0xb32e3ef184c5604c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696965d expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.996482:0:28651:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c55f2d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695f4 expref: 26 pid: 28651 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333173.996501:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333173.996504:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333173.996508:0:28651:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe48191400/0xb32e3ef184c5604c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696965d expref: 26 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333173.996546:0:28651:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c55f2d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695f4 expref: 26 pid: 28651 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333173.996559:0:28651:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c55f2d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695f4 expref: 26 pid: 28651 timeout: 1378 lvb_type: 1 00000100:00100000:0.0:1763333173.996573:0:28651:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe43998380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28651:1848987627254144:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333173.996633:0:28651:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe43aa6900 going to sleep for 11 seconds 00000100:00100000:3.0:1763333173.999291:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333173.999405:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613678336 00000100:00100000:2.0:1763333173.999415:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613678336 00000100:00100000:2.0:1763333173.999470:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9225 00000100:00100000:2.0:1763333173.999481:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56855:x1848987613678336:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333173.999514:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333173.999536:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56053 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969664 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.999610:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5605a lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333173.999626:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5605a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.999640:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5605a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.999650:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56061 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333173.999656:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56061 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.999663:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56061 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.999706:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5605a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.999713:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5605a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.999719:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5605a lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.999727:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5605a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.999733:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333173.999738:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5605a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.999745:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5605a lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.999757:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44400) 00010000:00010000:2.0:1763333173.999760:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333173.999766:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5605a lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.999773:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5605a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.999787:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56061 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.999793:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56061 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.999798:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56061 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.999803:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333173.999806:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56061 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.999812:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56061 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.999823:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045000) 00010000:00010000:2.0:1763333173.999825:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333173.999829:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56061 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.999834:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56061 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333173.999861:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56053 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969664 expref: 239 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.999871:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44400) 00010000:00010000:2.0:1763333173.999873:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333173.999877:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56053 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969664 expref: 239 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333173.999887:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4000, rc 0) 00000100:00100000:2.0:1763333173.999953:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56855:x1848987613678336:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 473us (672us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333173.999961:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9225 00000100:00100000:1.0:1763333174.000686:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333174.000752:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613678464 00000100:00100000:3.0:1763333174.000759:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613678464 00010000:00010000:3.0:1763333174.000804:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c55f2d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695f4 expref: 27 pid: 28651 timeout: 1378 lvb_type: 1 00000100:00100000:3.0:1763333174.000831:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3027 00000100:00100000:3.0:1763333174.000839:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50048380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+27:2420:x1848987613678464:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333174.000850:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333174.000866:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c55f2d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695f4 expref: 27 pid: 28651 timeout: 1378 lvb_type: 1 00010000:00010000:3.0:1763333174.000877:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c55f2d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695f4 expref: 27 pid: 28651 timeout: 1378 lvb_type: 1 00010000:00010000:3.0:1763333174.000897:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333174.000899:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333174.000907:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe48191400/0xb32e3ef184c5604c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696965d expref: 27 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.000916:0:28428:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe48191400/0xb32e3ef184c5604c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696965d expref: 27 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.000952:0:28428:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff92fe48191400/0xb32e3ef184c5604c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696965d expref: 27 pid: 28651 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333174.000965:0:28428:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe438ab100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:28428:1848987627254272:192.168.204.28@tcp:105: 00000100:00100000:3.0:1763333174.001019:0:28428:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff58cbff00 going to sleep for 11 seconds 00010000:00010000:0.0:1763333174.001163:0:28651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c55f2d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695f4 expref: 27 pid: 28651 timeout: 1378 lvb_type: 1 00000100:00100000:0.0:1763333174.001176:0:28651:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe43998380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28651:1848987627254144:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333174.001201:0:28651:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe48191400/0xb32e3ef184c5604c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696965d expref: 26 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.001216:0:28651:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48191400, rc 0) 00000100:00100000:0.0:1763333174.001253:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+26:56851:x1848987613678208:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 4818us (5129us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333174.001261:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6471 00000100:00080000:1.0:1763333174.001322:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1763333174.004298:0:28428:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe438ab100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:28428:1848987627254272:192.168.204.28@tcp:105: 00010000:00010000:3.0:1763333174.004325:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333174.004411:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50048380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:2420:x1848987613678464:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 3571us (3726us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333174.004424:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3027 00000100:00100000:2.0:1763333174.009915:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333174.010021:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.010097:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613678720 00000100:00100000:0.0:1763333174.010109:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613678720 00000100:00100000:0.0:1763333174.010186:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9226 00000100:00100000:0.0:1763333174.010201:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56855:x1848987613678720:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333174.010224:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333174.010228:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763333174.010255:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56045 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969656 expref: 238 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.010276:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44400) 00010000:00010000:0.0:1763333174.010286:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333174.010301:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56068 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696966b expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.010442:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c5606f lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333174.010457:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c5606f lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.010468:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c5606f lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.010479:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56076 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333174.010488:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56076 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.010506:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56076 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.010902:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c5607d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333174.010912:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c5607d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.010918:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c5607d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:0.0:1763333174.010928:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ae:0x0]: returning size 0 00010000:00010000:0.0:1763333174.010953:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c5606f lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.010960:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c5606f lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.010966:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c5606f lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.010972:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c5606f lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.010978:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48190400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333174.010982:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c5606f lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.010989:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c5606f lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.011002:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44300) 00010000:00010000:0.0:1763333174.011005:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333174.011009:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c5606f lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.011014:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c5606f lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000004:00010000:0.0:1763333174.011026:0:8606:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000059f8d10a reply state 00000000dfed16ce transno 4294972240 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56076 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.011036:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56076 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.011042:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045000) 00010000:00010000:0.0:1763333174.011044:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333174.011047:0:8606:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763333174.011073:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56068 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696966b expref: 240 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.011089:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c5607d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696966b expref: 239 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.011096:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ae:0x0].0x0 (ffff92fe43b44900) 00010000:00010000:0.0:1763333174.011099:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333174.011101:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdfe00, rc 0) 00000100:00100000:0.0:1763333174.011167:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:56855:x1848987613678720:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 971us (1265us total) trans 4294972240 rc 0/0 00000100:00100000:0.0:1763333174.011176:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9226 00000100:00100000:1.0:1763333174.011739:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613678848 00000100:00100000:1.0:1763333174.011746:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613678848 00000100:00100000:1.0:1763333174.011795:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6472 00000100:00100000:1.0:1763333174.011804:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:2420:x1848987613678848:12345-192.168.204.28@tcp:2:lfs.0 00002000:00010000:1.0:1763333174.011910:0:28651:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x22f:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1763333174.011914:0:28651:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x22f:0x0] updating lvb mtime from disk: 1763333173 -> 1763333173 00002000:00010000:1.0:1763333174.011916:0:28651:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x22f:0x0] updating lvb atime from disk: 0 -> 1763333173 00002000:00010000:1.0:1763333174.011918:0:28651:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x22f:0x0] updating lvb ctime from disk: 1763333173 -> 1763333174 00002000:00010000:1.0:1763333174.011920:0:28651:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x22f:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1763333174.011953:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+26:2420:x1848987613678848:12345-192.168.204.28@tcp:2:lfs.0 Request processed in 150us (1932us total) trans 21474838861 rc 0/0 00000100:00100000:1.0:1763333174.011960:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6472 00000100:00080000:3.0:1763333174.012195:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1763333174.014292:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.014408:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613679104 00000100:00100000:1.0:1763333174.014419:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613679104 00000100:00100000:1.0:1763333174.014476:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9227 00000100:00100000:1.0:1763333174.014485:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:56855:x1848987613679104:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333174.014522:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333174.014545:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5608b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969672 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.014655:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56092 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333174.014670:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c5607d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696966b expref: 241 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.014678:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56092 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1ae:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333174.014711:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c5607d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696966b expref: 241 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.014728:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c5607d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696966b expref: 241 pid: 8606 timeout: 1378 lvb_type: 0 00000100:00100000:1.0:1763333174.014742:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff50048000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627254400:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333174.018628:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7412bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1763333174.019765:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333174.020010:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613679360 00000100:00100000:3.0:1763333174.020022:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613679360 00000100:00100000:3.0:1763333174.020088:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3150 00000100:00100000:3.0:1763333174.020100:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bd5e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:56851:x1848987613679360:12345-192.168.204.28@tcp:35:lfs.0 00000004:00010000:3.0:1763333174.020161:0:35317:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x240000404:0x1ab:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c55e8c lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695bc expref: 242 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.020217:0:35317:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56099 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 35317 initiator: MDT0 00010000:00010000:3.0:1763333174.020233:0:35317:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55ee0 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695d8 expref: 242 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.020245:0:35317:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56099 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 35317 initiator: MDT1 00010000:00010000:3.0:1763333174.020285:0:35317:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55ee0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695d8 expref: 242 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.020299:0:35317:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55ee0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695d8 expref: 242 pid: 6521 timeout: 1378 lvb_type: 0 00000100:00100000:3.0:1763333174.020314:0:35317:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe438ab100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:35317:1848987627254528:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333174.020427:0:35317:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff58cbff00 going to sleep for 11 seconds 00000100:00100000:2.0:1763333174.028809:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333174.028894:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613679488 00000100:00100000:3.0:1763333174.028905:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613679488 00010000:00010000:3.0:1763333174.028962:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c5607d lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696966b expref: 243 pid: 8606 timeout: 1378 lvb_type: 0 00000100:00100000:0.0:1763333174.028967:0:35317:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe438ab100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:35317:1848987627254528:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333174.028996:0:35317:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56099 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 35317 initiator: MDT1 00000100:00100000:3.0:1763333174.029008:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3028 00000100:00100000:3.0:1763333174.029017:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:2421:x1848987613679488:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333174.029035:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333174.029042:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c5607d lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696966b expref: 243 pid: 8606 timeout: 1378 lvb_type: 0 00010000:00010000:3.0:1763333174.029055:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c5607d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696966b expref: 243 pid: 8606 timeout: 1378 lvb_type: 0 00010000:00010000:3.0:1763333174.029080:0:28428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ae:0x0].0x0 (ffff92fe43b44900) 00010000:00010000:3.0:1763333174.029087:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56092 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ae:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333174.029098:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56092 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ae:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333174.029107:0:28428:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56092 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1ae:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333174.029112:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c5607d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696966b expref: 243 pid: 8606 timeout: 1378 lvb_type: 0 00010000:00010000:3.0:1763333174.029124:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333174.029127:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff50048000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627254400:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333174.029139:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56092 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ae:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333174.029145:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56092 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ae:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333174.029150:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56092 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ae:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:1.0:1763333174.029178:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ae:0x0]: returning size 0 00000100:00100000:3.0:1763333174.029184:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:2421:x1848987613679488:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 168us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333174.029192:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3028 00000004:00080000:1.0:1763333174.029887:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x233:0x0], index 0: 0 00000004:00080000:1.0:1763333174.029900:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x233:0x0], index 1: 0 00000004:00080000:1.0:1763333174.029906:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x234:0x0], index 1: 0 00000004:00080000:1.0:1763333174.029911:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x234:0x0], index 0: 0 00010000:00010000:1.0:1763333174.030036:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56092 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ae:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333174.030046:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56092 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1ae:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333174.030053:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56092 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1ae:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333174.030059:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333174.030063:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56092 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1ae:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333174.030070:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56092 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1ae:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333174.030082:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ae:0x0].0x0 (ffff92fe43b44900) 00010000:00010000:1.0:1763333174.030085:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763333174.030090:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56092 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1ae:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333174.030096:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56092 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1ae:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333174.030155:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5608b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1ae:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969672 expref: 242 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.030165:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ae:0x0].0x0 (ffff92fe43b44900) 00010000:00010000:1.0:1763333174.030167:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763333174.030171:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5608b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1ae:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969672 expref: 242 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.030186:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7fe00, rc 0) 00000100:00100000:1.0:1763333174.030237:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56855:x1848987613679104:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 15752us (15953us total) trans 4294972241 rc 301/301 00000100:00100000:1.0:1763333174.030245:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9227 00000100:00100000:3.0:1763333174.030465:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.033744:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613679616 00000100:00100000:0.0:1763333174.033762:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613679616 00010000:00010000:0.0:1763333174.033819:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55ee0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695d8 expref: 241 pid: 6521 timeout: 1378 lvb_type: 0 00000100:00100000:0.0:1763333174.033870:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3029 00000100:00100000:0.0:1763333174.033880:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff51e56050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:2421:x1848987613679616:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333174.033897:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333174.033904:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55ee0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695d8 expref: 241 pid: 6521 timeout: 1378 lvb_type: 0 00010000:00010000:0.0:1763333174.033919:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55ee0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695d8 expref: 241 pid: 6521 timeout: 1378 lvb_type: 0 00010000:00010000:0.0:1763333174.033943:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c55ee0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695d8 expref: 241 pid: 6521 timeout: 1378 lvb_type: 0 00010000:00010000:0.0:1763333174.033976:0:28428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ab:0x0].0x0 (ffff92fe44e12c00) 00010000:00010000:0.0:1763333174.033982:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56099 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 35317 initiator: MDT1 00010000:00010000:0.0:1763333174.033993:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56099 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 35317 initiator: MDT1 00010000:00010000:0.0:1763333174.034001:0:28428:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56099 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 35317 initiator: MDT1 00010000:00010000:0.0:1763333174.034041:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333174.034107:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff51e56050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:2421:x1848987613679616:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 228us (3642us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333174.034116:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3029 00010000:00010000:3.0:1763333174.034419:0:35317:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56099 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 35317 initiator: MDT1 00010000:00010000:3.0:1763333174.034429:0:35317:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56099 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 35317 initiator: MDT1 00000040:00080000:3.0:1763333174.034696:0:35317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1394, 88 off117720 00000004:00080000:3.0:1763333174.034708:0:35317:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1278114358111ns, next at 1279025269818ns, rc = 0 00000040:00080000:3.0:1763333174.034734:0:35317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1393, 88 off117720 00000004:00080000:3.0:1763333174.034740:0:35317:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1278114391088ns, next at 1278526292086ns, rc = 0 00000040:00080000:3.0:1763333174.034759:0:35317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1394, 88 off117808 00000004:00080000:3.0:1763333174.034763:0:35317:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1278114414228ns, next at 1278526292086ns, rc = 0 00000040:00080000:3.0:1763333174.034772:0:35317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1395, 88 off117808 00000004:00080000:3.0:1763333174.034776:0:35317:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1278114426910ns, next at 1279025269818ns, rc = 0 00000100:00100000:0.0:1763333174.036132:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333174.038378:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613679872 00000100:00100000:3.0:1763333174.038394:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613679872 00000100:00100000:3.0:1763333174.038459:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3151 00000100:00100000:3.0:1763333174.038469:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56855:x1848987613679872:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333174.038791:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:56855:x1848987613679872:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 322us (2668us total) trans 4294972243 rc 0/0 00000100:00100000:3.0:1763333174.038803:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3151 00000001:00080000:0.0:1763333174.043775:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972242 is committed 00000004:00080000:0.0:1763333174.043791:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 915 committed 00000004:00080000:0.0:1763333174.043810:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 911 committed 00000004:00080000:0.0:1763333174.043818:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 910 committed 00000004:00080000:0.0:1763333174.043820:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 914 committed 00000004:00080000:0.0:1763333174.043831:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 913 committed 00000100:00100000:3.0:1763333174.044005:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe438a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627255040:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333174.044074:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333174.044119:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763333174.044126:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe438abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627254656:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763333174.044148:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333174.044176:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe438a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627254784:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763333174.044197:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333174.044212:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763333174.044218:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe438a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627254912:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333174.044237:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333174.044267:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627255040 00000100:00100000:3.0:1763333174.044273:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627255040 00000100:00100000:3.0:1763333174.044322:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627254656 00000100:00100000:3.0:1763333174.044325:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627254656 00000100:00100000:3.0:1763333174.044340:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627254784 00000100:00100000:3.0:1763333174.044342:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627254784 00000100:00100000:3.0:1763333174.044385:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627254912 00000100:00100000:3.0:1763333174.044388:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627254912 00000100:00100000:3.0:1763333174.044407:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6473 00000100:00100000:3.0:1763333174.044415:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+8:3654:x1848987627255040:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1763333174.044790:0:8404:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x230:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1763333174.044795:0:8404:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x230:0x0] updating lvb mtime from disk: 1763333174 -> 1763333174 00002000:00010000:3.0:1763333174.044797:0:8404:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x230:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333174.044800:0:8404:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x230:0x0] updating lvb ctime from disk: 1763333174 -> 1763333174 00002000:00010000:3.0:1763333174.044803:0:8404:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x230:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763333174.044846:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+9:3654:x1848987627255040:12345-0@lo:2:osp-syn-1-1.0 Request processed in 431us (772us total) trans 17179871557 rc 0/0 00000100:00100000:3.0:1763333174.044855:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6473 00000100:00100000:3.0:1763333174.044875:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6474 00000100:00100000:3.0:1763333174.044882:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+8:3654:x1848987627254656:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763333174.044897:0:8404:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:561 count 1 00010000:00010000:3.0:1763333174.044916:0:8404:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c560a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x231:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.044936:0:8404:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c55fab lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x231:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969625 expref: 15 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.044945:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333174.044948:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333174.044952:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c560a7 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x231:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.044983:0:8404:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c55fab lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x231:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969625 expref: 15 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.044999:0:8404:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c55fab lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x231:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969625 expref: 15 pid: 8404 timeout: 1378 lvb_type: 0 00000100:00100000:3.0:1763333174.045012:0:8404:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77c6c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8404:1848987627255168:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333174.045075:0:8404:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff6b0c2540 going to sleep for 11 seconds 00000100:00100000:3.0:1763333174.045098:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6475 00000100:00100000:3.0:1763333174.045106:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+8:3652:x1848987627254784:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763333174.045118:0:28600:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:562 count 1 00002000:00010000:3.0:1763333174.045139:0:28600:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x232:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333174.045145:0:28600:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c560ae lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.045154:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333174.045155:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333174.045160:0:28600:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c560ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.045173:0:28600:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c560ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.045183:0:28600:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c560ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.045192:0:28600:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c560ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.045212:0:28600:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763333174.045413:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+9:3652:x1848987627254784:12345-0@lo:6:osp-syn-1-1.0 Request processed in 307us (1213us total) trans 17179871558 rc 0/0 00000100:00100000:3.0:1763333174.045420:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6475 00000100:00100000:3.0:1763333174.045434:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6476 00000100:00100000:3.0:1763333174.045441:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+8:3652:x1848987627254912:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1763333174.045520:0:28600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x22f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333174.045523:0:28600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x22f:0x0] updating lvb mtime from disk: 1763333173 -> 1763333173 00002000:00010000:3.0:1763333174.045526:0:28600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x22f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333174.045529:0:28600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x22f:0x0] updating lvb ctime from disk: 1763333173 -> 1763333173 00002000:00010000:3.0:1763333174.045533:0:28600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x22f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333174.045559:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+9:3652:x1848987627254912:12345-0@lo:2:osp-syn-1-1.0 Request processed in 118us (1320us total) trans 17179871559 rc 0/0 00000100:00100000:3.0:1763333174.045565:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6476 00000100:00080000:3.0:1763333174.045585:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1763333174.045595:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333174.045602:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c560ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.045610:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff4139a600 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333174.045615:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c560ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.045624:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c560ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.045642:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c560ae lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.045650:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c560ae lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.045667:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333174.045669:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333174.045671:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763333174.045743:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff50064700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627255552:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1763333174.045764:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55fdc lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.045773:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55fdc lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00000100:00100000:3.0:1763333174.045774:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1763333174.045783:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55fdc lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.045788:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333174.045793:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55fdc lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.045799:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55fdc lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00000100:00100000:3.0:1763333174.045803:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763333174.045812:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff50067b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627255424:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1763333174.045813:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ab:0x0].0x0 (ffff92fe44e12c00) 00010000:00010000:1.0:1763333174.045819:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333174.045823:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55fdc lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.045829:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c55fdc lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000100:00100000:3.0:1763333174.045839:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1763333174.045845:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c55fea lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.045853:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c55fea lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.045859:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c55fea lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.045864:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333174.045868:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c55fea lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.045874:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c55fea lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.045882:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045000) 00000100:00100000:3.0:1763333174.045883:0:3652:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179871553 gen 2 00010000:00010000:1.0:1763333174.045886:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00080000:3.0:1763333174.045891:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe42ef9c00, transno 17179871540 00010000:00010000:1.0:1763333174.045891:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c55fea lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.045900:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c55fea lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000004:00080000:3.0:1763333174.045902:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe42ef9180, transno 17179871541 00000004:00080000:3.0:1763333174.045908:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe42ef9500, transno 17179871542 00000004:00080000:3.0:1763333174.045913:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe42ef8700, transno 17179871543 00010000:00010000:1.0:1763333174.045915:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56037 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00000004:00080000:3.0:1763333174.045916:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe469a1180, transno 17179871544 00000004:00080000:3.0:1763333174.045920:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe469a3b80, transno 17179871545 00000004:00080000:3.0:1763333174.045925:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe469a0700, transno 17179871546 00010000:00010000:1.0:1763333174.045928:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56037 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00000004:00080000:3.0:1763333174.045930:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe469a1f80, transno 17179871547 00000004:00080000:3.0:1763333174.045935:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff75667100, transno 17179871549 00010000:00010000:1.0:1763333174.045940:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56037 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00000004:00080000:3.0:1763333174.045941:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff75665c00, transno 17179871550 00000004:00080000:3.0:1763333174.045955:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe438aa300, transno 17179871552 00000004:00080000:3.0:1763333174.045958:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe438a8a80, transno 17179871553 00000100:00100000:3.0:1763333174.045964:0:3652:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff92fe438a9c00 x1848987627254912/t17179871559(17179871559) o2->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763333190 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1763333174.045976:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe438a9c00/2, rc 0, transno 17179871559 00000100:00100000:3.0:1763333174.045983:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe438a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627254912:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763333174.045995:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe438a9880/2, rc 0, transno 17179871558 00000100:00100000:3.0:1763333174.046000:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe438a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627254784:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1763333174.046078:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333174.046081:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56037 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333174.046087:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56037 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333174.046096:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ab:0x0].0x0 (ffff92fe44e12c00) 00010000:00010000:1.0:1763333174.046098:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333174.046101:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56037 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333174.046107:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56037 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333174.046122:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56076 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00000004:00080000:3.0:1763333174.046123:0:9836:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 4 in progress, 2 in flight, 12 done 00010000:00010000:1.0:1763333174.046137:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56076 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00000100:00100000:3.0:1763333174.046143:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff50065c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627255680:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1763333174.046145:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56076 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.046155:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48190c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333174.046158:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56076 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.046166:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56076 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.046173:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045000) 00010000:00010000:1.0:1763333174.046177:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763333174.046179:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1763333174.046181:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56076 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.046187:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56076 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000004:00080000:3.0:1763333174.046211:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe438a9180/2, rc 0, transno 17179871557 00000100:00100000:1.0:1763333174.046216:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627255552 00000100:00100000:3.0:1763333174.046218:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe438a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627255040:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333174.046224:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627255552 00000100:00100000:3.0:1763333174.046232:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763333174.046241:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77c6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627255296:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763333174.046264:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627255424 00000100:00100000:1.0:1763333174.046268:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627255424 00000100:00100000:3.0:1763333174.046269:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333174.046284:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627255680 00000100:00100000:1.0:1763333174.046287:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627255680 00000100:00100000:1.0:1763333174.046298:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627255296 00000100:00100000:1.0:1763333174.046300:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627255296 00000100:00100000:1.0:1763333174.046315:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6477 00000100:00100000:1.0:1763333174.046323:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50065880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+37:3653:x1848987627255552:12345-0@lo:2:osp-syn-0-1.0 00000004:00010000:3.0:1763333174.046330:0:35317:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e0e27d4a reply state 00000000817bb849 transno 4294972242 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56099 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35317 initiator: MDT1 00010000:00010000:3.0:1763333174.046344:0:35317:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56099 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35317 initiator: MDT1 00010000:00010000:3.0:1763333174.046383:0:35317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ab:0x0].0x0 (ffff92fe44e12c00) 00010000:00010000:3.0:1763333174.046386:0:35317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1763333174.046389:0:35317:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763333174.046396:0:35317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ab:0x0].0x0 (ffff92fe44e12c00) 00010000:00010000:3.0:1763333174.046399:0:35317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763333174.046405:0:35317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c55e8c lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695bc expref: 230 pid: 8606 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333174.046419:0:8611:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x22f:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1763333174.046424:0:8611:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x22f:0x0] updating lvb mtime from disk: 1763333173 -> 1763333173 00002000:00010000:1.0:1763333174.046426:0:8611:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x22f:0x0] updating lvb atime from disk: 1763333173 -> 1763333173 00002000:00010000:1.0:1763333174.046428:0:8611:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x22f:0x0] updating lvb ctime from disk: 1763333174 -> 1763333174 00002000:00010000:1.0:1763333174.046430:0:8611:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x22f:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1763333174.046465:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50065880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+38:3653:x1848987627255552:12345-0@lo:2:osp-syn-0-1.0 Request processed in 143us (691us total) trans 21474838862 rc 0/0 00000100:00100000:1.0:1763333174.046470:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6477 00010000:00080000:3.0:1763333174.046484:0:35317:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1763333174.046484:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6478 00000100:00100000:1.0:1763333174.046504:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50065180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+37:3653:x1848987627255424:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763333174.046515:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bd5e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56851:x1848987613679360:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 26416us (26755us total) trans 4294972242 rc 0/0 00002000:00080000:1.0:1763333174.046517:0:8611:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:562 count 1 00000100:00100000:3.0:1763333174.046528:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3150 00002000:00010000:1.0:1763333174.046536:0:8611:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x232:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333174.046543:0:8611:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c560b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.046551:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333174.046553:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333174.046557:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c560b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.046568:0:8611:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c560b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.046575:0:8611:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c560b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333174.046582:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6479 00010000:00010000:1.0:1763333174.046592:0:8611:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c560b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333174.046594:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50065f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+37:3654:x1848987627255680:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1763333174.046615:0:8611:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1763333174.046669:0:28600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x230:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333174.046674:0:28600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x230:0x0] updating lvb mtime from disk: 1763333174 -> 1763333174 00002000:00010000:3.0:1763333174.046677:0:28600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x230:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333174.046679:0:28600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x230:0x0] updating lvb ctime from disk: 1763333174 -> 1763333174 00002000:00010000:3.0:1763333174.046682:0:28600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x230:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333174.046720:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50065f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+39:3654:x1848987627255680:12345-0@lo:2:osp-syn-0-1.0 Request processed in 128us (542us total) trans 21474838863 rc 0/0 00000100:00100000:3.0:1763333174.046729:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6479 00000100:00100000:3.0:1763333174.046746:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6480 00000100:00100000:3.0:1763333174.046754:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50066a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+38:3654:x1848987627255296:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763333174.046766:0:28600:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:561 count 1 00000100:00100000:1.0:1763333174.046767:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50065180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+38:3653:x1848987627255424:12345-0@lo:6:osp-syn-0-1.0 Request processed in 263us (928us total) trans 21474838864 rc 0/0 00000100:00100000:1.0:1763333174.046778:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6478 00010000:00010000:3.0:1763333174.046781:0:28600:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c560bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x231:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.046796:0:28600:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55fb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x231:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696962c expref: 25 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.046803:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333174.046806:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333174.046809:0:28600:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c560bc lrc: 4/0,1 mode: --/PW res: [0x280000400:0x231:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.046817:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333174.046825:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c560b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.046831:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e800 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333174.046835:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c560b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.046837:0:28600:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55fb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x231:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696962c expref: 25 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.046846:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c560b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.046857:0:28600:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55fb9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x231:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696962c expref: 25 pid: 28651 timeout: 1378 lvb_type: 0 00010000:00010000:1.0:1763333174.046861:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c560b5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.046877:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c560b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333174.046880:0:28600:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff50064e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28600:1848987627255808:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333174.046898:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333174.046901:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333174.046904:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1763333174.046912:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1763333174.046928:0:28600:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff49c92a80 going to sleep for 11 seconds 00000004:00080000:1.0:1763333174.046936:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff50067b80/2, rc 0, transno 21474838864 00000100:00100000:1.0:1763333174.046943:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff50067b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627255424:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1763333174.046959:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff50065c00/2, rc 0, transno 21474838863 00000004:00080000:1.0:1763333174.046960:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff50064700/2, rc 0, transno 21474838862 00000100:00100000:3.0:1763333174.046969:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff50065c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627255680:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333174.046969:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff50064700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627255552:0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1763333174.047297:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56099 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35317 initiator: MDT1 00010000:00010000:0.0:1763333174.047306:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56099 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35317 initiator: MDT1 00010000:00010000:0.0:1763333174.047313:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56099 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35317 initiator: MDT1 00010000:00010000:0.0:1763333174.047319:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333174.047323:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56099 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35317 initiator: MDT1 00010000:00010000:0.0:1763333174.047330:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56099 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35317 initiator: MDT1 00010000:00010000:0.0:1763333174.047340:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ab:0x0].0x0 (ffff92fe44e12c00) 00010000:00010000:0.0:1763333174.047343:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333174.047371:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56099 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35317 initiator: MDT1 00010000:00010000:0.0:1763333174.047384:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56099 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35317 initiator: MDT1 00000100:00100000:0.0:1763333174.055339:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.055480:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.055519:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333174.055520:0:8404:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77c6c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8404:1848987627255168:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333174.055520:0:28600:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff50064e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28600:1848987627255808:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333174.055545:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613680256 00000100:00100000:0.0:1763333174.055552:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613680256 00010000:00010000:2.0:1763333174.055557:0:8404:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c560a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x231:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.055558:0:28600:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c560bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x231:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333174.055598:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613680384 00010000:00010000:0.0:1763333174.055599:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c55fab lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x231:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969625 expref: 16 pid: 8404 timeout: 1378 lvb_type: 0 00000100:00100000:2.0:1763333174.055601:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613680384 00010000:00010000:2.0:1763333174.055616:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55fb9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x231:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696962c expref: 26 pid: 28651 timeout: 1378 lvb_type: 0 00000100:00100000:0.0:1763333174.055629:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3030 00000100:00100000:2.0:1763333174.055635:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3031 00000100:00100000:0.0:1763333174.055639:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4399aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2419:x1848987613680256:12345-192.168.204.28@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1763333174.055642:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43999f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+26:2419:x1848987613680384:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333174.055654:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333174.055654:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:1.0:1763333174.055655:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1763333174.055662:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55fb9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x231:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696962c expref: 26 pid: 28651 timeout: 1378 lvb_type: 0 00010000:00010000:0.0:1763333174.055662:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c55fab lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x231:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969625 expref: 16 pid: 8404 timeout: 1378 lvb_type: 0 00010000:00010000:2.0:1763333174.055676:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55fb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x231:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696962c expref: 26 pid: 28651 timeout: 1378 lvb_type: 0 00010000:00010000:0.0:1763333174.055676:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c55fab lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x231:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969625 expref: 16 pid: 8404 timeout: 1378 lvb_type: 0 00010000:00010000:2.0:1763333174.055699:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c55fb9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x231:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696962c expref: 26 pid: 28651 timeout: 1378 lvb_type: 0 00010000:00010000:0.0:1763333174.055699:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c55fab lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x231:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969625 expref: 16 pid: 8404 timeout: 1378 lvb_type: 0 00010000:00010000:2.0:1763333174.055714:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333174.055715:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333174.055717:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333174.055717:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333174.055723:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c560bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x231:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.055723:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c560a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x231:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.055733:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c560bc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x231:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.055736:0:28428:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c560a7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x231:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.055755:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333174.055755:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333174.055805:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43999f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:2419:x1848987613680384:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 162us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333174.055812:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3031 00010000:00010000:2.0:1763333174.055840:0:8404:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c560a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.055847:0:8404:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c560a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.055858:0:8404:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c560a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.055865:0:8404:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c560a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.055880:0:8404:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763333174.056117:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+9:3654:x1848987627254656:12345-0@lo:6:osp-syn-1-1.0 Request processed in 11235us (11966us total) trans 17179871560 rc 0/0 00000100:00100000:2.0:1763333174.056125:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6474 00010000:00010000:2.0:1763333174.056145:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333174.056152:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c560a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333174.056159:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613680128 00010000:00010000:2.0:1763333174.056159:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96c00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333174.056163:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c560a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333174.056164:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613680128 00010000:00010000:2.0:1763333174.056172:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c560a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.056185:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c560a7 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.056192:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c560a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333174.056198:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3152 00000100:00100000:3.0:1763333174.056205:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+229:56855:x1848987613680128:12345-192.168.204.28@tcp:35:lfs.0 00010000:00010000:2.0:1763333174.056208:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333174.056210:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333174.056211:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763333174.056237:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe438abb80/2, rc 0, transno 17179871560 00000100:00100000:2.0:1763333174.056243:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe438abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627254656:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1763333174.056257:0:28600:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c560bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.056264:0:28600:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c560bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.056272:0:28600:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c560bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.056278:0:28600:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c560bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.056290:0:28600:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763333174.056436:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50066a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+38:3654:x1848987627255296:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9682us (10167us total) trans 21474838865 rc 0/0 00000100:00100000:2.0:1763333174.056446:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6480 00010000:00010000:2.0:1763333174.056464:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333174.056469:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c560bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.056476:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff4139a800 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333174.056479:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c560bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.056487:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c560bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.056510:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c560bc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.056517:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c560bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.056533:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333174.056534:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333174.056536:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763333174.056555:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff77c6d180/2, rc 0, transno 21474838865 00000100:00100000:2.0:1763333174.056561:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77c6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627255296:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763333174.056878:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4399aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2419:x1848987613680256:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 1239us (1396us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333174.056887:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3030 00000100:00100000:1.0:1763333174.056917:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333174.056932:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56855:x1848987613680128:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 727us (1604us total) trans 4294972244 rc 0/0 00000100:00100000:3.0:1763333174.056941:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3152 00000100:00100000:0.0:1763333174.057012:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613680512 00000100:00100000:0.0:1763333174.057017:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613680512 00000100:00100000:0.0:1763333174.057056:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9228 00000100:00100000:0.0:1763333174.057064:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+230:56851:x1848987613680512:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333174.057078:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333174.057096:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c560c3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969679 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.057140:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c560c3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969679 expref: 231 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.057154:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf400/0xb32e3ef184c560c3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969679 expref: 231 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.057171:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ab:0x0].0x0 (ffff92fe44e12c00) 00010000:00010000:0.0:1763333174.057174:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333174.057177:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdf400, rc 0) 00000100:00100000:0.0:1763333174.057201:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56851:x1848987613680512:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 138us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333174.057210:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9228 00000100:00100000:0.0:1763333174.060510:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333174.060565:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613680768 00000100:00100000:3.0:1763333174.060580:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613680768 00000100:00100000:3.0:1763333174.060654:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3153 00000100:00100000:3.0:1763333174.060665:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4399a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+231:56851:x1848987613680768:12345-192.168.204.28@tcp:35:lfs.0 00000004:00080000:3.0:1763333174.060997:0:19668:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x1ab:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1763333174.061078:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1396, 64 off117872 00000040:00080000:3.0:1763333174.061100:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1395, 64 off117872 00000040:00080000:3.0:1763333174.061109:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1396, 64 off117936 00000040:00080000:3.0:1763333174.061117:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1397, 64 off117936 00010000:00010000:3.0:1763333174.061185:0:19668:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c560ca lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19668 initiator: MDT0 00010000:00010000:3.0:1763333174.061205:0:19668:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c560ca lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ab:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 19668 initiator: MDT1 00010000:00010000:3.0:1763333174.061219:0:19668:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c560ca lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ab:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 19668 initiator: MDT1 00010000:00010000:3.0:1763333174.061228:0:19668:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c560ca lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1ab:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 19668 initiator: MDT1 00010000:00010000:3.0:1763333174.061235:0:19668:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c560ca lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1ab:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 19668 initiator: MDT1 00010000:00010000:3.0:1763333174.061244:0:19668:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c560ca lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1ab:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 19668 initiator: MDT1 00010000:00010000:3.0:1763333174.061275:0:19668:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763333174.061607:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4399a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56851:x1848987613680768:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 941us (1113us total) trans 4294972245 rc 0/0 00000100:00100000:3.0:1763333174.061615:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3153 00010000:00010000:0.0:1763333174.061729:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333174.061738:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c560ca lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1ab:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333174.061744:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff4139a000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333174.061748:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c560ca lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1ab:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333174.062069:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c560ca lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1ab:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333174.062084:0:8422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ab:0x0].0x0 (ffff92fe44e12c00) 00010000:00010000:0.0:1763333174.062087:0:8422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763333174.062092:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c560ca lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1ab:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333174.062098:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c560ca lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1ab:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333174.062112:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333174.062114:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333174.062116:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763333174.078151:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.078641:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613681024 00000100:00100000:1.0:1763333174.078654:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613681024 00000100:00100000:1.0:1763333174.078727:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9229 00000100:00100000:1.0:1763333174.078738:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:55917:x1848987613681024:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333174.078767:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333174.078795:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c560d1 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969680 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.078956:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c560d8 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333174.078971:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c560d8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.078982:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c560d8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.078998:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c560df lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333174.079004:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c560df lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.079010:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c560df lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.079068:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c560e6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333174.079075:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c560e6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.079082:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c560e6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:1.0:1763333174.079093:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ae:0x0]: returning size 0 00010000:00010000:1.0:1763333174.079182:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c560d8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.079190:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c560d8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.079197:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c560d8 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.079204:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c560d8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.079210:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333174.079215:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c560d8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.079226:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c560d8 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.079239:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe435f8d00) 00010000:00010000:1.0:1763333174.079243:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333174.079249:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c560d8 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.079255:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c560d8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.079269:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c560df lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.079276:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c560df lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.079282:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c560df lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.079288:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333174.079291:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c560df lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.079297:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c560df lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.079304:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe435f8600) 00010000:00010000:1.0:1763333174.079306:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333174.079309:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c560df lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.079313:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c560df lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.079390:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c560d1 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969680 expref: 235 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.079407:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c560e6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969680 expref: 234 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.079413:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ae:0x0].0x0 (ffff92fe435f8f00) 00010000:00010000:1.0:1763333174.079415:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333174.079417:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e600, rc 0) 00000100:00100000:1.0:1763333174.079504:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:55917:x1848987613681024:12345-192.168.204.28@tcp:101:bash.0 Request processed in 768us (1368us total) trans 4294972246 rc 0/0 00000100:00100000:1.0:1763333174.079512:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9229 00000100:00100000:2.0:1763333174.085372:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333174.085414:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.085414:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613681408 00000100:00100000:0.0:1763333174.085426:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613681408 00000100:00100000:0.0:1763333174.085485:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613681152 00000100:00100000:0.0:1763333174.085501:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613681152 00000100:00100000:0.0:1763333174.085536:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9230 00000100:00100000:0.0:1763333174.085547:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:56851:x1848987613681408:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333174.085578:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333174.085601:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c560f4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696968e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333174.085692:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9231 00000100:00100000:3.0:1763333174.085703:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:55917:x1848987613681152:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333174.085711:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333174.085719:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c560fb lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969687 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.085723:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c56102 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333174.085736:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c56102 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x1ae:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333174.085738:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56109 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333174.085748:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56109 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333174.085749:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c56102 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x1ae:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333174.085756:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56109 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:0.0:1763333174.085760:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ae:0x0]: returning size 0 00010000:00010000:3.0:1763333174.085854:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a600/0xb32e3ef184c560fb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969687 expref: 239 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.085869:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c560f4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1ae:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696968e expref: 239 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.085870:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56109 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969687 expref: 239 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.085879:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ae:0x0].0x0 (ffff92fe435f8f00) 00010000:00010000:3.0:1763333174.085884:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763333174.085893:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff4139a000, rc 0) 00000100:00100000:3.0:1763333174.085955:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:55917:x1848987613681152:12345-192.168.204.28@tcp:101:bash.0 Request processed in 254us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333174.085962:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9231 00010000:00010000:0.0:1763333174.086901:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c56102 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1ae:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696968e expref: 237 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.086915:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ae:0x0].0x0 (ffff92fe435f8f00) 00010000:00010000:0.0:1763333174.086917:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1763333174.086920:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdf200, rc 0) 00000100:00100000:0.0:1763333174.088254:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56851:x1848987613681408:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 2697us (2907us total) trans 4294972247 rc 0/0 00000100:00100000:0.0:1763333174.088267:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9230 00000100:00100000:3.0:1763333174.088889:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.090165:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613681664 00000100:00100000:0.0:1763333174.090187:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613681664 00000100:00100000:1.0:1763333174.090996:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9232 00000100:00100000:1.0:1763333174.091016:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50064e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:55917:x1848987613681664:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:1.0:1763333174.091084:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333174.091116:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c560e6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969680 expref: 237 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.091135:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ae:0x0].0x0 (ffff92fe435f8f00) 00010000:00010000:1.0:1763333174.091141:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333174.091395:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56117 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333174.091411:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56117 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ae:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.091420:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56117 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ae:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000001:00080000:1.0:1763333174.091472:0:8606:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294972248 00000004:00010000:1.0:1763333174.091516:0:8606:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d7c05de9 reply state 000000005241de5c transno 4294972249 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56117 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ae:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.091531:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56117 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1ae:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.091538:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ae:0x0].0x0 (ffff92fe435f8f00) 00010000:00010000:1.0:1763333174.091541:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333174.091544:0:8606:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763333174.091672:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50064e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:55917:x1848987613681664:12345-192.168.204.28@tcp:36:bash.0 Request processed in 661us (2784us total) trans 4294972249 rc 0/0 00000100:00100000:1.0:1763333174.091679:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9232 00000020:00080000:1.0:1763333174.091686:0:8606:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763333174.092636:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.092674:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613681792 00000100:00100000:0.0:1763333174.092685:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613681792 00000100:00100000:0.0:1763333174.092737:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9233 00000100:00100000:0.0:1763333174.092746:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7403b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56851:x1848987613681792:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333174.092767:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333174.092786:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c5611e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969695 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.092882:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c56125 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333174.092893:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c56125 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.092903:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c56125 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:0.0:1763333174.093048:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ae:0x0]: returning size 0 00000004:00200000:0.0:1763333174.093053:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763333174.093075:0:6521:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c56125 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.093101:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c5611e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1ae:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969695 expref: 241 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.093119:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c56125 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969695 expref: 240 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.093127:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ae:0x0].0x0 (ffff92fe435f8f00) 00010000:00010000:0.0:1763333174.093130:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333174.093134:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdee00, rc 0) 00000100:00100000:0.0:1763333174.093188:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7403b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:56851:x1848987613681792:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 442us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333174.093196:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9233 00000100:00100000:2.0:1763333174.094692:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.094884:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613682048 00000100:00100000:1.0:1763333174.094893:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613682048 00000100:00100000:1.0:1763333174.094956:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9234 00000100:00100000:1.0:1763333174.094966:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:55917:x1848987613682048:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333174.094988:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333174.094991:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763333174.095017:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c56102 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1ae:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696968e expref: 240 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.095037:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ae:0x0].0x0 (ffff92fe435f8f00) 00010000:00010000:1.0:1763333174.095041:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333174.095055:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5612c lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696969c expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.095106:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56133 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333174.095120:0:8606:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c56125 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969695 expref: 240 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.095129:0:8606:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56133 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1ae:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.095163:0:8606:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c56125 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969695 expref: 240 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.095178:0:8606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c56125 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969695 expref: 240 pid: 6521 timeout: 1378 lvb_type: 0 00000100:00100000:1.0:1763333174.095194:0:8606:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff5004ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627255936:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333174.095292:0:8606:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7412b000 going to sleep for 11 seconds 00000100:00100000:1.0:1763333174.099210:0:8606:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff5004ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627255936:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333174.099249:0:8606:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56133 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ae:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000100:00100000:2.0:1763333174.099500:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333174.099590:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.099686:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613682304 00000100:00100000:1.0:1763333174.099694:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613682304 00000100:00100000:1.0:1763333174.099752:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6481 00000100:00100000:1.0:1763333174.099761:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:2420:x1848987613682304:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333174.099779:0:28600:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333174.099800:0:28600:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c5613a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369696a3 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333174.099823:0:28600:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x233:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333174.099841:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333174.099843:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333174.099853:0:28600:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c5613a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696a3 expref: 26 pid: 28600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333174.099870:0:28600:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c5613a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696a3 expref: 26 pid: 28600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333174.099885:0:28600:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e600, rc 0) 00000100:00100000:1.0:1763333174.099950:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+26:2420:x1848987613682304:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 189us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333174.099958:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6481 00000100:00100000:0.0:1763333174.100014:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613682176 00000100:00100000:0.0:1763333174.100019:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613682176 00010000:00010000:0.0:1763333174.100043:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c56125 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969695 expref: 241 pid: 6521 timeout: 1378 lvb_type: 0 00000100:00100000:0.0:1763333174.100079:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3032 00000100:00100000:0.0:1763333174.100087:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:2421:x1848987613682176:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333174.100098:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333174.100105:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c56125 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969695 expref: 241 pid: 6521 timeout: 1378 lvb_type: 0 00010000:00010000:0.0:1763333174.100116:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c56125 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969695 expref: 241 pid: 6521 timeout: 1378 lvb_type: 0 00010000:00010000:0.0:1763333174.100135:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c56125 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969695 expref: 241 pid: 6521 timeout: 1378 lvb_type: 0 00010000:00010000:0.0:1763333174.100150:0:28428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ae:0x0].0x0 (ffff92fe435f8f00) 00010000:00010000:0.0:1763333174.100154:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56133 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ae:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.100163:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56133 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ae:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.100170:0:28428:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56133 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1ae:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.100196:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333174.100218:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:2421:x1848987613682176:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 132us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333174.100225:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3032 00000100:00100000:3.0:1763333174.105961:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.106073:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613682432 00000100:00100000:0.0:1763333174.106085:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613682432 00000100:00100000:0.0:1763333174.106152:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9235 00000100:00100000:0.0:1763333174.106163:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:56851:x1848987613682432:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333174.106187:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333174.106210:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c56141 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369696aa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.106271:0:6521:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56133 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ae:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.106283:0:6521:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c56141 lrc: 4/0,0 mode: --/CR res: [0x240000404:0x1ae:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696aa expref: 241 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.106304:0:6521:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56133 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1ae:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.106319:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c56141 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x1ae:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696aa expref: 241 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.106334:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ae:0x0].0x0 (ffff92fe435f8f00) 00010000:00010000:0.0:1763333174.106338:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333174.106341:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c56141 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x1ae:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696aa expref: 241 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.106375:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdea00, rc 0) 00000100:00100000:0.0:1763333174.106448:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56851:x1848987613682432:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 287us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333174.106457:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9235 00010000:00010000:1.0:1763333174.107190:0:8606:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56133 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ae:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.107201:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56133 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ae:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 8606 initiator: MDT1 00000040:00080000:1.0:1763333174.107483:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1398, 88 off118024 00000004:00080000:1.0:1763333174.107501:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1278187151756ns, next at 1279025269818ns, rc = 0 00000040:00080000:1.0:1763333174.107539:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1397, 88 off118024 00000004:00080000:1.0:1763333174.107544:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1278187194943ns, next at 1278526292086ns, rc = 0 00000040:00080000:1.0:1763333174.107568:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1398, 88 off118112 00000004:00080000:1.0:1763333174.107572:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1278187222746ns, next at 1278526292086ns, rc = 0 00000040:00080000:1.0:1763333174.107581:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1399, 88 off118112 00000004:00080000:1.0:1763333174.107585:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1278187235982ns, next at 1279025269818ns, rc = 0 00000001:00080000:1.0:1763333174.109566:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972250 is committed 00000004:00080000:1.0:1763333174.109583:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 917 committed 00000004:00080000:1.0:1763333174.109598:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 913 committed 00000004:00080000:1.0:1763333174.109616:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 912 committed 00000004:00080000:1.0:1763333174.109619:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 916 committed 00010000:00010000:1.0:1763333174.109713:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56133 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1ae:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696969c expref: 234 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.109729:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ae:0x0].0x0 (ffff92fe435f8f00) 00010000:00010000:1.0:1763333174.109732:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763333174.109737:0:8606:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c56141 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1ae:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696aa expref: 234 pid: 6521 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333174.109744:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe469a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627256192:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1763333174.109747:0:8606:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c56141 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x1ae:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696aa expref: 234 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.109754:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c56141 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1ae:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696aa expref: 234 pid: 6521 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333174.109768:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe469a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627256320:0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1763333174.109832:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56117 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1ae:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.109842:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56117 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1ae:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00000100:00100000:2.0:1763333174.109847:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe438aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627256448:0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1763333174.109850:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56117 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1ae:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.109856:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333174.109860:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56117 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1ae:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.109869:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56117 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1ae:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.109889:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ae:0x0].0x0 (ffff92fe435f8f00) 00010000:00010000:0.0:1763333174.109892:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333174.109897:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56117 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1ae:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.109904:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56117 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1ae:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000100:00100000:0.0:1763333174.109938:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe469a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627256064:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763333174.110097:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1763333174.110119:0:8606:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c56141 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1ae:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696aa expref: 233 pid: 6521 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333174.110133:0:8606:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff5004ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627256576:192.168.204.28@tcp:105: 00000100:00100000:1.0:1763333174.110146:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333174.110179:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627256192 00000100:00100000:1.0:1763333174.110188:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627256192 00000100:00100000:2.0:1763333174.110201:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333174.110241:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627256320 00000100:00100000:1.0:1763333174.110245:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627256320 00000100:00100000:2.0:1763333174.110248:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627256448 00000100:00100000:2.0:1763333174.110252:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627256448 00000100:00100000:1.0:1763333174.110269:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6482 00000100:00100000:2.0:1763333174.110278:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6483 00000100:00100000:1.0:1763333174.110279:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+40:3652:x1848987627256192:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763333174.110283:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50049f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+40:3653:x1848987627256320:12345-0@lo:2:osp-syn-0-1.0 00002000:00080000:1.0:1763333174.110315:0:28600:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:560 count 1 00010000:00010000:1.0:1763333174.110343:0:28600:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56148 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.110386:0:28600:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe48190e00/0xb32e3ef184c56006 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969641 expref: 25 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.110395:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333174.110398:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333174.110401:0:28600:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56148 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.110429:0:28600:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe48190e00/0xb32e3ef184c56006 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969641 expref: 25 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.110443:0:28600:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe48190e00/0xb32e3ef184c56006 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969641 expref: 25 pid: 28651 timeout: 1378 lvb_type: 0 00000100:00100000:1.0:1763333174.110454:0:28600:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff50048380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28600:1848987627256704:192.168.204.28@tcp:104: 00002000:00010000:2.0:1763333174.110522:0:8404:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x233:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333174.110526:0:8404:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x233:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1763333174.110528:0:8404:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x233:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333174.110530:0:8404:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x233:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1763333174.110533:0:8404:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x233:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333174.110538:0:28600:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff5119d780 going to sleep for 11 seconds 00000100:00100000:1.0:1763333174.110556:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6484 00000100:00100000:1.0:1763333174.110563:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+41:3654:x1848987627256448:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333174.110575:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50049f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+41:3653:x1848987627256320:12345-0@lo:2:osp-syn-0-1.0 Request processed in 291us (427us total) trans 21474838866 rc 0/0 00000100:00100000:2.0:1763333174.110583:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6483 00000004:00080000:2.0:1763333174.110639:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe469a1f80/2, rc 0, transno 21474838866 00000100:00100000:2.0:1763333174.110647:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe469a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627256320:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333174.110649:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+41:3654:x1848987627256448:12345-0@lo:2:osp-syn-0-1.0 Request processed in 88us (448us total) trans 21474838867 rc 0/0 00000100:00100000:1.0:1763333174.110656:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6484 00000004:00080000:2.0:1763333174.110666:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe438aa300/2, rc 0, transno 21474838867 00000100:00100000:2.0:1763333174.110670:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe438aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627256448:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333174.110734:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627257216:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333174.110760:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333174.110777:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1763333174.110783:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627256832:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763333174.110803:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333174.110805:0:8606:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7412bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1763333174.110821:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627257088:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333174.110842:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333174.110854:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1763333174.110860:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46e2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627256960:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763333174.110879:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333174.110910:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627257216 00000100:00100000:2.0:1763333174.110914:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627257216 00000100:00100000:0.0:1763333174.110918:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333174.110937:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627256832 00000100:00100000:2.0:1763333174.110940:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627256832 00000100:00100000:0.0:1763333174.111868:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627256960 00000100:00100000:0.0:1763333174.111876:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627256960 00000100:00100000:3.0:1763333174.111914:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627256064 00000100:00100000:3.0:1763333174.111919:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627256064 00000100:00100000:0.0:1763333174.111927:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6485 00000100:00100000:0.0:1763333174.111935:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+11:3654:x1848987627257216:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333174.111937:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6486 00000100:00100000:3.0:1763333174.111943:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+11:3654:x1848987627256832:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763333174.111957:0:8406:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:559 count 1 00010000:00010000:3.0:1763333174.111975:0:8406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c5614f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.111991:0:8406:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c55e23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695a0 expref: 14 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.111997:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333174.111999:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333174.112002:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c5614f lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.112031:0:8406:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c55e23 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695a0 expref: 14 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.112045:0:8406:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c55e23 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695a0 expref: 14 pid: 28600 timeout: 1378 lvb_type: 0 00000100:00100000:3.0:1763333174.112057:0:8406:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46a6e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8406:1848987627257344:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333174.112077:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+12:3654:x1848987627257216:12345-0@lo:2:osp-syn-1-1.0 Request processed in 143us (1316us total) trans 17179871561 rc 0/0 00000100:00100000:0.0:1763333174.112086:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6485 00000100:00100000:0.0:1763333174.112102:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6487 00000100:00100000:3.0:1763333174.112104:0:8406:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff49c92600 going to sleep for 11 seconds 00000100:00100000:0.0:1763333174.112108:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+11:3653:x1848987627256960:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1763333174.112118:0:28650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:560 count 1 00010000:00010000:0.0:1763333174.112129:0:28650:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c56156 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.112139:0:28650:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55fff lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696963a expref: 14 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.112146:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333174.112147:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333174.112150:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c56156 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.112279:0:28650:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55fff lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696963a expref: 14 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.112289:0:28650:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55fff lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696963a expref: 14 pid: 8404 timeout: 1378 lvb_type: 0 00000100:00100000:0.0:1763333174.112299:0:28650:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe43998a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28650:1848987627257472:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333174.112340:0:28650:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe43aa63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763333174.112381:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6488 00000100:00100000:0.0:1763333174.112389:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4399b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+41:3655:x1848987627256064:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1763333174.112402:0:8611:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:559 count 1 00010000:00010000:0.0:1763333174.112417:0:8611:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5615d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.112430:0:8611:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe48191400/0xb32e3ef184c5604c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696965d expref: 25 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.112436:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333174.112438:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333174.112440:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5615d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333174.112447:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627257088 00000100:00100000:2.0:1763333174.112452:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627257088 00010000:00010000:0.0:1763333174.112460:0:8611:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe48191400/0xb32e3ef184c5604c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696965d expref: 25 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.112468:0:8611:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe48191400/0xb32e3ef184c5604c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696965d expref: 25 pid: 28651 timeout: 1378 lvb_type: 0 00000100:00100000:2.0:1763333174.112473:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6489 00000100:00100000:2.0:1763333174.112479:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+12:3653:x1848987627257088:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333174.112480:0:8611:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe43999500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8611:1848987627257600:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333174.112534:0:8611:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe43aa6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1763333174.114003:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+13:3653:x1848987627257088:12345-0@lo:2:osp-syn-1-1.0 Request processed in 1517us (3153us total) trans 17179871562 rc 0/0 00000100:00100000:2.0:1763333174.114015:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6489 00000004:00080000:2.0:1763333174.114095:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe46e2df80/2, rc 0, transno 17179871561 00000100:00100000:2.0:1763333174.114102:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627257216:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1763333174.114313:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe46e2d500/2, rc 0, transno 17179871562 00000100:00100000:0.0:1763333174.114319:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627257088:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333174.116920:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333174.116952:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613682688 00000100:00100000:0.0:1763333174.116952:0:8406:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46a6e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8406:1848987627257344:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333174.116959:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613682688 00010000:00010000:0.0:1763333174.116985:0:8406:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c5614f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333174.117012:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3154 00000100:00100000:3.0:1763333174.117027:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:56851:x1848987613682688:12345-192.168.204.28@tcp:49:lfs.0 00000100:00100000:3.0:1763333174.117166:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:56851:x1848987613682688:12345-192.168.204.28@tcp:49:lfs.0 Request processed in 145us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333174.117226:0:28600:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff50048380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28600:1848987627256704:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333174.117243:0:28600:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56148 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333174.117331:0:8606:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff5004ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627256576:192.168.204.28@tcp:105: 00010000:00010000:2.0:1763333174.117396:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5612c lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1ae:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696969c expref: 234 pid: 8606 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1763333174.117421:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56133 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1ae:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696969c expref: 233 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.117443:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7fe00, rc 0) 00000100:00100000:2.0:1763333174.117469:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:55917:x1848987613682048:12345-192.168.204.28@tcp:101:bash.0 Request processed in 22505us (22786us total) trans 4294972250 rc 0/0 00000100:00100000:2.0:1763333174.117480:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9234 00000100:00100000:2.0:1763333174.117557:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333174.117633:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.117677:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613682816 00000100:00100000:0.0:1763333174.117682:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613682816 00010000:00010000:0.0:1763333174.117710:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c55e23 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695a0 expref: 15 pid: 28600 timeout: 1378 lvb_type: 0 00000100:00100000:0.0:1763333174.117734:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613682560 00000100:00100000:0.0:1763333174.117737:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613682560 00010000:00010000:0.0:1763333174.117750:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe48190e00/0xb32e3ef184c56006 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969641 expref: 26 pid: 28651 timeout: 1378 lvb_type: 0 00000100:00100000:0.0:1763333174.117779:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3033 00000100:00100000:0.0:1763333174.117787:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2418:x1848987613682816:12345-192.168.204.28@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1763333174.117795:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3034 00010000:00010000:0.0:1763333174.117799:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1763333174.117802:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+26:2418:x1848987613682560:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333174.117805:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c55e23 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x22f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695a0 expref: 15 pid: 28600 timeout: 1378 lvb_type: 0 00010000:00010000:1.0:1763333174.117810:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333174.117814:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe48190e00/0xb32e3ef184c56006 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x230:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969641 expref: 26 pid: 28651 timeout: 1378 lvb_type: 0 00010000:00010000:0.0:1763333174.117816:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c55e23 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x22f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695a0 expref: 15 pid: 28600 timeout: 1378 lvb_type: 0 00010000:00010000:1.0:1763333174.117825:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe48190e00/0xb32e3ef184c56006 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x230:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969641 expref: 26 pid: 28651 timeout: 1378 lvb_type: 0 00010000:00010000:0.0:1763333174.117836:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c55e23 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x22f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369695a0 expref: 15 pid: 28600 timeout: 1378 lvb_type: 0 00010000:00010000:1.0:1763333174.117838:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe48190e00/0xb32e3ef184c56006 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x230:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969641 expref: 26 pid: 28651 timeout: 1378 lvb_type: 0 00010000:00010000:1.0:1763333174.117852:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333174.117852:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333174.117854:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333174.117855:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333174.117860:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56148 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.117860:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c5614f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.117872:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56148 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.117872:0:28428:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c5614f lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.117893:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333174.117893:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333174.117923:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:2418:x1848987613682560:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 121us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333174.117929:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3034 00010000:00010000:1.0:1763333174.117951:0:28600:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56148 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.117960:0:28600:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56148 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.117970:0:28600:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56148 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.117978:0:28600:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56148 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.117994:0:28600:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763333174.118327:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3154 00000100:00100000:0.0:1763333174.118829:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2418:x1848987613682816:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 1040us (1270us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333174.118836:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3033 00010000:00010000:0.0:1763333174.118865:0:8406:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c5614f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.118874:0:8406:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c5614f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.118882:0:8406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c5614f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.118888:0:8406:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c5614f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.118905:0:8406:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1763333174.119624:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+42:3652:x1848987627256192:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9340us (9521us total) trans 21474838868 rc 0/0 00000100:00100000:1.0:1763333174.119635:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6482 00010000:00010000:1.0:1763333174.119663:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1763333174.119672:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56148 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.119682:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7ec00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333174.119686:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56148 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.119695:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56148 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.119714:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56148 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.119727:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56148 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.119750:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333174.119754:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c5614f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.119760:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97200 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333174.119763:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c5614f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.119770:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c5614f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.119780:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c5614f lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.119787:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c5614f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.119800:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333174.119802:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333174.119804:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763333174.121807:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe469a0700/2, rc 0, transno 21474838868 00000100:00100000:2.0:1763333174.121823:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe469a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627256192:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1763333174.122402:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763333174.122470:0:8611:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe43999500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8611:1848987627257600:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333174.122505:0:8611:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5615d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333174.124425:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333174.124511:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613683072 00000100:00100000:3.0:1763333174.124522:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613683072 00010000:00010000:3.0:1763333174.124570:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55fff lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696963a expref: 14 pid: 8404 timeout: 1378 lvb_type: 0 00000100:00100000:3.0:1763333174.124618:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3035 00000100:00100000:3.0:1763333174.124627:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2420:x1848987613683072:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333174.124644:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333174.124650:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55fff lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x230:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696963a expref: 14 pid: 8404 timeout: 1378 lvb_type: 0 00010000:00010000:3.0:1763333174.124669:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55fff lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x230:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696963a expref: 14 pid: 8404 timeout: 1378 lvb_type: 0 00010000:00010000:3.0:1763333174.124697:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333174.124699:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333174.124705:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c56156 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x230:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.124715:0:6506:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c56156 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x230:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.124737:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333174.124784:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2420:x1848987613683072:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 157us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333174.124792:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3035 00010000:00010000:1.0:1763333174.124906:0:28650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c55fff lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696963a expref: 13 pid: 8404 timeout: 1378 lvb_type: 0 00000100:00100000:1.0:1763333174.124922:0:28650:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe43998a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28650:1848987627257472:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333174.124947:0:28650:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c56156 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.124957:0:28650:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c56156 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.124964:0:28650:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c56156 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.124976:0:28650:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c56156 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.124984:0:28650:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c56156 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.125000:0:28650:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763333174.125331:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+14:3653:x1848987627256960:12345-0@lo:6:osp-syn-1-1.0 Request processed in 13221us (14448us total) trans 17179871564 rc 0/0 00000100:00100000:1.0:1763333174.125341:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6487 00000004:00080000:1.0:1763333174.125419:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe46e2ea00/2, rc 0, transno 17179871564 00000100:00100000:1.0:1763333174.125426:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46e2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627256960:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1763333174.125506:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333174.125514:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c56156 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.125523:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdfe00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333174.125527:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c56156 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.125538:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c56156 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.125553:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c56156 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.125562:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c56156 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.125583:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333174.125585:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333174.125587:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763333174.126279:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333174.126316:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.126424:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+13:3654:x1848987627256832:12345-0@lo:6:osp-syn-1-1.0 Request processed in 14477us (15616us total) trans 17179871563 rc 0/0 00000100:00100000:0.0:1763333174.126434:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6486 00000004:00080000:0.0:1763333174.126473:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe46e2c380/2, rc 0, transno 17179871563 00000100:00100000:0.0:1763333174.126477:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627256832:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763333174.126479:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613682944 00000100:00100000:2.0:1763333174.126485:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613682944 00010000:00010000:2.0:1763333174.126523:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe48191400/0xb32e3ef184c5604c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696965d expref: 25 pid: 28651 timeout: 1378 lvb_type: 0 00000100:00100000:2.0:1763333174.126557:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3036 00000100:00100000:2.0:1763333174.126566:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff51e56850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:2420:x1848987613682944:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333174.126580:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333174.126585:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe48191400/0xb32e3ef184c5604c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696965d expref: 25 pid: 28651 timeout: 1378 lvb_type: 0 00010000:00010000:2.0:1763333174.126596:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe48191400/0xb32e3ef184c5604c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696965d expref: 25 pid: 28651 timeout: 1378 lvb_type: 0 00010000:00010000:2.0:1763333174.126615:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe48191400/0xb32e3ef184c5604c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696965d expref: 25 pid: 28651 timeout: 1378 lvb_type: 0 00010000:00010000:2.0:1763333174.126633:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333174.126635:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333174.126640:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5615d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.126650:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5615d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.126686:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333174.126707:0:8611:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5615d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.126716:0:8611:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5615d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.126726:0:8611:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5615d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333174.126729:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff51e56850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:2420:x1848987613682944:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 165us (455us total) trans 0 rc 0/0 00010000:00010000:0.0:1763333174.126734:0:8611:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5615d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333174.126736:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3036 00010000:00010000:0.0:1763333174.126764:0:8611:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763333174.126882:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.127076:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4399b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+42:3655:x1848987627256064:12345-0@lo:6:osp-syn-0-1.0 Request processed in 14687us (16157us total) trans 21474838869 rc 0/0 00000100:00100000:0.0:1763333174.127084:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6488 00000100:00100000:0.0:1763333174.127102:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613683456 00000100:00100000:0.0:1763333174.127106:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613683456 00000100:00100000:0.0:1763333174.127129:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6490 00000100:00100000:0.0:1763333174.127136:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:55917:x1848987613683456:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333174.127153:0:8611:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333174.127171:0:8611:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdee00/0xb32e3ef184c56164 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x233:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369696b1 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1763333174.127183:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe469a3b80/2, rc 0, transno 21474838869 00000100:00100000:3.0:1763333174.127189:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe469a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627256064:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1763333174.127193:0:8611:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c5613a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x233:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696a3 expref: 25 pid: 28600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333174.127199:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333174.127201:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333174.127205:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdee00/0xb32e3ef184c56164 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x233:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696b1 expref: 25 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.127239:0:8611:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c5613a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x233:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696a3 expref: 25 pid: 28600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333174.127251:0:8611:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c5613a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x233:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696a3 expref: 25 pid: 28600 timeout: 1378 lvb_type: 1 00000100:00100000:0.0:1763333174.127266:0:8611:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe43999c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8611:1848987627257728:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333174.127323:0:8611:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe43aa6b40 going to sleep for 11 seconds 00010000:00010000:0.0:1763333174.127337:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333174.127344:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5615d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.127390:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf200 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333174.127394:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5615d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.127405:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5615d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.127419:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5615d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.127426:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5615d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.127444:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333174.127447:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333174.127449:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763333174.131065:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613683328 00000100:00100000:1.0:1763333174.131079:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613683328 00000100:00100000:1.0:1763333174.131150:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3155 00000100:00100000:1.0:1763333174.131161:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56851:x1848987613683328:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1763333174.131459:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56851:x1848987613683328:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 298us (5139us total) trans 4294972251 rc 0/0 00000100:00100000:1.0:1763333174.131467:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3155 00000100:00100000:3.0:1763333174.137429:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.137482:0:8611:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe43999c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8611:1848987627257728:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333174.137531:0:8611:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdee00/0xb32e3ef184c56164 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x233:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696b1 expref: 25 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.137557:0:8611:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdee00, rc 0) 00000100:00100000:0.0:1763333174.137637:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:55917:x1848987613683456:12345-192.168.204.28@tcp:101:bash.0 Request processed in 10500us (10754us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333174.137647:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6490 00000100:00100000:2.0:1763333174.137780:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613683712 00000100:00100000:2.0:1763333174.137788:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613683712 00000100:00100000:2.0:1763333174.137842:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9236 00000100:00100000:2.0:1763333174.137852:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56851:x1848987613683712:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333174.137875:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333174.137901:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5616b lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369696b8 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.137979:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56172 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333174.137993:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56172 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333174.138005:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56172 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333174.138019:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56179 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333174.138026:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56179 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333174.138033:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56179 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333174.138153:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56180 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333174.138163:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56180 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333174.138170:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56180 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:2.0:1763333174.138181:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ae:0x0]: returning size 2 00010000:00010000:2.0:1763333174.138276:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56172 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333174.138283:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56172 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333174.138290:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56172 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333174.138297:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56172 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333174.138303:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333174.138307:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56172 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333174.138316:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56172 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333174.138329:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31e00) 00010000:00010000:2.0:1763333174.138333:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333174.138339:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56172 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333174.138344:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56172 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333174.138435:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56179 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333174.138443:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56179 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333174.138448:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56179 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333174.138453:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333174.138456:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56179 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333174.138462:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56179 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333174.138469:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43a31900) 00010000:00010000:2.0:1763333174.138472:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333174.138474:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56179 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333174.138479:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56179 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333174.138536:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5616b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696b8 expref: 236 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.138550:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56180 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696b8 expref: 235 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.138557:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ae:0x0].0x0 (ffff92fe435f8f00) 00010000:00010000:2.0:1763333174.138560:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333174.138562:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5400, rc 0) 00000100:00100000:2.0:1763333174.138605:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:56851:x1848987613683712:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 755us (1189us total) trans 4294972252 rc 0/0 00000100:00100000:2.0:1763333174.138612:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9236 00000100:00100000:3.0:1763333174.138653:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333174.138866:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613683840 00000100:00100000:2.0:1763333174.138871:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613683840 00010000:00010000:2.0:1763333174.138892:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c5613a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x233:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696a3 expref: 25 pid: 28600 timeout: 1378 lvb_type: 1 00000100:00100000:2.0:1763333174.139209:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3037 00000100:00100000:2.0:1763333174.139220:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:2420:x1848987613683840:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333174.139232:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333174.139238:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c5613a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x233:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696a3 expref: 25 pid: 28600 timeout: 1378 lvb_type: 1 00010000:00010000:2.0:1763333174.139250:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c5613a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x233:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696a3 expref: 25 pid: 28600 timeout: 1378 lvb_type: 1 00010000:00010000:2.0:1763333174.139269:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e600/0xb32e3ef184c5613a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x233:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696a3 expref: 25 pid: 28600 timeout: 1378 lvb_type: 1 00010000:00010000:2.0:1763333174.139281:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333174.139283:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333174.139291:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdee00/0xb32e3ef184c56164 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x233:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696b1 expref: 24 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.139302:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdee00/0xb32e3ef184c56164 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x233:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696b1 expref: 24 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.139339:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdee00/0xb32e3ef184c56164 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x233:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696b1 expref: 24 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333174.139398:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4920f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6505:1848987627257856:192.168.204.28@tcp:105: 00000100:00100000:2.0:1763333174.140648:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff43ef5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1763333174.144037:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333174.144119:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613684096 00000100:00100000:2.0:1763333174.144131:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613684096 00000100:00100000:2.0:1763333174.144199:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3156 00000100:00100000:2.0:1763333174.144211:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bd5f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:56851:x1848987613684096:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333174.144481:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bd5f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56851:x1848987613684096:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 271us (454us total) trans 4294972253 rc 0/0 00000100:00100000:2.0:1763333174.144500:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3156 00000100:00100000:1.0:1763333174.145798:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.145918:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613684224 00000100:00100000:0.0:1763333174.145926:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613684224 00000100:00100000:0.0:1763333174.145979:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6491 00000100:00100000:0.0:1763333174.145990:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50048380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:55917:x1848987613684224:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333174.146005:0:8611:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333174.146028:0:8611:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c5618e lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369696bf expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763333174.146054:0:8611:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x233:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333174.146078:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333174.146081:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333174.146091:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c5618e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696bf expref: 14 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.146109:0:8611:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c5618e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696bf expref: 14 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.146128:0:8611:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdfe00, rc 0) 00000100:00100000:0.0:1763333174.146186:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50048380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:55917:x1848987613684224:12345-192.168.204.28@tcp:101:bash.0 Request processed in 197us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333174.146193:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6491 00000100:00100000:2.0:1763333174.146309:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4920f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6505:1848987627257856:192.168.204.28@tcp:105: 00010000:00010000:2.0:1763333174.146335:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333174.146398:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:2420:x1848987613683840:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 7179us (7744us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333174.146408:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3037 00000100:00100000:0.0:1763333174.149808:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.149914:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613684352 00000100:00100000:1.0:1763333174.149925:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613684352 00000100:00100000:1.0:1763333174.149986:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3157 00000100:00100000:1.0:1763333174.149996:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56851:x1848987613684352:12345-192.168.204.28@tcp:33:lfs.0 00000100:00100000:1.0:1763333174.150186:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56851:x1848987613684352:12345-192.168.204.28@tcp:33:lfs.0 Request processed in 189us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333174.150194:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3157 00000100:00100000:3.0:1763333174.150928:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333174.150967:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.152852:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613684480 00000100:00100000:1.0:1763333174.152870:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613684480 00002000:00010000:1.0:1763333174.152928:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/563 (0->18446744073709551615) 00002000:00100000:1.0:1763333174.152934:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe46a6ca80 with x1848987613684480 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333174.152951:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe46a6ca80. 00000100:00100000:1.0:1763333174.152988:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613684608 00000100:00100000:1.0:1763333174.152992:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613684608 00002000:00010000:1.0:1763333174.153011:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/563 (0->18446744073709551615) 00002000:00100000:1.0:1763333174.153014:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe46a6ce00 with x1848987613684608 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333174.153020:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe46a6ce00. 00000100:00100000:1.0:1763333174.153051:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1605 00000100:00100000:1.0:1763333174.153063:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:2421:x1848987613684480:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:1.0:1763333174.153315:0:28427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x233:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333174.153319:0:28427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x233:0x0] updating lvb mtime from disk: 0 -> 1763333174 00002000:00010000:1.0:1763333174.153322:0:28427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x233:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333174.153325:0:28427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x233:0x0] updating lvb ctime from disk: 0 -> 1763333174 00002000:00010000:1.0:1763333174.153327:0:28427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x233:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333174.153430:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:2421:x1848987613684480:12345-192.168.204.28@tcp:10:bash.0 Request processed in 367us (2503us total) trans 21474838870 rc 0/0 00000100:00100000:1.0:1763333174.153437:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1605 00002000:00010000:1.0:1763333174.153442:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/563 (0->18446744073709551615) 00002000:00100000:1.0:1763333174.153445:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe46a6ca80 with x1848987613684480 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333174.153449:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe46a6ca80. 00000100:00100000:1.0:1763333174.153470:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1606 00000100:00100000:1.0:1763333174.153478:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2421:x1848987613684608:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:1.0:1763333174.153587:0:28427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x233:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333174.153590:0:28427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x233:0x0] updating lvb mtime from disk: 0 -> 1763333174 00002000:00010000:1.0:1763333174.153592:0:28427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x233:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333174.153594:0:28427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x233:0x0] updating lvb ctime from disk: 0 -> 1763333174 00002000:00010000:1.0:1763333174.153596:0:28427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x233:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333174.153617:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2421:x1848987613684608:12345-192.168.204.28@tcp:10:bash.0 Request processed in 140us (2650us total) trans 17179871565 rc 0/0 00000100:00100000:1.0:1763333174.153623:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1606 00002000:00010000:1.0:1763333174.153626:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/563 (0->18446744073709551615) 00002000:00100000:1.0:1763333174.153628:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe46a6ce00 with x1848987613684608 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333174.153632:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe46a6ce00. 00000100:00100000:3.0:1763333174.159110:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333174.159449:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613684864 00000100:00100000:2.0:1763333174.159460:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613684864 00000100:00100000:2.0:1763333174.162651:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3158 00000100:00100000:2.0:1763333174.162682:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:55917:x1848987613684864:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:2.0:1763333174.163075:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:55917:x1848987613684864:12345-192.168.204.28@tcp:35:bash.0 Request processed in 408us (3972us total) trans 4294972254 rc 0/0 00000100:00100000:2.0:1763333174.163084:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3158 00000100:00100000:0.0:1763333174.166997:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333174.167077:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613685120 00000100:00100000:2.0:1763333174.167088:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613685120 00000100:00100000:2.0:1763333174.167149:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9237 00000100:00100000:2.0:1763333174.167162:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4399b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56856:x1848987613685120:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333174.167185:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333174.167209:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56195 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369696c6 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.167331:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5619c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333174.167382:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5619c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x1ae:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333174.167396:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5619c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x1ae:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:2.0:1763333174.167408:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ae:0x0]: returning size 5 00010000:00010000:2.0:1763333174.167544:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56195 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1ae:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696c6 expref: 240 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.167562:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5619c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1ae:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696c6 expref: 239 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.167571:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ae:0x0].0x0 (ffff92fe435f8f00) 00010000:00010000:2.0:1763333174.167574:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1763333174.167579:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4000, rc 0) 00000100:00100000:2.0:1763333174.167654:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4399b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56856:x1848987613685120:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 494us (668us total) trans 4294972255 rc 0/0 00000100:00100000:2.0:1763333174.167661:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9237 00000100:00100000:3.0:1763333174.173647:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333174.174328:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613685376 00000100:00100000:2.0:1763333174.174341:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613685376 00000100:00100000:3.0:1763333174.174513:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.175715:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613685504 00000100:00100000:1.0:1763333174.175726:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613685504 00000100:00100000:1.0:1763333174.175784:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9238 00000100:00100000:1.0:1763333174.175797:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:56857:x1848987613685376:12345-192.168.204.28@tcp:36:rm.0 00000100:00100000:0.0:1763333174.175941:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9239 00000100:00100000:0.0:1763333174.175954:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:56856:x1848987613685504:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333174.176074:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1763333174.176104:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56133 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1ae:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696969c expref: 240 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.176126:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c56141 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1ae:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696aa expref: 239 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.176140:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56180 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696b8 expref: 238 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.176153:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56109 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969687 expref: 237 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.176165:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ae:0x0].0x0 (ffff92fe435f8f00) 00010000:00010000:1.0:1763333174.176171:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333174.176205:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c561aa lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333174.176218:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c561aa lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.176229:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c561aa lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.176242:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c561b1 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333174.176255:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c561b1 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.176261:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c561b1 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.176406:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c561b8 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333174.176419:0:8606:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5619c lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x1ae:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696c6 expref: 236 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.176429:0:8606:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c561b8 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1ae:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.176469:0:8606:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5619c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1ae:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696c6 expref: 236 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.176485:0:8606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5619c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1ae:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696c6 expref: 236 pid: 8606 timeout: 1378 lvb_type: 0 00000100:00100000:1.0:1763333174.176515:0:8606:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff5004ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627257984:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333174.176605:0:8606:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff5119d780 going to sleep for 11 seconds 00010000:00010000:0.0:1763333174.176691:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333174.176704:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c561bf lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369696cd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.176783:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c561c6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333174.176793:0:6521:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c561b8 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ae:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.176799:0:6521:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c561c6 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.176810:0:6521:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c561b8 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1ae:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.176821:0:6521:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c561c6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000100:00100000:2.0:1763333174.179601:0:8606:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff5004ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627257984:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333174.179631:0:8606:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c561b8 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ae:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8606 initiator: MDT1 00000100:00100000:0.0:1763333174.180223:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333174.180304:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613685632 00000100:00100000:2.0:1763333174.180314:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613685632 00010000:00010000:2.0:1763333174.180395:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5619c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1ae:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696c6 expref: 238 pid: 8606 timeout: 1378 lvb_type: 0 00000100:00100000:2.0:1763333174.180438:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3038 00000100:00100000:2.0:1763333174.180450:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4399bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:2420:x1848987613685632:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333174.180467:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333174.180474:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5619c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1ae:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696c6 expref: 238 pid: 8606 timeout: 1378 lvb_type: 0 00010000:00010000:2.0:1763333174.180496:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5619c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1ae:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696c6 expref: 238 pid: 8606 timeout: 1378 lvb_type: 0 00010000:00010000:2.0:1763333174.180523:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5619c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1ae:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696c6 expref: 238 pid: 8606 timeout: 1378 lvb_type: 0 00010000:00010000:2.0:1763333174.180540:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ae:0x0].0x0 (ffff92fe435f8f00) 00010000:00010000:2.0:1763333174.180546:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c561b8 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ae:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333174.180557:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c561b8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ae:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333174.180565:0:6505:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c561b8 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1ae:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333174.180573:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c561c6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333174.180580:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c561c6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333174.180585:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c561c6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333174.180614:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333174.180679:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4399bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:2420:x1848987613685632:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 231us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333174.180688:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3038 00010000:00010000:1.0:1763333174.181245:0:8606:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c561b8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ae:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.181256:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c561b8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ae:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8606 initiator: MDT1 00000004:00080000:1.0:1763333174.181571:0:8606:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x1ae:0x0] is inserted into orphan list, open count = 1 00010000:00010000:1.0:1763333174.181662:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c561b8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ae:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.181672:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c561b8 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1ae:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.181678:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c561b8 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1ae:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.181684:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333174.181688:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c561b8 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1ae:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.181696:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c561b8 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1ae:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.181707:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ae:0x0].0x0 (ffff92fe435f8f00) 00010000:00010000:1.0:1763333174.181710:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763333174.181713:0:8606:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c561c6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.181721:0:8606:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c561c6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.181727:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c561c6 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.181760:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c561b8 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1ae:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.181767:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c561b8 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1ae:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.181782:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c561aa lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.181787:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c561aa lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.181793:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c561aa lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.181799:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c561aa lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.181803:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7ec00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333174.181806:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c561aa lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.181812:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c561aa lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.181819:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43978f00) 00010000:00010000:1.0:1763333174.181822:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333174.181824:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c561aa lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.181830:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c561aa lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000004:00010000:1.0:1763333174.181845:0:8606:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e4a03aca reply state 00000000fb1a3d8c transno 4294972256 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c561b1 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.181856:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c561b1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.181862:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43978000) 00010000:00010000:1.0:1763333174.181864:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333174.181867:0:8606:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763333174.181940:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56857:x1848987613685376:12345-192.168.204.28@tcp:36:rm.0 Request processed in 6143us (8308us total) trans 4294972256 rc 0/0 00000100:00100000:1.0:1763333174.181953:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9238 00010000:00010000:0.0:1763333174.182033:0:6521:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c561c6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.182041:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c561c6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:0.0:1763333174.182067:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ae:0x0]: returning size 5 00000004:00200000:0.0:1763333174.182071:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763333174.182086:0:6521:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c561c6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.182113:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c561bf lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1ae:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696cd expref: 238 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.182129:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191400/0xb32e3ef184c561c6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696cd expref: 237 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.182138:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ae:0x0].0x0 (ffff92fe435f8f00) 00010000:00010000:0.0:1763333174.182141:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333174.182144:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48191400, rc 0) 00000100:00100000:0.0:1763333174.182187:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56856:x1848987613685504:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 6237us (7674us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333174.182194:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9239 00000100:00100000:3.0:1763333174.189459:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333174.189560:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613685888 00000100:00100000:2.0:1763333174.189572:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613685888 00000100:00100000:2.0:1763333174.189633:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3159 00000100:00100000:2.0:1763333174.189644:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56856:x1848987613685888:12345-192.168.204.28@tcp:35:lfs.0 00000004:00080000:2.0:1763333174.189900:0:35317:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x1ae:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1763333174.189987:0:35317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1400, 64 off118176 00000040:00080000:2.0:1763333174.190016:0:35317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1399, 64 off118176 00000040:00080000:2.0:1763333174.190025:0:35317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1400, 64 off118240 00000040:00080000:2.0:1763333174.190033:0:35317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1401, 64 off118240 00010000:00010000:2.0:1763333174.190092:0:35317:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c561cd lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35317 initiator: MDT0 00010000:00010000:2.0:1763333174.190114:0:35317:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c561cd lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ae:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 35317 initiator: MDT1 00010000:00010000:2.0:1763333174.190126:0:35317:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c561cd lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ae:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 35317 initiator: MDT1 00010000:00010000:2.0:1763333174.190135:0:35317:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c561cd lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1ae:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 35317 initiator: MDT1 00010000:00010000:2.0:1763333174.190141:0:35317:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c561cd lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1ae:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 35317 initiator: MDT1 00010000:00010000:2.0:1763333174.190147:0:35317:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c561cd lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1ae:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 35317 initiator: MDT1 00010000:00010000:2.0:1763333174.190174:0:35317:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763333174.190407:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56856:x1848987613685888:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 762us (956us total) trans 4294972257 rc 0/0 00000100:00100000:2.0:1763333174.190416:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3159 00010000:00010000:1.0:1763333174.191527:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333174.191539:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c561cd lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1ae:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 35317 initiator: MDT1 00010000:00010000:1.0:1763333174.191551:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333174.191557:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c561cd lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1ae:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 35317 initiator: MDT1 00010000:00010000:1.0:1763333174.191564:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c561cd lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1ae:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 35317 initiator: MDT1 00010000:00010000:1.0:1763333174.191581:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ae:0x0].0x0 (ffff92fe435f8f00) 00010000:00010000:1.0:1763333174.191588:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1763333174.191594:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c561cd lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1ae:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 35317 initiator: MDT1 00010000:00010000:1.0:1763333174.191600:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c561cd lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1ae:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 35317 initiator: MDT1 00010000:00010000:1.0:1763333174.191614:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333174.191617:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333174.191619:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763333174.194302:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.194513:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613686016 00000100:00100000:0.0:1763333174.194524:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613686016 00000100:00100000:0.0:1763333174.194590:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9240 00000100:00100000:0.0:1763333174.194602:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5004ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56856:x1848987613686016:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333174.194630:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333174.194656:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c561d4 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369696d4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.194735:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c561db lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333174.194750:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c561db lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.194761:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c561db lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.194773:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c561e2 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333174.194781:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c561e2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.194787:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c561e2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.194836:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c561db lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.194842:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c561db lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.194848:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c561db lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.194854:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c561db lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.194859:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48190c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333174.194863:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c561db lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.194873:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c561db lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.194884:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44b00) 00010000:00010000:0.0:1763333174.194888:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333174.194893:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c561db lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.194898:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c561db lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.194910:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c561e2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.194915:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c561e2 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.194921:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c561e2 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.194925:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48190200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333174.194927:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c561e2 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.194932:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c561e2 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.194938:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43978000) 00010000:00010000:0.0:1763333174.194941:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333174.194943:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c561e2 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.194961:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c561e2 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.194991:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c561d4 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696d4 expref: 239 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.195000:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44b00) 00010000:00010000:0.0:1763333174.195003:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333174.195007:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c561d4 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696d4 expref: 239 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.195019:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48190e00, rc 0) 00000100:00100000:0.0:1763333174.195084:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5004ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56856:x1848987613686016:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 484us (792us total) trans 0 rc 301/301 00000100:00100000:0.0:1763333174.195091:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9240 00000100:00100000:3.0:1763333174.201290:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.204971:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613686144 00000100:00100000:1.0:1763333174.204990:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613686144 00000100:00100000:0.0:1763333174.205125:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9241 00000100:00100000:0.0:1763333174.205136:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56858:x1848987613686144:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333174.205158:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333174.205184:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c561e9 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369696db expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.205254:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c561f0 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333174.205268:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c561f0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.205278:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c561f0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.205288:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c561f7 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333174.205295:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c561f7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.205300:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c561f7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.205334:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c561f0 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.205340:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c561f0 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.205345:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c561f0 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.205373:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c561f0 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.205379:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48191600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333174.205383:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c561f0 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.205389:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c561f0 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.205400:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:0.0:1763333174.205402:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333174.205408:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c561f0 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.205413:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c561f0 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.205424:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c561f7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.205430:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c561f7 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.205435:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c561f7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.205439:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48191800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333174.205441:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c561f7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.205446:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c561f7 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.205451:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43978000) 00010000:00010000:0.0:1763333174.205453:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333174.205456:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c561f7 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.205460:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c561f7 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.205485:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c561e9 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696db expref: 239 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.205504:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:0.0:1763333174.205508:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333174.205511:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c561e9 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696db expref: 239 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.205526:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48190400, rc 0) 00000100:00100000:0.0:1763333174.205591:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56858:x1848987613686144:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 455us (4311us total) trans 0 rc 301/301 00000100:00100000:0.0:1763333174.205599:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9241 00000100:00100000:3.0:1763333174.207763:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.208291:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613686272 00000100:00100000:1.0:1763333174.208303:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613686272 00000100:00100000:1.0:1763333174.208397:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9242 00000100:00100000:1.0:1763333174.208410:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56858:x1848987613686272:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333174.208431:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333174.208457:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c561fe lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369696e2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.208537:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56205 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333174.208550:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56205 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.208561:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56205 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.208571:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5620c lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333174.208578:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5620c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.208584:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5620c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.208625:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56205 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.208631:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56205 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.208637:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56205 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.208644:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56205 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.208649:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333174.208652:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56205 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.208660:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56205 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.208671:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43978f00) 00010000:00010000:1.0:1763333174.208674:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333174.208679:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56205 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.208685:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56205 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.208697:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5620c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.208703:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5620c lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.208709:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5620c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.208726:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333174.208729:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5620c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.208735:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5620c lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.208742:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43978000) 00010000:00010000:1.0:1763333174.208744:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333174.208747:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5620c lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.208752:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5620c lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.208780:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c561fe lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696e2 expref: 239 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.208790:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43978f00) 00010000:00010000:1.0:1763333174.208792:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333174.208795:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c561fe lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696e2 expref: 239 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.208808:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f200, rc 0) 00000100:00100000:1.0:1763333174.208872:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56858:x1848987613686272:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 465us (1116us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333174.208879:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9242 00000100:00100000:1.0:1763333174.212189:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.212282:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613686400 00000100:00100000:0.0:1763333174.212293:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613686400 00000100:00100000:1.0:1763333174.212461:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9243 00000100:00100000:1.0:1763333174.212472:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56858:x1848987613686400:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333174.212501:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333174.212526:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56213 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369696e9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.212593:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5621a lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333174.212608:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5621a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.212619:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5621a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:1.0:1763333174.212672:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1763333174.212678:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1763333174.212716:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56213 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696e9 expref: 240 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.212736:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5621a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696e9 expref: 239 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.212745:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43978800) 00010000:00010000:1.0:1763333174.212747:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1763333174.212752:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7fc00, rc 0) 00000100:00100000:1.0:1763333174.212826:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56858:x1848987613686400:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 355us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333174.212833:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9243 00000100:00100000:3.0:1763333174.218017:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.219243:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613686656 00000100:00100000:0.0:1763333174.219255:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613686656 00000100:00100000:0.0:1763333174.220420:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9244 00000100:00100000:0.0:1763333174.220442:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56859:x1848987613686656:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333174.220468:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333174.220505:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c56221 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369696f0 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.220598:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56228 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333174.220614:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56228 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.220627:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56228 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.220640:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c5622f lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333174.220648:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c5622f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.220655:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c5622f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.220697:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56228 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.220711:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56228 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.220717:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56228 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.220724:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56228 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.220729:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48191800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333174.220733:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56228 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.220741:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56228 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.220755:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43978800) 00010000:00010000:0.0:1763333174.220758:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333174.220763:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56228 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.220770:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56228 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.220784:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c5622f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.220791:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c5622f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.220797:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c5622f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.220803:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48191600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333174.220807:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c5622f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.220812:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c5622f lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.220820:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43978000) 00010000:00010000:0.0:1763333174.220822:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333174.220825:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c5622f lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.220831:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c5622f lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.220863:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c56221 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696f0 expref: 240 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.220873:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43978800) 00010000:00010000:0.0:1763333174.220876:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763333174.220879:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c56221 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696f0 expref: 240 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.220888:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48190400, rc 0) 00000100:00100000:0.0:1763333174.221942:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56859:x1848987613686656:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1504us (3932us total) trans 0 rc 301/301 00000100:00100000:0.0:1763333174.221964:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9244 00000100:00100000:2.0:1763333174.228319:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.228693:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613686784 00000100:00100000:1.0:1763333174.228704:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613686784 00000100:00100000:1.0:1763333174.228770:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9245 00000100:00100000:1.0:1763333174.228781:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56858:x1848987613686784:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333174.228801:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333174.228825:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56236 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369696f7 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.228894:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5623d lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333174.228908:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5623d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.228920:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5623d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.228930:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56244 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333174.228936:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56244 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.228942:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56244 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.228994:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5623d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.229002:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5623d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.229008:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5623d lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.229015:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5623d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.229021:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333174.229025:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5623d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.229032:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5623d lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.229045:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43978800) 00010000:00010000:1.0:1763333174.229048:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333174.229053:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5623d lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.229060:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5623d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.229072:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56244 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.229078:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56244 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.229084:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56244 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.229088:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333174.229091:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56244 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.229096:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56244 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.229103:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43978000) 00010000:00010000:1.0:1763333174.229105:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333174.229107:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56244 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.229113:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56244 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.229141:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56236 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696f7 expref: 240 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.229151:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43978800) 00010000:00010000:1.0:1763333174.229153:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333174.229157:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56236 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696f7 expref: 240 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.229184:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f800, rc 0) 00000100:00100000:1.0:1763333174.229262:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56858:x1848987613686784:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 482us (954us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333174.229269:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9245 00000100:00100000:2.0:1763333174.236696:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.236810:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613687040 00000100:00100000:0.0:1763333174.236824:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613687040 00000100:00100000:0.0:1763333174.236905:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9246 00000100:00100000:0.0:1763333174.236917:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56858:x1848987613687040:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333174.236945:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333174.236949:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763333174.236982:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5621a lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696e9 expref: 239 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.237003:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43978800) 00010000:00010000:0.0:1763333174.237014:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333174.237030:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c5624b lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369696fe expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.237155:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56252 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333174.237183:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56252 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.237194:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56252 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.237204:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56259 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333174.237211:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56259 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.237217:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56259 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.237631:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c56260 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333174.237640:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c56260 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.237650:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c56260 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:0.0:1763333174.237659:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b0:0x0]: returning size 0 00010000:00010000:0.0:1763333174.237680:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56252 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.237686:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56252 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.237692:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56252 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.237697:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56252 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.237702:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48191600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333174.237706:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56252 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.237712:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56252 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.237719:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:0.0:1763333174.237721:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333174.237724:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56252 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.237729:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56252 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000004:00010000:0.0:1763333174.237738:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000008b116759 reply state 00000000187455c6 transno 4294972258 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56259 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.237751:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56259 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.237757:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43978000) 00010000:00010000:0.0:1763333174.237760:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333174.237762:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763333174.237790:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c5624b lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696fe expref: 241 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.237805:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c56260 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696fe expref: 240 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.237811:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b0:0x0].0x0 (ffff92fe43b44b00) 00010000:00010000:0.0:1763333174.237813:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333174.237816:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48190e00, rc 0) 00000100:00100000:0.0:1763333174.240124:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56858:x1848987613687040:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 3196us (3425us total) trans 4294972258 rc 0/0 00000100:00100000:0.0:1763333174.240138:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9246 00000100:00100000:3.0:1763333174.244258:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.244608:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613687424 00000100:00100000:0.0:1763333174.244620:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613687424 00000100:00100000:0.0:1763333174.244684:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9247 00000100:00100000:0.0:1763333174.244695:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56860:x1848987613687424:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333174.244723:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333174.244749:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c5626e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969705 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.244857:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56275 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333174.244872:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56275 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.244883:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56275 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:0.0:1763333174.244894:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b0:0x0]: returning size 0 00000100:00100000:3.0:1763333174.245097:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.245383:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613687552 00000100:00100000:1.0:1763333174.245390:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613687552 00000100:00100000:1.0:1763333174.245436:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9248 00000100:00100000:1.0:1763333174.245445:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56858:x1848987613687552:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333174.245456:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333174.245467:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56283 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696970c expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.245533:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5628a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333174.245545:0:8606:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c56260 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696fe expref: 245 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.245552:0:8606:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56275 lrc: 2/1,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.245559:0:8606:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5628a lrc: 5/0,1 mode: --/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.245578:0:8606:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56275 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.245605:0:8606:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c56260 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696fe expref: 245 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.245623:0:8606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c56260 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696fe expref: 245 pid: 6521 timeout: 1378 lvb_type: 0 00000100:00100000:1.0:1763333174.245637:0:8606:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7569d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627258112:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333174.246233:0:8606:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff43ef5cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1763333174.246545:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c5626e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969705 expref: 246 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.246568:0:6521:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56275 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969705 expref: 245 pid: 6521 timeout: 1378 lvb_type: 0 00010000:00010000:0.0:1763333174.246578:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56275 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969705 expref: 245 pid: 6521 timeout: 1378 lvb_type: 0 00010000:00010000:0.0:1763333174.246585:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48190c00, rc 0) 00000100:00100000:0.0:1763333174.246641:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56860:x1848987613687424:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1947us (2391us total) trans 4294972259 rc 0/0 00000100:00100000:0.0:1763333174.246649:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9247 00000100:00100000:3.0:1763333174.250514:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333174.250549:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.251090:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613687680 00000100:00100000:0.0:1763333174.251102:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613687680 00010000:00010000:0.0:1763333174.251148:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c56260 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696fe expref: 245 pid: 6521 timeout: 1378 lvb_type: 0 00000100:00100000:0.0:1763333174.251186:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613687808 00000100:00100000:0.0:1763333174.251189:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613687808 00010000:00010000:0.0:1763333174.251201:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56275 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969705 expref: 246 pid: 6521 timeout: 1378 lvb_type: 0 00000100:00100000:0.0:1763333174.251230:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3039 00000100:00100000:0.0:1763333174.251239:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:2421:x1848987613687680:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333174.251254:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333174.251259:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c56260 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696fe expref: 246 pid: 6521 timeout: 1378 lvb_type: 0 00010000:00010000:0.0:1763333174.251272:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c56260 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696fe expref: 246 pid: 6521 timeout: 1378 lvb_type: 0 00010000:00010000:0.0:1763333174.251297:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b0:0x0].0x0 (ffff92fe43b44b00) 00010000:00010000:0.0:1763333174.251302:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5628a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.251311:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333174.251390:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:2421:x1848987613687680:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 151us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333174.251399:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3039 00000100:00100000:0.0:1763333174.251420:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3040 00000100:00100000:0.0:1763333174.251427:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:2419:x1848987613687808:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333174.251434:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333174.251439:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56275 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969705 expref: 245 pid: 6521 timeout: 1378 lvb_type: 0 00010000:00010000:0.0:1763333174.251448:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56275 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969705 expref: 245 pid: 6521 timeout: 1378 lvb_type: 0 00010000:00010000:0.0:1763333174.251465:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56275 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969705 expref: 245 pid: 6521 timeout: 1378 lvb_type: 0 00010000:00010000:0.0:1763333174.251479:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b0:0x0].0x0 (ffff92fe43b44b00) 00010000:00010000:0.0:1763333174.251483:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5628a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.251504:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5628a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.251510:0:6506:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5628a lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.251529:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333174.251549:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:2419:x1848987613687808:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 123us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333174.251556:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3040 00010000:00010000:1.0:1763333174.251665:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c56260 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696fe expref: 243 pid: 6521 timeout: 1378 lvb_type: 0 00000100:00100000:1.0:1763333174.251678:0:8606:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7569d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627258112:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333174.251699:0:8606:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5628a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.251708:0:8606:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5628a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.251713:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5628a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:1.0:1763333174.251742:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b0:0x0]: returning size 0 00000004:00080000:1.0:1763333174.251944:0:8606:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x235:0x0], index 1: 0 00000004:00080000:1.0:1763333174.251952:0:8606:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x235:0x0], index 0: 0 00000004:00080000:1.0:1763333174.251956:0:8606:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x236:0x0], index 0: 0 00000004:00080000:1.0:1763333174.251960:0:8606:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x236:0x0], index 1: 0 00010000:00010000:1.0:1763333174.252076:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5628a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.252085:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5628a lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.252096:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5628a lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.252102:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333174.252106:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5628a lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.252114:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5628a lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.252122:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b0:0x0].0x0 (ffff92fe43b44b00) 00010000:00010000:1.0:1763333174.252125:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763333174.252128:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5628a lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.252134:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5628a lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.252187:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56283 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696970c expref: 243 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.252197:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b0:0x0].0x0 (ffff92fe43b44b00) 00010000:00010000:1.0:1763333174.252199:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763333174.252203:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56283 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696970c expref: 243 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.252218:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f800, rc 0) 00000100:00100000:1.0:1763333174.252277:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:56858:x1848987613687552:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 6833us (7180us total) trans 4294972260 rc 301/301 00000100:00100000:1.0:1763333174.252285:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9248 00000100:00100000:3.0:1763333174.255106:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333174.256113:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613688064 00000100:00100000:2.0:1763333174.256128:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613688064 00000100:00100000:2.0:1763333174.256209:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3160 00000100:00100000:2.0:1763333174.256222:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:56860:x1848987613688064:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333174.258311:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:56860:x1848987613688064:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 2081us (3201us total) trans 4294972261 rc 0/0 00000100:00100000:2.0:1763333174.258325:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3160 00000100:00100000:1.0:1763333174.259551:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333174.259622:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613688320 00000100:00100000:3.0:1763333174.259632:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613688320 00000100:00100000:3.0:1763333174.259849:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3161 00000100:00100000:3.0:1763333174.259860:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:56858:x1848987613688320:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333174.260108:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56858:x1848987613688320:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 248us (563us total) trans 4294972262 rc 0/0 00000100:00100000:3.0:1763333174.260116:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3161 00000100:00100000:1.0:1763333174.261982:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.262063:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333174.262195:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613688832 00000100:00100000:2.0:1763333174.262206:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613688832 00000100:00100000:2.0:1763333174.262264:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3162 00000100:00100000:2.0:1763333174.262274:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bd5c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56858:x1848987613688832:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333174.262535:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bd5c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56858:x1848987613688832:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 262us (561us total) trans 4294972263 rc 0/0 00000100:00100000:2.0:1763333174.262543:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3162 00000100:00100000:3.0:1763333174.262647:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613688576 00000100:00100000:3.0:1763333174.262652:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613688576 00000100:00100000:3.0:1763333174.262691:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9249 00000100:00100000:3.0:1763333174.262699:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56860:x1848987613688576:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333174.262710:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333174.262731:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c56298 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969713 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.262822:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c5629f lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333174.262836:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c5629f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333174.262847:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c5629f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333174.262857:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c562a6 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333174.262917:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c562a6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333174.262929:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c562a6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333174.263023:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c562ad lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333174.263031:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c562ad lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333174.263038:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c562ad lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:3.0:1763333174.263047:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b0:0x0]: returning size 0 00010000:00010000:3.0:1763333174.263096:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c5629f lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333174.263108:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c5629f lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333174.263114:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c5629f lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333174.263120:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c5629f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333174.263126:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333174.263130:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c5629f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333174.263138:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c5629f lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333174.263149:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff8016fb00) 00010000:00010000:3.0:1763333174.263152:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333174.263157:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c5629f lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333174.263163:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c5629f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333174.263174:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c562a6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333174.263180:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c562a6 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333174.263185:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c562a6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333174.263189:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333174.263192:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c562a6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333174.263197:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c562a6 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333174.263204:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43978000) 00010000:00010000:3.0:1763333174.263207:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333174.263209:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c562a6 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333174.263214:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c562a6 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333174.263243:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c56298 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969713 expref: 248 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.263259:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c562ad lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969713 expref: 247 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.263268:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b0:0x0].0x0 (ffff92ff8016f200) 00010000:00010000:3.0:1763333174.263270:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333174.263273:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96c00, rc 0) 00000100:00100000:3.0:1763333174.263315:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56860:x1848987613688576:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 616us (1251us total) trans 4294972264 rc 0/0 00000100:00100000:3.0:1763333174.263322:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9249 00000100:00100000:3.0:1763333174.269115:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333174.269213:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.269395:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613688960 00000100:00100000:1.0:1763333174.269405:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613688960 00000100:00100000:1.0:1763333174.269471:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6492 00000100:00100000:1.0:1763333174.269481:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2421:x1848987613688960:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333174.269535:0:28650:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333174.269560:0:28650:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c562bb lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696971a expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333174.269586:0:28650:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x235:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333174.269607:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333174.269610:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333174.269620:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c562bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696971a expref: 16 pid: 28650 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333174.269636:0:28650:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c562bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696971a expref: 16 pid: 28650 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333174.269649:0:28650:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f600, rc 0) 00000100:00100000:1.0:1763333174.269706:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2421:x1848987613688960:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 226us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333174.269713:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6492 00000100:00100000:2.0:1763333174.270104:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613689216 00000100:00100000:2.0:1763333174.270111:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613689216 00000100:00100000:2.0:1763333174.270158:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9250 00000100:00100000:2.0:1763333174.270165:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:55917:x1848987613689216:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333174.270529:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333174.270532:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763333174.270559:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c562ad lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969713 expref: 247 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.270582:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b0:0x0].0x0 (ffff92ff8016f200) 00010000:00010000:2.0:1763333174.270595:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333174.270611:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c562c2 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969721 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.270731:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c562c9 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333174.270743:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c562c9 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1b0:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333174.270752:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c562c9 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1b0:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:2.0:1763333174.270767:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b0:0x0]: returning size 0 00010000:00010000:2.0:1763333174.270892:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c562c2 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969721 expref: 249 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.270906:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c562c9 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1b0:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969721 expref: 248 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.270913:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b0:0x0].0x0 (ffff92fe43a31e00) 00010000:00010000:2.0:1763333174.270915:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:2.0:1763333174.270918:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5c00, rc 0) 00000100:00100000:2.0:1763333174.270981:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:55917:x1848987613689216:12345-192.168.204.28@tcp:101:bash.0 Request processed in 816us (1767us total) trans 4294972265 rc 0/0 00000100:00100000:2.0:1763333174.270988:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9250 00000100:00100000:1.0:1763333174.275302:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333174.275466:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613689344 00000100:00100000:3.0:1763333174.275478:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613689344 00000100:00100000:3.0:1763333174.276212:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9251 00000100:00100000:3.0:1763333174.276226:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:55917:x1848987613689344:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333174.276254:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333174.276277:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c562d7 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969728 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.276314:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c562de lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333174.276330:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c562de lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333174.276341:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c562de lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333174.276498:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c562d7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969728 expref: 250 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.276523:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c562de lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969728 expref: 249 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.276531:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b0:0x0].0x0 (ffff92fe43a31e00) 00010000:00010000:3.0:1763333174.276534:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763333174.276538:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a97800, rc 0) 00000100:00100000:3.0:1763333174.276609:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:55917:x1848987613689344:12345-192.168.204.28@tcp:101:bash.0 Request processed in 387us (1317us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333174.276617:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9251 00000100:00100000:0.0:1763333174.276803:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.277390:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613689600 00000100:00100000:1.0:1763333174.277399:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613689600 00000100:00100000:1.0:1763333174.277451:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3163 00000100:00100000:1.0:1763333174.277461:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:56860:x1848987613689600:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1763333174.277645:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:56860:x1848987613689600:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 185us (842us total) trans 4294972266 rc 0/0 00000100:00100000:1.0:1763333174.277652:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3163 00000100:00100000:3.0:1763333174.281460:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.282503:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613689856 00000100:00100000:1.0:1763333174.282516:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613689856 00000100:00100000:1.0:1763333174.283006:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9252 00000100:00100000:1.0:1763333174.283019:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:56860:x1848987613689856:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333174.283048:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333174.283077:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c562e5 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696972f expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.283194:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c562ec lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333174.283208:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c562ec lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.283220:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c562ec lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.283230:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c562f3 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333174.283239:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c562f3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.283245:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c562f3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.283400:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c562fa lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333174.283415:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c562fa lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.283422:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c562fa lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.283428:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c562fa lrc: 3/0,0 mode: --/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.283434:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333174.283438:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c562fa lrc: 3/0,0 mode: --/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.283446:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c562fa lrc: 4/0,0 mode: --/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.283455:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b0:0x0].0x0 (ffff92fe43a31e00) 00010000:00010000:1.0:1763333174.283462:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c562fa lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.283467:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c562fa lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000004:00200000:1.0:1763333174.283483:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b0:0x0]: returning size 0 00010000:00010000:1.0:1763333174.283572:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c562ec lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.283579:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c562ec lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.283583:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c562ec lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.283587:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c562ec lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.283592:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333174.283595:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c562ec lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.283600:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c562ec lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.283607:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43978400) 00010000:00010000:1.0:1763333174.283610:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333174.283613:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c562ec lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.283618:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c562ec lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.283626:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c562f3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.283631:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c562f3 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.283637:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c562f3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.283642:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333174.283644:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c562f3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.283650:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c562f3 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.283657:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43978000) 00010000:00010000:1.0:1763333174.283659:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333174.283662:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c562f3 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.283667:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c562f3 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.283701:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c562e5 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696972f expref: 252 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.283711:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43978400) 00010000:00010000:1.0:1763333174.283713:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763333174.283717:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c562e5 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696972f expref: 252 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.283730:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e800, rc 0) 00000100:00100000:1.0:1763333174.283808:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:56860:x1848987613689856:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 792us (2358us total) trans 4294972267 rc 301/301 00000100:00100000:1.0:1763333174.283815:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9252 00000100:00100000:3.0:1763333174.284912:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333174.288911:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613690112 00000100:00100000:2.0:1763333174.288928:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613690112 00000100:00100000:0.0:1763333174.289520:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9253 00000100:00100000:0.0:1763333174.289538:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:55917:x1848987613690112:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:0.0:1763333174.289602:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333174.289633:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c562c9 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1b0:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969721 expref: 251 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.289658:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b0:0x0].0x0 (ffff92fe43a31e00) 00010000:00010000:0.0:1763333174.289664:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333174.289863:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c56308 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333174.289882:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c56308 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.289892:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c56308 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000001:00080000:0.0:1763333174.289937:0:8606:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294972268 00000004:00010000:0.0:1763333174.289962:0:8606:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001fac7ad7 reply state 0000000026b67fab transno 4294972269 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c56308 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.289974:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c56308 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.289980:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b0:0x0].0x0 (ffff92fe43a31e00) 00010000:00010000:0.0:1763333174.289983:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333174.289986:0:8606:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763333174.295583:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:55917:x1848987613690112:12345-192.168.204.28@tcp:36:bash.0 Request processed in 6037us (10661us total) trans 4294972269 rc 0/0 00000100:00100000:0.0:1763333174.295596:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9253 00000020:00080000:0.0:1763333174.295606:0:8606:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763333174.296859:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.296948:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613690368 00000100:00100000:0.0:1763333174.296959:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613690368 00000100:00100000:0.0:1763333174.297014:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3164 00000100:00100000:0.0:1763333174.297023:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:56860:x1848987613690368:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333174.297253:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+254:56860:x1848987613690368:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 230us (403us total) trans 4294972270 rc 0/0 00000100:00100000:0.0:1763333174.297261:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3164 00000100:00100000:3.0:1763333174.302407:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.302827:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613690496 00000100:00100000:1.0:1763333174.302839:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613690496 00000100:00100000:1.0:1763333174.302896:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3165 00000100:00100000:1.0:1763333174.302906:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+254:56860:x1848987613690496:12345-192.168.204.28@tcp:33:lfs.0 00000100:00100000:1.0:1763333174.303047:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+254:56860:x1848987613690496:12345-192.168.204.28@tcp:33:lfs.0 Request processed in 141us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333174.303054:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3165 00000100:00100000:3.0:1763333174.303164:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.303298:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613690624 00000100:00100000:0.0:1763333174.303302:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613690624 00000100:00100000:0.0:1763333174.303342:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9254 00000100:00100000:0.0:1763333174.303376:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+254:55917:x1848987613690624:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333174.303385:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333174.303405:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c5630f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969736 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.303441:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c5630f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969736 expref: 255 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.303456:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c5630f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969736 expref: 255 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.303470:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b0:0x0].0x0 (ffff92fe43a31e00) 00010000:00010000:0.0:1763333174.303474:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333174.303477:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48191600, rc 0) 00000100:00100000:0.0:1763333174.303518:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+255:55917:x1848987613690624:12345-192.168.204.28@tcp:101:bash.0 Request processed in 169us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333174.303524:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9254 00000100:00100000:3.0:1763333174.310542:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333174.311080:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613690880 00000100:00100000:2.0:1763333174.311094:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613690880 00000100:00100000:0.0:1763333174.311868:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9255 00000100:00100000:0.0:1763333174.311886:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+255:55917:x1848987613690880:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333174.311908:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333174.311912:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763333174.311941:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c5630f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969736 expref: 255 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.312008:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b0:0x0].0x0 (ffff92fe43a31e00) 00010000:00010000:0.0:1763333174.312013:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333174.312029:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56316 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696973d expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.312074:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c5631d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333174.312085:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c5631d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.312093:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c5631d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000040:00080000:0.0:1763333174.312322:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1401, 88 off118328 00000004:00080000:0.0:1763333174.312331:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1278391981471ns, next at 1278526292086ns, rc = 0 00000040:00080000:0.0:1763333174.312403:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1402, 88 off118328 00000004:00080000:0.0:1763333174.312408:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1278392058817ns, next at 1279025269818ns, rc = 0 00000040:00080000:0.0:1763333174.312419:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1403, 88 off118416 00000004:00080000:0.0:1763333174.312422:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1278392073087ns, next at 1279025269818ns, rc = 0 00000040:00080000:0.0:1763333174.312430:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1402, 88 off118416 00000004:00080000:0.0:1763333174.312433:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1278392083692ns, next at 1278526292086ns, rc = 0 00000001:00080000:1.0:1763333174.317399:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972271 is committed 00000004:00080000:1.0:1763333174.317413:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 915 committed 00000004:00080000:1.0:1763333174.317426:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 919 committed 00000004:00080000:1.0:1763333174.317432:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 918 committed 00000004:00080000:1.0:1763333174.317435:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 914 committed 00000100:00100000:0.0:1763333174.317630:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe43998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627258624:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333174.317696:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333174.317729:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763333174.317734:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4399b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627258240:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763333174.317751:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1763333174.317820:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c5631d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b0:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696973d expref: 236 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.317834:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b0:0x0].0x0 (ffff92fe43a31e00) 00010000:00010000:0.0:1763333174.317838:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763333174.317855:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56316 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696973d expref: 236 pid: 8606 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1763333174.317871:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c5631d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b0:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696973d expref: 235 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.317899:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b0:0x0].0x0 (ffff92fe43a31e00) 00010000:00010000:0.0:1763333174.317902:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763333174.317904:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48190200, rc 0) 00000100:00100000:0.0:1763333174.318024:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:55917:x1848987613690880:12345-192.168.204.28@tcp:101:bash.0 Request processed in 6070us (7416us total) trans 4294972271 rc 0/0 00000100:00100000:0.0:1763333174.318035:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9255 00000100:00100000:1.0:1763333174.318107:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe43999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627258496:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333174.318133:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333174.318158:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1763333174.318163:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe43998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627258368:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763333174.318184:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333174.318210:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627258624 00000100:00100000:1.0:1763333174.318216:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627258624 00000100:00100000:1.0:1763333174.318248:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627258240 00000100:00100000:1.0:1763333174.318250:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627258240 00000100:00100000:1.0:1763333174.318263:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627258496 00000100:00100000:1.0:1763333174.318266:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627258496 00000100:00100000:1.0:1763333174.318277:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627258368 00000100:00100000:1.0:1763333174.318279:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627258368 00000100:00100000:1.0:1763333174.318294:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6493 00000100:00100000:1.0:1763333174.318302:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+16:3654:x1848987627258624:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333174.318512:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+17:3654:x1848987627258624:12345-0@lo:2:osp-syn-1-1.0 Request processed in 211us (815us total) trans 17179871566 rc 0/0 00000100:00100000:1.0:1763333174.318519:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6493 00000100:00100000:1.0:1763333174.318533:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6494 00000100:00100000:1.0:1763333174.318539:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4399a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+16:3654:x1848987627258240:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763333174.318554:0:28650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:563 count 1 00010000:00010000:1.0:1763333174.318574:0:28650:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56324 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x233:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.318593:0:28650:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c5618e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x233:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696bf expref: 15 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.318606:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333174.318608:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333174.318612:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56324 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x233:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.318639:0:28650:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c5618e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x233:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696bf expref: 15 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.318652:0:28650:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c5618e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x233:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696bf expref: 15 pid: 8611 timeout: 1378 lvb_type: 0 00000100:00100000:1.0:1763333174.318663:0:28650:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42ef9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28650:1848987627258752:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333174.318704:0:28650:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4869d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763333174.318721:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6495 00000100:00100000:1.0:1763333174.318727:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+16:3653:x1848987627258496:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1763333174.318782:0:28600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x235:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333174.318785:0:28600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x235:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763333174.318788:0:28600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x235:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333174.318790:0:28600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x235:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763333174.318792:0:28600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x235:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333174.318820:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+17:3653:x1848987627258496:12345-0@lo:2:osp-syn-1-1.0 Request processed in 92us (685us total) trans 17179871567 rc 0/0 00000100:00100000:1.0:1763333174.318825:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6495 00000100:00100000:1.0:1763333174.318837:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6496 00000100:00100000:1.0:1763333174.318842:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7df38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+16:3653:x1848987627258368:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763333174.318852:0:28600:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:564 count 1 00002000:00010000:1.0:1763333174.318868:0:28600:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x234:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333174.318873:0:28600:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5632b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.318880:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333174.318882:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333174.318885:0:28600:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5632b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.318896:0:28600:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5632b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.318905:0:28600:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5632b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.318912:0:28600:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5632b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.318926:0:28600:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763333174.319165:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44de0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627258880:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763333174.319195:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333174.319216:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763333174.319220:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44de1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627259264:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333174.319237:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333174.319258:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627258880 00000100:00100000:3.0:1763333174.319262:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627258880 00000100:00100000:3.0:1763333174.319286:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627259264 00000100:00100000:3.0:1763333174.319289:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627259264 00000100:00100000:3.0:1763333174.319301:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6497 00000100:00100000:3.0:1763333174.319308:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+43:3655:x1848987627258880:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763333174.319320:0:8611:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:563 count 1 00010000:00010000:3.0:1763333174.319339:0:8611:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c56332 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x233:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.319376:0:8611:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdee00/0xb32e3ef184c56164 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x233:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696b1 expref: 24 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.319383:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333174.319385:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333174.319387:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c56332 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x233:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.319410:0:8611:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdee00/0xb32e3ef184c56164 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x233:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696b1 expref: 24 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.319420:0:8611:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdee00/0xb32e3ef184c56164 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x233:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696b1 expref: 24 pid: 8611 timeout: 1378 lvb_type: 0 00000100:00100000:3.0:1763333174.319430:0:8611:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44de0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8611:1848987627259392:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333174.319463:0:8611:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff49c92b40 going to sleep for 11 seconds 00000100:00100000:3.0:1763333174.319478:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6498 00000100:00100000:3.0:1763333174.319496:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+43:3655:x1848987627259264:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333174.319600:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+44:3655:x1848987627259264:12345-0@lo:2:osp-syn-0-1.0 Request processed in 115us (361us total) trans 21474838871 rc 0/0 00000100:00100000:3.0:1763333174.319607:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6498 00000004:00080000:3.0:1763333174.319642:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44de1500/2, rc 0, transno 21474838871 00000100:00100000:3.0:1763333174.319647:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44de1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627259264:0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1763333174.319869:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c561b1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333174.319878:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c561b1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333174.319884:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c561b1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333174.319889:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333174.319893:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c561b1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333174.319900:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c561b1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333174.319917:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43978000) 00010000:00010000:2.0:1763333174.319920:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333174.319924:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c561b1 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333174.319930:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c561b1 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333174.319944:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56259 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333174.319961:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56259 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333174.319967:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56259 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333174.319972:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48191800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333174.319974:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56259 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333174.319978:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56259 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333174.319984:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43978000) 00010000:00010000:2.0:1763333174.319986:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333174.319988:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56259 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333174.319992:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56259 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333174.320006:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c56308 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333174.320012:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c56308 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333174.320017:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c56308 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333174.320021:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48190400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333174.320023:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c56308 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333174.320027:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c56308 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333174.320033:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b0:0x0].0x0 (ffff92fe43a31e00) 00010000:00010000:2.0:1763333174.320035:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333174.320038:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c56308 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333174.320042:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c56308 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000100:00100000:2.0:1763333174.320058:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44de0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627259008:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763333174.320085:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333174.320102:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1763333174.320107:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44de2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627259136:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333174.320120:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333174.320136:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627259008 00000100:00100000:2.0:1763333174.320139:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627259008 00000100:00100000:2.0:1763333174.320156:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627259136 00000100:00100000:2.0:1763333174.320157:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627259136 00000100:00100000:2.0:1763333174.320167:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6499 00000100:00100000:2.0:1763333174.320173:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+45:3652:x1848987627259008:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1763333174.320184:0:28651:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:564 count 1 00002000:00010000:2.0:1763333174.320206:0:28651:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x234:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763333174.320211:0:28651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56339 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.320221:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333174.320222:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333174.320226:0:28651:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56339 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.320237:0:28651:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56339 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.320244:0:28651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56339 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.320249:0:28651:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56339 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.320263:0:28651:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1763333174.320450:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+46:3652:x1848987627259008:12345-0@lo:6:osp-syn-0-1.0 Request processed in 277us (363us total) trans 21474838872 rc 0/0 00000100:00100000:2.0:1763333174.320458:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6499 00000100:00100000:2.0:1763333174.320473:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6500 00000100:00100000:2.0:1763333174.320479:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+45:3652:x1848987627259136:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333174.320563:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+46:3652:x1848987627259136:12345-0@lo:2:osp-syn-0-1.0 Request processed in 84us (440us total) trans 21474838873 rc 0/0 00000100:00100000:2.0:1763333174.320571:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6500 00010000:00010000:2.0:1763333174.320601:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1763333174.320607:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5632b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.320613:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fe00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333174.320617:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5632b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.320623:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5632b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.320635:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5632b lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.320641:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5632b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.320655:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333174.320659:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56339 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.320664:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5e00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333174.320667:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56339 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.320674:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56339 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.320683:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56339 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.320690:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56339 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.320700:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333174.320702:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333174.320704:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763333174.320731:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44de2a00/2, rc 0, transno 21474838873 00000100:00100000:2.0:1763333174.320736:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44de2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627259136:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1763333174.320744:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44de0e00/2, rc 0, transno 21474838872 00000100:00100000:2.0:1763333174.320748:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44de0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627259008:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763333174.324111:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7df38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+17:3653:x1848987627258368:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5260us (5917us total) trans 17179871568 rc 0/0 00000100:00100000:1.0:1763333174.324125:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6496 00000004:00080000:1.0:1763333174.324200:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe43998380/2, rc 0, transno 17179871566 00000100:00100000:1.0:1763333174.324207:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe43998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627258624:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1763333174.324235:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe43998000/2, rc 0, transno 17179871568 00000100:00100000:1.0:1763333174.324240:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe43998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627258368:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1763333174.324253:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe43999c00/2, rc 0, transno 17179871567 00000100:00100000:1.0:1763333174.324256:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe43999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627258496:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1763333174.324714:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763333174.325234:0:28650:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42ef9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28650:1848987627258752:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333174.325263:0:28650:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56324 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x233:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333174.326075:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333174.326329:0:8611:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44de0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8611:1848987627259392:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333174.326570:0:8611:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c56332 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x233:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333174.327029:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.327564:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613691136 00000100:00100000:0.0:1763333174.327573:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613691136 00010000:00010000:0.0:1763333174.327614:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdee00/0xb32e3ef184c56164 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x233:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696b1 expref: 25 pid: 8611 timeout: 1378 lvb_type: 0 00000100:00100000:0.0:1763333174.327651:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3041 00000100:00100000:0.0:1763333174.327661:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:2420:x1848987613691136:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333174.327678:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333174.327683:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdee00/0xb32e3ef184c56164 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x233:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696b1 expref: 25 pid: 8611 timeout: 1378 lvb_type: 0 00010000:00010000:0.0:1763333174.327698:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdee00/0xb32e3ef184c56164 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x233:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696b1 expref: 25 pid: 8611 timeout: 1378 lvb_type: 0 00010000:00010000:0.0:1763333174.327721:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdee00/0xb32e3ef184c56164 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x233:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696b1 expref: 25 pid: 8611 timeout: 1378 lvb_type: 0 00010000:00010000:0.0:1763333174.327737:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333174.327739:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333174.327744:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c56332 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x233:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.327754:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c56332 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x233:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.327782:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333174.327833:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:2420:x1848987613691136:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 174us (1763us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333174.327841:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3041 00010000:00010000:0.0:1763333174.327871:0:8611:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c56332 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.327879:0:8611:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c56332 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.327888:0:8611:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c56332 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.327900:0:8611:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c56332 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.327916:0:8611:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763333174.328157:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+46:3655:x1848987627258880:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8847us (8959us total) trans 21474838874 rc 0/0 00000100:00100000:0.0:1763333174.328165:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6497 00010000:00010000:0.0:1763333174.328190:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333174.328196:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c56332 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.328202:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333174.328206:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c56332 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.328215:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c56332 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.328227:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c56332 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.328234:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c56332 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.328249:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333174.328251:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333174.328254:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763333174.328285:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44de0000/2, rc 0, transno 21474838874 00000100:00100000:0.0:1763333174.328291:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44de0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627258880:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763333174.329825:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333174.330032:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.330116:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613691520 00000100:00100000:1.0:1763333174.330126:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613691520 00000100:00100000:3.0:1763333174.331072:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613691264 00000100:00100000:3.0:1763333174.331081:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613691264 00000100:00100000:3.0:1763333174.331126:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6501 00000100:00100000:3.0:1763333174.331136:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:55917:x1848987613691264:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333174.331153:0:8611:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333174.331173:0:8611:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56340 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969744 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.331205:0:8611:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c562bb lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696971a expref: 17 pid: 28650 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333174.331214:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333174.331216:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333174.331220:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56340 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969744 expref: 17 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333174.331993:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9256 00000100:00100000:1.0:1763333174.332009:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56861:x1848987613691520:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333174.332031:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333174.332052:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56347 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696974b expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.332130:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5634e lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333174.332145:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5634e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.332158:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5634e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.332171:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56355 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333174.332178:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56355 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.332185:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56355 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.332298:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5635c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333174.332308:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5635c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.332315:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5635c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:1.0:1763333174.332325:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b0:0x0]: returning size 2 00010000:00010000:1.0:1763333174.332435:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5634e lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.332443:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5634e lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.332448:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5634e lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.332455:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5634e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.332460:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333174.332464:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5634e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.332472:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5634e lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.332483:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe438a1b00) 00010000:00010000:1.0:1763333174.332497:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333174.332502:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5634e lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.332507:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5634e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.332520:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56355 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.332530:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56355 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.332535:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56355 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.332540:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fc00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333174.332543:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56355 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.332548:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56355 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.332554:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe438a1600) 00010000:00010000:1.0:1763333174.332556:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333174.332559:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56355 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.332564:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56355 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.332602:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56347 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696974b expref: 235 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.332616:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5635c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696974b expref: 234 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.332623:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b0:0x0].0x0 (ffff92fe43a31e00) 00010000:00010000:1.0:1763333174.332625:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333174.332628:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7ec00, rc 0) 00000100:00100000:1.0:1763333174.332695:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:56861:x1848987613691520:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 690us (5665us total) trans 4294972272 rc 0/0 00000100:00100000:1.0:1763333174.332703:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9256 00010000:00010000:3.0:1763333174.332854:0:8611:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c562bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696971a expref: 17 pid: 28650 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333174.332868:0:8611:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c562bb lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696971a expref: 17 pid: 28650 timeout: 1378 lvb_type: 1 00000100:00100000:3.0:1763333174.332885:0:8611:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77a3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8611:1848987627259520:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333174.332945:0:8611:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff49c923c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763333174.333193:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613691008 00000100:00100000:0.0:1763333174.333200:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613691008 00010000:00010000:0.0:1763333174.333229:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c5618e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x233:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696bf expref: 18 pid: 8611 timeout: 1378 lvb_type: 0 00000100:00100000:0.0:1763333174.333251:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3042 00000100:00100000:0.0:1763333174.333257:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2420:x1848987613691008:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333174.333265:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333174.333269:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c5618e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x233:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696bf expref: 18 pid: 8611 timeout: 1378 lvb_type: 0 00010000:00010000:0.0:1763333174.333279:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c5618e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x233:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696bf expref: 18 pid: 8611 timeout: 1378 lvb_type: 0 00010000:00010000:0.0:1763333174.333295:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c5618e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x233:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369696bf expref: 18 pid: 8611 timeout: 1378 lvb_type: 0 00010000:00010000:0.0:1763333174.333306:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333174.333308:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333174.333312:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56324 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x233:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.333321:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56324 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x233:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.333343:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333174.333380:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2420:x1848987613691008:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 123us (3560us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333174.333386:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3042 00010000:00010000:0.0:1763333174.333406:0:28650:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56324 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.333414:0:28650:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56324 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.333422:0:28650:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56324 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.333428:0:28650:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56324 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.333442:0:28650:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763333174.333672:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4399a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+17:3654:x1848987627258240:12345-0@lo:6:osp-syn-1-1.0 Request processed in 15132us (15918us total) trans 17179871569 rc 0/0 00000100:00100000:0.0:1763333174.333680:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6494 00010000:00010000:0.0:1763333174.333797:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333174.333804:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56324 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.333811:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e800 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333174.333814:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56324 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.333822:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56324 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.333832:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56324 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.333838:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56324 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.333854:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333174.333856:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333174.333857:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763333174.333887:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4399b800/2, rc 0, transno 17179871569 00000100:00100000:0.0:1763333174.333894:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4399b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627258240:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763333174.336305:0:8611:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77a3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8611:1848987627259520:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333174.336341:0:8611:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56340 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969744 expref: 16 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.336481:0:8611:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a97000, rc 0) 00000100:00100000:0.0:1763333174.336584:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:55917:x1848987613691264:12345-192.168.204.28@tcp:101:bash.0 Request processed in 5448us (6551us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333174.336593:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6501 00000100:00100000:0.0:1763333174.342788:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.346741:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.347117:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613691776 00000100:00100000:1.0:1763333174.347130:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613691776 00000100:00100000:1.0:1763333174.347195:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6502 00000100:00100000:1.0:1763333174.347206:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4399b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2418:x1848987613691776:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333174.347225:0:8611:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333174.347247:0:8611:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5636a lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x235:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969752 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.347275:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333174.347289:0:8611:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5636a lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0x235:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969752 expref: 17 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333174.347309:0:8611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5636a lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x235:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969752 expref: 17 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333174.347324:0:8611:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f000, rc 0) 00000100:00100000:1.0:1763333174.347405:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4399b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2418:x1848987613691776:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 201us (675us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333174.347413:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6502 00000100:00100000:3.0:1763333174.350913:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613691648 00000100:00100000:3.0:1763333174.350933:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613691648 00010000:00010000:0.0:1763333174.351106:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c562bb lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696971a expref: 16 pid: 28650 timeout: 1378 lvb_type: 1 00000100:00100000:0.0:1763333174.351161:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3043 00000100:00100000:0.0:1763333174.351172:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff44f09050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2421:x1848987613691648:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333174.351192:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333174.351197:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c562bb lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x235:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696971a expref: 16 pid: 28650 timeout: 1378 lvb_type: 1 00010000:00010000:0.0:1763333174.351210:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c562bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x235:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696971a expref: 16 pid: 28650 timeout: 1378 lvb_type: 1 00010000:00010000:0.0:1763333174.351235:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c562bb lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x235:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696971a expref: 16 pid: 28650 timeout: 1378 lvb_type: 1 00010000:00010000:0.0:1763333174.351252:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333174.351254:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333174.351261:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56340 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969744 expref: 15 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.351272:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56340 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969744 expref: 15 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.351317:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56340 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969744 expref: 15 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333174.351332:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe43999880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6505:1848987627259648:192.168.204.28@tcp:105: 00000100:00100000:0.0:1763333174.352431:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333174.352531:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613692032 00000100:00100000:2.0:1763333174.352538:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613692032 00000100:00100000:1.0:1763333174.352767:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe43aa6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1763333174.353074:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3166 00000100:00100000:2.0:1763333174.353086:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4399a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:56861:x1848987613692032:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333174.353930:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4399a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:56861:x1848987613692032:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 844us (1503us total) trans 4294972273 rc 0/0 00000100:00100000:2.0:1763333174.353940:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3166 00000100:00100000:0.0:1763333174.355727:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333174.355800:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613692160 00000100:00100000:3.0:1763333174.355811:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613692160 00000100:00100000:3.0:1763333174.355914:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6503 00000100:00100000:3.0:1763333174.355926:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:55917:x1848987613692160:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333174.355944:0:28650:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1763333174.355993:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe43999880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6505:1848987627259648:192.168.204.28@tcp:105: 00010000:00010000:1.0:1763333174.356016:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333174.356070:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff44f09050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2421:x1848987613691648:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 4899us (13291us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333174.356079:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3043 00010000:00010000:3.0:1763333174.356151:0:28650:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96e00/0xb32e3ef184c56371 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969759 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333174.356177:0:28650:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x235:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333174.356199:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333174.356201:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333174.356212:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96e00/0xb32e3ef184c56371 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969759 expref: 25 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.356230:0:28650:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96e00/0xb32e3ef184c56371 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969759 expref: 25 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.356242:0:28650:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96e00, rc 0) 00000100:00100000:3.0:1763333174.356281:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:55917:x1848987613692160:12345-192.168.204.28@tcp:101:bash.0 Request processed in 358us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333174.356328:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6503 00000100:00100000:0.0:1763333174.361034:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.361090:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.361187:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613692288 00000100:00100000:1.0:1763333174.361200:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613692288 00002000:00010000:1.0:1763333174.361241:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/565 (0->18446744073709551615) 00002000:00100000:1.0:1763333174.361247:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4399aa00 with x1848987613692288 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333174.361259:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe4399aa00. 00000100:00100000:1.0:1763333174.362477:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613692416 00000100:00100000:1.0:1763333174.362498:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613692416 00002000:00010000:1.0:1763333174.362535:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/565 (0->18446744073709551615) 00002000:00100000:1.0:1763333174.362541:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe43998a80 with x1848987613692416 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333174.362552:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe43998a80. 00000100:00100000:0.0:1763333174.362782:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1607 00000100:00100000:0.0:1763333174.362798:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4399aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2418:x1848987613692288:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:0.0:1763333174.362992:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x235:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333174.362996:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x235:0x0] updating lvb mtime from disk: 0 -> 1763333174 00002000:00010000:0.0:1763333174.362998:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x235:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333174.363001:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x235:0x0] updating lvb ctime from disk: 0 -> 1763333174 00002000:00010000:0.0:1763333174.363003:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x235:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333174.363069:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4399aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2418:x1848987613692288:12345-192.168.204.28@tcp:10:bash.0 Request processed in 276us (2045us total) trans 17179871570 rc 0/0 00000100:00100000:0.0:1763333174.363077:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1607 00002000:00010000:0.0:1763333174.363081:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/565 (0->18446744073709551615) 00002000:00100000:0.0:1763333174.363084:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4399aa00 with x1848987613692288 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333174.363088:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe4399aa00. 00000100:00100000:0.0:1763333174.363107:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1608 00000100:00100000:0.0:1763333174.363114:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43998a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:2418:x1848987613692416:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:0.0:1763333174.363205:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x235:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333174.363208:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x235:0x0] updating lvb mtime from disk: 0 -> 1763333174 00002000:00010000:0.0:1763333174.363210:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x235:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333174.363212:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x235:0x0] updating lvb ctime from disk: 0 -> 1763333174 00002000:00010000:0.0:1763333174.363214:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x235:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333174.363238:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43998a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+26:2418:x1848987613692416:12345-192.168.204.28@tcp:10:bash.0 Request processed in 124us (2147us total) trans 21474838875 rc 0/0 00000100:00100000:0.0:1763333174.363247:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1608 00002000:00010000:0.0:1763333174.363250:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/565 (0->18446744073709551615) 00002000:00100000:0.0:1763333174.363253:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe43998a80 with x1848987613692416 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333174.363257:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe43998a80. 00000100:00100000:2.0:1763333174.371978:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.372058:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613692672 00000100:00100000:0.0:1763333174.372069:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613692672 00000100:00100000:0.0:1763333174.372136:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3167 00000100:00100000:0.0:1763333174.372146:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:55917:x1848987613692672:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:0.0:1763333174.372560:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:55917:x1848987613692672:12345-192.168.204.28@tcp:35:bash.0 Request processed in 413us (591us total) trans 4294972274 rc 0/0 00000100:00100000:0.0:1763333174.372568:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3167 00000100:00100000:2.0:1763333174.382564:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.382686:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613692928 00000100:00100000:1.0:1763333174.382698:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613692928 00000100:00100000:1.0:1763333174.382768:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9257 00000100:00100000:1.0:1763333174.382778:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56862:x1848987613692928:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333174.382811:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333174.382835:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c56378 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969760 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.382958:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c5637f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333174.382975:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c5637f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x1b0:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.382988:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c5637f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x1b0:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:1.0:1763333174.383001:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b0:0x0]: returning size 5 00010000:00010000:1.0:1763333174.383129:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c56378 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969760 expref: 239 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.383154:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c5637f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b0:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969760 expref: 238 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.383163:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b0:0x0].0x0 (ffff92fe43a31e00) 00010000:00010000:1.0:1763333174.383166:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1763333174.383170:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f800, rc 0) 00000100:00100000:1.0:1763333174.383233:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56862:x1848987613692928:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 456us (682us total) trans 4294972275 rc 0/0 00000100:00100000:1.0:1763333174.383241:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9257 00000100:00100000:2.0:1763333174.391021:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333174.391146:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613693184 00000100:00100000:3.0:1763333174.391157:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613693184 00000100:00100000:1.0:1763333174.391675:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9258 00000100:00100000:1.0:1763333174.391691:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56862:x1848987613693184:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333174.391717:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333174.391739:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5638d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969767 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.391863:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56394 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333174.391878:0:8606:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5635c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696974b expref: 239 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.391889:0:8606:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56394 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x1b0:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.391922:0:8606:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5635c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696974b expref: 239 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.391940:0:8606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5635c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696974b expref: 239 pid: 8606 timeout: 1378 lvb_type: 0 00000100:00100000:1.0:1763333174.391969:0:8606:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42ef8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627259776:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333174.392059:0:8606:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe46e0e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763333174.396247:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333174.396386:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613693440 00000100:00100000:3.0:1763333174.396396:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613693440 00000100:00100000:3.0:1763333174.396443:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3168 00000100:00100000:3.0:1763333174.396451:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bd5f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:56863:x1848987613693440:12345-192.168.204.28@tcp:35:rm.0 00000100:00100000:3.0:1763333174.398113:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bd5f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56863:x1848987613693440:12345-192.168.204.28@tcp:35:rm.0 Request processed in 1652us (1865us total) trans 4294972276 rc 0/0 00000100:00100000:3.0:1763333174.398126:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3168 00000100:00100000:3.0:1763333174.399752:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.400225:0:8606:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42ef8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627259776:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333174.400254:0:8606:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56394 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1b0:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000100:00100000:0.0:1763333174.400610:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613693568 00000100:00100000:0.0:1763333174.400618:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613693568 00010000:00010000:0.0:1763333174.400658:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5635c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696974b expref: 241 pid: 8606 timeout: 1378 lvb_type: 0 00000100:00100000:0.0:1763333174.401250:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3044 00000100:00100000:0.0:1763333174.401264:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:2420:x1848987613693568:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333174.401283:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333174.401291:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5635c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696974b expref: 241 pid: 8606 timeout: 1378 lvb_type: 0 00010000:00010000:0.0:1763333174.401304:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5635c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696974b expref: 241 pid: 8606 timeout: 1378 lvb_type: 0 00010000:00010000:0.0:1763333174.401331:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5635c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696974b expref: 241 pid: 8606 timeout: 1378 lvb_type: 0 00010000:00010000:0.0:1763333174.401371:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b0:0x0].0x0 (ffff92fe43a31e00) 00010000:00010000:0.0:1763333174.401376:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56394 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1b0:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.401386:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56394 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1b0:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.401393:0:6505:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56394 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x1b0:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.401810:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333174.401945:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:2420:x1848987613693568:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 683us (2197us total) trans 0 rc 0/0 00010000:00010000:1.0:1763333174.402277:0:8606:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56394 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1b0:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.402287:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56394 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1b0:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:1.0:1763333174.402315:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b0:0x0]: returning size 5 00010000:00010000:1.0:1763333174.402480:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5638d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969767 expref: 242 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.402511:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56394 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1b0:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969767 expref: 241 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.402519:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b0:0x0].0x0 (ffff92fe43a31e00) 00010000:00010000:1.0:1763333174.402521:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1763333174.402524:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7fc00, rc 0) 00000100:00100000:1.0:1763333174.402563:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56862:x1848987613693184:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 10877us (11552us total) trans 4294972277 rc 0/0 00000100:00100000:1.0:1763333174.402576:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9258 00000100:00100000:0.0:1763333174.402681:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3044 00000100:00100000:3.0:1763333174.408011:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.408089:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613693952 00000100:00100000:1.0:1763333174.408101:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613693952 00000100:00100000:1.0:1763333174.408166:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9259 00000100:00100000:1.0:1763333174.408177:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:56863:x1848987613693952:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:1.0:1763333174.408236:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1763333174.408266:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c5637f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b0:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969760 expref: 240 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.408290:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c5631d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b0:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696973d expref: 239 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.408303:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c562de lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969728 expref: 238 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.408313:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b0:0x0].0x0 (ffff92fe43a31e00) 00010000:00010000:1.0:1763333174.408318:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333174.408375:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c563a2 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333174.408388:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c563a2 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.408397:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c563a2 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.408411:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c563a9 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333174.408417:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c563a9 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.408425:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c563a9 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.408514:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c563b0 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333174.408525:0:8606:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56394 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x1b0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969767 expref: 237 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.408533:0:8606:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c563b0 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.408573:0:8606:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56394 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1b0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969767 expref: 237 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.408587:0:8606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56394 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1b0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969767 expref: 237 pid: 8606 timeout: 1378 lvb_type: 0 00000100:00100000:1.0:1763333174.408603:0:8606:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42ef8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627259904:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333174.408707:0:8606:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff499ad9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763333174.411825:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.411876:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613694080 00000100:00100000:0.0:1763333174.411889:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613694080 00000100:00100000:0.0:1763333174.411959:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9260 00000100:00100000:0.0:1763333174.411969:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56862:x1848987613694080:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333174.411997:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333174.412020:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c563b7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696976e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.412129:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c563be lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333174.412142:0:6521:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c563b0 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.412150:0:6521:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c563be lrc: 4/1,0 mode: --/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.412167:0:6521:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c563b0 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.412176:0:6521:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c563be lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000100:00100000:1.0:1763333174.414546:0:8606:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42ef8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627259904:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333174.414577:0:8606:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c563b0 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8606 initiator: MDT1 00000100:00100000:2.0:1763333174.416084:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.416156:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613694208 00000100:00100000:0.0:1763333174.416166:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613694208 00010000:00010000:0.0:1763333174.416216:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56394 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1b0:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969767 expref: 240 pid: 8606 timeout: 1378 lvb_type: 0 00000100:00100000:0.0:1763333174.416260:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3045 00000100:00100000:0.0:1763333174.416270:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:2420:x1848987613694208:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333174.416285:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333174.416291:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56394 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1b0:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969767 expref: 240 pid: 8606 timeout: 1378 lvb_type: 0 00010000:00010000:0.0:1763333174.416302:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56394 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1b0:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969767 expref: 240 pid: 8606 timeout: 1378 lvb_type: 0 00010000:00010000:0.0:1763333174.416322:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56394 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1b0:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969767 expref: 240 pid: 8606 timeout: 1378 lvb_type: 0 00010000:00010000:0.0:1763333174.416339:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b0:0x0].0x0 (ffff92fe43a31e00) 00010000:00010000:0.0:1763333174.416343:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c563b0 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.416396:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c563b0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.416403:0:6505:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c563b0 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.416410:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c563be lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.416416:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c563be lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.416421:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c563be lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.416446:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333174.416508:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:2420:x1848987613694208:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 240us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333174.416516:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3045 00010000:00010000:1.0:1763333174.416591:0:8606:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c563b0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.416599:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c563b0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8606 initiator: MDT1 00000004:00080000:1.0:1763333174.416856:0:8606:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x1b0:0x0] is inserted into orphan list, open count = 1 00010000:00010000:1.0:1763333174.416941:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c563b0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.416949:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c563b0 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.416956:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c563b0 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.416962:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333174.416966:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c563b0 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.416973:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c563b0 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.416983:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b0:0x0].0x0 (ffff92fe43a31e00) 00010000:00010000:1.0:1763333174.416985:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763333174.416988:0:8606:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c563be lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.416995:0:8606:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c563be lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.417001:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c563be lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.417031:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c563b0 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.417037:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c563b0 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.417055:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c563a2 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.417061:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c563a2 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.417067:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c563a2 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.417073:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c563a2 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.417078:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333174.417081:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c563a2 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.417087:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c563a2 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.417095:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe438a1b00) 00010000:00010000:1.0:1763333174.417098:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333174.417101:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c563a2 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.417106:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c563a2 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000004:00010000:1.0:1763333174.417121:0:8606:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000033f05a46 reply state 000000003dea2b32 transno 4294972278 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c563a9 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.417131:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c563a9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.417136:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe438a1600) 00010000:00010000:1.0:1763333174.417139:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333174.417141:0:8606:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763333174.417186:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:56863:x1848987613693952:12345-192.168.204.28@tcp:36:rm.0 Request processed in 9010us (9185us total) trans 4294972278 rc 0/0 00000100:00100000:1.0:1763333174.417194:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9259 00010000:00010000:0.0:1763333174.417259:0:6521:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c563be lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.417267:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c563be lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:0.0:1763333174.417294:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b0:0x0]: returning size 5 00000004:00200000:0.0:1763333174.417299:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763333174.417313:0:6521:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c563be lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.417340:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c563b7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696976e expref: 240 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.417394:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c563be lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696976e expref: 239 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.417401:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b0:0x0].0x0 (ffff92fe43a31e00) 00010000:00010000:0.0:1763333174.417403:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333174.417405:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48191800, rc 0) 00000100:00100000:0.0:1763333174.417441:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56862:x1848987613694080:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 5473us (5629us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333174.417448:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9260 00000100:00100000:2.0:1763333174.424287:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.424419:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613694464 00000100:00100000:0.0:1763333174.424430:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613694464 00000100:00100000:0.0:1763333174.424500:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9261 00000100:00100000:0.0:1763333174.424511:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56862:x1848987613694464:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333174.424531:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333174.424552:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c563c5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969775 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.424680:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c563cc lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333174.424696:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c563cc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b0:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.424707:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c563cc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b0:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:0.0:1763333174.424721:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b0:0x0]: returning size 5 00010000:00010000:0.0:1763333174.424834:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c563c5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969775 expref: 242 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.424852:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c563cc lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1b0:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969775 expref: 241 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.424860:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b0:0x0].0x0 (ffff92fe43a31e00) 00010000:00010000:0.0:1763333174.424864:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763333174.424868:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48190400, rc 0) 00000100:00100000:0.0:1763333174.424931:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56862:x1848987613694464:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 422us (656us total) trans 4294972279 rc 0/0 00000100:00100000:0.0:1763333174.424939:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9261 00000100:00100000:3.0:1763333174.439826:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.440077:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613694592 00000100:00100000:0.0:1763333174.440088:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613694592 00000100:00100000:0.0:1763333174.440161:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6504 00000100:00100000:0.0:1763333174.440172:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2420:x1848987613694592:12345-192.168.204.28@tcp:1:lfs.0 00010000:00010000:0.0:1763333174.440236:0:28650:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe48191600/0xb32e3ef184c563da lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.440261:0:28650:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56340 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969744 expref: 16 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.440269:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333174.440272:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333174.440276:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe48191600/0xb32e3ef184c563da lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.440318:0:28650:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56340 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969744 expref: 16 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.440340:0:28650:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56340 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969744 expref: 16 pid: 8611 timeout: 1378 lvb_type: 0 00000100:00100000:0.0:1763333174.440414:0:28650:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe43999500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28650:1848987627260032:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333174.440504:0:28650:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe43aa6900 going to sleep for 11 seconds 00000100:00100000:3.0:1763333174.451437:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333174.451501:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.451602:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613694720 00000100:00100000:1.0:1763333174.451613:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613694720 00000100:00100000:1.0:1763333174.451678:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9262 00000100:00100000:1.0:1763333174.451691:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56864:x1848987613694720:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333174.451716:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333174.451740:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c563e1 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696977c expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.451832:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c563e8 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333174.451846:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c563e8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.451856:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c563e8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.451866:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c563ef lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333174.451872:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c563ef lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.451877:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c563ef lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.451925:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c563e8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.451933:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c563e8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.451939:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c563e8 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.451945:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c563e8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.451950:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333174.451955:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c563e8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.451962:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c563e8 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.451974:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe438a1b00) 00010000:00010000:1.0:1763333174.451978:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333174.451983:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c563e8 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.451989:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c563e8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.452002:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c563ef lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.452008:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c563ef lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.452012:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c563ef lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.452017:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333174.452020:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c563ef lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.452026:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c563ef lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.452033:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe438a1600) 00010000:00010000:1.0:1763333174.452036:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333174.452039:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c563ef lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.452044:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c563ef lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.452071:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c563e1 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696977c expref: 242 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.452081:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe438a1b00) 00010000:00010000:1.0:1763333174.452083:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333174.452086:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c563e1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696977c expref: 242 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.452098:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f200, rc 0) 00000100:00100000:1.0:1763333174.452155:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56864:x1848987613694720:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 467us (728us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333174.452163:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9262 00000100:00100000:2.0:1763333174.452254:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613694848 00000100:00100000:2.0:1763333174.452261:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613694848 00002000:00100000:2.0:1763333174.452298:0:28426:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000400:0x235:0x0] (0->4) req@ffff92ff77a3ce00 x1848987613694848/t0(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:485/0 lens 496/0 e 0 to 0 dl 1763333185 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763333174.452308:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff77a3ce00 with x1848987613694848 ext(0->4) 00010000:00010000:2.0:1763333174.452317:0:28426:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56340 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969744 expref: 17 pid: 8611 timeout: 1378 lvb_type: 0 00010000:00010000:2.0:1763333174.452332:0:28426:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56340 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969744 expref: 17 pid: 8611 timeout: 1378 lvb_type: 0 00002000:00010000:2.0:1763333174.452339:0:28426:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92ff77a3ce00 00000100:00100000:2.0:1763333174.452406:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 105 00000100:00100000:2.0:1763333174.452414:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2420:x1848987613694848:12345-192.168.204.28@tcp:4:bash.0 00000100:00100000:0.0:1763333174.453007:0:28650:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe43999500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28650:1848987627260032:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333174.453036:0:28650:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe48191600/0xb32e3ef184c563da lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333174.455664:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2420:x1848987613694848:12345-192.168.204.28@tcp:4:bash.0 Request processed in 3238us (4148us total) trans 17179871571 rc 0/0 00000100:00100000:0.0:1763333174.455680:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 105 00002000:00100000:0.0:1763333174.455695:0:28426:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000400:0x235:0x0] (0->4) req@ffff92ff77a3ce00 x1848987613694848/t17179871571(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:485/0 lens 496/448 e 0 to 0 dl 1763333185 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763333174.455706:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff77a3ce00 with x1848987613694848 ext(0->4) 00010000:00010000:0.0:1763333174.455717:0:28426:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56340 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969744 expref: 19 pid: 8611 timeout: 1378 lvb_type: 0 00010000:00010000:0.0:1763333174.455735:0:28426:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56340 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969744 expref: 19 pid: 8611 timeout: 1378 lvb_type: 0 00002000:00010000:0.0:1763333174.455743:0:28426:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92ff77a3ce00 00000100:00100000:3.0:1763333174.460658:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333174.462021:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.462434:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613694976 00000100:00100000:0.0:1763333174.462447:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613694976 00000100:00100000:0.0:1763333174.462516:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9263 00000100:00100000:0.0:1763333174.462525:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56864:x1848987613694976:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333174.462545:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333174.462566:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c563f6 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969783 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.462650:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c563fd lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333174.462664:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c563fd lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.462675:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c563fd lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.462686:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56404 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333174.462693:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56404 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.462700:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56404 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.462746:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c563fd lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.462753:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c563fd lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.462759:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c563fd lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.462766:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c563fd lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.462772:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48190c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333174.462775:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c563fd lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.462783:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c563fd lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.462795:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44300) 00010000:00010000:0.0:1763333174.462798:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333174.462803:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c563fd lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.462809:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c563fd lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.462823:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56404 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.462829:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56404 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.462835:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56404 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.462840:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48190200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333174.462842:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56404 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.462848:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56404 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.462855:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe438a1600) 00010000:00010000:0.0:1763333174.462858:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333174.462861:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56404 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.462866:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56404 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.462894:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c563f6 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969783 expref: 242 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.462904:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44300) 00010000:00010000:0.0:1763333174.462906:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333174.462909:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c563f6 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969783 expref: 242 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.462922:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48190e00, rc 0) 00000100:00100000:0.0:1763333174.462999:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56864:x1848987613694976:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 474us (2354us total) trans 0 rc 301/301 00000100:00100000:0.0:1763333174.463006:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9263 00000100:00100000:2.0:1763333174.463142:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613695104 00000100:00100000:2.0:1763333174.463148:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613695104 00010000:00010000:2.0:1763333174.463172:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56340 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969744 expref: 19 pid: 8611 timeout: 1378 lvb_type: 0 00000100:00100000:2.0:1763333174.463206:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3046 00000100:00100000:2.0:1763333174.463214:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2419:x1848987613695104:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333174.463225:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1763333174.463240:0:6504:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x235:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:2.0:1763333174.463243:0:6504:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x235:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1763333174.463248:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56340 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x235:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969744 expref: 19 pid: 8611 timeout: 1378 lvb_type: 0 00010000:00010000:2.0:1763333174.463268:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56340 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x235:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969744 expref: 19 pid: 8611 timeout: 1378 lvb_type: 0 00010000:00010000:2.0:1763333174.463287:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56340 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x235:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969744 expref: 19 pid: 8611 timeout: 1378 lvb_type: 0 00010000:00010000:2.0:1763333174.463299:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333174.463301:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333174.463306:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe48191600/0xb32e3ef184c563da lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.463315:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe48191600/0xb32e3ef184c563da lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.463378:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333174.463402:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2419:x1848987613695104:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 188us (1388us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333174.463408:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3046 00010000:00010000:2.0:1763333174.463432:0:28650:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe48191600/0xb32e3ef184c563da lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.463444:0:28650:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe48191600/0xb32e3ef184c563da lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.463464:0:28650:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe48191600/0xb32e3ef184c563da lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.463471:0:28650:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe48191600/0xb32e3ef184c563da lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.463477:0:28650:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe48191600/0xb32e3ef184c563da lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.463494:0:28650:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48191600 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333174.463498:0:28650:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe48191600/0xb32e3ef184c563da lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.463505:0:28650:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe48191600/0xb32e3ef184c563da lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.463516:0:28650:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe48191600/0xb32e3ef184c563da lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.463523:0:28650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe48191600/0xb32e3ef184c563da lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333174.463563:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2420:x1848987613694592:12345-192.168.204.28@tcp:1:lfs.0 Request processed in 23394us (23749us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333174.463571:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6504 00000100:00100000:2.0:1763333174.471288:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.471756:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613695360 00000100:00100000:1.0:1763333174.471769:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613695360 00000100:00100000:0.0:1763333174.472467:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9264 00000100:00100000:0.0:1763333174.472509:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56862:x1848987613695360:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:0.0:1763333174.472566:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333174.472593:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c563be lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696976e expref: 241 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.472615:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b0:0x0].0x0 (ffff92fe43a31e00) 00010000:00010000:0.0:1763333174.472620:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333174.472668:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f000/0xb32e3ef184c5640b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333174.472685:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f000/0xb32e3ef184c5640b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.472697:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f000/0xb32e3ef184c5640b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000100:00100000:2.0:1763333174.473266:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333174.473300:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613695488 00000100:00100000:2.0:1763333174.473307:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613695488 00000100:00100000:2.0:1763333174.473340:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9265 00000100:00100000:2.0:1763333174.473360:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56864:x1848987613695488:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333174.473371:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333174.473387:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56412 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696978a expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.473425:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56419 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333174.473433:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56419 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333174.473440:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56419 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:2.0:1763333174.473475:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1763333174.473480:0:12741:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1763333174.473524:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56412 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696978a expref: 243 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.473538:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56419 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696978a expref: 242 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.473545:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31900) 00010000:00010000:2.0:1763333174.473549:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1763333174.473551:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5e00, rc 0) 00000100:00100000:2.0:1763333174.475724:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:56864:x1848987613695488:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 2360us (2443us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333174.475736:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9265 00000040:00080000:0.0:1763333174.476131:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1403, 88 off118504 00000004:00080000:0.0:1763333174.476144:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1278555794710ns, next at 1278526292086ns, rc = 0 00000040:00080000:0.0:1763333174.476220:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1404, 88 off118504 00000004:00080000:0.0:1763333174.476224:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1278555875512ns, next at 1279025269818ns, rc = 0 00000040:00080000:0.0:1763333174.476254:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1405, 88 off118592 00000004:00080000:0.0:1763333174.476259:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1278555909980ns, next at 1279025269818ns, rc = 0 00000040:00080000:0.0:1763333174.476275:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1404, 88 off118592 00000004:00080000:0.0:1763333174.476278:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1278555929469ns, next at 1278526292086ns, rc = 0 00000001:00080000:2.0:1763333174.488207:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972280 is committed 00000004:00080000:2.0:1763333174.488222:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 917 committed 00000004:00080000:2.0:1763333174.488238:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 921 committed 00000004:00080000:2.0:1763333174.488252:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 920 committed 00000004:00080000:2.0:1763333174.488255:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 916 committed 00000100:00100000:3.0:1763333174.488454:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77a3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627260288:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333174.488555:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1763333174.489452:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c563a9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.489466:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c563a9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.489474:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c563a9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.489479:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333174.489493:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c563a9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.489501:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c563a9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.489518:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe438a1600) 00010000:00010000:0.0:1763333174.489522:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333174.489527:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c563a9 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.489534:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c563a9 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000100:00100000:0.0:1763333174.489570:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763333174.489584:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77a3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627260160:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333174.489630:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:0.0:1763333174.489709:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d1a8a485 reply state 0000000026e3c09c transno 4294972280 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f000/0xb32e3ef184c5640b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.489723:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f000/0xb32e3ef184c5640b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.489730:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b0:0x0].0x0 (ffff92fe43a31e00) 00010000:00010000:0.0:1763333174.489732:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1763333174.489735:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1763333174.489837:0:6521:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1763333174.489855:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56862:x1848987613695360:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 17376us (18578us total) trans 4294972280 rc 0/0 00000100:00100000:0.0:1763333174.489865:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9264 00010000:00010000:0.0:1763333174.489894:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f000/0xb32e3ef184c5640b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.489900:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f000/0xb32e3ef184c5640b lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.489906:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f000/0xb32e3ef184c5640b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.489910:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff4148f000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333174.489913:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f000/0xb32e3ef184c5640b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.489922:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f000/0xb32e3ef184c5640b lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.489931:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b0:0x0].0x0 (ffff92fe43a31e00) 00010000:00010000:0.0:1763333174.489933:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333174.489936:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f000/0xb32e3ef184c5640b lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.489941:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f000/0xb32e3ef184c5640b lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000100:00100000:1.0:1763333174.490497:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42ef9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627260544:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333174.490535:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333174.490567:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763333174.490575:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42ef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627260416:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333174.490598:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333174.490624:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627260288 00000100:00100000:1.0:1763333174.490632:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627260288 00000100:00100000:1.0:1763333174.490667:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627260160 00000100:00100000:1.0:1763333174.490671:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627260160 00000100:00100000:1.0:1763333174.490688:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627260544 00000100:00100000:1.0:1763333174.490691:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627260544 00000100:00100000:1.0:1763333174.490709:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627260416 00000100:00100000:1.0:1763333174.490712:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627260416 00000100:00100000:1.0:1763333174.490731:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6505 00000100:00100000:1.0:1763333174.490741:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+18:3652:x1848987627260288:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333174.490916:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+19:3652:x1848987627260288:12345-0@lo:2:osp-syn-1-1.0 Request processed in 176us (2361us total) trans 17179871572 rc 0/0 00000100:00100000:1.0:1763333174.490923:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6505 00000100:00100000:1.0:1763333174.490938:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6506 00000100:00100000:1.0:1763333174.490944:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+18:3654:x1848987627260160:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333174.491109:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+19:3654:x1848987627260160:12345-0@lo:2:osp-syn-1-1.0 Request processed in 165us (1477us total) trans 17179871573 rc 0/0 00000100:00100000:1.0:1763333174.491116:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6506 00000100:00100000:1.0:1763333174.491129:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6507 00000100:00100000:1.0:1763333174.491136:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+47:3654:x1848987627260544:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333174.491224:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+48:3654:x1848987627260544:12345-0@lo:2:osp-syn-0-1.0 Request processed in 88us (689us total) trans 21474838876 rc 0/0 00000100:00100000:1.0:1763333174.491231:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6507 00000100:00100000:1.0:1763333174.491243:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6508 00000100:00100000:1.0:1763333174.491249:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+47:3652:x1848987627260416:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1763333174.491292:0:28600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x235:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333174.491295:0:28600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x235:0x0] updating lvb mtime from disk: 1763333174 -> 1763333174 00002000:00010000:1.0:1763333174.491298:0:28600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x235:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333174.491300:0:28600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x235:0x0] updating lvb ctime from disk: 1763333174 -> 1763333174 00002000:00010000:1.0:1763333174.491302:0:28600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x235:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333174.491326:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+48:3652:x1848987627260416:12345-0@lo:2:osp-syn-0-1.0 Request processed in 77us (727us total) trans 21474838877 rc 0/0 00000100:00100000:1.0:1763333174.491332:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6508 00000004:00080000:1.0:1763333174.491422:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe42ef9f80/2, rc 0, transno 21474838876 00000100:00100000:1.0:1763333174.491428:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42ef9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627260544:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1763333174.491440:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff77a3c700/2, rc 0, transno 17179871573 00000100:00100000:1.0:1763333174.491444:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77a3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627260160:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1763333174.491460:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe42ef8700/2, rc 0, transno 21474838877 00000100:00100000:1.0:1763333174.491463:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42ef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627260416:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1763333174.491472:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff77a3e680/2, rc 0, transno 17179871572 00000100:00100000:1.0:1763333174.491476:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77a3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627260288:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333174.491803:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.493141:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613695616 00000100:00100000:0.0:1763333174.493151:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613695616 00000100:00100000:0.0:1763333174.493215:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9266 00000100:00100000:0.0:1763333174.493224:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56864:x1848987613695616:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333174.493242:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333174.493264:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f800/0xb32e3ef184c56420 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969791 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.493331:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c56427 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333174.493362:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c56427 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.493374:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c56427 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.493388:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e800/0xb32e3ef184c5642e lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333174.493395:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e800/0xb32e3ef184c5642e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.493401:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e800/0xb32e3ef184c5642e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.493442:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c56427 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.493448:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c56427 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.493454:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c56427 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.493461:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c56427 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.493466:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff4148e200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333174.493470:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c56427 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.493476:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c56427 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.493496:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31900) 00010000:00010000:0.0:1763333174.493500:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333174.493505:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c56427 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.493511:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c56427 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.493522:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e800/0xb32e3ef184c5642e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.493528:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e800/0xb32e3ef184c5642e lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.493534:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e800/0xb32e3ef184c5642e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.493539:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff4148e800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333174.493541:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e800/0xb32e3ef184c5642e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.493546:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e800/0xb32e3ef184c5642e lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.493553:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b44300) 00010000:00010000:0.0:1763333174.493555:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333174.493558:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e800/0xb32e3ef184c5642e lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.493563:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e800/0xb32e3ef184c5642e lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.493597:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f800/0xb32e3ef184c56420 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969791 expref: 233 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.493609:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31900) 00010000:00010000:0.0:1763333174.493611:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333174.493615:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f800/0xb32e3ef184c56420 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969791 expref: 233 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.493624:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff4148f800, rc 0) 00000100:00100000:0.0:1763333174.493685:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+232:56864:x1848987613695616:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 462us (1884us total) trans 0 rc 301/301 00000100:00100000:0.0:1763333174.493692:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9266 00000100:00100000:3.0:1763333174.495636:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333174.497181:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333174.498930:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613695744 00000100:00100000:2.0:1763333174.498946:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613695744 00000100:00100000:0.0:1763333174.499043:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613696000 00000100:00100000:0.0:1763333174.499048:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613696000 00000100:00100000:0.0:1763333174.499168:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9267 00000100:00100000:0.0:1763333174.499179:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56862:x1848987613695744:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333174.499205:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333174.499228:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c56435 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969798 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.499293:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c56435 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969798 expref: 234 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.499306:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c56435 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969798 expref: 234 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.499323:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b0:0x0].0x0 (ffff92fe43a31e00) 00010000:00010000:0.0:1763333174.499326:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333174.499330:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff4148ee00, rc 0) 00000100:00100000:0.0:1763333174.500026:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:56862:x1848987613695744:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 844us (4395us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333174.500037:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9267 00000100:00100000:0.0:1763333174.500865:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9268 00000100:00100000:0.0:1763333174.500880:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56864:x1848987613696000:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333174.500899:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333174.500903:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763333174.500929:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56419 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696978a expref: 233 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.500948:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31900) 00010000:00010000:0.0:1763333174.500959:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333174.500973:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c5643c lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696979f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.501075:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56443 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333174.501087:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56443 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.501096:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56443 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.501108:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c5644a lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333174.501114:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c5644a lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.501120:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c5644a lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000100:00100000:1.0:1763333174.507055:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:0.0:1763333174.507531:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c56451 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333174.507551:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c56451 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.507563:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c56451 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:0.0:1763333174.507577:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b1:0x0]: returning size 0 00010000:00010000:0.0:1763333174.507604:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56443 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.507611:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56443 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.507618:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56443 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.507625:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56443 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.507631:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48191800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333174.507635:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56443 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.507642:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56443 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.507653:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44400) 00010000:00010000:0.0:1763333174.507656:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333174.507660:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56443 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.507666:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56443 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000004:00010000:0.0:1763333174.507677:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a2ce2a7b reply state 0000000099c23692 transno 4294972281 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c5644a lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.507687:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c5644a lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.507693:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b44e00) 00010000:00010000:0.0:1763333174.507696:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333174.507698:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763333174.507729:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c5643c lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696979f expref: 235 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.507754:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c56451 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696979f expref: 234 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.507762:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b1:0x0].0x0 (ffff92fe43b44800) 00010000:00010000:0.0:1763333174.507765:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333174.507767:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48190e00, rc 0) 00000100:00100000:0.0:1763333174.507824:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:56864:x1848987613696000:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 6950us (10653us total) trans 4294972281 rc 0/0 00000100:00100000:0.0:1763333174.507834:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9268 00000100:00100000:0.0:1763333174.508716:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613696128 00000100:00100000:0.0:1763333174.508727:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613696128 00000100:00100000:0.0:1763333174.508774:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9269 00000100:00100000:0.0:1763333174.508782:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:56862:x1848987613696128:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333174.508800:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333174.508820:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c5645f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369697a6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.508884:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56466 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333174.508897:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56466 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.508906:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56466 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:0.0:1763333174.508937:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b0:0x0]: returning size 5 00000004:00200000:0.0:1763333174.508941:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763333174.508955:0:6521:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56466 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.508974:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c5645f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697a6 expref: 237 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.508988:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56466 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697a6 expref: 236 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.508996:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b0:0x0].0x0 (ffff92fe43a31e00) 00010000:00010000:0.0:1763333174.508999:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1763333174.509002:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48190c00, rc 0) 00000100:00100000:0.0:1763333174.509035:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56862:x1848987613696128:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 254us (1992us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333174.509041:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9269 00000100:00100000:3.0:1763333174.512648:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333174.513343:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613696256 00000100:00100000:2.0:1763333174.513386:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613696256 00000100:00100000:2.0:1763333174.513452:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6509 00000100:00100000:2.0:1763333174.513462:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2418:x1848987613696256:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333174.513491:0:28650:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333174.513515:0:28650:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5646d lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369697ad expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763333174.513542:0:28650:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x235:0x0] initial LVB size: 5, mtime: 0x691a5436, atime: 0x0, ctime: 0x691a5436, blocks: 0x8 00010000:00010000:2.0:1763333174.513562:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333174.513564:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333174.513575:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5646d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697ad expref: 18 pid: 28650 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333174.513592:0:28650:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5646d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697ad expref: 18 pid: 28650 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333174.513609:0:28650:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4a00, rc 0) 00000100:00100000:2.0:1763333174.517726:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2418:x1848987613696256:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 4250us (5072us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333174.517740:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6509 00000100:00100000:3.0:1763333174.517883:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333174.518052:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613696512 00000100:00100000:2.0:1763333174.518061:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613696512 00000100:00100000:2.0:1763333174.518108:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9270 00000100:00100000:2.0:1763333174.518116:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56864:x1848987613696512:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333174.518138:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333174.518158:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56474 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1b1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369697b4 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.518271:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5647b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333174.518285:0:12741:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c56451 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696979f expref: 237 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.518294:0:12741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5647b lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333174.518323:0:12741:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c56451 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696979f expref: 237 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.518335:0:12741:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c56451 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696979f expref: 237 pid: 6521 timeout: 1378 lvb_type: 0 00000100:00100000:2.0:1763333174.518373:0:12741:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4920ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627260672:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333174.518441:0:12741:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff6b0c2540 going to sleep for 11 seconds 00000100:00100000:2.0:1763333174.527619:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.527980:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613696640 00000100:00100000:0.0:1763333174.527991:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613696640 00010000:00010000:0.0:1763333174.528045:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c56451 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696979f expref: 238 pid: 6521 timeout: 1378 lvb_type: 0 00000100:00100000:3.0:1763333174.528961:0:12741:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4920ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627260672:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333174.528998:0:12741:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5647b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000100:00100000:0.0:1763333174.529096:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3047 00000100:00100000:0.0:1763333174.529112:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:2420:x1848987613696640:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333174.529132:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333174.529141:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c56451 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696979f expref: 238 pid: 6521 timeout: 1378 lvb_type: 0 00010000:00010000:0.0:1763333174.529152:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c56451 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696979f expref: 238 pid: 6521 timeout: 1378 lvb_type: 0 00010000:00010000:0.0:1763333174.529180:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c56451 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696979f expref: 238 pid: 6521 timeout: 1378 lvb_type: 0 00010000:00010000:0.0:1763333174.529198:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b1:0x0].0x0 (ffff92fe43b44800) 00010000:00010000:0.0:1763333174.529202:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5647b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.529211:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5647b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.529217:0:6505:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5647b lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.529237:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333174.529291:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:2420:x1848987613696640:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 185us (1683us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333174.529299:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3047 00010000:00010000:3.0:1763333174.529538:0:12741:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5647b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.529545:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5647b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:3.0:1763333174.529571:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b1:0x0]: returning size 0 00000004:00080000:3.0:1763333174.529757:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x237:0x0], index 0: 0 00000004:00080000:3.0:1763333174.529764:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x237:0x0], index 1: 0 00000004:00080000:3.0:1763333174.529768:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x238:0x0], index 1: 0 00000004:00080000:3.0:1763333174.529772:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x238:0x0], index 0: 0 00010000:00010000:3.0:1763333174.529883:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5647b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.529891:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5647b lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.529899:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5647b lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.529905:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333174.529910:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5647b lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.529917:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5647b lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.529926:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b1:0x0].0x0 (ffff92fe43b44800) 00010000:00010000:3.0:1763333174.529929:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763333174.529932:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5647b lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.529938:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5647b lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.530001:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56474 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1b1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697b4 expref: 237 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.530011:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b1:0x0].0x0 (ffff92fe43b44800) 00010000:00010000:3.0:1763333174.530013:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763333174.530017:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56474 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697b4 expref: 237 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.530030:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4800, rc 0) 00000100:00100000:3.0:1763333174.530253:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56864:x1848987613696512:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 12135us (12369us total) trans 4294972282 rc 301/301 00000100:00100000:3.0:1763333174.530261:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9270 00000100:00100000:2.0:1763333174.543765:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333174.543844:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613696896 00000100:00100000:3.0:1763333174.543854:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613696896 00000100:00100000:3.0:1763333174.543921:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3169 00000100:00100000:3.0:1763333174.543932:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56864:x1848987613696896:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333174.544253:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56864:x1848987613696896:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 322us (497us total) trans 4294972283 rc 0/0 00000100:00100000:3.0:1763333174.544262:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3169 00000100:00100000:3.0:1763333174.547471:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.547594:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613697152 00000100:00100000:0.0:1763333174.547606:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613697152 00000100:00100000:0.0:1763333174.547680:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3170 00000100:00100000:0.0:1763333174.547690:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56864:x1848987613697152:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333174.549412:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56864:x1848987613697152:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 1711us (1939us total) trans 4294972284 rc 0/0 00000100:00100000:2.0:1763333174.549425:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3170 00000100:00100000:2.0:1763333174.555586:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333174.555820:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613697408 00000100:00100000:3.0:1763333174.555833:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613697408 00000100:00100000:3.0:1763333174.555904:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9271 00000100:00100000:3.0:1763333174.555916:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:55917:x1848987613697408:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333174.555944:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333174.556018:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56489 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369697bb expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.556215:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56490 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333174.556232:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56490 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.556249:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56490 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.556260:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c56497 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333174.556269:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c56497 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.556276:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c56497 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.556342:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5649e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333174.556396:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5649e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.556403:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5649e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:3.0:1763333174.556413:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b1:0x0]: returning size 0 00010000:00010000:3.0:1763333174.556522:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56490 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.556530:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56490 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.556537:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56490 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.556544:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56490 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.556549:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333174.556555:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56490 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.556563:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56490 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.556578:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:3.0:1763333174.556582:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333174.556587:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56490 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.556594:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56490 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.556610:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c56497 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.556616:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c56497 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.556621:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c56497 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.556626:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333174.556628:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c56497 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.556633:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c56497 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.556639:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b44e00) 00010000:00010000:3.0:1763333174.556642:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333174.556644:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c56497 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.556654:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c56497 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.556694:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56489 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697bb expref: 241 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.556711:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5649e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697bb expref: 240 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.556719:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b1:0x0].0x0 (ffff92ff8016f800) 00010000:00010000:3.0:1763333174.556721:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333174.556724:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a97000, rc 0) 00000100:00100000:3.0:1763333174.556800:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:55917:x1848987613697408:12345-192.168.204.28@tcp:101:bash.0 Request processed in 886us (1226us total) trans 4294972285 rc 0/0 00000100:00100000:3.0:1763333174.556808:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9271 00000100:00100000:1.0:1763333174.561705:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333174.561884:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613697536 00000100:00100000:3.0:1763333174.561898:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613697536 00000100:00100000:2.0:1763333174.562658:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9272 00000100:00100000:2.0:1763333174.562675:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:55917:x1848987613697536:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333174.562702:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333174.562726:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c564ac lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1b1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369697c2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.562770:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c564b3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333174.562789:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c564b3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.562801:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c564b3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.562941:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c564ac lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697c2 expref: 242 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.562974:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c564b3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697c2 expref: 241 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.562983:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b1:0x0].0x0 (ffff92ff8016f800) 00010000:00010000:2.0:1763333174.562987:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763333174.562990:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5e00, rc 0) 00000100:00100000:2.0:1763333174.563066:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:55917:x1848987613697536:12345-192.168.204.28@tcp:101:bash.0 Request processed in 397us (1377us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333174.563073:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9272 00000100:00100000:2.0:1763333174.566973:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.567157:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613697792 00000100:00100000:0.0:1763333174.567169:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613697792 00000100:00100000:0.0:1763333174.567784:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9273 00000100:00100000:0.0:1763333174.567805:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:55917:x1848987613697792:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:0.0:1763333174.567873:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333174.567905:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5649e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697bb expref: 241 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.567927:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b1:0x0].0x0 (ffff92ff8016f800) 00010000:00010000:0.0:1763333174.567933:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333174.568140:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c564ba lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1b1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333174.568155:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c564ba lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.568166:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c564ba lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000001:00080000:0.0:1763333174.568219:0:12741:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294972286 00000004:00010000:0.0:1763333174.568247:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000592714d7 reply state 00000000285d893c transno 4294972287 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c564ba lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.568260:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c564ba lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1b1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.568266:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b1:0x0].0x0 (ffff92ff8016f800) 00010000:00010000:0.0:1763333174.568270:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333174.568272:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763333174.568425:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:55917:x1848987613697792:12345-192.168.204.28@tcp:36:bash.0 Request processed in 626us (1472us total) trans 4294972287 rc 0/0 00000100:00100000:0.0:1763333174.569508:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9273 00000020:00080000:0.0:1763333174.569518:0:12741:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763333174.572215:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.572297:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613697920 00000100:00100000:1.0:1763333174.572310:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613697920 00000100:00100000:1.0:1763333174.572403:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9274 00000100:00100000:1.0:1763333174.572413:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:55917:x1848987613697920:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333174.572440:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333174.572462:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c564c1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1b1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369697c9 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.572556:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c564c1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697c9 expref: 244 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.572569:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c564c1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697c9 expref: 244 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.572588:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b1:0x0].0x0 (ffff92ff8016f800) 00010000:00010000:1.0:1763333174.572591:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763333174.572596:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f000, rc 0) 00000100:00100000:1.0:1763333174.572655:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:55917:x1848987613697920:12345-192.168.204.28@tcp:101:bash.0 Request processed in 244us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333174.572662:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9274 00000100:00100000:1.0:1763333174.573828:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333174.574044:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613698048 00000100:00100000:2.0:1763333174.574052:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613698048 00000100:00100000:2.0:1763333174.574106:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6510 00000100:00100000:2.0:1763333174.574116:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2419:x1848987613698048:12345-192.168.204.28@tcp:23:lfs.0 00000100:00100000:2.0:1763333174.574434:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2419:x1848987613698048:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 318us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333174.574443:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6510 00000100:00100000:0.0:1763333174.574760:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333174.574815:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613698304 00000100:00100000:3.0:1763333174.574822:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613698304 00000100:00100000:3.0:1763333174.574866:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9275 00000100:00100000:3.0:1763333174.574874:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4399a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:55917:x1848987613698304:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333174.574890:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333174.574893:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763333174.574924:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c564c1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697c9 expref: 244 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.574943:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b1:0x0].0x0 (ffff92ff8016f800) 00010000:00010000:3.0:1763333174.574955:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333174.574971:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c564c8 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1b1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369697d0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.575018:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c564cf lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333174.575032:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c564cf lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b1:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333174.575041:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c564cf lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b1:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000040:00080000:3.0:1763333174.575299:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1406, 88 off118680 00000004:00080000:3.0:1763333174.575308:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1278654958208ns, next at 1279025269818ns, rc = 0 00000040:00080000:3.0:1763333174.575371:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1405, 88 off118680 00000004:00080000:3.0:1763333174.575377:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1278655028131ns, next at 1278526292086ns, rc = 0 00000040:00080000:3.0:1763333174.575400:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1406, 88 off118768 00000004:00080000:3.0:1763333174.575405:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1278655055931ns, next at 1278526292086ns, rc = 0 00000040:00080000:3.0:1763333174.575415:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1407, 88 off118768 00000004:00080000:3.0:1763333174.575419:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1278655070566ns, next at 1279025269818ns, rc = 0 00000100:00100000:1.0:1763333174.576812:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333174.576932:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613698432 00000100:00100000:3.0:1763333174.576942:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613698432 00000001:00080000:2.0:1763333174.577306:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972288 is committed 00000004:00080000:2.0:1763333174.577315:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 923 committed 00000004:00080000:2.0:1763333174.577329:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 919 committed 00000004:00080000:2.0:1763333174.577336:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 918 committed 00000004:00080000:2.0:1763333174.577338:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 922 committed 00000100:00100000:3.0:1763333174.577344:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6511 00000100:00100000:3.0:1763333174.577372:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2418:x1848987613698432:12345-192.168.204.28@tcp:23:lfs.0 00010000:00010000:0.0:1763333174.577474:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c5644a lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.577496:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c5644a lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00000100:00100000:3.0:1763333174.577499:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2418:x1848987613698432:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 127us (695us total) trans 0 rc 0/0 00010000:00010000:0.0:1763333174.577504:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c5644a lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00000100:00100000:3.0:1763333174.577506:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6511 00010000:00010000:0.0:1763333174.577510:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48191600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333174.577515:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c5644a lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.577523:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c5644a lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.577538:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b44e00) 00010000:00010000:0.0:1763333174.577541:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333174.577545:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c5644a lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333174.577551:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c5644a lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333174.577566:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c564cf lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b1:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697d0 expref: 238 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.577575:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c564ba lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1b1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.577581:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c564ba lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1b1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00000100:00100000:1.0:1763333174.577682:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1763333174.577695:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e00ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627260800:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333174.577731:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333174.577760:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e00df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627260928:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333174.577777:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763333174.577822:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b1:0x0].0x0 (ffff92ff8016f800) 00010000:00010000:0.0:1763333174.577822:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c564ba lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1b1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.577825:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763333174.577828:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48191800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333174.577831:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c564ba lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1b1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.577841:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c564c8 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697d0 expref: 237 pid: 6519 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1763333174.577948:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c564ba lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.577960:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b1:0x0].0x0 (ffff92ff8016f800) 00010000:00010000:3.0:1763333174.577962:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c564cf lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b1:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697d0 expref: 236 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.577962:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333174.577966:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c564ba lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1b1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.577971:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c564ba lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.577994:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b1:0x0].0x0 (ffff92ff8016f800) 00010000:00010000:3.0:1763333174.577996:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763333174.577998:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a97200, rc 0) 00000100:00100000:3.0:1763333174.578029:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4399a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:55917:x1848987613698304:12345-192.168.204.28@tcp:101:bash.0 Request processed in 3155us (3269us total) trans 4294972288 rc 0/0 00000100:00100000:3.0:1763333174.578037:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9275 00000100:00100000:0.0:1763333174.578044:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1763333174.578052:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe43999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627261184:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333174.578059:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627260800 00000100:00100000:3.0:1763333174.578063:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627260800 00000100:00100000:0.0:1763333174.578080:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333174.578087:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627260928 00000100:00100000:3.0:1763333174.578090:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627260928 00000100:00100000:3.0:1763333174.578106:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627261184 00000100:00100000:3.0:1763333174.578108:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627261184 00000100:00100000:0.0:1763333174.578110:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6512 00000100:00100000:0.0:1763333174.578121:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+49:3654:x1848987627260800:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333174.578125:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6513 00000100:00100000:3.0:1763333174.578130:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+49:3652:x1848987627260928:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333174.578255:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+51:3652:x1848987627260928:12345-0@lo:2:osp-syn-0-1.0 Request processed in 124us (476us total) trans 21474838878 rc 0/0 00000100:00100000:0.0:1763333174.578255:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+51:3654:x1848987627260800:12345-0@lo:2:osp-syn-0-1.0 Request processed in 137us (522us total) trans 21474838879 rc 0/0 00000100:00100000:0.0:1763333174.578261:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6512 00000100:00100000:3.0:1763333174.578264:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6513 00000100:00100000:0.0:1763333174.578273:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6514 00000100:00100000:0.0:1763333174.578279:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+19:3655:x1848987627261184:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333174.578400:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+20:3655:x1848987627261184:12345-0@lo:2:osp-syn-1-1.0 Request processed in 121us (318us total) trans 17179871574 rc 0/0 00000100:00100000:0.0:1763333174.578406:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6514 00000004:00080000:0.0:1763333174.578442:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7e00ea00/2, rc 0, transno 21474838879 00000100:00100000:0.0:1763333174.578448:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e00ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627260800:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1763333174.578504:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe43999880/2, rc 0, transno 17179871574 00000100:00100000:3.0:1763333174.578509:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe43999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627261184:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333174.578613:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4399bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627261056:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333174.578641:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1763333174.578725:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7e00df80/2, rc 0, transno 21474838878 00000100:00100000:2.0:1763333174.578730:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e00df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627260928:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333174.578851:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627261056 00000100:00100000:0.0:1763333174.578856:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627261056 00000100:00100000:1.0:1763333174.580254:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6515 00000100:00100000:1.0:1763333174.580270:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+20:3653:x1848987627261056:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333174.582376:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.582410:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.582436:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613698688 00000100:00100000:0.0:1763333174.582444:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613698688 00000100:00100000:0.0:1763333174.582519:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1609 00000100:00100000:0.0:1763333174.582528:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2421:x1848987613698688:12345-192.168.204.28@tcp:3:lfs.0 00010000:00010000:0.0:1763333174.582584:0:28426:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c564d6 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.582599:0:28426:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333174.582601:0:28426:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333174.582607:0:28426:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c564d6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.582619:0:28426:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c564d6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.582712:0:28426:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c564d6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.582721:0:28426:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c564d6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.582729:0:28426:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c564d6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.582736:0:28426:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48190e00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333174.582739:0:28426:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c564d6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.582747:0:28426:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c564d6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.582768:0:28426:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c564d6 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.582776:0:28426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c564d6 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333174.582837:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2421:x1848987613698688:12345-192.168.204.28@tcp:3:lfs.0 Request processed in 310us (425us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1763333174.582845:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1609 00000100:00100000:3.0:1763333174.583050:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613698560 00000100:00100000:3.0:1763333174.583055:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613698560 00000100:00100000:3.0:1763333174.583082:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6516 00000100:00100000:3.0:1763333174.583088:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+26:55917:x1848987613698560:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333174.583098:0:28650:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333174.583113:0:28650:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96c00/0xb32e3ef184c564dd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369697d7 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333174.583133:0:28650:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x237:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333174.583145:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333174.583147:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333174.583153:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96c00/0xb32e3ef184c564dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697d7 expref: 27 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.583165:0:28650:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96c00/0xb32e3ef184c564dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697d7 expref: 27 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.583174:0:28650:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96c00, rc 0) 00000100:00100000:3.0:1763333174.583199:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+27:55917:x1848987613698560:12345-192.168.204.28@tcp:101:bash.0 Request processed in 111us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333174.583205:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6516 00000100:00100000:1.0:1763333174.583689:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+21:3653:x1848987627261056:12345-0@lo:2:osp-syn-1-1.0 Request processed in 3423us (5044us total) trans 17179871575 rc 0/0 00000100:00100000:1.0:1763333174.583701:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6515 00000004:00080000:3.0:1763333174.584366:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4399bb80/2, rc 0, transno 17179871575 00000100:00100000:3.0:1763333174.584374:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4399bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627261056:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333174.589535:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.594492:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613698816 00000100:00100000:1.0:1763333174.594509:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613698816 00000100:00100000:1.0:1763333174.594602:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6517 00000100:00100000:1.0:1763333174.594613:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:55917:x1848987613698816:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333174.594631:0:29010:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333174.594654:0:29010:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c564e4 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369697de expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333174.594677:0:29010:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x237:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333174.594698:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333174.594701:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333174.594710:0:29010:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c564e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697de expref: 19 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.594725:0:29010:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c564e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697de expref: 19 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.594737:0:29010:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f600, rc 0) 00000100:00100000:1.0:1763333174.594804:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:55917:x1848987613698816:12345-192.168.204.28@tcp:101:bash.0 Request processed in 192us (5459us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333174.594812:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6517 00000100:00100000:2.0:1763333174.595080:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.595340:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613698944 00000100:00100000:0.0:1763333174.595375:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613698944 00000100:00100000:0.0:1763333174.595410:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9276 00000100:00100000:0.0:1763333174.595418:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:56862:x1848987613698944:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333174.595434:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333174.595451:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f800/0xb32e3ef184c564eb lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369697e5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.595494:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e800/0xb32e3ef184c564f2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333174.595507:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e800/0xb32e3ef184c564f2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333174.595517:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e800/0xb32e3ef184c564f2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333174.595637:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f800/0xb32e3ef184c564eb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697e5 expref: 237 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.595658:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e800/0xb32e3ef184c564f2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697e5 expref: 236 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.595666:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b0:0x0].0x0 (ffff92fe43a31e00) 00010000:00010000:0.0:1763333174.595669:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763333174.595672:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff4148e800, rc 0) 00000100:00100000:0.0:1763333174.595716:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56862:x1848987613698944:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 298us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333174.595724:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9276 00000100:00100000:0.0:1763333174.600033:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.600066:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.600098:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.600173:0:28430:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613699072 00000100:00100000:1.0:1763333174.600184:0:28430:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613699072 00002000:00010000:1.0:1763333174.600226:0:28430:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/567 (0->18446744073709551615) 00002000:00100000:1.0:1763333174.600231:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7e123800 with x1848987613699072 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333174.600244:0:28430:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7e123800. 00000100:00100000:1.0:1763333174.600274:0:28430:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613699328 00000100:00100000:1.0:1763333174.600278:0:28430:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613699328 00000100:00100000:1.0:1763333174.600302:0:28430:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613699200 00000100:00100000:1.0:1763333174.600305:0:28430:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613699200 00002000:00010000:1.0:1763333174.600316:0:28430:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/567 (0->18446744073709551615) 00002000:00100000:1.0:1763333174.600319:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff50065f80 with x1848987613699200 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333174.600325:0:28430:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff50065f80. 00000100:00100000:1.0:1763333174.600341:0:28430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1610 00000100:00100000:1.0:1763333174.600376:0:28430:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+28:2420:x1848987613699072:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:1.0:1763333174.600565:0:28430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x237:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333174.600569:0:28430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x237:0x0] updating lvb mtime from disk: 0 -> 1763333174 00002000:00010000:1.0:1763333174.600572:0:28430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x237:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333174.600575:0:28430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x237:0x0] updating lvb ctime from disk: 0 -> 1763333174 00002000:00010000:1.0:1763333174.600577:0:28430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x237:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333174.600626:0:28430:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:2420:x1848987613699072:12345-192.168.204.28@tcp:10:bash.0 Request processed in 277us (602us total) trans 21474838880 rc 0/0 00000100:00100000:1.0:1763333174.600634:0:28430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1610 00002000:00010000:1.0:1763333174.600637:0:28430:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/567 (0->18446744073709551615) 00002000:00100000:1.0:1763333174.600640:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7e123800 with x1848987613699072 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333174.600644:0:28430:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7e123800. 00000100:00100000:1.0:1763333174.600662:0:28430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1611 00000100:00100000:1.0:1763333174.600668:0:28430:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50065880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+28:2418:x1848987613699328:12345-192.168.204.28@tcp:4:lfs.0 00002000:00010000:1.0:1763333174.600700:0:28430:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x236:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333174.600708:0:28430:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c564f9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.600725:0:28430:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333174.600728:0:28430:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333174.600733:0:28430:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c564f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.600746:0:28430:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c564f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333174.601117:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1612 00000100:00100000:1.0:1763333174.601126:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50065f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2420:x1848987613699200:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:1.0:1763333174.601219:0:24027:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x237:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333174.601222:0:24027:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x237:0x0] updating lvb mtime from disk: 0 -> 1763333174 00002000:00010000:1.0:1763333174.601224:0:24027:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x237:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333174.601226:0:24027:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x237:0x0] updating lvb ctime from disk: 0 -> 1763333174 00002000:00010000:1.0:1763333174.601228:0:24027:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x237:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333174.601254:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50065f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2420:x1848987613699200:12345-192.168.204.28@tcp:10:bash.0 Request processed in 130us (1156us total) trans 17179871576 rc 0/0 00000100:00100000:1.0:1763333174.601295:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1612 00002000:00010000:1.0:1763333174.601299:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/567 (0->18446744073709551615) 00002000:00100000:1.0:1763333174.601301:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff50065f80 with x1848987613699200 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333174.601306:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff50065f80. 00000100:00100000:0.0:1763333174.606079:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333174.606175:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613699584 00000100:00100000:2.0:1763333174.606186:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613699584 00000100:00100000:2.0:1763333174.606245:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3171 00000100:00100000:2.0:1763333174.606257:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50065180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:55917:x1848987613699584:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:2.0:1763333174.606635:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50065180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:55917:x1848987613699584:12345-192.168.204.28@tcp:35:bash.0 Request processed in 379us (565us total) trans 4294972289 rc 0/0 00000100:00100000:2.0:1763333174.606643:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3171 00000001:00080000:1.0:1763333174.606888:0:24714:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838881 is committed 00000001:00080000:1.0:1763333174.606904:0:24714:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838878 is committed 00000001:00080000:1.0:1763333174.606910:0:24714:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838879 is committed 00002000:00010000:2.0:1763333174.607275:0:28430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x236:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:2.0:1763333174.607424:0:28430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x236:0x0] updating lvb mtime from disk: 0 -> 1763333174 00002000:00010000:2.0:1763333174.607426:0:28430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x236:0x0] updating lvb ctime from disk: 0 -> 1763333174 00002000:00010000:2.0:1763333174.607428:0:28430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x236:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1763333174.607440:0:28430:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c564f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.607450:0:28430:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c564f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.607458:0:28430:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c564f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.607465:0:28430:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f800 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333174.607470:0:28430:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c564f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.607488:0:28430:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c564f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.607509:0:28430:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c564f9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.607519:0:28430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c564f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333174.608292:0:28430:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50065880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+11:2418:x1848987613699328:12345-192.168.204.28@tcp:4:lfs.0 Request processed in 7617us (8218us total) trans 21474838881 rc 0/0 00000100:00100000:2.0:1763333174.608303:0:28430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1611 00000100:00100000:0.0:1763333174.621778:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.621875:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613699712 00000100:00100000:1.0:1763333174.621885:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613699712 00000100:00100000:1.0:1763333174.621945:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9277 00000100:00100000:1.0:1763333174.621955:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50066a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56865:x1848987613699712:12345-192.168.204.28@tcp:101:rm.0 00010000:00010000:1.0:1763333174.621979:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333174.622001:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56500 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369697ec expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.622062:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56507 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333174.622076:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56507 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.622086:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56507 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.622097:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5650e lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333174.622103:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5650e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.622110:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5650e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.622179:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c56515 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333174.622187:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c56515 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b1:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.622193:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c56515 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b1:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:1.0:1763333174.622229:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b1:0x0]: returning size 5 00000004:00200000:1.0:1763333174.622234:0:12741:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763333174.622250:0:12741:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c56515 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b1:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.622260:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c56515 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.622269:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56507 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.622276:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56507 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.622282:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56507 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.622288:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56507 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.622293:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333174.622297:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56507 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.622304:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56507 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.622314:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff42c64a00) 00010000:00010000:1.0:1763333174.622317:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333174.622321:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56507 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.622327:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56507 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.622339:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5650e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.622398:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5650e lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.622405:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5650e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.622410:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fc00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333174.622413:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5650e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.622419:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5650e lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.622425:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff42c64400) 00010000:00010000:1.0:1763333174.622428:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333174.622430:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5650e lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.622435:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5650e lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.622460:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56500 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697ec expref: 239 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.622474:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c56515 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697ec expref: 238 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.622492:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b1:0x0].0x0 (ffff92ff8016f800) 00010000:00010000:1.0:1763333174.622494:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333174.622497:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e600, rc 0) 00000100:00100000:1.0:1763333174.622562:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50066a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56865:x1848987613699712:12345-192.168.204.28@tcp:101:rm.0 Request processed in 609us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333174.622570:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9277 00000100:00100000:0.0:1763333174.631158:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333174.633160:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613699968 00000100:00100000:3.0:1763333174.633176:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613699968 00000100:00100000:2.0:1763333174.633290:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9278 00000100:00100000:2.0:1763333174.633302:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56865:x1848987613699968:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:2.0:1763333174.633391:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1763333174.633420:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c564cf lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b1:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697d0 expref: 238 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.633448:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c56515 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697ec expref: 237 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.633461:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c564b3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697c2 expref: 236 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.633471:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b1:0x0].0x0 (ffff92ff8016f800) 00010000:00010000:2.0:1763333174.633491:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333174.633510:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:2.0:1763333174.633523:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5651c lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333174.633535:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5651c lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.633546:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5651c lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.633560:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56523 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00000100:00100000:1.0:1763333174.633565:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613700224 00010000:00010000:2.0:1763333174.633566:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56523 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00000100:00100000:1.0:1763333174.633569:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613700224 00010000:00010000:2.0:1763333174.633572:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56523 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000100:00100000:1.0:1763333174.633605:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9279 00000100:00100000:1.0:1763333174.633612:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56862:x1848987613700224:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:1.0:1763333174.633635:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333174.633647:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56466 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b0:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697a6 expref: 236 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.633657:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b0:0x0].0x0 (ffff92fe43a31e00) 00010000:00010000:2.0:1763333174.633658:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5652a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333174.633660:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333174.633665:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5652a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.633671:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5652a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333174.633704:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56531 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333174.633712:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56531 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.633718:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56531 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00010000:1.0:1763333174.633812:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e7791932 reply state 00000000a618fc21 transno 4294972290 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56531 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.633824:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56531 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.633830:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b0:0x0].0x0 (ffff92fe43a31e00) 00010000:00010000:1.0:1763333174.633832:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333174.633835:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000040:00080000:2.0:1763333174.633864:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1408, 64 off118832 00000040:00080000:2.0:1763333174.633894:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1407, 64 off118832 00000004:00080000:2.0:1763333174.633900:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1278713550425ns, next at 1279713547966ns, rc = 0 00000040:00080000:2.0:1763333174.633909:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1408, 64 off118896 00000040:00080000:2.0:1763333174.633918:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1409, 64 off118896 00000100:00100000:1.0:1763333174.633919:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56862:x1848987613700224:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 307us (408us total) trans 4294972290 rc 0/0 00000100:00100000:1.0:1763333174.633927:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9279 00010000:00010000:2.0:1763333174.633952:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56538 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1b1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333174.633961:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56538 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.633968:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56538 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.633975:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56538 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1b1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.633982:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56538 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1b1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.633987:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56538 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1b1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.634015:0:6519:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763333174.634028:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5652a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.634034:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5652a lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1b1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.634039:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5652a lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1b1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.634044:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333174.634048:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5652a lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1b1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.634054:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5652a lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1b1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.634062:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b1:0x0].0x0 (ffff92fe43a31800) 00010000:00010000:2.0:1763333174.634065:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763333174.634069:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5652a lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1b1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.634074:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5652a lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1b1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.634189:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5651c lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.634199:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5651c lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.634205:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5651c lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.634211:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5651c lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.634215:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333174.634217:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5651c lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.634223:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5651c lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.634230:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31100) 00010000:00010000:2.0:1763333174.634232:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333174.634235:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5651c lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.634240:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5651c lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:2.0:1763333174.634251:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ecc86d1c reply state 00000000f1ab2685 transno 4294972291 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56523 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.634259:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56523 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.634264:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43a31600) 00010000:00010000:2.0:1763333174.634266:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333174.634267:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763333174.634298:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56865:x1848987613699968:12345-192.168.204.28@tcp:36:rm.0 Request processed in 999us (3149us total) trans 4294972291 rc 0/0 00000100:00100000:2.0:1763333174.634305:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9278 00010000:00010000:1.0:1763333174.634455:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333174.634461:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56538 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1b1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333174.634467:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5c00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333174.634474:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56538 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1b1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333174.634491:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56538 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1b1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333174.634500:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b1:0x0].0x0 (ffff92fe43a31800) 00010000:00010000:1.0:1763333174.634502:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1763333174.634505:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56538 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1b1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333174.634510:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56538 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1b1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333174.634521:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333174.634523:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333174.634525:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763333174.637755:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333174.638046:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613700352 00000100:00100000:3.0:1763333174.638056:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613700352 00000100:00100000:3.0:1763333174.638110:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6518 00000100:00100000:3.0:1763333174.638118:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+11:56862:x1848987613700352:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333174.638135:0:29013:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333174.638156:0:29013:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c5653f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369697f3 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333174.638178:0:29013:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x236:0x0] initial LVB size: 4096, mtime: 0x691a5436, atime: 0x0, ctime: 0x691a5436, blocks: 0x8 00010000:00010000:3.0:1763333174.638196:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333174.638198:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333174.638206:0:29013:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c5653f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697f3 expref: 12 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.638220:0:29013:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c5653f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697f3 expref: 12 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.638231:0:29013:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96400, rc 0) 00000100:00100000:3.0:1763333174.638282:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:56862:x1848987613700352:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 165us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333174.638289:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6518 00000100:00100000:0.0:1763333174.640158:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.640488:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613700480 00000100:00100000:1.0:1763333174.640497:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613700480 00000100:00100000:1.0:1763333174.640553:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6519 00000100:00100000:1.0:1763333174.640563:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:56862:x1848987613700480:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333174.640580:0:29010:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333174.640600:0:29010:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56546 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369697fa expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333174.640625:0:29010:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x236:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333174.640643:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333174.640645:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333174.640651:0:29010:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56546 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697fa expref: 21 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.640665:0:29010:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56546 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697fa expref: 21 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.640677:0:29010:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f200, rc 0) 00000100:00100000:1.0:1763333174.640722:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:56862:x1848987613700480:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 161us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333174.640729:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6519 00000100:00100000:0.0:1763333174.645271:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.645312:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333174.645435:0:28430:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613700608 00000100:00100000:2.0:1763333174.645445:0:28430:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613700608 00002000:00010000:2.0:1763333174.645495:0:28430:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/566 (5->18446744073709551615) 00002000:00100000:2.0:1763333174.645500:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe438a9f80 with x1848987613700608 ext(5->18446744073709551615) 00002000:00010000:2.0:1763333174.645513:0:28430:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe438a9f80. 00000100:00100000:2.0:1763333174.645541:0:28430:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613700736 00000100:00100000:2.0:1763333174.645544:0:28430:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613700736 00002000:00010000:2.0:1763333174.645555:0:28430:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/566 (0->18446744073709551615) 00002000:00100000:2.0:1763333174.645559:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe438a9500 with x1848987613700736 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333174.645564:0:28430:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe438a9500. 00000100:00100000:2.0:1763333174.645583:0:28430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1613 00000100:00100000:2.0:1763333174.645591:0:28430:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:2421:x1848987613700608:12345-192.168.204.28@tcp:10:lfs.0 00002000:00010000:2.0:1763333174.647433:0:28430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x236:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:2.0:1763333174.647442:0:28430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x236:0x0] updating lvb mtime from disk: 1763333174 -> 1763333174 00002000:00010000:2.0:1763333174.647445:0:28430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x236:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333174.647447:0:28430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x236:0x0] updating lvb ctime from disk: 1763333174 -> 1763333174 00002000:00010000:2.0:1763333174.647449:0:28430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x236:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1763333174.647546:0:28430:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2421:x1848987613700608:12345-192.168.204.28@tcp:10:lfs.0 Request processed in 1950us (2280us total) trans 21474838882 rc 0/0 00000100:00100000:2.0:1763333174.647557:0:28430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1613 00002000:00010000:2.0:1763333174.647562:0:28430:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/566 (5->18446744073709551615) 00002000:00100000:2.0:1763333174.647566:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe438a9f80 with x1848987613700608 ext(5->18446744073709551615) 00002000:00010000:2.0:1763333174.647572:0:28430:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe438a9f80. 00000100:00100000:2.0:1763333174.647604:0:28430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1614 00000100:00100000:2.0:1763333174.647615:0:28430:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2421:x1848987613700736:12345-192.168.204.28@tcp:10:lfs.0 00002000:00010000:2.0:1763333174.647761:0:28430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x236:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333174.647764:0:28430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x236:0x0] updating lvb mtime from disk: 0 -> 1763333174 00002000:00010000:2.0:1763333174.647766:0:28430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x236:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333174.647768:0:28430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x236:0x0] updating lvb ctime from disk: 0 -> 1763333174 00002000:00010000:2.0:1763333174.647770:0:28430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x236:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333174.647791:0:28430:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2421:x1848987613700736:12345-192.168.204.28@tcp:10:lfs.0 Request processed in 179us (2477us total) trans 17179871577 rc 0/0 00000100:00100000:2.0:1763333174.647796:0:28430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1614 00002000:00010000:2.0:1763333174.647799:0:28430:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/566 (0->18446744073709551615) 00002000:00100000:2.0:1763333174.647802:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe438a9500 with x1848987613700736 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333174.647807:0:28430:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe438a9500. 00000100:00100000:0.0:1763333174.649401:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333174.649490:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613700864 00000100:00100000:2.0:1763333174.649499:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613700864 00000100:00100000:2.0:1763333174.649555:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9280 00000100:00100000:2.0:1763333174.649564:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56866:x1848987613700864:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333174.649591:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333174.649615:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5654d lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969801 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.649679:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56554 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333174.649692:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56554 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.649704:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56554 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.649717:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5655b lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333174.649725:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5655b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.649731:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5655b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.649771:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56554 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.649778:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56554 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.649784:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56554 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.649790:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56554 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.649795:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333174.649799:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56554 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.649805:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56554 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.649816:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31100) 00010000:00010000:2.0:1763333174.649819:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333174.649824:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56554 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.649830:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56554 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.649846:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5655b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.649852:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5655b lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.649857:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5655b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.649861:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333174.649864:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5655b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.649869:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5655b lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.649876:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43a31600) 00010000:00010000:2.0:1763333174.649878:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333174.649881:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5655b lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.649886:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5655b lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.649913:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5654d lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969801 expref: 239 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.649922:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31100) 00010000:00010000:2.0:1763333174.649924:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333174.649928:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5654d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969801 expref: 239 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.649944:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4000, rc 0) 00000100:00100000:2.0:1763333174.650684:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56866:x1848987613700864:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1116us (1286us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333174.650693:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9280 00000100:00100000:0.0:1763333174.655829:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.655946:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.656115:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613701120 00000100:00100000:1.0:1763333174.656126:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613701120 00000100:00100000:1.0:1763333174.656182:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613701248 00000100:00100000:1.0:1763333174.656186:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613701248 00000100:00100000:1.0:1763333174.656220:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9281 00000100:00100000:1.0:1763333174.656231:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56862:x1848987613701120:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:1.0:1763333174.656315:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56562 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333174.656333:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56562 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.656344:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56562 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00010000:1.0:1763333174.656506:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007fb01f15 reply state 0000000090e65f2e transno 4294972292 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56562 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.656519:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56562 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.656527:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b0:0x0].0x0 (ffff92fe43a31e00) 00010000:00010000:1.0:1763333174.656531:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333174.656534:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763333174.656629:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56862:x1848987613701120:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 399us (809us total) trans 4294972292 rc 0/0 00000100:00100000:1.0:1763333174.656636:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9281 00000100:00100000:1.0:1763333174.656657:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9282 00000100:00100000:1.0:1763333174.656664:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6b3cd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:56866:x1848987613701248:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333174.656673:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333174.656688:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56569 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969808 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.656732:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c56570 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333174.656740:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c56570 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.656747:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c56570 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.656757:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56577 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333174.656764:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56577 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.656771:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56577 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.656802:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c56570 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.656808:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c56570 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.656814:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c56570 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.656820:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c56570 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.656825:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333174.656829:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c56570 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.656836:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c56570 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.656845:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff42c64500) 00010000:00010000:1.0:1763333174.656848:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333174.656852:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c56570 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.656858:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c56570 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.656872:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56577 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.656878:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56577 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.656884:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56577 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.656889:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333174.656891:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56577 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.656897:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56577 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.656903:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43a31600) 00010000:00010000:1.0:1763333174.656906:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333174.656908:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56577 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.656914:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56577 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.656936:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56569 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969808 expref: 241 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.656945:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff42c64500) 00010000:00010000:1.0:1763333174.656960:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333174.656964:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56569 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969808 expref: 241 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.656976:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7ec00, rc 0) 00000100:00100000:1.0:1763333174.656998:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6b3cd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:56866:x1848987613701248:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 335us (1053us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333174.657005:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9282 00000100:00100000:0.0:1763333174.660806:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.661032:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333174.661088:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613701504 00000100:00100000:2.0:1763333174.661100:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613701504 00000100:00100000:3.0:1763333174.661154:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613701376 00000100:00100000:3.0:1763333174.661159:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613701376 00000100:00100000:2.0:1763333174.661160:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9283 00000100:00100000:2.0:1763333174.661169:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:56866:x1848987613701504:12345-192.168.204.28@tcp:101:lfs.0 00000100:00100000:3.0:1763333174.661196:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6520 00010000:00010000:2.0:1763333174.661199:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1763333174.661203:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2420:x1848987613701376:12345-192.168.204.28@tcp:2:lfs.0 00010000:00010000:2.0:1763333174.661226:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5657e lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696980f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.661295:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56585 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333174.661311:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56585 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.661322:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56585 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:2.0:1763333174.661387:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1763333174.661392:0:6519:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00002000:00010000:3.0:1763333174.661396:0:29013:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x235:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1763333174.661399:0:29013:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x235:0x0] updating lvb mtime from disk: 1763333174 -> 1763333174 00002000:00010000:3.0:1763333174.661402:0:29013:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x235:0x0] updating lvb atime from disk: 0 -> 1763333174 00002000:00010000:3.0:1763333174.661404:0:29013:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x235:0x0] updating lvb ctime from disk: 1763333174 -> 1763333174 00002000:00010000:3.0:1763333174.661407:0:29013:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x235:0x0] updating lvb blocks from disk: 8 -> 8 00010000:00010000:2.0:1763333174.661427:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5657e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696980f expref: 242 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.661443:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56585 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696980f expref: 241 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.661456:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31100) 00010000:00010000:2.0:1763333174.661459:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1763333174.661461:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2420:x1848987613701376:12345-192.168.204.28@tcp:2:lfs.0 Request processed in 259us (668us total) trans 17179871578 rc 0/0 00010000:00010000:2.0:1763333174.661463:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5e00, rc 0) 00000100:00100000:3.0:1763333174.661469:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6520 00000100:00100000:2.0:1763333174.661496:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56866:x1848987613701504:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 328us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333174.661502:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9283 00000100:00100000:0.0:1763333174.665618:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.665696:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613701632 00000100:00100000:1.0:1763333174.665706:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613701632 00000100:00100000:1.0:1763333174.665765:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9284 00000100:00100000:1.0:1763333174.665775:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56866:x1848987613701632:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333174.665796:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333174.665816:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5658c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969816 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.665882:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56593 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333174.665895:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56593 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.665906:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56593 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.665916:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5659a lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333174.665923:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5659a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.665930:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5659a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.665967:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56593 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.665974:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56593 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.665980:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56593 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.665986:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56593 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.665992:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333174.665996:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56593 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.666004:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56593 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.666015:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31100) 00010000:00010000:1.0:1763333174.666018:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333174.666023:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56593 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.666029:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56593 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.666041:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5659a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.666047:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5659a lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.666052:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5659a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.666057:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333174.666060:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5659a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.666065:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5659a lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.666076:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43a31600) 00010000:00010000:1.0:1763333174.666078:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333174.666081:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5659a lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.666086:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5659a lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.666112:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5658c lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969816 expref: 242 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.666122:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31100) 00010000:00010000:1.0:1763333174.666124:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333174.666127:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5658c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969816 expref: 242 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.666137:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f000, rc 0) 00000100:00100000:1.0:1763333174.666210:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56866:x1848987613701632:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 436us (601us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333174.666217:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9284 00000100:00100000:3.0:1763333174.666256:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.666337:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613701888 00000100:00100000:1.0:1763333174.666341:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613701888 00000100:00100000:1.0:1763333174.666404:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3172 00000100:00100000:1.0:1763333174.666412:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56862:x1848987613701888:12345-192.168.204.28@tcp:35:lfs.0 00000004:00010000:1.0:1763333174.666446:0:19668:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x240000404:0x1b0:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c563cc lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1b0:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969775 expref: 241 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.666475:0:19668:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c565a1 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19668 initiator: MDT0 00010000:00010000:1.0:1763333174.666495:0:19668:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c56435 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969798 expref: 241 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.666503:0:19668:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c565a1 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19668 initiator: MDT1 00010000:00010000:1.0:1763333174.666534:0:19668:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c56435 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969798 expref: 241 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.666548:0:19668:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c56435 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969798 expref: 241 pid: 12741 timeout: 1378 lvb_type: 0 00000100:00100000:1.0:1763333174.666564:0:19668:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7dcfdf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:19668:1848987627261312:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333174.666634:0:19668:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff44fdf900 going to sleep for 11 seconds 00000100:00100000:3.0:1763333174.671908:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333174.671968:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613702144 00000100:00100000:2.0:1763333174.671980:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613702144 00000100:00100000:2.0:1763333174.672052:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9285 00000100:00100000:2.0:1763333174.672062:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:56866:x1848987613702144:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333174.672083:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333174.672087:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763333174.672112:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56585 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696980f expref: 242 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.672131:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31100) 00010000:00010000:2.0:1763333174.672140:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333174.672155:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c565a8 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696981d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.672261:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c565af lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333174.672274:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c565af lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.672284:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c565af lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.672301:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c565b6 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333174.672307:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c565b6 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.672313:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c565b6 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000100:00100000:1.0:1763333174.672591:0:19668:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7dcfdf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:19668:1848987627261312:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333174.672624:0:19668:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c565a1 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333174.672768:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c565bd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333174.672776:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c565bd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.672784:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c565bd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:2.0:1763333174.672795:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b3:0x0]: returning size 0 00010000:00010000:2.0:1763333174.672822:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c565af lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.672828:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c565af lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.672834:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c565af lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.672840:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c565af lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.672845:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333174.672849:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c565af lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.672859:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c565af lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.672868:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31c00) 00010000:00010000:2.0:1763333174.672871:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333174.672875:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c565af lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.672880:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c565af lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:2.0:1763333174.672890:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000011cfc356 reply state 000000006f889468 transno 4294972293 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c565b6 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.672900:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c565b6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333174.672905:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43a31600) 00010000:00010000:2.0:1763333174.672908:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333174.672910:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763333174.672936:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c565a8 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696981d expref: 244 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.672953:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c565bd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696981d expref: 243 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.672960:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43a31400) 00010000:00010000:2.0:1763333174.672962:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333174.672965:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea800, rc 0) 00000100:00100000:2.0:1763333174.673038:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56866:x1848987613702144:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 977us (1143us total) trans 4294972293 rc 0/0 00000100:00100000:2.0:1763333174.673049:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9285 00000100:00100000:0.0:1763333174.676049:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.676143:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613702272 00000100:00100000:1.0:1763333174.676153:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613702272 00010000:00010000:1.0:1763333174.676191:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c56435 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969798 expref: 244 pid: 12741 timeout: 1378 lvb_type: 0 00000100:00100000:1.0:1763333174.676233:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3048 00000100:00100000:1.0:1763333174.676242:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:2421:x1848987613702272:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333174.676257:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333174.676263:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c56435 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969798 expref: 244 pid: 12741 timeout: 1378 lvb_type: 0 00010000:00010000:1.0:1763333174.676277:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c56435 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969798 expref: 244 pid: 12741 timeout: 1378 lvb_type: 0 00010000:00010000:1.0:1763333174.676297:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c56435 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969798 expref: 244 pid: 12741 timeout: 1378 lvb_type: 0 00010000:00010000:1.0:1763333174.676313:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b0:0x0].0x0 (ffff92fe43a31e00) 00010000:00010000:1.0:1763333174.676318:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c565a1 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19668 initiator: MDT1 00010000:00010000:1.0:1763333174.676328:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c565a1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 19668 initiator: MDT1 00010000:00010000:1.0:1763333174.676336:0:6505:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c565a1 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 19668 initiator: MDT1 00010000:00010000:1.0:1763333174.676392:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333174.676440:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:2421:x1848987613702272:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 198us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333174.676447:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3048 00010000:00010000:0.0:1763333174.676723:0:19668:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c565a1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333174.676732:0:19668:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c565a1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19668 initiator: MDT1 00000040:00080000:0.0:1763333174.676961:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1409, 88 off118984 00000004:00080000:0.0:1763333174.676969:0:19668:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1278756619678ns, next at 1279713547966ns, rc = 0 00000040:00080000:0.0:1763333174.677012:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1410, 88 off118984 00000004:00080000:0.0:1763333174.677017:0:19668:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1278756667943ns, next at 1279025269818ns, rc = 0 00000040:00080000:0.0:1763333174.677043:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1411, 88 off119072 00000004:00080000:0.0:1763333174.677048:0:19668:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1278756699160ns, next at 1279025269818ns, rc = 0 00000040:00080000:0.0:1763333174.677057:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1410, 88 off119072 00000004:00080000:0.0:1763333174.677061:0:19668:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1278756711628ns, next at 1279713547966ns, rc = 0 00000100:00100000:1.0:1763333174.679430:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.679567:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613702528 00000100:00100000:0.0:1763333174.679579:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613702528 00000100:00100000:0.0:1763333174.679649:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9286 00000100:00100000:0.0:1763333174.679660:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56866:x1848987613702528:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333174.679847:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333174.679871:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f800/0xb32e3ef184c565cb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969824 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1763333174.680165:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972294 is committed 00000004:00080000:2.0:1763333174.680174:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 922 committed 00010000:00010000:3.0:1763333174.680239:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56531 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.680248:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56531 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.680255:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56531 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.680261:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333174.680266:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56531 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.680274:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56531 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.680290:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b0:0x0].0x0 (ffff92fe43a31e00) 00010000:00010000:3.0:1763333174.680294:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333174.680299:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56531 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.680305:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56531 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.680325:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56523 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333174.680336:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56523 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333174.680341:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56523 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333174.680366:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333174.680370:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56523 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333174.680376:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56523 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333174.680384:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43a31600) 00010000:00010000:3.0:1763333174.680387:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333174.680389:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56523 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333174.680395:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56523 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333174.680407:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56562 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333174.680413:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56562 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333174.680419:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56562 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333174.680424:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fc00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333174.680426:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56562 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333174.680433:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56562 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333174.680440:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b0:0x0].0x0 (ffff92fe43a31e00) 00010000:00010000:3.0:1763333174.680442:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333174.680445:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56562 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333174.680450:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56562 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333174.680461:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c565b6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333174.680467:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c565b6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333174.680473:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c565b6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333174.680488:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333174.680492:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c565b6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333174.680498:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c565b6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333174.680505:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43a31600) 00010000:00010000:3.0:1763333174.680508:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333174.680510:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c565b6 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333174.680516:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c565b6 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00080000:2.0:1763333174.680576:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 925 committed 00000004:00080000:2.0:1763333174.680594:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 924 committed 00000004:00080000:2.0:1763333174.680598:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 921 committed 00000004:00080000:2.0:1763333174.680758:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 920 committed 00000100:00100000:2.0:1763333174.680794:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7dcff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627261568:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763333174.680849:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333174.680883:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1763333174.680889:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7dcfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627261696:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333174.680908:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333174.680933:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627261568 00000100:00100000:2.0:1763333174.680938:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627261568 00000100:00100000:2.0:1763333174.680977:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627261696 00000100:00100000:2.0:1763333174.680981:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627261696 00000100:00100000:2.0:1763333174.680998:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6521 00000100:00100000:2.0:1763333174.681004:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+22:3652:x1848987627261568:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1763333174.681025:0:29010:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:568 count 1 00002000:00010000:2.0:1763333174.681053:0:29010:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x238:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763333174.681059:0:29010:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c565d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.681070:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333174.681072:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333174.681078:0:29010:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c565d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.681095:0:29010:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c565d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.681104:0:29010:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c565d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.681110:0:29010:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c565d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.681125:0:29010:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763333174.681321:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+23:3652:x1848987627261568:12345-0@lo:6:osp-syn-1-1.0 Request processed in 316us (470us total) trans 17179871579 rc 0/0 00000100:00100000:2.0:1763333174.681329:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6521 00000004:00080000:2.0:1763333174.681389:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7dcff800/2, rc 0, transno 17179871579 00000100:00100000:2.0:1763333174.681395:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7dcff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627261568:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763333174.681410:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6522 00000100:00100000:2.0:1763333174.681417:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+22:3652:x1848987627261696:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1763333174.681500:0:29010:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x235:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1763333174.681504:0:29010:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x235:0x0] updating lvb mtime from disk: 1763333174 -> 1763333174 00002000:00010000:2.0:1763333174.681506:0:29010:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x235:0x0] updating lvb atime from disk: 1763333174 -> 1763333174 00002000:00010000:2.0:1763333174.681509:0:29010:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x235:0x0] updating lvb ctime from disk: 1763333174 -> 1763333174 00002000:00010000:2.0:1763333174.681511:0:29010:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x235:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1763333174.681538:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+23:3652:x1848987627261696:12345-0@lo:2:osp-syn-1-1.0 Request processed in 122us (628us total) trans 17179871580 rc 0/0 00000100:00100000:2.0:1763333174.681545:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6522 00000004:00080000:2.0:1763333174.681566:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7dcfc000/2, rc 0, transno 17179871580 00000100:00100000:2.0:1763333174.681571:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7dcfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627261696:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333174.681889:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7dcff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627261440:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763333174.681919:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333174.681956:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763333174.681962:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7dcfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627261824:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333174.681980:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333174.682017:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627261440 00000100:00100000:3.0:1763333174.682022:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627261440 00000100:00100000:3.0:1763333174.682046:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627261824 00000100:00100000:3.0:1763333174.682049:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627261824 00000100:00100000:3.0:1763333174.682066:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6523 00000100:00100000:3.0:1763333174.682072:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+24:3655:x1848987627261440:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763333174.682084:0:8407:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:567 count 1 00010000:00010000:3.0:1763333174.682099:0:8407:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c565d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x237:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.682114:0:8407:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c564e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x237:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697de expref: 22 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.682122:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333174.682123:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333174.682127:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c565d9 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x237:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.682154:0:8407:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c564e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x237:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697de expref: 22 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.682168:0:8407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c564e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x237:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697de expref: 22 pid: 29010 timeout: 1378 lvb_type: 0 00000100:00100000:3.0:1763333174.682180:0:8407:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e06a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8407:1848987627261952:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333174.682237:0:8407:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff49c92540 going to sleep for 11 seconds 00010000:00010000:3.0:1763333174.682249:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333174.682255:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c565d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.682263:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feba00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333174.682267:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c565d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.682276:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c565d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.682293:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c565d2 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.682300:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c565d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.682315:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333174.682318:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333174.682319:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763333174.682331:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6524 00000100:00100000:3.0:1763333174.682338:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+24:3655:x1848987627261824:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1763333174.682429:0:8404:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x236:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333174.682433:0:8404:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x236:0x0] updating lvb mtime from disk: 1763333174 -> 1763333174 00002000:00010000:3.0:1763333174.682435:0:8404:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x236:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333174.682438:0:8404:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x236:0x0] updating lvb ctime from disk: 1763333174 -> 1763333174 00002000:00010000:3.0:1763333174.682440:0:8404:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x236:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333174.682471:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+25:3655:x1848987627261824:12345-0@lo:2:osp-syn-1-1.0 Request processed in 133us (489us total) trans 17179871581 rc 0/0 00000100:00100000:3.0:1763333174.682490:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6524 00000100:00100000:3.0:1763333174.682566:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627262336:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333174.682590:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333174.682606:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763333174.682612:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627262208:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763333174.682629:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333174.682646:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627262336 00000100:00100000:3.0:1763333174.682651:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627262336 00000100:00100000:3.0:1763333174.682672:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627262208 00000100:00100000:3.0:1763333174.682675:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627262208 00000100:00100000:3.0:1763333174.682693:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6525 00000100:00100000:3.0:1763333174.682698:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3653:x1848987627262336:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1763333174.682768:0:8406:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x235:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333174.682771:0:8406:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x235:0x0] updating lvb mtime from disk: 1763333174 -> 1763333174 00002000:00010000:3.0:1763333174.682774:0:8406:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x235:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333174.682776:0:8406:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x235:0x0] updating lvb ctime from disk: 1763333174 -> 1763333174 00002000:00010000:3.0:1763333174.682778:0:8406:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x235:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333174.682807:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+7:3653:x1848987627262336:12345-0@lo:2:osp-syn-0-1.0 Request processed in 108us (216us total) trans 21474838883 rc 0/0 00000100:00100000:3.0:1763333174.682814:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6525 00000100:00100000:3.0:1763333174.682826:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6526 00000100:00100000:3.0:1763333174.682833:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3653:x1848987627262208:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763333174.682845:0:8406:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:568 count 1 00002000:00010000:3.0:1763333174.682864:0:8406:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x238:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333174.682870:0:8406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c565e0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.682879:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333174.682881:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333174.682884:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c565e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.682895:0:8406:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c565e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.682904:0:8406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c565e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.682913:0:8406:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c565e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.682931:0:8406:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763333174.683062:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+7:3653:x1848987627262208:12345-0@lo:6:osp-syn-0-1.0 Request processed in 228us (431us total) trans 21474838884 rc 0/0 00000100:00100000:3.0:1763333174.683069:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6526 00010000:00010000:3.0:1763333174.683092:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333174.683097:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c565e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.683104:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97800 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333174.683108:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c565e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.683115:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c565e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.683127:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c565e0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.683135:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97800/0xb32e3ef184c565e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.683147:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333174.683148:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333174.683150:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763333174.683170:0:3653:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474838879 gen 2 00000004:00080000:3.0:1763333174.683175:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe472f7800, transno 21474838822 00000004:00080000:3.0:1763333174.683182:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe472f6d80, transno 21474838823 00000004:00080000:3.0:1763333174.683185:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe472f7b80, transno 21474838824 00000004:00080000:3.0:1763333174.683188:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe472f4000, transno 21474838825 00000004:00080000:3.0:1763333174.683191:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7e121180, transno 21474838827 00000004:00080000:3.0:1763333174.683194:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7e122d80, transno 21474838828 00000004:00080000:3.0:1763333174.683196:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7e00f100, transno 21474838829 00000004:00080000:3.0:1763333174.683199:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7569f480, transno 21474838830 00000004:00080000:3.0:1763333174.683202:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7e00d880, transno 21474838831 00000004:00080000:3.0:1763333174.683204:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7e00fb80, transno 21474838832 00000004:00080000:3.0:1763333174.683206:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7e00ca80, transno 21474838833 00000004:00080000:3.0:1763333174.683209:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7e00c700, transno 21474838834 00000004:00080000:3.0:1763333174.683212:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4684d500, transno 21474838837 00000004:00080000:3.0:1763333174.683215:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4684ce00, transno 21474838838 00000004:00080000:3.0:1763333174.683218:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe472f0e00, transno 21474838839 00000004:00080000:3.0:1763333174.683220:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe472f1c00, transno 21474838840 00000004:00080000:3.0:1763333174.683223:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff77b17b80, transno 21474838844 00000004:00080000:3.0:1763333174.683225:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7dcfce00, transno 21474838845 00000004:00080000:3.0:1763333174.683228:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff77b16d80, transno 21474838846 00000004:00080000:3.0:1763333174.683230:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7dcfed80, transno 21474838847 00000004:00080000:3.0:1763333174.683233:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7dcff100, transno 21474838848 00000004:00080000:3.0:1763333174.683235:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7dcfc700, transno 21474838849 00000004:00080000:3.0:1763333174.683238:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff77b15500, transno 21474838850 00000004:00080000:3.0:1763333174.683240:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff77b14a80, transno 21474838851 00000004:00080000:3.0:1763333174.683243:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe472f2300, transno 21474838854 00000004:00080000:3.0:1763333174.683245:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe472f3b80, transno 21474838855 00000004:00080000:3.0:1763333174.683256:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff5004bb80, transno 21474838857 00000004:00080000:3.0:1763333174.683259:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff5004b480, transno 21474838858 00000004:00080000:3.0:1763333174.683262:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff50064700, transno 21474838862 00000004:00080000:3.0:1763333174.683264:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff50065c00, transno 21474838863 00000004:00080000:3.0:1763333174.683267:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff50067b80, transno 21474838864 00000004:00080000:3.0:1763333174.683270:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff77c6d180, transno 21474838865 00000004:00080000:3.0:1763333174.683272:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe469a1f80, transno 21474838866 00000004:00080000:3.0:1763333174.683275:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe438aa300, transno 21474838867 00000004:00080000:3.0:1763333174.683278:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe469a0700, transno 21474838868 00000004:00080000:3.0:1763333174.683281:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe469a3b80, transno 21474838869 00000004:00080000:3.0:1763333174.683283:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44de1500, transno 21474838871 00000004:00080000:3.0:1763333174.683286:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44de0e00, transno 21474838872 00000004:00080000:3.0:1763333174.683288:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44de2a00, transno 21474838873 00000004:00080000:3.0:1763333174.683291:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44de0000, transno 21474838874 00000004:00080000:3.0:1763333174.683294:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe42ef9f80, transno 21474838876 00000004:00080000:3.0:1763333174.683296:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe42ef8700, transno 21474838877 00000004:00080000:3.0:1763333174.683299:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7e00df80, transno 21474838878 00000004:00080000:3.0:1763333174.683302:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7e00ea00, transno 21474838879 00000100:00100000:3.0:1763333174.683308:0:3653:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff92fe44e07800 x1848987627262208/t21474838884(21474838884) o6->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1763333190 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1763333174.683318:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44e07800/2, rc 0, transno 21474838884 00000100:00100000:3.0:1763333174.683322:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627262208:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1763333174.683333:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44e05880/2, rc 0, transno 21474838883 00000100:00100000:3.0:1763333174.683337:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627262336:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333174.683380:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627262080:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763333174.683405:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1763333174.683428:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7dcfdc00/2, rc 0, transno 17179871581 00000100:00100000:3.0:1763333174.683433:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7dcfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627261824:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333174.683441:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763333174.683446:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627262464:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333174.683465:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333174.683503:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627262080 00000100:00100000:3.0:1763333174.683508:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627262080 00000100:00100000:3.0:1763333174.683531:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627262464 00000100:00100000:3.0:1763333174.683533:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627262464 00000100:00100000:3.0:1763333174.683547:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6527 00000100:00100000:3.0:1763333174.683552:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+8:3655:x1848987627262080:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763333174.683564:0:17605:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:567 count 1 00010000:00010000:3.0:1763333174.683577:0:17605:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c565e7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x237:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.683589:0:17605:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96c00/0xb32e3ef184c564dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x237:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697d7 expref: 12 pid: 28650 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1763333174.683594:0:19668:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000ca7fa77 reply state 00000000a5fecc4f transno 4294972294 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c565a1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19668 initiator: MDT1 00010000:00010000:3.0:1763333174.683601:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333174.683602:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333174.683605:0:17605:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c565e7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x237:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.683608:0:19668:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c565a1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333174.683616:0:19668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b0:0x0].0x0 (ffff92fe43a31e00) 00010000:00010000:0.0:1763333174.683620:0:19668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1763333174.683623:0:19668:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763333174.683627:0:17605:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96c00/0xb32e3ef184c564dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x237:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697d7 expref: 12 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.683628:0:19668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b0:0x0].0x0 (ffff92fe43a31e00) 00010000:00010000:0.0:1763333174.683631:0:19668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763333174.683635:0:19668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c563cc lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1b0:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969775 expref: 235 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.683638:0:17605:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96c00/0xb32e3ef184c564dd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x237:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697d7 expref: 12 pid: 28650 timeout: 1378 lvb_type: 0 00000100:00100000:3.0:1763333174.683647:0:17605:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17605:1848987627262592:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333174.683680:0:17605:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff49c92000 going to sleep for 11 seconds 00000100:00100000:3.0:1763333174.683695:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6528 00010000:00080000:0.0:1763333174.683701:0:19668:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1763333174.683702:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+8:3655:x1848987627262464:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333174.683713:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:56862:x1848987613701888:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 17302us (17458us total) trans 4294972294 rc 0/0 00000100:00100000:0.0:1763333174.683721:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3172 00010000:00010000:0.0:1763333174.683747:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c565a1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333174.683754:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c565a1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333174.683760:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c565a1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19668 initiator: MDT1 00002000:00010000:3.0:1763333174.683765:0:28600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x236:0x0] updating lvb size from disk: 5 -> 5 00010000:00010000:0.0:1763333174.683765:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdfe00 already unused, calling callback (ffffffffc17b3550) 00002000:00010000:3.0:1763333174.683768:0:28600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x236:0x0] updating lvb mtime from disk: 1763333174 -> 1763333174 00010000:00010000:0.0:1763333174.683769:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c565a1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19668 initiator: MDT1 00002000:00010000:3.0:1763333174.683770:0:28600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x236:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333174.683773:0:28600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x236:0x0] updating lvb ctime from disk: 1763333174 -> 1763333174 00002000:00010000:3.0:1763333174.683775:0:28600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x236:0x0] updating lvb blocks from disk: 8 -> 8 00010000:00010000:0.0:1763333174.683777:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c565a1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333174.683785:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b0:0x0].0x0 (ffff92fe43a31e00) 00010000:00010000:0.0:1763333174.683788:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333174.683791:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c565a1 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333174.683796:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c565a1 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19668 initiator: MDT1 00000100:00100000:3.0:1763333174.683805:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+9:3655:x1848987627262464:12345-0@lo:2:osp-syn-0-1.0 Request processed in 104us (338us total) trans 21474838885 rc 0/0 00000100:00100000:3.0:1763333174.683811:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6528 00010000:00010000:0.0:1763333174.683847:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c565ee lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333174.683857:0:12741:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c565bd lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696981d expref: 234 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.683864:0:12741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c565ee lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.683883:0:12741:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c565bd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696981d expref: 234 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.683891:0:12741:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c565bd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696981d expref: 234 pid: 6519 timeout: 1378 lvb_type: 0 00000100:00100000:0.0:1763333174.683899:0:12741:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe438a8000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627262720:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333174.683924:0:12741:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe43aa6b40 going to sleep for 11 seconds 00000004:00080000:3.0:1763333174.684023:0:8604:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 4 in progress, 2 in flight, 44 done 00000004:00080000:3.0:1763333174.684055:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44e04a80/2, rc 0, transno 21474838885 00000100:00100000:3.0:1763333174.684060:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627262464:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333174.690110:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.690230:0:17605:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17605:1848987627262592:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333174.690257:0:17605:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c565e7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x237:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333174.690517:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.690574:0:12741:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe438a8000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627262720:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333174.690591:0:12741:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c565ee lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000100:00100000:3.0:1763333174.691979:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.692381:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613702912 00000100:00100000:0.0:1763333174.692395:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613702912 00000100:00100000:0.0:1763333174.692450:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9287 00000100:00100000:0.0:1763333174.692459:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:56862:x1848987613702912:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333174.692496:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1763333174.692498:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613702656 00000100:00100000:2.0:1763333174.692505:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613702656 00010000:00010000:0.0:1763333174.692520:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f000/0xb32e3ef184c565f5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696982b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.692535:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96c00/0xb32e3ef184c564dd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x237:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697d7 expref: 13 pid: 28650 timeout: 1378 lvb_type: 0 00000100:00100000:2.0:1763333174.692565:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613702784 00000100:00100000:2.0:1763333174.692568:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613702784 00010000:00010000:0.0:1763333174.692575:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f000/0xb32e3ef184c565f5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696982b expref: 236 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.692585:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c565bd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696981d expref: 236 pid: 6519 timeout: 1378 lvb_type: 0 00010000:00010000:0.0:1763333174.692594:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f000/0xb32e3ef184c565f5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696982b expref: 236 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333174.692611:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3049 00010000:00010000:0.0:1763333174.692613:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b0:0x0].0x0 (ffff92fe43a31e00) 00010000:00010000:0.0:1763333174.692618:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1763333174.692622:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2418:x1848987613702656:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333174.692624:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff4148f000, rc 0) 00010000:00010000:2.0:1763333174.692637:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333174.692644:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96c00/0xb32e3ef184c564dd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x237:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697d7 expref: 13 pid: 28650 timeout: 1378 lvb_type: 0 00010000:00010000:2.0:1763333174.692655:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96c00/0xb32e3ef184c564dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x237:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697d7 expref: 13 pid: 28650 timeout: 1378 lvb_type: 0 00010000:00010000:2.0:1763333174.692675:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96c00/0xb32e3ef184c564dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x237:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697d7 expref: 13 pid: 28650 timeout: 1378 lvb_type: 0 00000100:00100000:0.0:1763333174.692686:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56862:x1848987613702912:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 226us (710us total) trans 0 rc 0/0 00010000:00010000:2.0:1763333174.692691:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333174.692694:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1763333174.692696:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9287 00010000:00010000:2.0:1763333174.692700:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c565e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x237:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.692715:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c565e7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x237:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.692745:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333174.692772:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:2418:x1848987613702656:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 154us (2670us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333174.692781:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3049 00000100:00100000:2.0:1763333174.692803:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3050 00000100:00100000:2.0:1763333174.692812:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff44f0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:2418:x1848987613702784:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333174.692821:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333174.692826:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c565bd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696981d expref: 235 pid: 6519 timeout: 1378 lvb_type: 0 00010000:00010000:2.0:1763333174.692836:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c565bd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696981d expref: 235 pid: 6519 timeout: 1378 lvb_type: 0 00010000:00010000:2.0:1763333174.692849:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c565bd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696981d expref: 235 pid: 6519 timeout: 1378 lvb_type: 0 00010000:00010000:2.0:1763333174.692859:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43a31400) 00010000:00010000:2.0:1763333174.692864:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c565ee lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333174.692870:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c565ee lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333174.692876:0:6504:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c565ee lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333174.692916:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333174.692940:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff44f0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:2418:x1848987613702784:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 129us (2423us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333174.692947:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3050 00010000:00010000:2.0:1763333174.693073:0:17605:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c565e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.693082:0:17605:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c565e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.693092:0:17605:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c565e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.693100:0:17605:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c565e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.693117:0:17605:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763333174.693396:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+9:3655:x1848987627262080:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9840us (9987us total) trans 21474838886 rc 0/0 00000100:00100000:2.0:1763333174.693405:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6527 00010000:00010000:2.0:1763333174.693754:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333174.693760:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c565e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.693768:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97200 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333174.693772:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c565e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.693784:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c565e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.693798:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c565e7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.693805:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c565e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.693823:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333174.693825:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333174.693826:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763333174.693862:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44e07480/2, rc 0, transno 21474838886 00000100:00100000:2.0:1763333174.693870:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627262080:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1763333174.695077:0:12741:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c565ee lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.695089:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c565ee lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:0.0:1763333174.695117:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b3:0x0]: returning size 0 00000004:00080000:0.0:1763333174.695295:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x239:0x0], index 1: 0 00000004:00080000:0.0:1763333174.695301:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x239:0x0], index 0: 0 00000004:00080000:0.0:1763333174.695305:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x23a:0x0], index 0: 0 00000004:00080000:0.0:1763333174.695309:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x23a:0x0], index 1: 0 00010000:00010000:0.0:1763333174.695462:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c565ee lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.695470:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c565ee lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.695496:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c565ee lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.695501:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff4148e200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333174.695505:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c565ee lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.695512:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c565ee lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.695526:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43a31400) 00010000:00010000:0.0:1763333174.695529:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333174.695533:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c565ee lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.695538:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c565ee lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.695587:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f800/0xb32e3ef184c565cb lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969824 expref: 234 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.695597:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43a31400) 00010000:00010000:0.0:1763333174.695599:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763333174.695603:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f800/0xb32e3ef184c565cb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969824 expref: 234 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.695615:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff4148f800, rc 0) 00000100:00100000:0.0:1763333174.695951:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56866:x1848987613702528:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 16292us (16531us total) trans 4294972295 rc 301/301 00000100:00100000:0.0:1763333174.695960:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9286 00000100:00100000:1.0:1763333174.696281:0:8407:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e06a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8407:1848987627261952:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333174.696296:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:1.0:1763333174.696307:0:8407:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c565d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x237:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333174.696370:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613703040 00000100:00100000:2.0:1763333174.696378:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613703040 00010000:00010000:2.0:1763333174.696409:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c564e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x237:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697de expref: 23 pid: 29010 timeout: 1378 lvb_type: 0 00000100:00100000:2.0:1763333174.696450:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3051 00000100:00100000:2.0:1763333174.696460:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2420:x1848987613703040:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333174.696473:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333174.696486:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c564e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x237:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697de expref: 23 pid: 29010 timeout: 1378 lvb_type: 0 00010000:00010000:2.0:1763333174.696498:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c564e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x237:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697de expref: 23 pid: 29010 timeout: 1378 lvb_type: 0 00010000:00010000:2.0:1763333174.697942:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c564e4 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x237:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697de expref: 23 pid: 29010 timeout: 1378 lvb_type: 0 00010000:00010000:2.0:1763333174.697957:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333174.697959:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333174.697963:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c565d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x237:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.697973:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c565d9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x237:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.698937:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333174.699309:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.699382:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613703296 00000100:00100000:0.0:1763333174.699391:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613703296 00000100:00100000:0.0:1763333174.699441:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3173 00000100:00100000:0.0:1763333174.699451:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bd5f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+233:56862:x1848987613703296:12345-192.168.204.28@tcp:35:lfs.0 00000004:00080000:0.0:1763333174.699710:0:19668:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x1b0:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1763333174.699770:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1411, 64 off119136 00000040:00080000:0.0:1763333174.699793:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1412, 64 off119136 00000040:00080000:0.0:1763333174.699803:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1413, 64 off119200 00000040:00080000:0.0:1763333174.699811:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1412, 64 off119200 00010000:00010000:0.0:1763333174.699875:0:19668:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c56603 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19668 initiator: MDT0 00010000:00010000:0.0:1763333174.699892:0:19668:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c56603 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333174.699903:0:19668:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c56603 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333174.699924:0:19668:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c56603 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1b0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333174.699930:0:19668:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c56603 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1b0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333174.699935:0:19668:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c56603 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1b0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333174.699961:0:19668:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763333174.700075:0:8407:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c565d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.700085:0:8407:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c565d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.700094:0:8407:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c565d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.700101:0:8407:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c565d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.700117:0:8407:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1763333174.700250:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2420:x1848987613703040:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 3788us (3953us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333174.700259:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3051 00010000:00010000:2.0:1763333174.700301:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1763333174.700306:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c56603 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1b0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333174.700312:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff4148e600 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333174.700316:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c56603 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1b0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333174.700323:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c56603 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1b0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333174.700334:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b0:0x0].0x0 (ffff92fe43a31e00) 00010000:00010000:2.0:1763333174.700337:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1763333174.700342:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c56603 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1b0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333174.700370:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c56603 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1b0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333174.700381:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333174.700385:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c565d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.700390:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333174.700393:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c565d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.700400:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c565d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.700411:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c565d9 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.700417:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c565d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.700431:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333174.700433:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333174.700434:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763333174.701246:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+25:3655:x1848987627261440:12345-0@lo:6:osp-syn-1-1.0 Request processed in 19167us (19318us total) trans 17179871582 rc 0/0 00000100:00100000:2.0:1763333174.701257:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6523 00000004:00080000:3.0:1763333174.701382:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7dcff480/2, rc 0, transno 17179871582 00000100:00100000:3.0:1763333174.701396:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7dcff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627261440:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763333174.701597:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bd5f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:56862:x1848987613703296:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 2146us (2290us total) trans 4294972296 rc 0/0 00000100:00100000:0.0:1763333174.701606:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3173 00010000:00010000:1.0:1763333174.701855:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763333174.701901:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.701980:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613703552 00000100:00100000:0.0:1763333174.701988:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613703552 00000100:00100000:0.0:1763333174.702388:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3174 00000100:00100000:0.0:1763333174.702400:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:56866:x1848987613703552:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333174.702630:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:56866:x1848987613703552:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 233us (729us total) trans 4294972297 rc 0/0 00000100:00100000:0.0:1763333174.702638:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3174 00000100:00100000:0.0:1763333174.707681:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.707780:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613703808 00000100:00100000:1.0:1763333174.707792:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613703808 00000100:00100000:1.0:1763333174.707858:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9288 00000100:00100000:1.0:1763333174.707868:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:56862:x1848987613703808:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333174.707898:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333174.707923:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c5660a lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969832 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.708015:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c56611 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333174.708029:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c56611 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.708040:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c56611 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.708053:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c56618 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333174.708060:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c56618 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.708066:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c56618 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.708179:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5661f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333174.708187:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5661f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.708194:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5661f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:1.0:1763333174.708203:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b3:0x0]: returning size 0 00010000:00010000:1.0:1763333174.708283:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c56611 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.708290:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c56611 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.708295:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c56611 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.708301:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c56611 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.708307:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333174.708311:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c56611 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.708318:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c56611 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.708330:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff42c64500) 00010000:00010000:1.0:1763333174.708333:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333174.708339:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c56611 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.708344:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c56611 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.708405:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c56618 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.708410:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c56618 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.708415:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c56618 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.708419:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdfe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333174.708422:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c56618 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.708427:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c56618 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.708434:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff42c64000) 00010000:00010000:1.0:1763333174.708436:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333174.708439:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c56618 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.708443:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c56618 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.708491:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c5660a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969832 expref: 238 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.708506:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5661f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969832 expref: 237 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.708513:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92ff42c64600) 00010000:00010000:1.0:1763333174.708520:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333174.708522:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdee00, rc 0) 00000100:00100000:1.0:1763333174.708582:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56862:x1848987613703808:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 716us (912us total) trans 4294972298 rc 0/0 00000100:00100000:1.0:1763333174.708590:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9288 00000100:00100000:0.0:1763333174.709227:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333174.710445:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613704064 00000100:00100000:2.0:1763333174.710455:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613704064 00000100:00100000:2.0:1763333174.710516:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3175 00000100:00100000:2.0:1763333174.710525:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56866:x1848987613704064:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333174.710710:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56866:x1848987613704064:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 186us (1486us total) trans 4294972299 rc 0/0 00000100:00100000:2.0:1763333174.710718:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3175 00000100:00100000:0.0:1763333174.731224:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.731284:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333174.732292:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613704192 00000100:00100000:2.0:1763333174.732305:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613704192 00000100:00100000:1.0:1763333174.732408:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613704320 00000100:00100000:1.0:1763333174.732414:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613704320 00000100:00100000:1.0:1763333174.732460:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6529 00000100:00100000:1.0:1763333174.732471:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:2421:x1848987613704192:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333174.732500:0:28651:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333174.732525:0:28651:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c5662d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969839 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333174.732551:0:28651:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x23a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333174.732570:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333174.732572:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333174.732581:0:28651:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c5662d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969839 expref: 13 pid: 28651 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333174.732599:0:28651:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c5662d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969839 expref: 13 pid: 28651 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333174.732613:0:28651:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdea00, rc 0) 00000100:00100000:2.0:1763333174.732637:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6530 00000100:00100000:2.0:1763333174.732648:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2421:x1848987613704320:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333174.732657:0:8407:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333174.732671:0:8407:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c56634 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969840 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333174.732681:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2421:x1848987613704192:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 209us (1466us total) trans 0 rc 0/0 00002000:00010000:2.0:1763333174.732689:0:8407:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x23a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1763333174.732691:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6529 00010000:00010000:2.0:1763333174.732704:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333174.732708:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333174.732714:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c56634 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969840 expref: 23 pid: 8407 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333174.732727:0:8407:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c56634 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969840 expref: 23 pid: 8407 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333174.732737:0:8407:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea800, rc 0) 00000100:00100000:2.0:1763333174.732762:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2421:x1848987613704320:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 116us (1476us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333174.732768:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6530 00000100:00100000:2.0:1763333174.733467:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.736325:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613704576 00000100:00100000:0.0:1763333174.736344:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613704576 00000100:00100000:0.0:1763333174.736442:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9289 00000100:00100000:0.0:1763333174.736453:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:55917:x1848987613704576:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333174.736488:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333174.736491:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763333174.736519:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c5661f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969832 expref: 238 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.736541:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92ff42c64600) 00010000:00010000:0.0:1763333174.736551:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333174.736568:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c5663b lrc: 2/0,0 mode: --/CW res: [0x240000404:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969847 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.736679:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c56642 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333174.736693:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c56642 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1b3:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.736705:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c56642 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1b3:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:0.0:1763333174.736721:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b3:0x0]: returning size 0 00010000:00010000:0.0:1763333174.736838:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c5663b lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969847 expref: 240 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.736853:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c56642 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1b3:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969847 expref: 239 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.736861:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:0.0:1763333174.736864:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:0.0:1763333174.736866:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff4148e600, rc 0) 00000100:00100000:0.0:1763333174.736937:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:55917:x1848987613704576:12345-192.168.204.28@tcp:101:bash.0 Request processed in 486us (3472us total) trans 4294972300 rc 0/0 00000100:00100000:0.0:1763333174.736945:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9289 00000100:00100000:1.0:1763333174.737111:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.737148:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613704704 00000100:00100000:0.0:1763333174.737154:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613704704 00000100:00100000:0.0:1763333174.737181:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9290 00000100:00100000:0.0:1763333174.737189:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56862:x1848987613704704:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333174.737198:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333174.737206:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c56650 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696984e expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.737232:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c56650 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696984e expref: 240 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.737242:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c56650 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696984e expref: 240 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.737259:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:0.0:1763333174.737261:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333174.737264:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff4148ee00, rc 0) 00000100:00100000:0.0:1763333174.738084:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:56862:x1848987613704704:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 890us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333174.738093:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9290 00000100:00100000:3.0:1763333174.739906:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.741243:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613704832 00000100:00100000:1.0:1763333174.741258:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613704832 00000100:00100000:2.0:1763333174.741980:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.742623:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9291 00000100:00100000:1.0:1763333174.742640:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:55917:x1848987613704832:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333174.742668:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333174.742688:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c56657 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969855 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333174.742716:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613705088 00010000:00010000:1.0:1763333174.742722:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5665e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00000100:00100000:0.0:1763333174.742723:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613705088 00010000:00010000:1.0:1763333174.742736:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5665e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.742746:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5665e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000100:00100000:0.0:1763333174.742762:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3176 00000100:00100000:0.0:1763333174.742768:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:56862:x1848987613705088:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333174.746458:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:56862:x1848987613705088:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 3677us (4470us total) trans 4294972301 rc 0/0 00000100:00100000:0.0:1763333174.746473:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3176 00010000:00010000:1.0:1763333174.746597:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c56657 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969855 expref: 243 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.746621:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5665e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969855 expref: 242 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.746631:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:1.0:1763333174.746634:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763333174.746638:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdf200, rc 0) 00000100:00100000:1.0:1763333174.746684:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:55917:x1848987613704832:12345-192.168.204.28@tcp:101:bash.0 Request processed in 4050us (6789us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333174.746691:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9291 00000100:00100000:2.0:1763333174.751126:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.751214:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613705344 00000100:00100000:1.0:1763333174.751226:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613705344 00000100:00100000:1.0:1763333174.751286:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9292 00000100:00100000:1.0:1763333174.751297:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:55917:x1848987613705344:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:1.0:1763333174.751831:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333174.751861:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c56642 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1b3:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969847 expref: 242 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.751880:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:1.0:1763333174.751886:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333174.752083:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c56665 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333174.752100:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c56665 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.752110:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c56665 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000001:00080000:1.0:1763333174.752158:0:12741:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294972302 00000004:00010000:1.0:1763333174.752182:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000045d78ce8 reply state 00000000fb1a3d8c transno 4294972303 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c56665 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.752209:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c56665 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.752215:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:1.0:1763333174.752217:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333174.752220:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763333174.752322:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:55917:x1848987613705344:12345-192.168.204.28@tcp:36:bash.0 Request processed in 1026us (1206us total) trans 4294972303 rc 0/0 00000100:00100000:1.0:1763333174.752330:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9292 00000020:00080000:1.0:1763333174.752337:0:12741:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763333174.755709:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.755750:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613705600 00000100:00100000:1.0:1763333174.755763:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613705600 00000100:00100000:1.0:1763333174.755824:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9293 00000100:00100000:1.0:1763333174.755834:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56862:x1848987613705600:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333174.755856:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333174.755879:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5666c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696985c expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.755959:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56673 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333174.755973:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56673 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.755984:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56673 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.755995:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5667a lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333174.756002:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5667a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.756008:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5667a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.756118:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c56681 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333174.756127:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c56681 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.756133:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c56681 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:1.0:1763333174.756144:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b3:0x0]: returning size 0 00010000:00010000:1.0:1763333174.756239:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56673 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.756247:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56673 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.756253:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56673 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.756259:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56673 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.756266:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fc00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333174.756270:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56673 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.756277:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56673 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.756290:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff42c64200) 00010000:00010000:1.0:1763333174.756294:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333174.756297:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56673 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.756303:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56673 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.756316:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5667a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.756322:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5667a lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.756331:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5667a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.756335:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333174.756338:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5667a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.756343:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5667a lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.756396:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff42c64900) 00010000:00010000:1.0:1763333174.756400:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333174.756403:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5667a lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.756409:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5667a lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.756450:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5666c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696985c expref: 247 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.756467:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c56681 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696985c expref: 246 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.756474:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:1.0:1763333174.756487:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333174.756491:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f000, rc 0) 00000100:00100000:1.0:1763333174.756547:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56862:x1848987613705600:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 714us (846us total) trans 4294972304 rc 0/0 00000100:00100000:1.0:1763333174.756555:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9293 00000100:00100000:2.0:1763333174.759762:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.759835:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613705856 00000100:00100000:0.0:1763333174.759846:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613705856 00000100:00100000:2.0:1763333174.759854:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.759915:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9294 00000100:00100000:0.0:1763333174.759926:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:55917:x1848987613705856:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333174.759949:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333174.759952:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763333174.759977:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c56650 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696984e expref: 246 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.759996:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:0.0:1763333174.760002:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333174.760015:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c5668f lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969863 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.760060:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f800/0xb32e3ef184c56696 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333174.760073:0:8606:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c56681 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696985c expref: 246 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.760082:0:8606:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f800/0xb32e3ef184c56696 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.760112:0:8606:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c56681 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696985c expref: 246 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.760125:0:8606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c56681 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696985c expref: 246 pid: 12741 timeout: 1378 lvb_type: 0 00000100:00100000:0.0:1763333174.760137:0:8606:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe438a8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627262848:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333174.760232:0:8606:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe43aa6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1763333174.760621:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613706112 00000100:00100000:3.0:1763333174.760628:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613706112 00000100:00100000:3.0:1763333174.760675:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3177 00000100:00100000:3.0:1763333174.760684:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56862:x1848987613706112:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333174.760885:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:56862:x1848987613706112:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 202us (1030us total) trans 4294972305 rc 0/0 00000100:00100000:3.0:1763333174.760896:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3177 00000100:00100000:0.0:1763333174.762869:0:8606:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe438a8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627262848:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333174.763199:0:8606:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f800/0xb32e3ef184c56696 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000100:00100000:2.0:1763333174.765874:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.766010:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613706240 00000100:00100000:1.0:1763333174.766023:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613706240 00000100:00100000:1.0:1763333174.766083:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3178 00000100:00100000:1.0:1763333174.766094:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:56862:x1848987613706240:12345-192.168.204.28@tcp:33:lfs.0 00000100:00100000:1.0:1763333174.766269:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:56862:x1848987613706240:12345-192.168.204.28@tcp:33:lfs.0 Request processed in 176us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333174.766276:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3178 00000100:00100000:2.0:1763333174.767102:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.768892:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613706368 00000100:00100000:1.0:1763333174.768906:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613706368 00010000:00010000:1.0:1763333174.768959:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c56681 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696985c expref: 248 pid: 12741 timeout: 1378 lvb_type: 0 00000100:00100000:1.0:1763333174.769008:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3052 00000100:00100000:1.0:1763333174.769019:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:2419:x1848987613706368:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333174.769037:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333174.769044:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c56681 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696985c expref: 248 pid: 12741 timeout: 1378 lvb_type: 0 00010000:00010000:1.0:1763333174.769059:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c56681 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696985c expref: 248 pid: 12741 timeout: 1378 lvb_type: 0 00010000:00010000:1.0:1763333174.769081:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c56681 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696985c expref: 248 pid: 12741 timeout: 1378 lvb_type: 0 00010000:00010000:1.0:1763333174.769097:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:1.0:1763333174.769103:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f800/0xb32e3ef184c56696 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.769118:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f800/0xb32e3ef184c56696 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.769125:0:6505:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f800/0xb32e3ef184c56696 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.770116:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333174.770200:0:8606:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f800/0xb32e3ef184c56696 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.770213:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f800/0xb32e3ef184c56696 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000040:00080000:0.0:1763333174.770500:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1413, 88 off119288 00000004:00080000:0.0:1763333174.770509:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1278850159079ns, next at 1279713547966ns, rc = 0 00000040:00080000:0.0:1763333174.770533:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1414, 88 off119288 00000004:00080000:0.0:1763333174.770537:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1278850188217ns, next at 1279025269818ns, rc = 0 00000040:00080000:0.0:1763333174.770601:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1415, 88 off119376 00000004:00080000:0.0:1763333174.770606:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1278850257098ns, next at 1279025269818ns, rc = 0 00000040:00080000:0.0:1763333174.770628:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1414, 88 off119376 00000004:00080000:0.0:1763333174.770632:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1278850283258ns, next at 1279713547966ns, rc = 0 00000100:00100000:1.0:1763333174.771393:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:2419:x1848987613706368:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 2369us (4288us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333174.771406:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3052 00000001:00080000:1.0:1763333174.783140:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972306 is committed 00000004:00080000:1.0:1763333174.783155:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 924 committed 00000004:00080000:1.0:1763333174.783175:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 927 committed 00000100:00100000:3.0:1763333174.783485:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4920ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627263104:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763333174.783562:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333174.783619:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763333174.783625:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4920d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627263232:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333174.783650:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333174.783682:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4920ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627262976:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763333174.783703:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333174.783720:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763333174.783725:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44de1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627263360:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333174.783744:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333174.783774:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627263104 00000100:00100000:3.0:1763333174.783781:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627263104 00010000:00010000:0.0:1763333174.783804:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c56665 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.783817:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c56665 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.783825:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c56665 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00000100:00100000:3.0:1763333174.783829:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627263232 00010000:00010000:0.0:1763333174.783831:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdee00 already unused, calling callback (ffffffffc17b3550) 00000100:00100000:3.0:1763333174.783833:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627263232 00010000:00010000:0.0:1763333174.783838:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c56665 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.783846:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c56665 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00000100:00100000:3.0:1763333174.783854:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627262976 00000100:00100000:3.0:1763333174.783858:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627262976 00010000:00010000:0.0:1763333174.783862:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:0.0:1763333174.783866:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333174.783871:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c56665 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000100:00100000:3.0:1763333174.783874:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627263360 00000100:00100000:3.0:1763333174.783879:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627263360 00010000:00010000:0.0:1763333174.783880:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c56665 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000100:00100000:3.0:1763333174.783902:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6531 00000100:00100000:3.0:1763333174.783911:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+28:3652:x1848987627263104:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763333174.783937:0:28651:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:566 count 1 00010000:00010000:3.0:1763333174.783961:0:28651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5669d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.783978:0:28651:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56546 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697fa expref: 22 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.783991:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333174.783994:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333174.783997:0:28651:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5669d lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.784021:0:28651:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56546 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697fa expref: 22 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.784035:0:28651:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56546 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697fa expref: 22 pid: 29010 timeout: 1378 lvb_type: 0 00000100:00100000:3.0:1763333174.784046:0:28651:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e1b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28651:1848987627263488:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333174.784120:0:28651:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff49c92240 going to sleep for 11 seconds 00000100:00100000:3.0:1763333174.784139:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6532 00000100:00100000:3.0:1763333174.784146:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e0f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+28:3652:x1848987627263232:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333174.784312:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e0f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+29:3652:x1848987627263232:12345-0@lo:2:osp-syn-1-1.0 Request processed in 165us (659us total) trans 17179871583 rc 0/0 00000100:00100000:3.0:1763333174.784320:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6532 00000100:00100000:3.0:1763333174.784340:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6533 00000100:00100000:3.0:1763333174.784346:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+28:3655:x1848987627262976:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763333174.784378:0:8611:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:565 count 1 00010000:00010000:3.0:1763333174.784390:0:8611:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c566a4 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.784401:0:8611:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5646d lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697ad expref: 22 pid: 28650 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333174.784408:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333174.784409:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333174.784412:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c566a4 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.784429:0:8611:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5646d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697ad expref: 22 pid: 28650 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333174.784438:0:8611:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5646d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697ad expref: 22 pid: 28650 timeout: 1378 lvb_type: 1 00000100:00100000:3.0:1763333174.784447:0:8611:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8611:1848987627263616:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333174.784470:0:8611:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff49c92540 going to sleep for 11 seconds 00000100:00100000:3.0:1763333174.784496:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6534 00000100:00100000:3.0:1763333174.784503:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+28:3655:x1848987627263360:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1763333174.784574:0:8406:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x23a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333174.784577:0:8406:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x23a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763333174.784580:0:8406:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x23a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333174.784582:0:8406:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x23a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763333174.784584:0:8406:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x23a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333174.784613:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+29:3655:x1848987627263360:12345-0@lo:2:osp-syn-1-1.0 Request processed in 111us (868us total) trans 17179871584 rc 0/0 00000100:00100000:3.0:1763333174.784618:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6534 00000004:00080000:3.0:1763333174.784656:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4920d500/2, rc 0, transno 17179871583 00000100:00100000:3.0:1763333174.784661:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4920d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627263232:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1763333174.784679:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 926 committed 00000004:00080000:3.0:1763333174.784680:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44de1500/2, rc 0, transno 17179871584 00000004:00080000:1.0:1763333174.784685:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 923 committed 00000100:00100000:3.0:1763333174.784688:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44de1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627263360:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333174.787384:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff5004b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627264128:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333174.787445:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333174.787496:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1763333174.787503:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe438a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627263744:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763333174.787524:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333174.787589:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff5004bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627264000:0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1763333174.791623:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f800/0xb32e3ef184c56696 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969863 expref: 235 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.791643:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:0.0:1763333174.791646:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763333174.791667:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c5668f lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969863 expref: 235 pid: 8606 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1763333174.791687:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f800/0xb32e3ef184c56696 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969863 expref: 234 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.791719:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:0.0:1763333174.791721:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763333174.791724:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff4148f800, rc 0) 00000100:00100000:0.0:1763333174.791818:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:55917:x1848987613705856:12345-192.168.204.28@tcp:101:bash.0 Request processed in 31891us (32063us total) trans 4294972306 rc 0/0 00000100:00100000:0.0:1763333174.791828:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9294 00000100:00100000:2.0:1763333174.792954:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627264128 00000100:00100000:2.0:1763333174.792968:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627264128 00000100:00100000:2.0:1763333174.793030:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627263744 00000100:00100000:2.0:1763333174.793035:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627263744 00000100:00100000:1.0:1763333174.793058:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6535 00000100:00100000:2.0:1763333174.793067:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6536 00000100:00100000:1.0:1763333174.793072:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+10:3654:x1848987627264128:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333174.793079:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+10:3654:x1848987627263744:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1763333174.793104:0:8407:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:565 count 1 00010000:00010000:2.0:1763333174.793130:0:8407:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c566ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.793150:0:8407:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96e00/0xb32e3ef184c56371 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969759 expref: 12 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.793159:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333174.793162:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333174.793166:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c566ab lrc: 4/0,1 mode: --/PW res: [0x280000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.793203:0:8407:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96e00/0xb32e3ef184c56371 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969759 expref: 12 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.793223:0:8407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96e00/0xb32e3ef184c56371 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969759 expref: 12 pid: 28650 timeout: 1378 lvb_type: 0 00002000:00010000:1.0:1763333174.793235:0:29013:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x23a:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:2.0:1763333174.793239:0:8407:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44de0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8407:1848987627264256:192.168.204.28@tcp:104: 00002000:00010000:1.0:1763333174.793241:0:29013:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x23a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763333174.793248:0:29013:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x23a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333174.793250:0:29013:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x23a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763333174.793252:0:29013:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x23a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333174.793315:0:8407:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff742b9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1763333174.793326:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333174.793377:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627264000 00000100:00100000:2.0:1763333174.793382:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627264000 00000100:00100000:2.0:1763333174.793410:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6537 00000100:00100000:2.0:1763333174.793416:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50049500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+12:3653:x1848987627264000:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333174.793444:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+12:3654:x1848987627264128:12345-0@lo:2:osp-syn-0-1.0 Request processed in 376us (5998us total) trans 21474838887 rc 0/0 00000100:00100000:1.0:1763333174.793453:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6535 00000004:00080000:1.0:1763333174.793515:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff5004b480/2, rc 0, transno 21474838887 00000100:00100000:1.0:1763333174.793523:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff5004b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627264128:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333174.793525:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50049500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+12:3653:x1848987627264000:12345-0@lo:2:osp-syn-0-1.0 Request processed in 106us (198us total) trans 21474838888 rc 0/0 00000100:00100000:2.0:1763333174.793537:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6537 00000004:00080000:1.0:1763333174.795595:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff5004bb80/2, rc 0, transno 21474838888 00000100:00100000:2.0:1763333174.795596:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe438aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627263872:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763333174.795609:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff5004bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627264000:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333174.795662:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333174.795732:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627263872 00000100:00100000:2.0:1763333174.795738:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627263872 00000100:00100000:2.0:1763333174.795786:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6538 00000100:00100000:2.0:1763333174.795795:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+12:3652:x1848987627263872:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1763333174.795822:0:29010:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:566 count 1 00010000:00010000:2.0:1763333174.795845:0:29010:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c566b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.795866:0:29010:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c5653f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697f3 expref: 12 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.795879:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333174.795881:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333174.795884:0:29010:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c566b2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.795917:0:29010:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c5653f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697f3 expref: 12 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.795928:0:29010:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c5653f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697f3 expref: 12 pid: 29013 timeout: 1378 lvb_type: 0 00000100:00100000:2.0:1763333174.795938:0:29010:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44de0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:29010:1848987627264384:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333174.796005:0:29010:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff742b93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763333174.798659:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333174.798683:0:8611:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8611:1848987627263616:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333174.798714:0:8611:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c566a4 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333174.798919:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613706624 00000100:00100000:2.0:1763333174.798929:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613706624 00010000:00010000:2.0:1763333174.798973:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5646d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697ad expref: 23 pid: 28650 timeout: 1378 lvb_type: 1 00000100:00100000:2.0:1763333174.799010:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3053 00000100:00100000:2.0:1763333174.799019:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50049180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2420:x1848987613706624:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333174.799035:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333174.799041:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5646d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x235:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697ad expref: 23 pid: 28650 timeout: 1378 lvb_type: 1 00010000:00010000:2.0:1763333174.799052:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5646d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x235:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697ad expref: 23 pid: 28650 timeout: 1378 lvb_type: 1 00010000:00010000:2.0:1763333174.799076:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5646d lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x235:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697ad expref: 23 pid: 28650 timeout: 1378 lvb_type: 1 00010000:00010000:2.0:1763333174.799090:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333174.799093:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333174.799097:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c566a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.799107:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c566a4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.799132:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333174.799181:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50049180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2420:x1848987613706624:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 162us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333174.799189:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3053 00000100:00100000:1.0:1763333174.800315:0:28651:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e1b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28651:1848987627263488:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333174.800334:0:28651:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5669d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333174.800762:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:3.0:1763333174.801407:0:8611:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c566a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.801420:0:8611:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c566a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.801431:0:8611:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c566a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.801440:0:8611:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c566a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.801462:0:8611:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763333174.801815:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+29:3655:x1848987627262976:12345-0@lo:6:osp-syn-1-1.0 Request processed in 17466us (18107us total) trans 17179871585 rc 0/0 00000100:00100000:3.0:1763333174.801824:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6533 00000004:00080000:2.0:1763333174.802056:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4920ed80/2, rc 0, transno 17179871585 00000100:00100000:2.0:1763333174.802063:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4920ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627262976:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763333174.802152:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.802192:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613706496 00000100:00100000:3.0:1763333174.802193:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613706752 00000100:00100000:2.0:1763333174.802200:0:29010:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44de0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:29010:1848987627264384:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333174.802202:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613706496 00000100:00100000:3.0:1763333174.802203:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613706752 00010000:00010000:2.0:1763333174.802222:0:29010:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c566b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.802240:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56546 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697fa expref: 23 pid: 29010 timeout: 1378 lvb_type: 0 00000100:00100000:3.0:1763333174.802251:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6539 00000100:00100000:3.0:1763333174.802263:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:55917:x1848987613706752:12345-192.168.204.28@tcp:101:bash.0 00000100:00100000:1.0:1763333174.802275:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3054 00000100:00100000:2.0:1763333174.802277:0:8407:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44de0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8407:1848987627264256:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333174.802280:0:8611:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1763333174.802288:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5004aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2420:x1848987613706496:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333174.802292:0:8407:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c566ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.802304:0:8611:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c566b9 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696986a expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.802304:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333174.802314:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56546 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x236:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697fa expref: 23 pid: 29010 timeout: 1378 lvb_type: 0 00002000:00010000:3.0:1763333174.802330:0:8611:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x239:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333174.802330:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56546 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x236:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697fa expref: 23 pid: 29010 timeout: 1378 lvb_type: 0 00000100:00100000:2.0:1763333174.802337:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333174.802369:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613706880 00000100:00100000:2.0:1763333174.802373:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613706880 00010000:00010000:3.0:1763333174.802377:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333174.802379:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56546 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x236:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697fa expref: 24 pid: 29010 timeout: 1378 lvb_type: 0 00010000:00010000:3.0:1763333174.802381:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333174.802392:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96e00/0xb32e3ef184c56371 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969759 expref: 13 pid: 28650 timeout: 1378 lvb_type: 0 00010000:00010000:3.0:1763333174.802393:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c566b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696986a expref: 24 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.802409:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333174.802413:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333174.802419:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5669d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.802426:0:8611:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c566b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696986a expref: 23 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333174.802433:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3055 00010000:00010000:1.0:1763333174.802435:0:6506:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5669d lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333174.802446:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2419:x1848987613706880:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333174.802451:0:8611:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96000, rc 0) 00010000:00010000:2.0:1763333174.802461:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333174.802467:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96e00/0xb32e3ef184c56371 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x235:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969759 expref: 13 pid: 28650 timeout: 1378 lvb_type: 0 00010000:00010000:1.0:1763333174.802487:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333174.802490:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96e00/0xb32e3ef184c56371 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x235:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969759 expref: 13 pid: 28650 timeout: 1378 lvb_type: 0 00000100:00100000:3.0:1763333174.802508:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:55917:x1848987613706752:12345-192.168.204.28@tcp:101:bash.0 Request processed in 246us (354us total) trans 0 rc 0/0 00010000:00010000:2.0:1763333174.802511:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96e00/0xb32e3ef184c56371 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x235:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969759 expref: 13 pid: 28650 timeout: 1378 lvb_type: 0 00000100:00100000:1.0:1763333174.802521:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5004aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2420:x1848987613706496:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 234us (1758us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333174.802525:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6539 00010000:00010000:2.0:1763333174.802531:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333174.802535:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333174.802539:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c566ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333174.802539:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3054 00010000:00010000:2.0:1763333174.802551:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c566ab lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.802574:0:28651:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5669d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.802575:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333174.802586:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:1.0:1763333174.802591:0:28651:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5669d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333174.802600:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:2419:x1848987613706880:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 155us (266us total) trans 0 rc 0/0 00010000:00010000:1.0:1763333174.802605:0:28651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5669d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333174.802610:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3055 00010000:00010000:1.0:1763333174.802620:0:28651:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5669d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333174.802630:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613707008 00000100:00100000:2.0:1763333174.802634:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613707008 00010000:00010000:2.0:1763333174.802648:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c5653f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697f3 expref: 12 pid: 29013 timeout: 1378 lvb_type: 0 00000100:00100000:2.0:1763333174.802672:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3056 00000100:00100000:2.0:1763333174.802680:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:2419:x1848987613707008:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333174.802688:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333174.802692:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c5653f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697f3 expref: 12 pid: 29013 timeout: 1378 lvb_type: 0 00010000:00010000:2.0:1763333174.802702:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c5653f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697f3 expref: 12 pid: 29013 timeout: 1378 lvb_type: 0 00010000:00010000:2.0:1763333174.802720:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c5653f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x236:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369697f3 expref: 12 pid: 29013 timeout: 1378 lvb_type: 0 00010000:00010000:2.0:1763333174.802729:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333174.802731:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333174.802734:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c566b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.802747:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c566b2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.802772:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333174.802790:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+11:2419:x1848987613707008:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 111us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333174.802796:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3056 00010000:00010000:2.0:1763333174.802816:0:8407:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c566ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.802824:0:8407:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c566ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.802841:0:29010:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c566b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.802847:0:8407:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c566ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.802855:0:29010:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c566b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.802858:0:8407:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c566ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.802875:0:29010:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c566b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.802888:0:29010:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c566b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.805095:0:28651:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1763333174.805587:0:8407:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1763333174.805628:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1763333174.805640:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c566a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.805652:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97800 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333174.805656:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c566a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.805667:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c566a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.805675:0:29010:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1763333174.805690:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c566a4 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.805699:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c566a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.805725:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1763333174.805729:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5669d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.805737:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333174.805740:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5669d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.805747:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5669d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.805757:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5669d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.805763:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5669d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.805777:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1763333174.805781:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c566ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.805791:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333174.805794:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c566ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.805801:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c566ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.805810:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c566ab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.805817:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c566ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.805832:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333174.805836:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c566b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.805841:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feaa00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333174.805844:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c566b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.805851:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c566b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333174.805858:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+14:3654:x1848987627263744:12345-0@lo:6:osp-syn-0-1.0 Request processed in 12776us (18326us total) trans 21474838889 rc 0/0 00010000:00010000:0.0:1763333174.805863:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c566b2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333174.805872:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6536 00010000:00010000:0.0:1763333174.805882:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c566b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.805895:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333174.805898:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333174.805900:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333174.805925:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333174.805932:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763333174.805973:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe438a8000/2, rc 0, transno 21474838889 00000100:00100000:2.0:1763333174.805980:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe438a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627263744:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763333174.806059:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.806460:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+29:3652:x1848987627263104:12345-0@lo:6:osp-syn-1-1.0 Request processed in 22547us (22895us total) trans 17179871586 rc 0/0 00000100:00100000:1.0:1763333174.806468:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6531 00000004:00080000:2.0:1763333174.806752:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4920ea00/2, rc 0, transno 17179871586 00000100:00100000:2.0:1763333174.806758:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4920ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627263104:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763333174.807726:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613707264 00000100:00100000:0.0:1763333174.807736:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613707264 00000100:00100000:0.0:1763333174.807791:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9295 00000100:00100000:0.0:1763333174.807799:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+234:56867:x1848987613707264:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333174.807822:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333174.807843:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c566c0 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969871 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333174.808034:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763333174.808191:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+13:3652:x1848987627263872:12345-0@lo:6:osp-syn-0-1.0 Request processed in 12395us (12527us total) trans 21474838890 rc 0/0 00000100:00100000:3.0:1763333174.808201:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6538 00010000:00010000:0.0:1763333174.808459:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c566c7 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333174.808475:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c566c7 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.808494:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c566c7 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.808506:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c566ce lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333174.808513:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c566ce lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.808520:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c566ce lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.808615:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c566d5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333174.808623:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c566d5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.808629:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c566d5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:0.0:1763333174.808640:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b3:0x0]: returning size 2 00000004:00080000:2.0:1763333174.808678:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe438aa300/2, rc 0, transno 21474838890 00000100:00100000:2.0:1763333174.808685:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe438aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627263872:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1763333174.808724:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c566c7 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.808732:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c566c7 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.808738:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c566c7 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.808744:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c566c7 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.808749:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48192200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333174.808753:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c566c7 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.808759:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c566c7 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.808772:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12000) 00010000:00010000:0.0:1763333174.808775:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333174.808780:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c566c7 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.808788:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c566c7 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.808799:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c566ce lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.808804:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c566ce lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.808809:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c566ce lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.808814:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48192400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333174.808817:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c566ce lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.808822:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c566ce lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.808829:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe44e12400) 00010000:00010000:0.0:1763333174.808831:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333174.808833:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c566ce lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.808838:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c566ce lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.808875:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c566c0 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969871 expref: 237 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.808890:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c566d5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969871 expref: 236 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.808902:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:0.0:1763333174.808904:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333174.808906:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48193c00, rc 0) 00000100:00100000:3.0:1763333174.810704:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333174.810743:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613707392 00000100:00100000:3.0:1763333174.810751:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613707392 00000100:00100000:0.0:1763333174.810797:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56867:x1848987613707264:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 2995us (4736us total) trans 4294972307 rc 0/0 00000100:00100000:0.0:1763333174.810810:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9295 00000100:00100000:3.0:1763333174.810812:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6540 00000100:00100000:3.0:1763333174.810824:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1370b1d7-8612-4b90-ab37-e53288bbf9fd+11:55917:x1848987613707392:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333174.810843:0:29010:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333174.810870:0:29010:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c566e3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969878 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333174.810898:0:29010:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x239:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333174.810921:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333174.810923:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333174.810933:0:29010:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c566e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969878 expref: 12 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.810949:0:29010:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c566e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969878 expref: 12 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.810962:0:29010:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a97200, rc 0) 00000100:00100000:3.0:1763333174.811029:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:55917:x1848987613707392:12345-192.168.204.28@tcp:101:bash.0 Request processed in 206us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333174.811036:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6540 00000100:00100000:1.0:1763333174.821156:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333174.822088:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613707648 00000100:00100000:3.0:1763333174.822101:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613707648 00000100:00100000:3.0:1763333174.822170:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3179 00000100:00100000:3.0:1763333174.822180:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7ad4a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56867:x1848987613707648:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333174.822462:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7ad4a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56867:x1848987613707648:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 282us (2216us total) trans 4294972308 rc 0/0 00000100:00100000:3.0:1763333174.822470:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3179 00000100:00100000:0.0:1763333174.822617:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.823168:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.824976:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613707776 00000100:00100000:0.0:1763333174.824990:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613707776 00000100:00100000:3.0:1763333174.825026:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613707904 00000100:00100000:3.0:1763333174.825031:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613707904 00002000:00010000:0.0:1763333174.825035:0:16635:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/569 (0->18446744073709551615) 00002000:00100000:0.0:1763333174.825040:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff5004a300 with x1848987613707776 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333174.825043:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/569 (0->18446744073709551615) 00002000:00100000:3.0:1763333174.825045:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7dcfd880 with x1848987613707904 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333174.825053:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7dcfd880. 00002000:00010000:0.0:1763333174.825053:0:16635:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff5004a300. 00000100:00100000:0.0:1763333174.825079:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1615 00000100:00100000:3.0:1763333174.825083:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1616 00000100:00100000:0.0:1763333174.825088:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5004a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2420:x1848987613707776:12345-192.168.204.28@tcp:10:bash.0 00000100:00100000:3.0:1763333174.825089:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:2420:x1848987613707904:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:3.0:1763333174.825235:0:28427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x239:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333174.825235:0:16635:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x239:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333174.825239:0:28427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x239:0x0] updating lvb mtime from disk: 0 -> 1763333175 00002000:00010000:0.0:1763333174.825239:0:16635:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x239:0x0] updating lvb mtime from disk: 0 -> 1763333175 00002000:00010000:3.0:1763333174.825242:0:28427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x239:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333174.825242:0:16635:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x239:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333174.825245:0:28427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x239:0x0] updating lvb ctime from disk: 0 -> 1763333175 00002000:00010000:0.0:1763333174.825245:0:16635:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x239:0x0] updating lvb ctime from disk: 0 -> 1763333175 00002000:00010000:3.0:1763333174.825248:0:28427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x239:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1763333174.825248:0:16635:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x239:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333174.825317:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2420:x1848987613707904:12345-192.168.204.28@tcp:10:bash.0 Request processed in 226us (2149us total) trans 21474838891 rc 0/0 00000100:00100000:3.0:1763333174.825323:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1616 00002000:00010000:3.0:1763333174.825328:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/569 (0->18446744073709551615) 00002000:00100000:3.0:1763333174.825331:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7dcfd880 with x1848987613707904 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333174.825335:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7dcfd880. 00000100:00100000:1.0:1763333174.833149:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5004a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2420:x1848987613707776:12345-192.168.204.28@tcp:10:bash.0 Request processed in 8045us (10515us total) trans 17179871587 rc 0/0 00000100:00100000:1.0:1763333174.833168:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1615 00002000:00010000:1.0:1763333174.833178:0:16635:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/569 (0->18446744073709551615) 00002000:00100000:1.0:1763333174.833183:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff5004a300 with x1848987613707776 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333174.833198:0:16635:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff5004a300. 00000100:00100000:1.0:1763333174.844576:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.844651:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613708160 00000100:00100000:0.0:1763333174.844665:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613708160 00000100:00100000:0.0:1763333174.844739:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9296 00000100:00100000:0.0:1763333174.844749:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56868:x1848987613708160:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333174.844777:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333174.844803:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c566ea lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696987f expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.844917:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c566f1 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333174.844935:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c566f1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.844945:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c566f1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:0.0:1763333174.844957:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b3:0x0]: returning size 2 00010000:00010000:0.0:1763333174.845069:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c566ea lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696987f expref: 240 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.845088:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c566f1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696987f expref: 239 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.845096:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:0.0:1763333174.845099:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1763333174.845103:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48192400, rc 0) 00000100:00100000:0.0:1763333174.845183:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56868:x1848987613708160:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 435us (616us total) trans 4294972309 rc 0/0 00000100:00100000:0.0:1763333174.845191:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9296 00000100:00100000:2.0:1763333174.848930:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333174.849023:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613708416 00000100:00100000:3.0:1763333174.849038:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613708416 00000100:00100000:3.0:1763333174.849624:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3180 00000100:00100000:3.0:1763333174.849637:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:55917:x1848987613708416:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:2.0:1763333174.853714:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:55917:x1848987613708416:12345-192.168.204.28@tcp:35:bash.0 Request processed in 4068us (4781us total) trans 4294972310 rc 0/0 00000100:00100000:2.0:1763333174.853731:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3180 00000100:00100000:1.0:1763333174.853912:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333174.854026:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613708672 00000100:00100000:3.0:1763333174.854035:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613708672 00000100:00100000:3.0:1763333174.854079:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9297 00000100:00100000:3.0:1763333174.854088:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:56868:x1848987613708672:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333174.854112:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333174.854135:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c566ff lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969886 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.854242:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56706 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333174.854258:0:12741:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c566d5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969871 expref: 241 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.854267:0:12741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56706 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x1b3:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.854298:0:12741:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c566d5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969871 expref: 241 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.854311:0:12741:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c566d5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969871 expref: 241 pid: 8606 timeout: 1378 lvb_type: 0 00000100:00100000:3.0:1763333174.854331:0:12741:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e1a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627264512:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333174.854421:0:12741:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff49c92b40 going to sleep for 11 seconds 00000100:00100000:2.0:1763333174.857783:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333174.857927:0:12741:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e1a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627264512:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333174.858018:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613708800 00000100:00100000:0.0:1763333174.858026:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613708800 00010000:00010000:0.0:1763333174.858067:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c566d5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969871 expref: 242 pid: 8606 timeout: 1378 lvb_type: 0 00000100:00100000:0.0:1763333174.858111:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3057 00000100:00100000:0.0:1763333174.858122:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff44f0a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:2421:x1848987613708800:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333174.858138:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333174.858144:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c566d5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969871 expref: 242 pid: 8606 timeout: 1378 lvb_type: 0 00010000:00010000:0.0:1763333174.858156:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c566d5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969871 expref: 242 pid: 8606 timeout: 1378 lvb_type: 0 00010000:00010000:0.0:1763333174.858180:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c566d5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969871 expref: 242 pid: 8606 timeout: 1378 lvb_type: 0 00010000:00010000:0.0:1763333174.858196:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:0.0:1763333174.858201:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56706 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1b3:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.858211:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56706 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1b3:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.858219:0:6506:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56706 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x1b3:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.858238:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333174.858292:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff44f0a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:2421:x1848987613708800:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 172us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333174.858300:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3057 00010000:00010000:3.0:1763333174.858432:0:12741:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56706 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1b3:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.858441:0:12741:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56706 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1b3:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.858447:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56706 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1b3:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:3.0:1763333174.858472:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b3:0x0]: returning size 5 00010000:00010000:3.0:1763333174.858627:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c566ff lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969886 expref: 242 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.858641:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56706 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1b3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969886 expref: 241 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.858648:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:3.0:1763333174.858651:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1763333174.858653:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96400, rc 0) 00000100:00100000:3.0:1763333174.858695:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56868:x1848987613708672:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 4607us (4783us total) trans 4294972311 rc 0/0 00000100:00100000:3.0:1763333174.858702:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9297 00010000:00010000:0.0:1763333174.864778:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763333174.865205:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333174.865320:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613708928 00000100:00100000:3.0:1763333174.865332:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613708928 00000100:00100000:3.0:1763333174.865456:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9298 00000100:00100000:3.0:1763333174.865467:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56868:x1848987613708928:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333174.865502:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333174.865523:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c56714 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696988d expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.865640:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5671b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333174.865658:0:12741:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56706 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x1b3:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969886 expref: 242 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.865667:0:12741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5671b lrc: 4/1,0 mode: --/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.865708:0:12741:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56706 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1b3:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969886 expref: 242 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.865722:0:12741:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56706 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1b3:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969886 expref: 242 pid: 12741 timeout: 1378 lvb_type: 0 00000100:00100000:3.0:1763333174.865735:0:12741:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e1a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627264640:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333174.865833:0:12741:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff49c92600 going to sleep for 11 seconds 00000100:00100000:3.0:1763333174.867631:0:12741:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e1a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627264640:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333174.867657:0:12741:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5671b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000100:00100000:2.0:1763333174.868501:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.868659:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613709056 00000100:00100000:0.0:1763333174.868668:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613709056 00010000:00010000:0.0:1763333174.868708:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56706 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1b3:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969886 expref: 243 pid: 12741 timeout: 1378 lvb_type: 0 00000100:00100000:0.0:1763333174.868754:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3058 00000100:00100000:0.0:1763333174.868765:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:2420:x1848987613709056:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333174.868780:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333174.868786:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56706 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1b3:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969886 expref: 243 pid: 12741 timeout: 1378 lvb_type: 0 00010000:00010000:0.0:1763333174.868798:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56706 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1b3:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969886 expref: 243 pid: 12741 timeout: 1378 lvb_type: 0 00010000:00010000:0.0:1763333174.868820:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56706 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1b3:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969886 expref: 243 pid: 12741 timeout: 1378 lvb_type: 0 00010000:00010000:0.0:1763333174.868836:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:0.0:1763333174.868841:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5671b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.868850:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5671b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.868857:0:6504:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5671b lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.868888:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333174.868942:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:2420:x1848987613709056:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 178us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333174.868950:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3058 00010000:00010000:3.0:1763333174.870007:0:12741:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5671b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.870020:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5671b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:3.0:1763333174.870070:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b3:0x0]: returning size 5 00000004:00200000:3.0:1763333174.870074:0:12741:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763333174.870093:0:12741:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5671b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.870127:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c56714 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696988d expref: 242 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.870143:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5671b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696988d expref: 241 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.870150:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:3.0:1763333174.870153:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333174.870156:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a97000, rc 0) 00000100:00100000:3.0:1763333174.870194:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56868:x1848987613708928:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 4730us (4998us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333174.870201:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9298 00000100:00100000:2.0:1763333174.875676:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333174.875713:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333174.875824:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613709184 00000100:00100000:3.0:1763333174.875835:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613709184 00000100:00100000:3.0:1763333174.877390:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9299 00000100:00100000:3.0:1763333174.877408:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56869:x1848987613709184:12345-192.168.204.28@tcp:101:rm.0 00010000:00010000:3.0:1763333174.877432:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333174.877458:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56722 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969894 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.877545:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c56729 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333174.877562:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c56729 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.877576:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c56729 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.877590:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c56730 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333174.877596:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c56730 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.877602:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c56730 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.877680:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56737 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333174.877689:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56737 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.877695:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56737 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:3.0:1763333174.877743:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b3:0x0]: returning size 5 00000004:00200000:3.0:1763333174.877748:0:12741:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763333174.877768:0:12741:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56737 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.877777:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56737 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.877785:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c56729 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.877791:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c56729 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.877797:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c56729 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.877802:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c56729 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.877806:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333174.877810:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c56729 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.877817:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c56729 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.877828:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff80045d00) 00010000:00010000:3.0:1763333174.877832:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333174.877836:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c56729 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.877842:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c56729 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.877858:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c56730 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.877864:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c56730 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.877869:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c56730 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.877874:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48190400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333174.877876:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c56730 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.877881:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c56730 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.877887:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff80045000) 00010000:00010000:3.0:1763333174.877889:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333174.877892:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c56730 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.877897:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c56730 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333174.877927:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56722 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969894 expref: 243 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.877942:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56737 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969894 expref: 242 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.877948:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:3.0:1763333174.877951:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333174.877953:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48190c00, rc 0) 00000100:00100000:3.0:1763333174.878036:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:56869:x1848987613709184:12345-192.168.204.28@tcp:101:rm.0 Request processed in 635us (2367us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333174.878043:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9299 00000100:00100000:0.0:1763333174.882279:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613709440 00000100:00100000:0.0:1763333174.882295:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613709440 00000100:00100000:0.0:1763333174.882398:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3181 00000100:00100000:0.0:1763333174.882411:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:56868:x1848987613709440:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333174.882739:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:56868:x1848987613709440:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 323us (7014us total) trans 4294972312 rc 0/0 00000100:00100000:0.0:1763333174.882747:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3181 00000100:00100000:3.0:1763333174.888285:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.888410:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613709568 00000100:00100000:1.0:1763333174.888425:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613709568 00000100:00100000:1.0:1763333174.888512:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 409 00000100:00100000:1.0:1763333174.888521:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:2418:x1848987613709568:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333174.888541:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333174.888567:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56737 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969894 expref: 243 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.888585:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:1.0:1763333174.888591:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333174.888650:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:2418:x1848987613709568:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 130us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333174.888657:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 409 00000100:00100000:2.0:1763333174.900302:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.900408:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613709824 00000100:00100000:1.0:1763333174.900420:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613709824 00000100:00100000:1.0:1763333174.900498:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9300 00000100:00100000:1.0:1763333174.900509:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:56869:x1848987613709824:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:1.0:1763333174.900569:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1763333174.900598:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f800/0xb32e3ef184c56696 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969863 expref: 242 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.900623:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c5671b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696988d expref: 241 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.900635:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5665e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969855 expref: 240 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.900647:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:1.0:1763333174.900652:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333174.900679:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5673e lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333174.900691:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5673e lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.900701:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5673e lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.900711:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56745 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333174.900717:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56745 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.900723:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56745 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.900890:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5674c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333174.900903:0:12741:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c566f1 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696987f expref: 239 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.900912:0:12741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5674c lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.900947:0:12741:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c566f1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696987f expref: 239 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.900960:0:12741:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c566f1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696987f expref: 239 pid: 8606 timeout: 1378 lvb_type: 0 00000100:00100000:1.0:1763333174.900975:0:12741:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7dcfed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627264768:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333174.901051:0:12741:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff44fdf900 going to sleep for 11 seconds 00000100:00100000:2.0:1763333174.901666:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.901856:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613710080 00000100:00100000:0.0:1763333174.901864:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613710080 00000100:00100000:0.0:1763333174.902010:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9301 00000100:00100000:0.0:1763333174.902020:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:56868:x1848987613710080:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333174.902036:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333174.902039:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763333174.902049:0:8606:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c566f1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696987f expref: 240 pid: 8606 timeout: 1378 lvb_type: 0 00010000:00010000:0.0:1763333174.902068:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:0.0:1763333174.902072:0:8606:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5674c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.902080:0:8606:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5674c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.902085:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5674c lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.902100:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333174.902111:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c56753 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696989b expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.902196:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c5675a lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333174.902206:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c5675a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b3:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.902214:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c5675a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b3:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:0.0:1763333174.902226:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b3:0x0]: returning size 5 00010000:00010000:0.0:1763333174.902331:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c56753 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696989b expref: 243 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.902346:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c5675a lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1b3:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696989b expref: 242 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.903114:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:0.0:1763333174.903117:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763333174.903120:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48193400, rc 0) 00000100:00100000:0.0:1763333174.903199:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:56868:x1848987613710080:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1179us (1532us total) trans 4294972313 rc 0/0 00000100:00100000:0.0:1763333174.903207:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9301 00010000:00010000:1.0:1763333174.906634:0:12741:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.204.28@tcp) returned -22 from blocking AST (req@0000000052a79940 x1848987627264768) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c566f1 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696987f expref: 241 pid: 8606 timeout: 1378 lvb_type: 0 00010000:00010000:1.0:1763333174.906662:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c566f1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696987f expref: 241 pid: 8606 timeout: 1378 lvb_type: 0 00000100:00100000:1.0:1763333174.906681:0:12741:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7dcfed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627264768:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333174.906706:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:1.0:1763333174.906714:0:12741:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5674c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.906728:0:12741:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5674c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.906733:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5674c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00080000:1.0:1763333174.906999:0:12741:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x1b3:0x0] is inserted into orphan list, open count = 2 00010000:00010000:1.0:1763333174.907089:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5674c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.907097:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5674c lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.907104:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5674c lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.907110:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fc00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333174.907114:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5674c lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.907121:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5674c lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.907132:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:1.0:1763333174.907135:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763333174.907138:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5674c lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.907143:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5674c lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.907157:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5673e lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.907166:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5673e lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.907172:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5673e lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.907178:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5673e lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.907183:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333174.907185:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5673e lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.907190:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5673e lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.907197:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff42c64200) 00010000:00010000:1.0:1763333174.907199:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333174.907202:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5673e lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.907207:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5673e lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000004:00010000:1.0:1763333174.907223:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009cb16739 reply state 000000003dea2b32 transno 4294972314 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56745 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.907234:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56745 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.907240:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff42c64900) 00010000:00010000:1.0:1763333174.907242:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333174.907246:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763333174.907323:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:56869:x1848987613709824:12345-192.168.204.28@tcp:36:rm.0 Request processed in 6814us (7033us total) trans 4294972314 rc 0/0 00000100:00100000:1.0:1763333174.907331:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9300 00000100:00100000:3.0:1763333174.940019:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.940137:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613710208 00000100:00100000:1.0:1763333174.940149:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613710208 00000100:00100000:1.0:1763333174.940215:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9302 00000100:00100000:1.0:1763333174.940225:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:56868:x1848987613710208:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333174.940248:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333174.940267:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56768 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369698a2 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.940320:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56768 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698a2 expref: 243 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.940335:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56768 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698a2 expref: 243 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.940388:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:1.0:1763333174.940392:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763333174.940395:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f600, rc 0) 00000100:00100000:1.0:1763333174.940442:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:56868:x1848987613710208:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 219us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333174.940449:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9302 00000100:00100000:2.0:1763333174.950868:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.951132:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613710336 00000100:00100000:0.0:1763333174.951142:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613710336 00000100:00100000:0.0:1763333174.951204:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9303 00000100:00100000:0.0:1763333174.951214:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:56870:x1848987613710336:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333174.951237:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333174.951261:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c5676f lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369698a9 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.951327:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c56776 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333174.951341:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c56776 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.951392:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c56776 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.951405:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c5677d lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333174.951414:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c5677d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.951420:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c5677d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.951458:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c56776 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.951465:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c56776 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.951471:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c56776 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.951487:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c56776 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.951493:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48192200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333174.951497:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c56776 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.951504:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c56776 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.951520:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12000) 00010000:00010000:0.0:1763333174.951523:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333174.951528:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c56776 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.951534:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c56776 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.951546:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c5677d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.951551:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c5677d lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.951556:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c5677d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.951561:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48192400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333174.951564:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c5677d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.951569:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c5677d lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.951576:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff42c64900) 00010000:00010000:0.0:1763333174.951578:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333174.951581:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c5677d lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.951587:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c5677d lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.951611:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c5676f lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698a9 expref: 244 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.951621:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12000) 00010000:00010000:0.0:1763333174.951624:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333174.951628:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c5676f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698a9 expref: 244 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.951640:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48193c00, rc 0) 00000100:00100000:0.0:1763333174.951706:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:56870:x1848987613710336:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 494us (848us total) trans 0 rc 301/301 00000100:00100000:0.0:1763333174.951714:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9303 00000100:00100000:3.0:1763333174.952030:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.952113:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613710464 00000100:00100000:0.0:1763333174.952118:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613710464 00000100:00100000:0.0:1763333174.952160:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6541 00000100:00100000:0.0:1763333174.952168:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2421:x1848987613710464:12345-192.168.204.28@tcp:1:lfs.0 00010000:00010000:0.0:1763333174.952198:0:28651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56784 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.952213:0:28651:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c566b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696986a expref: 23 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.952220:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333174.952222:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333174.952226:0:28651:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56784 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.952258:0:28651:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c566b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696986a expref: 23 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.952275:0:28651:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c566b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696986a expref: 23 pid: 8611 timeout: 1379 lvb_type: 0 00000100:00100000:0.0:1763333174.952289:0:28651:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff50049180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28651:1848987627264896:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333174.952341:0:28651:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe43aa6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1763333174.963389:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.963472:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613710592 00000100:00100000:1.0:1763333174.963490:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613710592 00002000:00100000:1.0:1763333174.963539:0:16635:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0x239:0x0] (0->4) req@ffff92fe44e1ad80 x1848987613710592/t0(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:485/0 lens 496/0 e 0 to 0 dl 1763333185 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763333174.963558:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe44e1ad80 with x1848987613710592 ext(0->4) 00010000:00010000:1.0:1763333174.963567:0:16635:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c566b9 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696986a expref: 24 pid: 8611 timeout: 1379 lvb_type: 0 00010000:00010000:1.0:1763333174.963584:0:16635:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c566b9 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696986a expref: 24 pid: 8611 timeout: 1379 lvb_type: 0 00002000:00010000:1.0:1763333174.963592:0:16635:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92fe44e1ad80 00000100:00100000:1.0:1763333174.963625:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 106 00000100:00100000:1.0:1763333174.963634:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:2420:x1848987613710592:12345-192.168.204.28@tcp:4:bash.0 00000100:00100000:1.0:1763333174.964527:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+26:2420:x1848987613710592:12345-192.168.204.28@tcp:4:bash.0 Request processed in 891us (1178us total) trans 17179871588 rc 0/0 00000100:00100000:1.0:1763333174.964539:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 106 00002000:00100000:1.0:1763333174.964548:0:16635:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0x239:0x0] (0->4) req@ffff92fe44e1ad80 x1848987613710592/t17179871588(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:485/0 lens 496/448 e 0 to 0 dl 1763333185 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763333174.964557:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe44e1ad80 with x1848987613710592 ext(0->4) 00010000:00010000:1.0:1763333174.964564:0:16635:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c566b9 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696986a expref: 26 pid: 8611 timeout: 1379 lvb_type: 0 00010000:00010000:1.0:1763333174.964578:0:16635:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c566b9 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696986a expref: 26 pid: 8611 timeout: 1379 lvb_type: 0 00002000:00010000:1.0:1763333174.964586:0:16635:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92fe44e1ad80 00000100:00100000:0.0:1763333174.965782:0:28651:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff50049180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28651:1848987627264896:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333174.965811:0:28651:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56784 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333174.975072:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333174.975454:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.975519:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613710848 00000100:00100000:0.0:1763333174.975531:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613710848 00010000:00010000:0.0:1763333174.975575:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c566b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696986a expref: 26 pid: 8611 timeout: 1379 lvb_type: 0 00000100:00100000:0.0:1763333174.975628:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3059 00000100:00100000:0.0:1763333174.975640:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+26:2418:x1848987613710848:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333174.975656:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1763333174.975674:0:6504:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x239:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:0.0:1763333174.975677:0:6504:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x239:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1763333174.975683:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c566b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696986a expref: 26 pid: 8611 timeout: 1379 lvb_type: 0 00010000:00010000:0.0:1763333174.975698:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c566b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696986a expref: 26 pid: 8611 timeout: 1379 lvb_type: 0 00010000:00010000:0.0:1763333174.975733:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c566b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696986a expref: 26 pid: 8611 timeout: 1379 lvb_type: 0 00010000:00010000:0.0:1763333174.975749:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333174.975752:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333174.975758:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56784 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333174.975768:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613710720 00010000:00010000:0.0:1763333174.975768:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56784 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333174.975776:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613710720 00010000:00010000:0.0:1763333174.975804:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333174.975822:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9304 00000100:00100000:1.0:1763333174.975832:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:56870:x1848987613710720:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333174.975849:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1763333174.975857:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:2418:x1848987613710848:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 218us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333174.975867:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3059 00010000:00010000:1.0:1763333174.975869:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5678b lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369698b0 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.975925:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56792 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333174.975938:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56792 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.975947:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56792 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.975956:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56799 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333174.975963:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56799 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.975969:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56799 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.976009:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56792 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.976016:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56792 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.976021:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56792 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.976032:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56792 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.976039:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333174.976042:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56792 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.976050:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56792 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.976060:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff42c64200) 00010000:00010000:1.0:1763333174.976062:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333174.976066:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56792 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.976071:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56792 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.976081:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56799 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.976086:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56799 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.976092:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56799 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.976096:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7ec00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333174.976099:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56799 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.976104:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56799 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.976115:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff42c64900) 00010000:00010000:1.0:1763333174.976117:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333174.976120:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56799 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.976125:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56799 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.976147:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5678b lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698b0 expref: 244 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.976154:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff42c64200) 00010000:00010000:1.0:1763333174.976156:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333174.976160:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c5678b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698b0 expref: 244 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.976171:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7fc00, rc 0) 00000100:00100000:1.0:1763333174.976194:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:56870:x1848987613710720:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 365us (1133us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333174.976200:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9304 00010000:00010000:3.0:1763333174.976303:0:28651:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56784 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.976312:0:28651:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56784 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.976330:0:28651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56784 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.976336:0:28651:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56784 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.976344:0:28651:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56784 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.976377:0:28651:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700f400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333174.976381:0:28651:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56784 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.976390:0:28651:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56784 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.976402:0:28651:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56784 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333174.976410:0:28651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56784 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333174.976456:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:2421:x1848987613710464:12345-192.168.204.28@tcp:1:lfs.0 Request processed in 24290us (24428us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333174.976465:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6541 00000100:00100000:2.0:1763333174.978525:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.979691:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613711104 00000100:00100000:0.0:1763333174.979702:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613711104 00000100:00100000:2.0:1763333174.979876:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.980726:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613711232 00000100:00100000:0.0:1763333174.980732:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613711232 00000100:00100000:0.0:1763333174.980772:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9305 00000100:00100000:0.0:1763333174.980782:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56868:x1848987613711104:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:0.0:1763333174.980834:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333174.980859:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56768 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698a2 expref: 244 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.980878:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:0.0:1763333174.980882:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333174.980910:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c567a0 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333174.980923:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c567a0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333174.980932:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c567a0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000040:00080000:0.0:1763333174.981145:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1415, 88 off119464 00000004:00080000:0.0:1763333174.981153:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1279060803832ns, next at 1279713547966ns, rc = 0 00000040:00080000:0.0:1763333174.981222:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1416, 88 off119464 00000004:00080000:0.0:1763333174.981228:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1279060878428ns, next at 1279025269818ns, rc = 0 00000040:00080000:0.0:1763333174.981261:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1417, 88 off119552 00000004:00080000:0.0:1763333174.981265:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1279060916288ns, next at 1279025269818ns, rc = 0 00000100:00100000:1.0:1763333174.981467:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9306 00000100:00100000:1.0:1763333174.981486:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:56870:x1848987613711232:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333174.981497:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333174.981512:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c567a7 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369698b7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.981553:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c567ae lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333174.981567:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c567ae lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333174.981580:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c567ae lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:1.0:1763333174.981611:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1763333174.981616:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1763333174.981656:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c567a7 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698b7 expref: 245 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.981669:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c567ae lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698b7 expref: 244 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.981676:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff42c64c00) 00010000:00010000:1.0:1763333174.981679:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1763333174.981682:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e600, rc 0) 00000040:00080000:0.0:1763333174.981697:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1416, 88 off119552 00000004:00080000:0.0:1763333174.981701:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1279061352562ns, next at 1279713547966ns, rc = 0 00000100:00100000:1.0:1763333174.981756:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56870:x1848987613711232:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 280us (1881us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333174.981764:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9306 00000100:00100000:3.0:1763333174.985453:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333174.986018:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613711360 00000100:00100000:0.0:1763333174.986031:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613711360 00000100:00100000:0.0:1763333174.986104:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9307 00000100:00100000:0.0:1763333174.986115:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56870:x1848987613711360:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333174.986136:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333174.986160:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e000/0xb32e3ef184c567b5 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369698be expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.986226:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c567bc lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333174.986240:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c567bc lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.986251:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c567bc lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.986261:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c567c3 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333174.986268:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c567c3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.986275:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c567c3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.986317:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c567bc lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.986325:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c567bc lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.986330:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c567bc lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.986337:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c567bc lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.986343:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700fe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333174.986373:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c567bc lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.986381:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c567bc lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.986392:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff42c64c00) 00010000:00010000:0.0:1763333174.986395:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333174.986399:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c567bc lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.986406:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c567bc lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.986420:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c567c3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.986425:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c567c3 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.986431:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c567c3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.986435:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700ee00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333174.986438:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c567c3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.986443:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c567c3 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.986449:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff42c64900) 00010000:00010000:0.0:1763333174.986452:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333174.986455:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c567c3 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.986460:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c567c3 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.988278:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e000/0xb32e3ef184c567b5 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698be expref: 246 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.988301:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff42c64c00) 00010000:00010000:0.0:1763333174.988304:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333174.988309:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e000/0xb32e3ef184c567b5 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698be expref: 246 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333174.988334:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4700e000, rc 0) 00000100:00100000:0.0:1763333174.989376:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56870:x1848987613711360:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 3238us (3910us total) trans 0 rc 301/301 00000100:00100000:0.0:1763333174.989388:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9307 00000100:00100000:2.0:1763333174.993669:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333174.993756:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613711616 00000100:00100000:1.0:1763333174.993767:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613711616 00000100:00100000:1.0:1763333174.993819:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9308 00000100:00100000:1.0:1763333174.993827:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56870:x1848987613711616:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333174.993846:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333174.993850:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763333174.993874:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c567ae lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698b7 expref: 245 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.993896:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff42c64c00) 00010000:00010000:1.0:1763333174.993906:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333174.993919:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c567ca lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369698c5 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1763333174.994080:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972315 is committed 00000004:00080000:3.0:1763333174.994089:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 926 committed 00000004:00080000:3.0:1763333174.994104:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 929 committed 00000004:00080000:3.0:1763333174.994114:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 928 committed 00000004:00080000:3.0:1763333174.994116:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 925 committed 00000100:00100000:2.0:1763333174.994302:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1763333174.994317:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46a6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627265024:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333174.994385:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333174.994417:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46a6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627265152:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333174.994434:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333174.994462:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627265024 00000100:00100000:2.0:1763333174.994466:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627265024 00000100:00100000:2.0:1763333174.994512:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627265152 00000100:00100000:2.0:1763333174.994515:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627265152 00000100:00100000:2.0:1763333174.994533:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6542 00000100:00100000:2.0:1763333174.994540:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+30:3654:x1848987627265024:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333174.994711:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+31:3654:x1848987627265024:12345-0@lo:2:osp-syn-1-1.0 Request processed in 171us (324us total) trans 17179871589 rc 0/0 00000100:00100000:2.0:1763333174.994719:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6542 00000100:00100000:2.0:1763333174.994736:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6543 00000100:00100000:2.0:1763333174.994742:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+30:3652:x1848987627265152:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1763333174.994799:0:28651:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x23a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333174.994803:0:28651:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x23a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1763333174.994805:0:28651:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x23a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333174.994807:0:28651:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x23a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1763333174.994809:0:28651:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x23a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333174.994837:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+31:3652:x1848987627265152:12345-0@lo:2:osp-syn-1-1.0 Request processed in 96us (401us total) trans 17179871590 rc 0/0 00000100:00100000:2.0:1763333174.994843:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6543 00000004:00080000:2.0:1763333174.994885:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe46a6f480/2, rc 0, transno 17179871590 00000100:00100000:2.0:1763333174.994891:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46a6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627265152:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1763333174.994908:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe46a6c380/2, rc 0, transno 17179871589 00000100:00100000:2.0:1763333174.994913:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46a6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627265024:0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1763333174.995568:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56745 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.995579:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56745 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.995587:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56745 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.995593:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333174.995598:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56745 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.995605:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56745 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.995619:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff42c64900) 00010000:00010000:0.0:1763333174.995622:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333174.995627:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56745 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333174.995633:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56745 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000100:00100000:0.0:1763333174.995733:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1763333174.995742:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff5004aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627265408:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333174.995780:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333174.995812:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627265408 00000100:00100000:0.0:1763333174.995817:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627265408 00000100:00100000:0.0:1763333174.995849:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6544 00000100:00100000:0.0:1763333174.995856:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50048700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+13:3655:x1848987627265408:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1763333174.995940:0:17605:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x23a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333174.995943:0:17605:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x23a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763333174.995946:0:17605:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x23a:0x0] updating lvb atime from disk: 0 -> 0 00010000:00010000:1.0:1763333174.996127:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c567d1 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333174.996141:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c567d1 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.996151:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c567d1 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.996164:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c567d8 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333174.996171:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c567d8 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.996178:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c567d8 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.996587:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c567df lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333174.996596:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c567df lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.996604:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c567df lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:1.0:1763333174.996613:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b4:0x0]: returning size 0 00010000:00010000:1.0:1763333174.996639:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c567d1 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.996646:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c567d1 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.996651:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c567d1 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.996657:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c567d1 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.996662:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fc00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333174.996666:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c567d1 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.996672:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c567d1 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.996680:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44cd0300) 00010000:00010000:1.0:1763333174.996683:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333174.996686:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c567d1 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.996691:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c567d1 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000004:00010000:1.0:1763333174.996703:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d0b2e365 reply state 00000000888c3da9 transno 4294972316 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c567d8 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.996713:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c567d8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333174.996719:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe44cd0500) 00010000:00010000:1.0:1763333174.996721:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333174.996724:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763333174.996753:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c567ca lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698c5 expref: 237 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.996769:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c567df lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698c5 expref: 236 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333174.996776:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b4:0x0].0x0 (ffff92fe44cd0c00) 00010000:00010000:1.0:1763333174.996778:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333174.996780:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e800, rc 0) 00000100:00100000:1.0:1763333174.996835:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56870:x1848987613711616:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 3009us (3176us total) trans 4294972316 rc 0/0 00000100:00100000:1.0:1763333174.996844:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9308 00000004:00010000:1.0:1763333174.996911:0:8606:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000628f8dca reply state 000000004b03e8b6 transno 4294972315 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c567a0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.996922:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c567a0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333174.996928:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:1.0:1763333174.996930:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1763333174.996933:0:8606:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00002000:00010000:0.0:1763333174.997078:0:17605:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x23a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763333174.997082:0:17605:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x23a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333174.997129:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50048700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+14:3655:x1848987627265408:12345-0@lo:2:osp-syn-0-1.0 Request processed in 1273us (1348us total) trans 21474838892 rc 0/0 00000100:00100000:0.0:1763333174.997136:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6544 00000004:00080000:0.0:1763333174.997176:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff5004aa00/2, rc 0, transno 21474838892 00000100:00100000:0.0:1763333174.997182:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff5004aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627265408:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333174.997280:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763333174.997293:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff50049180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627265280:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333174.997329:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333174.997667:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627265280 00000100:00100000:0.0:1763333174.997674:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627265280 00000100:00100000:0.0:1763333174.997706:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6545 00000100:00100000:0.0:1763333174.997714:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+14:3652:x1848987627265280:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1763333174.997813:0:29010:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x239:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333174.997816:0:29010:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x239:0x0] updating lvb mtime from disk: 1763333175 -> 1763333175 00002000:00010000:0.0:1763333174.997819:0:29010:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x239:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333174.997821:0:29010:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x239:0x0] updating lvb ctime from disk: 1763333175 -> 1763333175 00002000:00010000:0.0:1763333174.997824:0:29010:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x239:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333174.997857:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+15:3652:x1848987627265280:12345-0@lo:2:osp-syn-0-1.0 Request processed in 144us (528us total) trans 21474838893 rc 0/0 00000100:00100000:0.0:1763333174.997866:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6545 00000004:00080000:0.0:1763333174.997892:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff50049180/2, rc 0, transno 21474838893 00000100:00100000:0.0:1763333174.997897:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff50049180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627265280:0@lo:2:osp-syn-0-1.0 00010000:00080000:1.0:1763333174.998509:0:8606:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1763333174.998526:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56868:x1848987613711104:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 17742us (20008us total) trans 4294972315 rc 0/0 00000100:00100000:1.0:1763333174.998533:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9305 00010000:00010000:0.0:1763333175.001372:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c567a0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.001390:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c567a0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.001397:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c567a0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.001403:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700e400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333175.001408:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c567a0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.003061:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c567a0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.003081:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:0.0:1763333175.003084:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333175.003090:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c567a0 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.003097:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c567a0 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000100:00100000:2.0:1763333175.003521:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.003566:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613711872 00000100:00100000:1.0:1763333175.003576:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613711872 00000100:00100000:1.0:1763333175.003639:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9309 00000100:00100000:1.0:1763333175.003650:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56870:x1848987613711872:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333175.003679:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333175.003698:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c567ed lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1b4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369698cc expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.003802:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c567f4 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333175.003816:0:8606:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c567df lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1b4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698c5 expref: 237 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.003825:0:8606:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c567f4 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1b4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333175.003858:0:8606:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c567df lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698c5 expref: 237 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.003871:0:8606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c567df lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1b4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698c5 expref: 237 pid: 12741 timeout: 1379 lvb_type: 0 00000100:00100000:1.0:1763333175.003886:0:8606:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7dcfed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627265536:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333175.003903:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.004386:0:8606:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff801ac180 going to sleep for 11 seconds 00000100:00100000:2.0:1763333175.004803:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613712000 00000100:00100000:2.0:1763333175.004809:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613712000 00000100:00100000:2.0:1763333175.004859:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9310 00000100:00100000:2.0:1763333175.004867:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56868:x1848987613712000:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333175.004881:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333175.004895:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c567fb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369698d3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.004934:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c567fb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698d3 expref: 239 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.004947:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c567fb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698d3 expref: 239 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.004966:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:2.0:1763333175.004969:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333175.004972:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feb400, rc 0) 00000100:00100000:2.0:1763333175.005012:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56868:x1848987613712000:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 146us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333175.005020:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9310 00000100:00100000:3.0:1763333175.011584:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.011677:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.011898:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613712128 00000100:00100000:2.0:1763333175.011908:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613712128 00010000:00010000:2.0:1763333175.011952:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c567df lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1b4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698c5 expref: 239 pid: 12741 timeout: 1379 lvb_type: 0 00000100:00100000:2.0:1763333175.011992:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3060 00000100:00100000:2.0:1763333175.012001:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:2420:x1848987613712128:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333175.012019:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333175.012026:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c567df lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1b4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698c5 expref: 239 pid: 12741 timeout: 1379 lvb_type: 0 00010000:00010000:2.0:1763333175.012039:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c567df lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1b4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698c5 expref: 239 pid: 12741 timeout: 1379 lvb_type: 0 00010000:00010000:2.0:1763333175.012063:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b4:0x0].0x0 (ffff92fe44cd0c00) 00010000:00010000:2.0:1763333175.012069:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c567f4 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.012078:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c567f4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.012086:0:6504:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c567f4 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1b4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.012106:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333175.012156:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:2420:x1848987613712128:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 156us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333175.012163:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3060 00000100:00100000:1.0:1763333175.012345:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613712256 00000100:00100000:1.0:1763333175.012377:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613712256 00000100:00100000:1.0:1763333175.012426:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9311 00000100:00100000:1.0:1763333175.012434:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:56868:x1848987613712256:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333175.012452:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333175.012479:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56802 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369698da expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.012558:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56809 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333175.012570:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56809 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333175.012579:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56809 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:1.0:1763333175.012624:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b3:0x0]: returning size 5 00000004:00200000:1.0:1763333175.012629:0:6519:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763333175.012649:0:6519:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56809 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333175.012674:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56802 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698da expref: 242 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.012692:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56809 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698da expref: 241 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.012700:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:1.0:1763333175.012703:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1763333175.012706:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7fc00, rc 0) 00000100:00100000:1.0:1763333175.012740:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56868:x1848987613712256:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 307us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333175.012747:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9311 00010000:00010000:1.0:1763333175.012799:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c567df lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698c5 expref: 240 pid: 12741 timeout: 1379 lvb_type: 0 00000100:00100000:1.0:1763333175.012811:0:8606:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7dcfed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627265536:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333175.012834:0:8606:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c567f4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333175.012843:0:8606:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c567f4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333175.012848:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c567f4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:1.0:1763333175.012866:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b4:0x0]: returning size 0 00000004:00080000:1.0:1763333175.013036:0:8606:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x23b:0x0], index 0: 0 00000004:00080000:1.0:1763333175.013043:0:8606:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x23b:0x0], index 1: 0 00000004:00080000:1.0:1763333175.013048:0:8606:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x23c:0x0], index 1: 0 00000004:00080000:1.0:1763333175.013052:0:8606:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x23c:0x0], index 0: 0 00010000:00010000:1.0:1763333175.013144:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c567f4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333175.013151:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c567f4 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1b4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333175.013158:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c567f4 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1b4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333175.013163:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333175.013166:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c567f4 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1b4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333175.013174:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c567f4 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1b4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333175.013183:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b4:0x0].0x0 (ffff92fe44cd0c00) 00010000:00010000:1.0:1763333175.013185:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763333175.013189:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c567f4 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1b4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333175.013195:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c567f4 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1b4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333175.013230:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c567ed lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1b4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698cc expref: 240 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.013239:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b4:0x0].0x0 (ffff92fe44cd0c00) 00010000:00010000:1.0:1763333175.013242:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763333175.013245:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c567ed lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698cc expref: 240 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.013260:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e600, rc 0) 00000100:00100000:1.0:1763333175.013283:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56870:x1848987613711872:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 9636us (9767us total) trans 4294972317 rc 301/301 00000100:00100000:1.0:1763333175.013289:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9309 00000100:00100000:3.0:1763333175.017481:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.018201:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613712512 00000100:00100000:1.0:1763333175.018212:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613712512 00000100:00100000:1.0:1763333175.018275:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3182 00000100:00100000:1.0:1763333175.018284:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56870:x1848987613712512:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1763333175.018618:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56870:x1848987613712512:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 333us (1153us total) trans 4294972318 rc 0/0 00000100:00100000:1.0:1763333175.018626:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3182 00000100:00100000:3.0:1763333175.022747:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333175.023055:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613712640 00000100:00100000:0.0:1763333175.023066:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613712640 00000100:00100000:0.0:1763333175.023133:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6546 00000100:00100000:0.0:1763333175.023143:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:2421:x1848987613712640:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333175.023165:0:17605:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333175.023186:0:17605:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c56817 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369698e1 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763333175.023211:0:17605:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x239:0x0] initial LVB size: 5, mtime: 0x691a5437, atime: 0x0, ctime: 0x691a5437, blocks: 0x8 00010000:00010000:0.0:1763333175.023232:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333175.023234:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333175.023245:0:17605:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c56817 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698e1 expref: 25 pid: 17605 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333175.023262:0:17605:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c56817 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698e1 expref: 25 pid: 17605 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333175.023275:0:17605:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4700e400, rc 0) 00000100:00100000:0.0:1763333175.023341:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:2421:x1848987613712640:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 200us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333175.023379:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6546 00000100:00100000:1.0:1763333175.024574:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.024776:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613712896 00000100:00100000:2.0:1763333175.024784:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613712896 00000100:00100000:2.0:1763333175.024832:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3183 00000100:00100000:2.0:1763333175.024840:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56870:x1848987613712896:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333175.025076:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:56870:x1848987613712896:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 235us (505us total) trans 4294972319 rc 0/0 00000100:00100000:2.0:1763333175.025083:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3183 00000100:00100000:1.0:1763333175.033914:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333175.034075:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613713152 00000100:00100000:0.0:1763333175.034086:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613713152 00000100:00100000:0.0:1763333175.034529:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9312 00000100:00100000:0.0:1763333175.034542:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:55917:x1848987613713152:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333175.034568:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333175.034591:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e000/0xb32e3ef184c5681e lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369698e8 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.034734:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56825 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333175.034753:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56825 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333175.034765:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56825 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333175.034776:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c5682c lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333175.034783:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c5682c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333175.034789:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c5682c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333175.034843:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56833 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333175.034849:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56833 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333175.034855:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56833 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:0.0:1763333175.034865:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b4:0x0]: returning size 0 00010000:00010000:0.0:1763333175.034939:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56825 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333175.034946:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56825 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333175.040849:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56825 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333175.040859:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56825 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333175.040867:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700ee00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333175.040872:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56825 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333175.040882:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56825 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333175.040899:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12700) 00010000:00010000:0.0:1763333175.040902:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333175.040907:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56825 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333175.040916:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56825 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333175.040937:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c5682c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333175.040942:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c5682c lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333175.040947:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c5682c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333175.040963:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700fe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333175.040966:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c5682c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333175.040971:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c5682c lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333175.040978:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe44cd0500) 00010000:00010000:0.0:1763333175.040980:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333175.040985:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c5682c lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333175.040989:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c5682c lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.042211:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e000/0xb32e3ef184c5681e lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698e8 expref: 243 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.042241:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56833 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698e8 expref: 242 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.042250:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b4:0x0].0x0 (ffff92fe44e12f00) 00010000:00010000:2.0:1763333175.042253:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333175.042256:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4700f000, rc 0) 00000100:00100000:2.0:1763333175.042340:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:55917:x1848987613713152:12345-192.168.204.28@tcp:101:bash.0 Request processed in 7800us (8437us total) trans 4294972320 rc 0/0 00000100:00100000:2.0:1763333175.042393:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9312 00000100:00100000:0.0:1763333175.047024:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.049405:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613713280 00000100:00100000:2.0:1763333175.049421:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613713280 00000100:00100000:1.0:1763333175.050180:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9313 00000100:00100000:1.0:1763333175.050197:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5004b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:55917:x1848987613713280:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333175.050224:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333175.050246:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56841 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1b4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369698ef expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.050278:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56848 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333175.050291:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56848 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333175.050303:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56848 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333175.050445:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56841 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698ef expref: 244 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.050464:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56848 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698ef expref: 243 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.050483:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b4:0x0].0x0 (ffff92fe44e12f00) 00010000:00010000:1.0:1763333175.050486:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763333175.050491:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e800, rc 0) 00000100:00100000:1.0:1763333175.050567:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5004b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:55917:x1848987613713280:12345-192.168.204.28@tcp:101:bash.0 Request processed in 376us (3552us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333175.050575:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9313 00000100:00100000:3.0:1763333175.054691:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.054818:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613713536 00000100:00100000:2.0:1763333175.054831:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613713536 00000100:00100000:2.0:1763333175.054940:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9314 00000100:00100000:2.0:1763333175.055028:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:55917:x1848987613713536:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:2.0:1763333175.055090:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333175.055119:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56833 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698e8 expref: 243 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.055139:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b4:0x0].0x0 (ffff92fe44e12f00) 00010000:00010000:2.0:1763333175.055145:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333175.055345:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5684f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1b4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333175.055516:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5684f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.055526:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5684f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000001:00080000:2.0:1763333175.055577:0:12741:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294972321 00000004:00010000:2.0:1763333175.055607:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000db5d7507 reply state 00000000f1ab2685 transno 4294972322 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5684f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.055620:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5684f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1b4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.055628:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b4:0x0].0x0 (ffff92fe44e12f00) 00010000:00010000:2.0:1763333175.055631:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333175.055634:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763333175.055751:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:55917:x1848987613713536:12345-192.168.204.28@tcp:36:bash.0 Request processed in 800us (1071us total) trans 4294972322 rc 0/0 00000100:00100000:2.0:1763333175.055760:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9314 00000020:00080000:2.0:1763333175.055766:0:12741:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763333175.059067:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.059218:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613713664 00000100:00100000:2.0:1763333175.059233:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613713664 00000100:00100000:2.0:1763333175.059303:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9315 00000100:00100000:2.0:1763333175.059312:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:55917:x1848987613713664:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333175.059336:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333175.059399:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c56856 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1b4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369698f6 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.059460:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c56856 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698f6 expref: 246 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.059485:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c56856 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698f6 expref: 246 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.059505:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b4:0x0].0x0 (ffff92fe44e12f00) 00010000:00010000:2.0:1763333175.059510:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333175.059515:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea000, rc 0) 00000100:00100000:2.0:1763333175.059595:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:55917:x1848987613713664:12345-192.168.204.28@tcp:101:bash.0 Request processed in 282us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333175.059604:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9315 00000100:00100000:0.0:1763333175.062878:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.063270:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613713920 00000100:00100000:1.0:1763333175.063283:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613713920 00000100:00100000:1.0:1763333175.063482:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9316 00000100:00100000:1.0:1763333175.063494:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5004ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:55917:x1848987613713920:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333175.063522:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333175.063525:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763333175.063560:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c56856 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698f6 expref: 246 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.063587:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b4:0x0].0x0 (ffff92fe44e12f00) 00010000:00010000:1.0:1763333175.063594:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333175.063609:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5685d lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1b4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369698fd expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.063671:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56864 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333175.063686:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56864 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b4:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333175.063696:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56864 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b4:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000040:00080000:1.0:1763333175.064013:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1418, 88 off119640 00000004:00080000:1.0:1763333175.064026:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1279143676622ns, next at 1279025269818ns, rc = 0 00000040:00080000:1.0:1763333175.064063:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1417, 88 off119640 00000004:00080000:1.0:1763333175.064071:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1279143721410ns, next at 1279713547966ns, rc = 0 00000040:00080000:1.0:1763333175.064134:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1418, 88 off119728 00000004:00080000:1.0:1763333175.064139:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1279143789794ns, next at 1279713547966ns, rc = 0 00000040:00080000:1.0:1763333175.064162:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1419, 88 off119728 00000004:00080000:1.0:1763333175.064166:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1279143817132ns, next at 1279025269818ns, rc = 0 00000001:00080000:3.0:1763333175.067172:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972323 is committed 00000004:00080000:3.0:1763333175.067192:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 931 committed 00000004:00080000:3.0:1763333175.067221:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 928 committed 00000004:00080000:3.0:1763333175.067803:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 927 committed 00010000:00010000:0.0:1763333175.068165:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c567d8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333175.068179:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c567d8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333175.068187:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c567d8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333175.068192:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7ec00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333175.068197:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c567d8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333175.068205:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c567d8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333175.068220:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe44cd0500) 00010000:00010000:0.0:1763333175.068223:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333175.068228:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c567d8 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333175.068234:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c567d8 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333175.068262:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5684f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333175.068268:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5684f lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333175.068273:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5684f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333175.068277:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feaa00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333175.068279:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5684f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333175.068284:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5684f lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333175.068289:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b4:0x0].0x0 (ffff92fe44e12f00) 00010000:00010000:0.0:1763333175.068291:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333175.068294:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5684f lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333175.068298:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5684f lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000100:00100000:1.0:1763333175.068483:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7dcfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627265664:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333175.068558:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333175.068631:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7dcfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627265792:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333175.068659:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333175.068678:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763333175.068684:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46a6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627265920:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333175.068705:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333175.068737:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627265664 00000100:00100000:1.0:1763333175.068745:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627265664 00000100:00100000:1.0:1763333175.068788:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627265792 00000100:00100000:1.0:1763333175.068792:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627265792 00000100:00100000:1.0:1763333175.068809:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627265920 00000100:00100000:1.0:1763333175.068811:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627265920 00000100:00100000:1.0:1763333175.068836:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6547 00000100:00100000:1.0:1763333175.068845:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+16:3655:x1848987627265664:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333175.069058:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+17:3655:x1848987627265664:12345-0@lo:2:osp-syn-0-1.0 Request processed in 213us (499us total) trans 21474838894 rc 0/0 00000100:00100000:1.0:1763333175.069067:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6547 00000100:00100000:1.0:1763333175.069088:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6548 00000100:00100000:1.0:1763333175.069095:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+16:3652:x1848987627265792:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333175.069189:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+17:3652:x1848987627265792:12345-0@lo:2:osp-syn-0-1.0 Request processed in 94us (528us total) trans 21474838895 rc 0/0 00000100:00100000:1.0:1763333175.069196:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6548 00000100:00100000:1.0:1763333175.069210:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6549 00000100:00100000:1.0:1763333175.069217:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+31:3652:x1848987627265920:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333175.069303:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+32:3652:x1848987627265920:12345-0@lo:2:osp-syn-1-1.0 Request processed in 87us (597us total) trans 17179871591 rc 0/0 00000100:00100000:1.0:1763333175.069309:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6549 00000004:00080000:1.0:1763333175.069377:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe46a6d500/2, rc 0, transno 17179871591 00000100:00100000:1.0:1763333175.069384:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46a6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627265920:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1763333175.069401:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7dcfe300/2, rc 0, transno 21474838895 00000100:00100000:1.0:1763333175.069406:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7dcfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627265792:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1763333175.069424:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7dcfc700/2, rc 0, transno 21474838894 00000100:00100000:1.0:1763333175.069427:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7dcfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627265664:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1763333175.069605:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 930 committed 00010000:00010000:0.0:1763333175.069915:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56864 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698fd expref: 238 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.069929:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b4:0x0].0x0 (ffff92fe44e12f00) 00010000:00010000:0.0:1763333175.069932:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763333175.069998:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5685d lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1b4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698fd expref: 238 pid: 8606 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1763333175.070018:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56864 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b4:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698fd expref: 237 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.070053:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b4:0x0].0x0 (ffff92fe44e12f00) 00010000:00010000:0.0:1763333175.070057:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763333175.070059:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f800, rc 0) 00000100:00100000:0.0:1763333175.070927:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5004ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:55917:x1848987613713920:12345-192.168.204.28@tcp:101:bash.0 Request processed in 7431us (8059us total) trans 4294972323 rc 0/0 00000100:00100000:0.0:1763333175.070938:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9316 00000100:00100000:1.0:1763333175.071144:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46a6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627266048:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333175.071205:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333175.072043:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627266048 00000100:00100000:0.0:1763333175.072053:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627266048 00000100:00100000:1.0:1763333175.073557:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6550 00000100:00100000:1.0:1763333175.073570:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+32:3654:x1848987627266048:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333175.073783:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+33:3654:x1848987627266048:12345-0@lo:2:osp-syn-1-1.0 Request processed in 216us (2577us total) trans 17179871592 rc 0/0 00000100:00100000:1.0:1763333175.073791:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6550 00000004:00080000:0.0:1763333175.073988:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe46a6df80/2, rc 0, transno 17179871592 00000100:00100000:0.0:1763333175.073996:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46a6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627266048:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333175.076136:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.076224:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613714048 00000100:00100000:1.0:1763333175.076234:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613714048 00000100:00100000:1.0:1763333175.076294:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6551 00000100:00100000:1.0:1763333175.076303:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:55917:x1848987613714048:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333175.076320:0:28650:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333175.076340:0:28650:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5686b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969904 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333175.076394:0:28650:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x23b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333175.076414:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333175.076417:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333175.076426:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5686b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969904 expref: 14 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.076448:0:28650:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5686b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969904 expref: 14 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.076461:0:28650:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f000, rc 0) 00000100:00100000:1.0:1763333175.077306:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:55917:x1848987613714048:12345-192.168.204.28@tcp:101:bash.0 Request processed in 999us (1173us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333175.077315:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6551 00000100:00100000:2.0:1763333175.079773:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.079891:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613714176 00000100:00100000:1.0:1763333175.079911:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613714176 00000100:00100000:1.0:1763333175.079971:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6552 00000100:00100000:1.0:1763333175.079982:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:55917:x1848987613714176:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333175.080003:0:28650:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333175.080024:0:28650:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56872 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696990b expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333175.080045:0:28650:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x23b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333175.080066:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333175.080068:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333175.080077:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56872 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696990b expref: 26 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.080091:0:28650:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56872 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696990b expref: 26 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.080104:0:28650:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f200, rc 0) 00000100:00100000:1.0:1763333175.080161:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+26:55917:x1848987613714176:12345-192.168.204.28@tcp:101:bash.0 Request processed in 180us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333175.080169:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6552 00000100:00100000:3.0:1763333175.087095:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.087144:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.090264:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613714304 00000100:00100000:1.0:1763333175.090286:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613714304 00002000:00010000:1.0:1763333175.090600:0:16635:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/571 (0->18446744073709551615) 00002000:00100000:1.0:1763333175.090606:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe42f0fb80 with x1848987613714304 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333175.090621:0:16635:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe42f0fb80. 00000100:00100000:1.0:1763333175.090659:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613714432 00000100:00100000:1.0:1763333175.090663:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613714432 00002000:00010000:1.0:1763333175.090677:0:16635:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/571 (0->18446744073709551615) 00002000:00100000:1.0:1763333175.090681:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe42f0e300 with x1848987613714432 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333175.090686:0:16635:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe42f0e300. 00000100:00100000:1.0:1763333175.090710:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1617 00000100:00100000:1.0:1763333175.090720:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2421:x1848987613714304:12345-192.168.204.28@tcp:10:bash.0 00000100:00100000:0.0:1763333175.090786:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1618 00000100:00100000:0.0:1763333175.090802:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+26:2420:x1848987613714432:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:1.0:1763333175.090947:0:16635:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x23b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333175.090948:0:28427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x23b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333175.090955:0:16635:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x23b:0x0] updating lvb mtime from disk: 0 -> 1763333175 00002000:00010000:0.0:1763333175.090955:0:28427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x23b:0x0] updating lvb mtime from disk: 0 -> 1763333175 00002000:00010000:1.0:1763333175.090962:0:16635:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x23b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333175.090962:0:28427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x23b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333175.090969:0:16635:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x23b:0x0] updating lvb ctime from disk: 0 -> 1763333175 00002000:00010000:0.0:1763333175.090969:0:28427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x23b:0x0] updating lvb ctime from disk: 0 -> 1763333175 00002000:00010000:1.0:1763333175.090975:0:16635:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x23b:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1763333175.090976:0:28427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x23b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333175.091069:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2421:x1848987613714304:12345-192.168.204.28@tcp:10:bash.0 Request processed in 345us (3980us total) trans 21474838896 rc 0/0 00000100:00100000:0.0:1763333175.091069:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+27:2420:x1848987613714432:12345-192.168.204.28@tcp:10:bash.0 Request processed in 268us (3919us total) trans 17179871593 rc 0/0 00000100:00100000:1.0:1763333175.091082:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1617 00002000:00010000:1.0:1763333175.091087:0:16635:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/571 (0->18446744073709551615) 00002000:00100000:1.0:1763333175.091089:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe42f0fb80 with x1848987613714304 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333175.091093:0:16635:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe42f0fb80. 00000100:00100000:0.0:1763333175.092514:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1618 00002000:00010000:0.0:1763333175.092523:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/571 (0->18446744073709551615) 00002000:00100000:0.0:1763333175.092527:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe42f0e300 with x1848987613714432 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333175.092535:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe42f0e300. 00000100:00100000:3.0:1763333175.096100:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.096317:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613714688 00000100:00100000:1.0:1763333175.096327:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613714688 00000100:00100000:2.0:1763333175.096955:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3184 00000100:00100000:2.0:1763333175.096970:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:55917:x1848987613714688:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:2.0:1763333175.097283:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:55917:x1848987613714688:12345-192.168.204.28@tcp:35:bash.0 Request processed in 316us (1190us total) trans 4294972324 rc 0/0 00000100:00100000:2.0:1763333175.097291:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3184 00000100:00100000:2.0:1763333175.104083:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333175.104297:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613714816 00000100:00100000:0.0:1763333175.104309:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613714816 00000100:00100000:0.0:1763333175.104400:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9317 00000100:00100000:0.0:1763333175.104410:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56871:x1848987613714816:12345-192.168.204.28@tcp:101:rm.0 00010000:00010000:0.0:1763333175.104434:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333175.104457:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56879 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969912 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.104528:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56880 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333175.104541:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56880 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.104551:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56880 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.104563:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56887 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333175.104570:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56887 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.104576:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56887 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.104643:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c5688e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333175.104650:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c5688e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.104656:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c5688e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:0.0:1763333175.104698:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b4:0x0]: returning size 5 00000004:00200000:0.0:1763333175.104702:0:8606:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763333175.104721:0:8606:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c5688e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.104732:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c5688e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.104740:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56880 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.104747:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56880 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.104754:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56880 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.104760:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56880 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.104766:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700ee00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333175.104769:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56880 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.104777:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56880 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.104787:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12900) 00010000:00010000:0.0:1763333175.104790:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333175.104794:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56880 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.104800:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56880 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.104813:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56887 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.104818:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56887 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.104824:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56887 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.104829:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700f400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333175.104831:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56887 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.104836:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56887 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.104842:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe44e12e00) 00010000:00010000:0.0:1763333175.104844:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333175.104846:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56887 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.104851:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56887 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.104875:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56879 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969912 expref: 240 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.104888:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c5688e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969912 expref: 239 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.104895:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b4:0x0].0x0 (ffff92fe44e12f00) 00010000:00010000:0.0:1763333175.104898:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333175.104901:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4700f000, rc 0) 00000100:00100000:0.0:1763333175.105263:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56871:x1848987613714816:12345-192.168.204.28@tcp:101:rm.0 Request processed in 853us (1188us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333175.105270:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9317 00000100:00100000:3.0:1763333175.112835:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.113007:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613715072 00000100:00100000:1.0:1763333175.113018:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613715072 00000100:00100000:2.0:1763333175.115643:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9318 00000100:00100000:2.0:1763333175.115672:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56871:x1848987613715072:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:2.0:1763333175.115743:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1763333175.115778:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56864 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b4:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698fd expref: 239 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.115803:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c5688e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969912 expref: 238 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.115816:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56848 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698ef expref: 237 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.115826:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b4:0x0].0x0 (ffff92fe44e12f00) 00010000:00010000:2.0:1763333175.115836:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333175.115867:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c56895 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333175.115879:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c56895 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.115888:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c56895 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.115901:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5689c lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333175.115907:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5689c lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.115913:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5689c lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.116002:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c568a3 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333175.116010:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c568a3 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.116016:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c568a3 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000040:00080000:2.0:1763333175.116242:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1420, 64 off119792 00000004:00080000:2.0:1763333175.116250:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1279195900542ns, next at 1280195897991ns, rc = 0 00000040:00080000:2.0:1763333175.116271:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1419, 64 off119792 00000040:00080000:2.0:1763333175.116279:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1420, 64 off119856 00000040:00080000:2.0:1763333175.116286:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1421, 64 off119856 00010000:00010000:2.0:1763333175.116335:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c568aa lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1b4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333175.116343:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c568aa lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.116396:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c568aa lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.116403:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c568aa lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1b4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.116409:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c568aa lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1b4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.116414:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c568aa lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1b4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.116430:0:12741:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763333175.116447:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c568a3 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.116453:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c568a3 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1b4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.116459:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c568a3 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1b4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.116464:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333175.116467:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c568a3 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1b4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.116484:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c568a3 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1b4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.116492:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b4:0x0].0x0 (ffff92fe43a31f00) 00010000:00010000:2.0:1763333175.116494:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763333175.116498:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c568a3 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1b4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.116507:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c568a3 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1b4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.116629:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c56895 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.116637:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c56895 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.116642:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c56895 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.116648:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c56895 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.116652:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333175.116655:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c56895 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.116660:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c56895 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.116667:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31b00) 00010000:00010000:2.0:1763333175.116669:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333175.116672:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c56895 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.116677:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c56895 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000004:00010000:2.0:1763333175.116688:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b8f98215 reply state 00000000861c3af9 transno 4294972325 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5689c lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.116698:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5689c lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.116703:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43a31900) 00010000:00010000:2.0:1763333175.116705:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333175.116708:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763333175.116789:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56871:x1848987613715072:12345-192.168.204.28@tcp:36:rm.0 Request processed in 1131us (3962us total) trans 4294972325 rc 0/0 00000100:00100000:2.0:1763333175.116797:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9318 00010000:00010000:0.0:1763333175.117003:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333175.117010:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c568aa lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1b4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333175.117017:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feaa00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333175.117020:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c568aa lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1b4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333175.117025:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c568aa lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1b4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333175.117033:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b4:0x0].0x0 (ffff92fe43a31f00) 00010000:00010000:0.0:1763333175.117036:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763333175.117039:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c568aa lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1b4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333175.117043:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c568aa lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1b4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333175.117055:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333175.117057:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333175.117059:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763333175.118297:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333175.118961:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613715200 00000100:00100000:0.0:1763333175.118970:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613715200 00000100:00100000:0.0:1763333175.119019:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6553 00000100:00100000:0.0:1763333175.119027:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1370b1d7-8612-4b90-ab37-e53288bbf9fd+27:2418:x1848987613715200:12345-192.168.204.28@tcp:23:lfs.0 00000100:00100000:0.0:1763333175.119129:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1370b1d7-8612-4b90-ab37-e53288bbf9fd+27:2418:x1848987613715200:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 103us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333175.119136:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6553 00000100:00100000:2.0:1763333175.124233:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.124321:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613715328 00000100:00100000:1.0:1763333175.124330:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613715328 00000100:00100000:1.0:1763333175.124418:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6554 00000100:00100000:1.0:1763333175.124428:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+27:2419:x1848987613715328:12345-192.168.204.28@tcp:23:lfs.0 00000100:00100000:1.0:1763333175.124540:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+27:2419:x1848987613715328:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 113us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333175.124547:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6554 00000100:00100000:3.0:1763333175.138294:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.138436:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613715456 00000100:00100000:2.0:1763333175.138447:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613715456 00000100:00100000:2.0:1763333175.138529:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1619 00000100:00100000:2.0:1763333175.138540:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+27:2419:x1848987613715456:12345-192.168.204.28@tcp:3:lfs.0 00010000:00010000:2.0:1763333175.138575:0:28427:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c568b1 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.138589:0:28427:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333175.138592:0:28427:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333175.138599:0:28427:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c568b1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.138612:0:28427:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c568b1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.138716:0:28427:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c568b1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.138726:0:28427:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c568b1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.138741:0:28427:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c568b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.138748:0:28427:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5c00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333175.138752:0:28427:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c568b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.138761:0:28427:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c568b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.138777:0:28427:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c568b1 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.138785:0:28427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c568b1 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333175.138871:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+27:2419:x1848987613715456:12345-192.168.204.28@tcp:3:lfs.0 Request processed in 332us (588us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1763333175.138879:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1619 00000100:00100000:3.0:1763333175.144510:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.145731:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613715584 00000100:00100000:1.0:1763333175.145743:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613715584 00000100:00100000:0.0:1763333175.145883:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9319 00000100:00100000:0.0:1763333175.145896:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56872:x1848987613715584:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333175.145923:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333175.145961:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c568b8 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969919 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.146040:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c568bf lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333175.146054:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c568bf lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.146065:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c568bf lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.146076:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e000/0xb32e3ef184c568c6 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333175.146083:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e000/0xb32e3ef184c568c6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.146089:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e000/0xb32e3ef184c568c6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.146129:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c568bf lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.146135:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c568bf lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.146142:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c568bf lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.146148:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c568bf lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.146154:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700ee00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333175.146158:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c568bf lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.146165:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c568bf lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.146176:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12900) 00010000:00010000:0.0:1763333175.146180:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333175.146184:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c568bf lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.146190:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c568bf lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.146203:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e000/0xb32e3ef184c568c6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.146209:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e000/0xb32e3ef184c568c6 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.146214:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e000/0xb32e3ef184c568c6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.146219:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700e000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333175.146222:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e000/0xb32e3ef184c568c6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.146232:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e000/0xb32e3ef184c568c6 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.146238:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43a31900) 00010000:00010000:0.0:1763333175.146241:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333175.146244:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e000/0xb32e3ef184c568c6 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.146249:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e000/0xb32e3ef184c568c6 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.146276:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c568b8 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969919 expref: 239 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.146286:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12900) 00010000:00010000:0.0:1763333175.146289:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333175.146293:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c568b8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969919 expref: 239 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.146305:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4700f400, rc 0) 00000100:00100000:0.0:1763333175.146415:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56872:x1848987613715584:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 521us (1915us total) trans 0 rc 301/301 00000100:00100000:0.0:1763333175.146423:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9319 00000100:00100000:0.0:1763333175.151409:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333175.151452:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.151555:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613715712 00000100:00100000:1.0:1763333175.151568:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613715712 00000100:00100000:1.0:1763333175.151633:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613715840 00000100:00100000:1.0:1763333175.151637:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613715840 00000100:00100000:1.0:1763333175.151672:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9320 00000100:00100000:1.0:1763333175.151684:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5004a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56872:x1848987613715712:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333175.151706:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333175.151730:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c568cd lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969920 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.151802:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c568d4 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333175.151814:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c568d4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333175.151824:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c568d4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333175.151839:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c568db lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333175.151846:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c568db lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333175.151852:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c568db lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333175.151896:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c568d4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333175.151903:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c568d4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333175.151908:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c568d4 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333175.151915:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c568d4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333175.151920:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333175.151924:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c568d4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333175.151931:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c568d4 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333175.151942:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44cd0000) 00010000:00010000:1.0:1763333175.151945:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333175.151962:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c568d4 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333175.151968:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c568d4 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333175.151980:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c568db lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333175.151985:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c568db lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333175.151990:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c568db lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333175.151995:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7ec00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333175.151999:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c568db lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333175.152004:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c568db lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333175.152011:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43a31900) 00010000:00010000:1.0:1763333175.152014:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333175.152017:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c568db lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333175.152022:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c568db lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333175.152049:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c568cd lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969920 expref: 240 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.152059:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44cd0000) 00010000:00010000:1.0:1763333175.152061:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333175.152065:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c568cd lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969920 expref: 240 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.152088:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f800, rc 0) 00000100:00100000:1.0:1763333175.152144:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5004a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56872:x1848987613715712:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 462us (744us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333175.152152:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9320 00000100:00100000:1.0:1763333175.152172:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9321 00000100:00100000:1.0:1763333175.152179:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5004b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56868:x1848987613715840:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333175.152187:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333175.152195:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c568e2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969927 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.152214:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c568e9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333175.152224:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c568e9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333175.152231:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c568e9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333175.152328:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c568e2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969927 expref: 240 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.152343:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e600/0xb32e3ef184c568e9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969927 expref: 239 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.152389:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:1.0:1763333175.152392:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763333175.152395:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e600, rc 0) 00000100:00100000:1.0:1763333175.152426:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5004b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56868:x1848987613715840:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 247us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333175.152432:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9321 00000100:00100000:0.0:1763333175.161561:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333175.161611:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.161758:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613716096 00000100:00100000:3.0:1763333175.161768:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613716096 00000100:00100000:3.0:1763333175.161835:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1620 00000100:00100000:3.0:1763333175.161844:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50049f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2418:x1848987613716096:12345-192.168.204.28@tcp:4:lfs.0 00010000:00010000:3.0:1763333175.161880:0:28426:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe48190400/0xb32e3ef184c568f0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.161898:0:28426:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c5662d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969839 expref: 15 pid: 28651 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333175.161906:0:28426:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333175.161908:0:28426:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333175.161911:0:28426:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe48190400/0xb32e3ef184c568f0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.161945:0:28426:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c5662d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969839 expref: 15 pid: 28651 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333175.162368:0:28426:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c5662d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969839 expref: 15 pid: 28651 timeout: 1379 lvb_type: 1 00000100:00100000:3.0:1763333175.162384:0:28426:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe45182d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:28426:1848987627266176:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333175.162729:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613715968 00000100:00100000:2.0:1763333175.162735:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613715968 00000100:00100000:2.0:1763333175.162776:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9322 00000100:00100000:2.0:1763333175.162783:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50049c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56872:x1848987613715968:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333175.162795:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333175.162812:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c568f7 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696992e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.162863:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c568fe lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333175.162874:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c568fe lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.162883:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c568fe lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:2.0:1763333175.162923:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1763333175.162927:0:6519:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1763333175.163142:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c568f7 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696992e expref: 241 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.163163:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c568fe lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696992e expref: 240 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.163172:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31b00) 00010000:00010000:2.0:1763333175.163174:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1763333175.163177:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4800, rc 0) 00000100:00100000:3.0:1763333175.163580:0:28426:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff49c92600 going to sleep for 11 seconds 00000100:00100000:2.0:1763333175.163643:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50049c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:56872:x1848987613715968:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 859us (2095us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333175.163651:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9322 00000100:00100000:0.0:1763333175.169709:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333175.170251:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.170327:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613716352 00000100:00100000:1.0:1763333175.170337:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613716352 00000100:00100000:3.0:1763333175.170405:0:28426:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe45182d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:28426:1848987627266176:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333175.170407:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c5662d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969839 expref: 16 pid: 28651 timeout: 1379 lvb_type: 1 00010000:00010000:3.0:1763333175.170431:0:28426:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe48190400/0xb32e3ef184c568f0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333175.170500:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613716224 00000100:00100000:2.0:1763333175.170504:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613716224 00000100:00100000:2.0:1763333175.170545:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9323 00000100:00100000:2.0:1763333175.170555:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50048380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:56872:x1848987613716224:12345-192.168.204.28@tcp:101:lfs.0 00000100:00100000:1.0:1763333175.170559:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3061 00000100:00100000:1.0:1763333175.170565:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2420:x1848987613716352:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333175.170572:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333175.170579:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333175.170590:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56905 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969935 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.170598:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c5662d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969839 expref: 16 pid: 28651 timeout: 1379 lvb_type: 1 00010000:00010000:1.0:1763333175.170609:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c5662d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969839 expref: 16 pid: 28651 timeout: 1379 lvb_type: 1 00010000:00010000:1.0:1763333175.170629:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c5662d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x23a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969839 expref: 16 pid: 28651 timeout: 1379 lvb_type: 1 00010000:00010000:2.0:1763333175.170646:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5690c lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333175.170658:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5690c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.170668:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5690c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.170678:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56913 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333175.170685:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56913 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.170692:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56913 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.170735:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5690c lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.170742:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5690c lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.170748:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5690c lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.170754:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5690c lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.170760:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333175.170764:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5690c lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.170772:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5690c lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333175.170779:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333175.170780:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31b00) 00010000:00010000:1.0:1763333175.170781:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333175.170783:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333175.170786:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe48190400/0xb32e3ef184c568f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.170787:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5690c lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.170793:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5690c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.170803:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56913 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.170809:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56913 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.170815:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56913 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.170819:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333175.170822:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56913 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.170827:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56913 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.170834:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43a31900) 00010000:00010000:2.0:1763333175.170837:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333175.170840:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56913 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.170846:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56913 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333175.170856:0:6506:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe48190400/0xb32e3ef184c568f0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.170869:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56905 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969935 expref: 241 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.170877:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31b00) 00010000:00010000:2.0:1763333175.170879:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333175.170882:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333175.170883:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56905 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969935 expref: 241 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.170890:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5c00, rc 0) 00000100:00100000:1.0:1763333175.170931:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2420:x1848987613716352:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 365us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333175.170938:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3061 00010000:00010000:3.0:1763333175.171798:0:28426:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe48190400/0xb32e3ef184c568f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.171809:0:28426:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe48190400/0xb32e3ef184c568f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333175.174050:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50048380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:56872:x1848987613716224:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 3486us (4341us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333175.174062:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9323 00000001:00080000:1.0:1763333175.178834:0:24714:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838897 is committed 00000001:00080000:1.0:1763333175.178855:0:24714:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838895 is committed 00002000:00010000:3.0:1763333175.182142:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x23a:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:3.0:1763333175.182152:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x23a:0x0] updating lvb mtime from disk: 0 -> 1763333175 00002000:00010000:3.0:1763333175.182155:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x23a:0x0] updating lvb ctime from disk: 0 -> 1763333175 00002000:00010000:3.0:1763333175.182158:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x23a:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1763333175.182694:0:28426:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe48190400/0xb32e3ef184c568f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.182710:0:28426:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe48190400/0xb32e3ef184c568f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.182719:0:28426:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe48190400/0xb32e3ef184c568f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.182726:0:28426:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48190400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333175.182731:0:28426:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe48190400/0xb32e3ef184c568f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.182741:0:28426:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe48190400/0xb32e3ef184c568f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.182768:0:28426:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe48190400/0xb32e3ef184c568f0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.182777:0:28426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe48190400/0xb32e3ef184c568f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333175.182894:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50049f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+11:2418:x1848987613716096:12345-192.168.204.28@tcp:4:lfs.0 Request processed in 21045us (21276us total) trans 21474838897 rc 0/0 00000100:00100000:3.0:1763333175.182905:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1620 00000100:00100000:0.0:1763333175.191131:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.192643:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613716608 00000100:00100000:2.0:1763333175.192659:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613716608 00000100:00100000:2.0:1763333175.192741:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9324 00000100:00100000:2.0:1763333175.192755:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:56872:x1848987613716608:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333175.192776:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333175.192780:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763333175.192808:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c568fe lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696992e expref: 240 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.192830:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31b00) 00010000:00010000:2.0:1763333175.192841:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333175.192859:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5691a lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696993c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.193214:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56921 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333175.193229:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56921 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.193239:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56921 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.193250:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56928 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333175.193258:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56928 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.193264:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56928 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.193717:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5692f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333175.193727:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5692f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.193735:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5692f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:2.0:1763333175.193745:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b6:0x0]: returning size 0 00010000:00010000:2.0:1763333175.193770:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56921 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.193778:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56921 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.193783:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56921 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.193790:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56921 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.193797:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333175.193801:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56921 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.193809:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56921 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.193818:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31f00) 00010000:00010000:2.0:1763333175.193821:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333175.193825:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56921 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.193832:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56921 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:2.0:1763333175.193843:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001e1cc704 reply state 000000009c84f371 transno 4294972326 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56928 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.193853:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56928 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.193859:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43a31900) 00010000:00010000:2.0:1763333175.193862:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333175.193865:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763333175.193896:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5691a lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696993c expref: 242 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.193914:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5692f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696993c expref: 241 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.193922:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b6:0x0].0x0 (ffff92fe43a31400) 00010000:00010000:2.0:1763333175.193924:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333175.193927:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5e00, rc 0) 00000100:00100000:2.0:1763333175.194811:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:56872:x1848987613716608:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 2054us (3686us total) trans 4294972326 rc 0/0 00000100:00100000:2.0:1763333175.194822:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9324 00000100:00100000:0.0:1763333175.199405:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.199515:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613716864 00000100:00100000:1.0:1763333175.199528:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613716864 00000100:00100000:1.0:1763333175.199596:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9325 00000100:00100000:1.0:1763333175.199607:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:56872:x1848987613716864:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333175.199637:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333175.199659:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c5693d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969943 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.199781:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56944 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333175.199798:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5692f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1b6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696993c expref: 243 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.199807:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56944 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1b6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333175.199841:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5692f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696993c expref: 243 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.199854:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5692f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1b6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696993c expref: 243 pid: 6519 timeout: 1379 lvb_type: 0 00000100:00100000:1.0:1763333175.199872:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4920dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627266304:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333175.199956:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff499ad9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763333175.204504:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.204600:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613717120 00000100:00100000:1.0:1763333175.204611:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613717120 00000100:00100000:1.0:1763333175.204681:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9326 00000100:00100000:1.0:1763333175.204691:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56868:x1848987613717120:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:1.0:1763333175.204746:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333175.204773:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56809 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698da expref: 244 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.204791:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:1.0:1763333175.204796:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333175.204862:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5694b lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333175.204877:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5694b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333175.204889:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5694b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00010000:1.0:1763333175.205543:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007fdcc446 reply state 00000000a618fc21 transno 4294972327 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5694b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333175.205559:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5694b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333175.205566:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:1.0:1763333175.205568:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333175.205572:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763333175.205670:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56868:x1848987613717120:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 979us (1174us total) trans 4294972327 rc 0/0 00000100:00100000:1.0:1763333175.205678:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9326 00000100:00100000:0.0:1763333175.205813:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.205846:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4920dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627266304:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333175.205870:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56944 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000100:00100000:2.0:1763333175.206172:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613717248 00000100:00100000:2.0:1763333175.206178:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613717248 00010000:00010000:2.0:1763333175.206205:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5692f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1b6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696993c expref: 245 pid: 6519 timeout: 1379 lvb_type: 0 00000100:00100000:2.0:1763333175.206241:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3062 00000100:00100000:2.0:1763333175.206250:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:2421:x1848987613717248:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333175.206261:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333175.206267:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5692f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1b6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696993c expref: 245 pid: 6519 timeout: 1379 lvb_type: 0 00010000:00010000:2.0:1763333175.206278:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5692f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696993c expref: 245 pid: 6519 timeout: 1379 lvb_type: 0 00010000:00010000:2.0:1763333175.206295:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5692f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696993c expref: 245 pid: 6519 timeout: 1379 lvb_type: 0 00010000:00010000:2.0:1763333175.206308:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b6:0x0].0x0 (ffff92fe43a31400) 00010000:00010000:2.0:1763333175.206312:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56944 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.206326:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56944 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.206336:0:6504:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56944 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1b6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.206394:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333175.206441:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:2421:x1848987613717248:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 192us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333175.206448:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3062 00010000:00010000:3.0:1763333175.206692:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56944 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.206700:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56944 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:3.0:1763333175.206760:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b6:0x0]: returning size 0 00000004:00080000:3.0:1763333175.206937:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x23d:0x0], index 1: 0 00000004:00080000:3.0:1763333175.206944:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x23d:0x0], index 0: 0 00000004:00080000:3.0:1763333175.206956:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x23e:0x0], index 0: 0 00000004:00080000:3.0:1763333175.206961:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x23e:0x0], index 1: 0 00010000:00010000:3.0:1763333175.207120:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56944 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.207128:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56944 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1b6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.207135:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56944 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1b6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.207141:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7ec00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333175.207146:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56944 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1b6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.207152:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56944 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1b6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.207162:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b6:0x0].0x0 (ffff92fe43a31400) 00010000:00010000:3.0:1763333175.207166:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763333175.207169:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56944 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1b6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.207176:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56944 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1b6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.207217:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c5693d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1b6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969943 expref: 244 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.207226:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b6:0x0].0x0 (ffff92fe43a31400) 00010000:00010000:3.0:1763333175.207229:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763333175.207232:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c5693d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969943 expref: 244 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.207245:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f800, rc 0) 00000100:00100000:3.0:1763333175.207289:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:56872:x1848987613716864:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 7684us (7895us total) trans 4294972328 rc 301/301 00000100:00100000:3.0:1763333175.207296:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9325 00000100:00100000:0.0:1763333175.210196:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.210586:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613717376 00000100:00100000:2.0:1763333175.210597:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613717376 00000100:00100000:2.0:1763333175.210656:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6555 00000100:00100000:2.0:1763333175.210667:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1370b1d7-8612-4b90-ab37-e53288bbf9fd+11:56868:x1848987613717376:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333175.210686:0:29010:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333175.210709:0:29010:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56959 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696994a expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763333175.210733:0:29010:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x23a:0x0] initial LVB size: 4096, mtime: 0x691a5437, atime: 0x0, ctime: 0x691a5437, blocks: 0x8 00010000:00010000:2.0:1763333175.210755:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333175.210757:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333175.210765:0:29010:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56959 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696994a expref: 12 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.210780:0:29010:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56959 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696994a expref: 12 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.210793:0:29010:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5c00, rc 0) 00000100:00100000:2.0:1763333175.210854:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:56868:x1848987613717376:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 189us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333175.210864:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6555 00000100:00100000:0.0:1763333175.211671:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.211734:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613717632 00000100:00100000:1.0:1763333175.211741:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613717632 00000100:00100000:1.0:1763333175.211786:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3185 00000100:00100000:1.0:1763333175.211795:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7ad4b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:56872:x1848987613717632:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1763333175.212073:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7ad4b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56872:x1848987613717632:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 279us (403us total) trans 4294972329 rc 0/0 00000100:00100000:1.0:1763333175.212081:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3185 00000100:00100000:0.0:1763333175.213817:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333175.215782:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.216571:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613718016 00000100:00100000:2.0:1763333175.216585:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613718016 00000100:00100000:1.0:1763333175.216592:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613717760 00000100:00100000:1.0:1763333175.216596:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613717760 00000100:00100000:2.0:1763333175.216644:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3186 00000100:00100000:1.0:1763333175.216644:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6556 00000100:00100000:2.0:1763333175.216653:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56872:x1848987613718016:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1763333175.216653:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+27:56868:x1848987613717760:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333175.216672:0:28650:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333175.216693:0:28650:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56960 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969951 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.216720:0:28650:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c56634 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969840 expref: 28 pid: 8407 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333175.216728:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333175.216731:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333175.216736:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56960 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969951 expref: 28 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.216770:0:28650:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c56634 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969840 expref: 28 pid: 8407 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333175.216783:0:28650:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c56634 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969840 expref: 28 pid: 8407 timeout: 1379 lvb_type: 1 00000100:00100000:1.0:1763333175.216798:0:28650:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4920dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28650:1848987627266432:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333175.216895:0:28650:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff6be07d80 going to sleep for 11 seconds 00000100:00100000:2.0:1763333175.217135:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56872:x1848987613718016:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 481us (1359us total) trans 4294972330 rc 0/0 00000100:00100000:2.0:1763333175.217144:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3186 00000100:00100000:1.0:1763333175.222255:0:28650:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4920dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28650:1848987627266432:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333175.222296:0:28650:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56960 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969951 expref: 28 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.222317:0:28650:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7fc00, rc 0) 00000100:00100000:1.0:1763333175.223174:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+28:56868:x1848987613717760:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 6518us (9362us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333175.223185:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6556 00000100:00100000:0.0:1763333175.224261:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.224386:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613718400 00000100:00100000:1.0:1763333175.224396:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613718400 00010000:00010000:1.0:1763333175.224691:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c56634 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969840 expref: 28 pid: 8407 timeout: 1379 lvb_type: 1 00000100:00100000:1.0:1763333175.224739:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3063 00000100:00100000:1.0:1763333175.224752:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff44f08450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+28:2421:x1848987613718400:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333175.224772:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333175.224796:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c56634 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x23a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969840 expref: 28 pid: 8407 timeout: 1379 lvb_type: 1 00010000:00010000:1.0:1763333175.224811:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c56634 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x23a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969840 expref: 28 pid: 8407 timeout: 1379 lvb_type: 1 00010000:00010000:1.0:1763333175.224838:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c56634 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x23a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969840 expref: 28 pid: 8407 timeout: 1379 lvb_type: 1 00010000:00010000:1.0:1763333175.224853:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333175.224856:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333175.224862:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56960 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969951 expref: 27 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.224873:0:6506:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56960 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969951 expref: 27 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.224913:0:6506:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56960 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969951 expref: 27 pid: 28650 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333175.224928:0:6506:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4920dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6506:1848987627266560:192.168.204.28@tcp:105: 00000100:00100000:1.0:1763333175.226752:0:6506:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff6be07d80 going to sleep for 11 seconds 00000100:00100000:0.0:1763333175.226820:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.226985:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613718272 00000100:00100000:1.0:1763333175.226993:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613718272 00000100:00100000:1.0:1763333175.227324:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9327 00000100:00100000:1.0:1763333175.227334:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:55917:x1848987613718272:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333175.227390:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333175.228548:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56967 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969958 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.228708:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5696e lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333175.228722:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5696e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333175.228733:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5696e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333175.228744:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c56975 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333175.228752:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c56975 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333175.228759:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c56975 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333175.228813:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5697c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333175.228820:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5697c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333175.228826:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5697c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:1.0:1763333175.228835:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b6:0x0]: returning size 0 00010000:00010000:1.0:1763333175.228909:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5696e lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333175.228920:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5696e lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333175.228926:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5696e lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333175.228932:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5696e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333175.228938:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7ec00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333175.228942:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5696e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333175.228949:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5696e lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333175.228960:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff42c64600) 00010000:00010000:1.0:1763333175.228963:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333175.228968:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5696e lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333175.228974:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5696e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333175.228987:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c56975 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333175.228992:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c56975 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333175.228997:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c56975 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333175.229002:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333175.229005:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c56975 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333175.229010:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c56975 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333175.229016:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43a31900) 00010000:00010000:1.0:1763333175.229018:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333175.229021:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c56975 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333175.229026:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c56975 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333175.229059:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56967 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969958 expref: 248 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.229075:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5697c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969958 expref: 247 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.229081:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b6:0x0].0x0 (ffff92ff42c64200) 00010000:00010000:1.0:1763333175.229084:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333175.229086:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f600, rc 0) 00000100:00100000:1.0:1763333175.229152:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:55917:x1848987613718272:12345-192.168.204.28@tcp:101:bash.0 Request processed in 1819us (2334us total) trans 4294972331 rc 0/0 00000100:00100000:1.0:1763333175.229162:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9327 00000100:00100000:1.0:1763333175.232100:0:6506:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4920dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6506:1848987627266560:192.168.204.28@tcp:105: 00010000:00010000:1.0:1763333175.232128:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333175.232179:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff44f08450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+27:2421:x1848987613718400:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 7428us (7923us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333175.232195:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3063 00000100:00100000:0.0:1763333175.232936:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.233577:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613718528 00000100:00100000:1.0:1763333175.233586:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613718528 00002000:00010000:1.0:1763333175.233626:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/570 (5->18446744073709551615) 00002000:00100000:1.0:1763333175.233631:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe472f7800 with x1848987613718528 ext(5->18446744073709551615) 00002000:00010000:1.0:1763333175.233644:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe472f7800. 00000100:00100000:1.0:1763333175.233667:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1621 00000100:00100000:1.0:1763333175.233676:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:2420:x1848987613718528:12345-192.168.204.28@tcp:10:lfs.0 00002000:00010000:1.0:1763333175.233979:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x23a:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:1.0:1763333175.233983:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x23a:0x0] updating lvb mtime from disk: 1763333175 -> 1763333175 00002000:00010000:1.0:1763333175.233986:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x23a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333175.233988:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x23a:0x0] updating lvb ctime from disk: 1763333175 -> 1763333175 00002000:00010000:1.0:1763333175.233991:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x23a:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1763333175.234053:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2420:x1848987613718528:12345-192.168.204.28@tcp:10:lfs.0 Request processed in 378us (1120us total) trans 21474838898 rc 0/0 00000100:00100000:1.0:1763333175.234061:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1621 00002000:00010000:1.0:1763333175.234066:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/570 (5->18446744073709551615) 00002000:00100000:1.0:1763333175.234068:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe472f7800 with x1848987613718528 ext(5->18446744073709551615) 00002000:00010000:1.0:1763333175.234073:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe472f7800. 00000100:00100000:3.0:1763333175.234285:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.234386:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.234408:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613718784 00000100:00100000:3.0:1763333175.234423:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613718784 00000100:00100000:3.0:1763333175.234456:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9328 00000100:00100000:3.0:1763333175.234464:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:55917:x1848987613718784:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333175.234492:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333175.234510:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c5698a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696995f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.234542:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56991 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333175.234556:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56991 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333175.234566:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56991 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333175.234679:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c5698a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696995f expref: 249 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.234697:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56991 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696995f expref: 248 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.234707:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b6:0x0].0x0 (ffff92ff42c64200) 00010000:00010000:3.0:1763333175.234710:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763333175.234714:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48191600, rc 0) 00000100:00100000:3.0:1763333175.234744:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:55917:x1848987613718784:12345-192.168.204.28@tcp:101:bash.0 Request processed in 281us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333175.234750:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9328 00000100:00100000:0.0:1763333175.234938:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613718656 00000100:00100000:0.0:1763333175.234944:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613718656 00002000:00010000:0.0:1763333175.234965:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/570 (0->18446744073709551615) 00002000:00100000:0.0:1763333175.234969:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45182d80 with x1848987613718656 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333175.234975:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe45182d80. 00000100:00100000:0.0:1763333175.235000:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1622 00000100:00100000:0.0:1763333175.235009:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+27:2420:x1848987613718656:12345-192.168.204.28@tcp:10:lfs.0 00002000:00010000:0.0:1763333175.235129:0:28427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x23a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333175.235133:0:28427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x23a:0x0] updating lvb mtime from disk: 0 -> 1763333175 00002000:00010000:0.0:1763333175.235135:0:28427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x23a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333175.235137:0:28427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x23a:0x0] updating lvb ctime from disk: 0 -> 1763333175 00002000:00010000:0.0:1763333175.235139:0:28427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x23a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333175.235174:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+28:2420:x1848987613718656:12345-192.168.204.28@tcp:10:lfs.0 Request processed in 165us (889us total) trans 17179871594 rc 0/0 00000100:00100000:0.0:1763333175.235181:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1622 00002000:00010000:0.0:1763333175.235184:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/570 (0->18446744073709551615) 00002000:00100000:0.0:1763333175.235188:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45182d80 with x1848987613718656 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333175.235192:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe45182d80. 00000100:00100000:2.0:1763333175.239102:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.239161:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613719040 00000100:00100000:3.0:1763333175.239171:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613719040 00000100:00100000:2.0:1763333175.239180:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333175.239321:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613719296 00000100:00100000:0.0:1763333175.239326:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613719296 00000100:00100000:0.0:1763333175.239379:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9329 00000100:00100000:0.0:1763333175.239390:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:55917:x1848987613719040:12345-192.168.204.28@tcp:36:bash.0 00000100:00100000:1.0:1763333175.239405:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9330 00000100:00100000:1.0:1763333175.239413:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:56868:x1848987613719296:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:1.0:1763333175.239505:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56998 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333175.239525:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56998 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333175.239539:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56998 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333175.239548:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333175.239568:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5697c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969958 expref: 249 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.239583:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b6:0x0].0x0 (ffff92ff42c64200) 00010000:00010000:0.0:1763333175.239588:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00010000:1.0:1763333175.239656:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ae8d1b63 reply state 000000008998455d transno 4294972332 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56998 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333175.239669:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56998 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333175.239674:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:1.0:1763333175.239677:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333175.239679:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763333175.239691:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c5699f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333175.239699:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c5699f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.239705:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c5699f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000001:00080000:0.0:1763333175.239739:0:6521:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294972333 00000004:00010000:0.0:1763333175.239757:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c5bff94e reply state 000000008171e833 transno 4294972334 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c5699f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.239766:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c5699f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1b6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.239772:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b6:0x0].0x0 (ffff92ff42c64200) 00010000:00010000:0.0:1763333175.239775:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333175.239777:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763333175.239873:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:55917:x1848987613719040:12345-192.168.204.28@tcp:36:bash.0 Request processed in 485us (779us total) trans 4294972334 rc 0/0 00000100:00100000:0.0:1763333175.239880:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9329 00000020:00080000:0.0:1763333175.239885:0:6521:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763333175.240192:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:56868:x1848987613719296:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 779us (1010us total) trans 4294972332 rc 0/0 00000100:00100000:1.0:1763333175.240199:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9330 00000100:00100000:2.0:1763333175.242592:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.242651:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613719424 00000100:00100000:1.0:1763333175.242660:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613719424 00000100:00100000:2.0:1763333175.242667:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.242715:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9331 00000100:00100000:1.0:1763333175.242725:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:55917:x1848987613719424:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333175.242745:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333175.242763:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c569a6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969966 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.242817:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c569a6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969966 expref: 253 pid: 12741 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333175.242820:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613719552 00000100:00100000:0.0:1763333175.242825:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613719552 00010000:00010000:1.0:1763333175.242831:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c569a6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969966 expref: 253 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.242853:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b6:0x0].0x0 (ffff92ff42c64200) 00010000:00010000:1.0:1763333175.242857:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763333175.242860:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e000, rc 0) 00000100:00100000:0.0:1763333175.242862:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6557 00000100:00100000:0.0:1763333175.242869:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+28:56868:x1848987613719552:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333175.242878:0:28650:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333175.242888:0:28650:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4700e000/0xb32e3ef184c569ad lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696996d expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.242907:0:28650:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c56817 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698e1 expref: 29 pid: 17605 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333175.242914:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1763333175.242916:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:55917:x1848987613719424:12345-192.168.204.28@tcp:101:bash.0 Request processed in 193us (333us total) trans 0 rc 0/0 00010000:00010000:0.0:1763333175.242917:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333175.242921:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4700e000/0xb32e3ef184c569ad lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696996d expref: 29 pid: 28650 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333175.242922:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9331 00010000:00010000:0.0:1763333175.242953:0:28650:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c56817 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698e1 expref: 29 pid: 17605 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333175.242966:0:28650:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c56817 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698e1 expref: 29 pid: 17605 timeout: 1379 lvb_type: 1 00000100:00100000:0.0:1763333175.242981:0:28650:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28650:1848987627266688:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333175.243399:0:28650:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe43aa6900 going to sleep for 11 seconds 00000100:00100000:2.0:1763333175.245271:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.245309:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.245413:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613719936 00000100:00100000:0.0:1763333175.245417:0:28650:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28650:1848987627266688:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333175.245421:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613719936 00010000:00010000:0.0:1763333175.245450:0:28650:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe4700e000/0xb32e3ef184c569ad lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696996d expref: 29 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.245478:0:28650:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4700e000, rc 0) 00000100:00100000:3.0:1763333175.245484:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9332 00000100:00100000:3.0:1763333175.245494:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:55917:x1848987613719936:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333175.245513:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333175.245515:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00100000:0.0:1763333175.245532:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:56868:x1848987613719552:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 2662us (2862us total) trans 0 rc 0/0 00010000:00010000:3.0:1763333175.245540:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c569a6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969966 expref: 253 pid: 12741 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333175.245545:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6557 00000100:00100000:1.0:1763333175.245549:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613719680 00000100:00100000:1.0:1763333175.245554:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613719680 00010000:00010000:3.0:1763333175.245563:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b6:0x0].0x0 (ffff92ff42c64200) 00010000:00010000:3.0:1763333175.245569:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333175.245576:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c56817 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698e1 expref: 29 pid: 17605 timeout: 1379 lvb_type: 1 00010000:00010000:3.0:1763333175.245582:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c569b4 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969974 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333175.245602:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3064 00000100:00100000:1.0:1763333175.245610:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:2421:x1848987613719680:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333175.245621:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333175.245626:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c569bb lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333175.245638:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c569bb lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333175.245643:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c56817 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x239:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698e1 expref: 29 pid: 17605 timeout: 1379 lvb_type: 1 00010000:00010000:3.0:1763333175.245650:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c569bb lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333175.245658:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c56817 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x239:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698e1 expref: 29 pid: 17605 timeout: 1379 lvb_type: 1 00010000:00010000:1.0:1763333175.245676:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c56817 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x239:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698e1 expref: 29 pid: 17605 timeout: 1379 lvb_type: 1 00010000:00010000:1.0:1763333175.245686:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333175.245688:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333175.245695:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4700e000/0xb32e3ef184c569ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696996d expref: 28 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.245704:0:6506:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4700e000/0xb32e3ef184c569ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696996d expref: 28 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.245733:0:6506:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff92fe4700e000/0xb32e3ef184c569ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696996d expref: 28 pid: 28650 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333175.245746:0:6506:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4920dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6506:1848987627266816:192.168.204.28@tcp:105: 00000100:00100000:1.0:1763333175.245796:0:6506:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff6be07e40 going to sleep for 11 seconds 00000040:00080000:3.0:1763333175.245891:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1421, 88 off119944 00000004:00080000:3.0:1763333175.245899:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1279325549971ns, next at 1279713547966ns, rc = 0 00000040:00080000:3.0:1763333175.245938:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1422, 88 off119944 00000004:00080000:3.0:1763333175.245943:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1279325594361ns, next at 1280195897991ns, rc = 0 00000040:00080000:3.0:1763333175.245979:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1423, 88 off120032 00000004:00080000:3.0:1763333175.245984:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1279325635125ns, next at 1280195897991ns, rc = 0 00000040:00080000:3.0:1763333175.245994:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1422, 88 off120032 00000004:00080000:3.0:1763333175.245998:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1279325648516ns, next at 1279713547966ns, rc = 0 00000001:00080000:0.0:1763333175.248684:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972335 is committed 00000004:00080000:0.0:1763333175.248698:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 930 committed 00000004:00080000:0.0:1763333175.248705:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 934 committed 00000004:00080000:0.0:1763333175.248711:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 933 committed 00000004:00080000:0.0:1763333175.248713:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 929 committed 00000004:00080000:0.0:1763333175.248732:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 932 committed 00000100:00100000:0.0:1763333175.248771:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46e2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627266944:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763333175.248809:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46e2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627267328:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333175.248821:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333175.248839:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333175.248868:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627267328 00000100:00100000:0.0:1763333175.248868:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627266944 00000100:00100000:2.0:1763333175.248875:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627267328 00000100:00100000:0.0:1763333175.248875:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627266944 00000100:00100000:0.0:1763333175.248914:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6558 00000100:00100000:0.0:1763333175.248922:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+34:3655:x1848987627266944:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763333175.248932:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46e2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627267072:0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1763333175.248945:0:28650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:571 count 1 00000100:00100000:1.0:1763333175.248972:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1763333175.248981:0:28650:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c569c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x23b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333175.248991:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763333175.248995:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46e2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627267200:0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1763333175.249000:0:28650:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56872 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x23b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696990b expref: 28 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.249008:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333175.249011:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1763333175.249013:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1763333175.249015:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c569c2 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x23b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.249041:0:28650:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56872 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x23b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696990b expref: 28 pid: 28650 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333175.249051:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627267072 00010000:00010000:0.0:1763333175.249053:0:28650:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56872 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x23b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696990b expref: 28 pid: 28650 timeout: 1379 lvb_type: 0 00000100:00100000:1.0:1763333175.249054:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627267072 00000100:00100000:0.0:1763333175.249064:0:28650:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28650:1848987627267456:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333175.249143:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627267200 00000100:00100000:2.0:1763333175.249147:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627267200 00010000:00010000:3.0:1763333175.249167:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5689c lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00000100:00100000:2.0:1763333175.249168:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6559 00000100:00100000:2.0:1763333175.249174:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73164700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+36:3654:x1848987627267328:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1763333175.249177:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5689c lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.249184:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5689c lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.249189:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feba00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333175.249194:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5689c lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.249201:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5689c lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.249215:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43a31900) 00010000:00010000:3.0:1763333175.249217:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333175.249222:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5689c lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.249228:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5689c lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.249242:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56928 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.249248:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56928 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.249253:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56928 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.249258:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333175.249260:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56928 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.249266:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56928 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.249272:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43a31900) 00010000:00010000:3.0:1763333175.249274:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333175.249276:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56928 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.249281:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56928 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.249295:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5694b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333175.249301:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5694b lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333175.249306:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5694b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00000100:00100000:2.0:1763333175.249311:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73164700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+37:3654:x1848987627267328:12345-0@lo:2:osp-syn-1-1.0 Request processed in 138us (471us total) trans 17179871595 rc 0/0 00010000:00010000:3.0:1763333175.249312:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333175.249315:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5694b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00000100:00100000:2.0:1763333175.249319:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6559 00010000:00010000:3.0:1763333175.249320:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5694b lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333175.249327:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:3.0:1763333175.249329:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333175.249332:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5694b lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000100:00100000:2.0:1763333175.249335:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6560 00010000:00010000:3.0:1763333175.249338:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5694b lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000100:00100000:2.0:1763333175.249341:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+36:3652:x1848987627267200:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1763333175.249369:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c5699f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333175.249376:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c5699f lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333175.249381:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c5699f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333175.249386:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700ee00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333175.249389:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c5699f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333175.249394:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c5699f lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333175.249402:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b6:0x0].0x0 (ffff92ff42c64200) 00010000:00010000:3.0:1763333175.249405:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333175.249407:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c5699f lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333175.249412:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c5699f lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333175.249424:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56998 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.249430:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56998 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00000100:00100000:2.0:1763333175.249430:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+37:3652:x1848987627267200:12345-0@lo:2:osp-syn-1-1.0 Request processed in 88us (415us total) trans 17179871596 rc 0/0 00010000:00010000:3.0:1763333175.249436:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56998 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00000100:00100000:2.0:1763333175.249436:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6560 00010000:00010000:3.0:1763333175.249441:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333175.249444:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56998 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.249450:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56998 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.249457:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:3.0:1763333175.249459:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333175.249462:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56998 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.249466:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56998 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000004:00080000:2.0:1763333175.249492:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe46e2d180/2, rc 0, transno 17179871595 00000100:00100000:2.0:1763333175.249498:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46e2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627267328:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333175.249553:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333175.249893:0:28650:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe43aa6900 going to sleep for 11 seconds 00000100:00100000:1.0:1763333175.250295:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613720064 00000100:00100000:1.0:1763333175.250301:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613720064 00000100:00100000:3.0:1763333175.250314:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6561 00000100:00100000:3.0:1763333175.250321:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+36:3652:x1848987627267072:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763333175.250331:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6562 00000100:00100000:1.0:1763333175.250336:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:2420:x1848987613720064:12345-192.168.204.28@tcp:2:lfs.0 00002000:00080000:3.0:1763333175.250338:0:8406:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:572 count 1 00002000:00010000:3.0:1763333175.250375:0:8406:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x23c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333175.250382:0:8406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c569c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.250391:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333175.250393:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333175.250398:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c569c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.250409:0:8406:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c569c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.250416:0:8406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c569c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.250423:0:8406:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c569c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333175.250423:0:17605:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x239:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1763333175.250426:0:17605:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x239:0x0] updating lvb mtime from disk: 1763333175 -> 1763333175 00002000:00010000:1.0:1763333175.250429:0:17605:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x239:0x0] updating lvb atime from disk: 0 -> 1763333174 00002000:00010000:1.0:1763333175.250431:0:17605:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x239:0x0] updating lvb ctime from disk: 1763333175 -> 1763333175 00002000:00010000:1.0:1763333175.250433:0:17605:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x239:0x0] updating lvb blocks from disk: 8 -> 8 00010000:00010000:3.0:1763333175.250441:0:8406:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763333175.250478:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:2420:x1848987613720064:12345-192.168.204.28@tcp:2:lfs.0 Request processed in 133us (917us total) trans 17179871597 rc 0/0 00000100:00100000:1.0:1763333175.250486:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6562 00000100:00100000:1.0:1763333175.250587:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4920d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627267840:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333175.250614:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333175.250615:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+37:3652:x1848987627267072:12345-0@lo:6:osp-syn-1-1.0 Request processed in 294us (1642us total) trans 17179871598 rc 0/0 00000100:00100000:3.0:1763333175.250622:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6561 00000100:00100000:3.0:1763333175.250632:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627267840 00000100:00100000:1.0:1763333175.250633:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763333175.250635:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627267840 00000100:00100000:1.0:1763333175.250639:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4920f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627267712:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763333175.250658:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6563 00000100:00100000:1.0:1763333175.250658:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333175.250663:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1848987627267840:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333175.250679:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627267712 00000100:00100000:1.0:1763333175.250683:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627267712 00000100:00100000:1.0:1763333175.250719:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6564 00000100:00100000:1.0:1763333175.250725:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+7:3653:x1848987627267712:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1763333175.250736:0:28651:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:572 count 1 00002000:00010000:1.0:1763333175.250752:0:28651:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x23c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333175.250757:0:28651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c569d0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333175.250759:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+7:3653:x1848987627267840:12345-0@lo:2:osp-syn-0-1.0 Request processed in 96us (145us total) trans 21474838899 rc 0/0 00000100:00100000:3.0:1763333175.250766:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6563 00010000:00010000:1.0:1763333175.250766:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333175.250768:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333175.250771:0:28651:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c569d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.250781:0:28651:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c569d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.250788:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333175.250788:0:28651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c569d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.250794:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c569c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.250795:0:28651:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c569d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.250802:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48191800 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333175.250807:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c569c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.250808:0:28651:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763333175.250815:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c569c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.250832:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c569c9 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.250839:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c569c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.250854:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333175.250858:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c569d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.250864:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7ec00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333175.250868:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c569d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.250875:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c569d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.250884:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c569d0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.250891:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c569d0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.250902:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333175.250903:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333175.250906:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763333175.250918:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+7:3653:x1848987627267712:12345-0@lo:6:osp-syn-0-1.0 Request processed in 193us (258us total) trans 21474838900 rc 0/0 00000100:00100000:1.0:1763333175.250924:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6564 00000100:00100000:3.0:1763333175.250929:0:3653:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474838895 gen 2 00000004:00080000:3.0:1763333175.250933:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44e05880, transno 21474838883 00000004:00080000:3.0:1763333175.250941:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44e07800, transno 21474838884 00000004:00080000:3.0:1763333175.250944:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44e04a80, transno 21474838885 00000004:00080000:3.0:1763333175.250947:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44e07480, transno 21474838886 00000004:00080000:3.0:1763333175.250949:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff5004b480, transno 21474838887 00000004:00080000:3.0:1763333175.250952:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff5004bb80, transno 21474838888 00000004:00080000:3.0:1763333175.250954:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe438a8000, transno 21474838889 00000004:00080000:3.0:1763333175.250956:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe438aa300, transno 21474838890 00000004:00080000:3.0:1763333175.250959:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff5004aa00, transno 21474838892 00000004:00080000:3.0:1763333175.250962:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff50049180, transno 21474838893 00000004:00080000:3.0:1763333175.250964:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7dcfc700, transno 21474838894 00000004:00080000:1.0:1763333175.250965:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe46e2e300/2, rc 0, transno 17179871596 00000004:00080000:3.0:1763333175.250966:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7dcfe300, transno 21474838895 00000100:00100000:1.0:1763333175.250970:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46e2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627267200:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333175.250972:0:3653:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff92fe4920f100 x1848987627267712/t21474838900(21474838900) o6->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1763333191 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1763333175.250979:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe46e2f480/2, rc 0, transno 17179871598 00000004:00080000:3.0:1763333175.250980:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4920f100/2, rc 0, transno 21474838900 00000100:00100000:1.0:1763333175.250982:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46e2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627267072:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763333175.250984:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4920f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627267712:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1763333175.250992:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4920d180/2, rc 0, transno 21474838899 00000100:00100000:3.0:1763333175.250995:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4920d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627267840:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333175.250998:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4920ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627267584:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763333175.251020:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333175.251037:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1763333175.251041:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44de0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627267968:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333175.251058:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333175.251075:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627267584 00000100:00100000:1.0:1763333175.251079:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627267584 00000100:00100000:1.0:1763333175.251096:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627267968 00000100:00100000:1.0:1763333175.251098:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627267968 00000100:00100000:1.0:1763333175.251115:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6565 00000004:00080000:3.0:1763333175.251116:0:8604:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 4 in progress, 2 in flight, 12 done 00000100:00100000:1.0:1763333175.251121:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+8:3655:x1848987627267584:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1763333175.251132:0:29013:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:571 count 1 00010000:00010000:1.0:1763333175.251144:0:29013:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c569d7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.251157:0:29013:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5686b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969904 expref: 12 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.251161:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c569bb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969974 expref: 238 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.251170:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333175.251171:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b6:0x0].0x0 (ffff92ff42c64200) 00010000:00010000:1.0:1763333175.251172:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333175.251174:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763333175.251175:0:29013:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c569d7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x23b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.251185:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c569b4 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1b6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969974 expref: 238 pid: 12741 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763333175.251194:0:29013:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5686b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969904 expref: 12 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.251199:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c569bb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969974 expref: 237 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.251205:0:29013:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5686b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969904 expref: 12 pid: 28650 timeout: 1379 lvb_type: 0 00000100:00100000:1.0:1763333175.251216:0:29013:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e1a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29013:1848987627268096:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333175.251229:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b6:0x0].0x0 (ffff92ff42c64200) 00010000:00010000:3.0:1763333175.251232:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763333175.251234:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48190200, rc 0) 00000100:00100000:1.0:1763333175.251250:0:29013:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff6be07780 going to sleep for 11 seconds 00000100:00100000:3.0:1763333175.251254:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:55917:x1848987613719936:12345-192.168.204.28@tcp:101:bash.0 Request processed in 5762us (5945us total) trans 4294972335 rc 0/0 00000100:00100000:3.0:1763333175.251261:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9332 00000100:00100000:1.0:1763333175.251265:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6566 00000100:00100000:1.0:1763333175.251271:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+8:3655:x1848987627267968:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333175.251387:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+9:3655:x1848987627267968:12345-0@lo:2:osp-syn-0-1.0 Request processed in 116us (327us total) trans 21474838901 rc 0/0 00000100:00100000:1.0:1763333175.251394:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6566 00010000:00010000:2.0:1763333175.251492:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763333175.252482:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44de0380/2, rc 0, transno 21474838901 00000100:00100000:2.0:1763333175.252491:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44de0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627267968:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333175.253561:0:6506:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4920dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6506:1848987627266816:192.168.204.28@tcp:105: 00010000:00010000:1.0:1763333175.253586:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333175.253653:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:2421:x1848987613719680:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 8042us (8386us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333175.253663:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3064 00000100:00100000:3.0:1763333175.254680:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333175.254776:0:28650:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28650:1848987627267456:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333175.254800:0:28650:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c569c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x23b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333175.254974:0:29013:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e1a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29013:1848987627268096:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333175.254989:0:29013:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c569d7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333175.255215:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.255531:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613720448 00000100:00100000:2.0:1763333175.255538:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613720448 00010000:00010000:2.0:1763333175.255574:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56872 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x23b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696990b expref: 29 pid: 28650 timeout: 1379 lvb_type: 0 00000100:00100000:2.0:1763333175.255813:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613720576 00000100:00100000:2.0:1763333175.255818:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613720576 00010000:00010000:2.0:1763333175.255832:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5686b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969904 expref: 13 pid: 28650 timeout: 1379 lvb_type: 0 00000100:00100000:1.0:1763333175.255860:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3065 00000100:00100000:1.0:1763333175.255869:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45182a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:2420:x1848987613720448:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333175.255885:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333175.255891:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56872 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x23b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696990b expref: 29 pid: 28650 timeout: 1379 lvb_type: 0 00010000:00010000:1.0:1763333175.255902:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56872 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x23b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696990b expref: 29 pid: 28650 timeout: 1379 lvb_type: 0 00010000:00010000:1.0:1763333175.255925:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56872 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x23b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696990b expref: 29 pid: 28650 timeout: 1379 lvb_type: 0 00010000:00010000:1.0:1763333175.255940:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333175.255942:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333175.255946:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c569c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x23b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333175.255974:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.255994:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613720704 00000100:00100000:3.0:1763333175.255998:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613720704 00000100:00100000:3.0:1763333175.256025:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6567 00000100:00100000:3.0:1763333175.256032:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:55917:x1848987613720704:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333175.256046:0:29010:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1763333175.256105:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3066 00000100:00100000:0.0:1763333175.256114:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45183b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2420:x1848987613720576:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333175.256123:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333175.256127:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5686b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969904 expref: 13 pid: 28650 timeout: 1379 lvb_type: 0 00010000:00010000:0.0:1763333175.256137:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5686b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969904 expref: 13 pid: 28650 timeout: 1379 lvb_type: 0 00010000:00010000:1.0:1763333175.256153:0:28428:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c569c2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x23b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.256153:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5686b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969904 expref: 13 pid: 28650 timeout: 1379 lvb_type: 0 00010000:00010000:0.0:1763333175.256167:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333175.256169:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333175.256172:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c569d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.256179:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c569d7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x23b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.256196:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333175.256216:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333175.256244:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45183b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:2420:x1848987613720576:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 132us (1028us total) trans 0 rc 0/0 00010000:00010000:2.0:1763333175.256245:0:28650:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c569c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333175.256252:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3066 00010000:00010000:2.0:1763333175.256253:0:28650:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c569c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.256262:0:28650:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c569c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.256279:0:28650:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c569c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.256296:0:28650:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763333175.256302:0:29010:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c569de lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696997b expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333175.256318:0:29010:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x23d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333175.256331:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333175.256333:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333175.256339:0:29010:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c569de lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696997b expref: 30 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.256371:0:29010:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c569de lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696997b expref: 30 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.256386:0:29010:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48190e00, rc 0) 00000100:00100000:1.0:1763333175.256439:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45182a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:2420:x1848987613720448:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 570us (1760us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333175.256446:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3065 00010000:00010000:1.0:1763333175.256465:0:29013:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c569d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.256483:0:29013:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c569d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333175.256489:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:1.0:1763333175.256491:0:29013:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c569d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.256498:0:29013:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c569d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.256511:0:29013:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1763333175.256512:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613720320 00000100:00100000:0.0:1763333175.256516:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613720320 00000100:00100000:0.0:1763333175.256543:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3187 00000100:00100000:0.0:1763333175.256549:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56868:x1848987613720320:12345-192.168.204.28@tcp:35:lfs.0 00000004:00010000:0.0:1763333175.256592:0:19668:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x240000404:0x1b3:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c5675a lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1b3:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696989b expref: 237 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.256626:0:19668:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c569e5 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19668 initiator: MDT0 00010000:00010000:0.0:1763333175.256637:0:19668:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c567fb lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698d3 expref: 237 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.256645:0:19668:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c569e5 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333175.256673:0:19668:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c567fb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698d3 expref: 237 pid: 6521 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333175.256674:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+9:3655:x1848987627267584:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5552us (5652us total) trans 21474838902 rc 0/0 00000100:00100000:1.0:1763333175.256681:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6565 00010000:00010000:0.0:1763333175.256685:0:19668:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c567fb lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698d3 expref: 237 pid: 6521 timeout: 1379 lvb_type: 0 00000100:00100000:0.0:1763333175.256699:0:19668:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:19668:1848987627268224:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333175.256701:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1763333175.256708:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c569c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.256714:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700f000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333175.256719:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c569c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.256727:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c569c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.256738:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c569c2 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.256746:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c569c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333175.256749:0:19668:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe43aa6900 going to sleep for 11 seconds 00010000:00010000:1.0:1763333175.256761:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333175.256764:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c569d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.256769:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e800 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333175.256772:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c569d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.256778:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c569d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.256787:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c569d7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.256794:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c569d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.256806:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333175.256808:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333175.256809:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763333175.256842:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4920ce00/2, rc 0, transno 21474838902 00000100:00100000:1.0:1763333175.256849:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4920ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627267584:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763333175.256893:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:55917:x1848987613720704:12345-192.168.204.28@tcp:101:bash.0 Request processed in 859us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333175.256899:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6567 00000100:00100000:2.0:1763333175.257154:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+37:3655:x1848987627266944:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8233us (8332us total) trans 17179871599 rc 0/0 00000100:00100000:2.0:1763333175.257163:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6558 00010000:00010000:2.0:1763333175.257182:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763333175.257230:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe46e2ce00/2, rc 0, transno 17179871599 00000100:00100000:1.0:1763333175.257236:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46e2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627266944:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763333175.259531:0:19668:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:19668:1848987627268224:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333175.259531:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:2.0:1763333175.259559:0:19668:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c569e5 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19668 initiator: MDT1 00000100:00100000:0.0:1763333175.259568:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.259631:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613720960 00000100:00100000:3.0:1763333175.259638:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613720960 00000100:00100000:3.0:1763333175.259694:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6568 00000100:00100000:3.0:1763333175.259703:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e0f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:55917:x1848987613720960:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333175.259722:0:28650:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333175.259748:0:28650:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe48190c00/0xb32e3ef184c569ec lrc: 2/0,0 mode: --/PW res: [0x280000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969982 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333175.259770:0:28650:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x23d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333175.259791:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333175.259794:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333175.259802:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe48190c00/0xb32e3ef184c569ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969982 expref: 13 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.259817:0:28650:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe48190c00/0xb32e3ef184c569ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969982 expref: 13 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.259831:0:28650:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48190c00, rc 0) 00000100:00100000:1.0:1763333175.259839:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613720832 00000100:00100000:1.0:1763333175.259843:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613720832 00010000:00010000:1.0:1763333175.259867:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c567fb lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698d3 expref: 238 pid: 6521 timeout: 1379 lvb_type: 0 00000100:00100000:3.0:1763333175.259896:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e0f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:55917:x1848987613720960:12345-192.168.204.28@tcp:101:bash.0 Request processed in 193us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333175.259898:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3067 00000100:00100000:3.0:1763333175.259903:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6568 00000100:00100000:1.0:1763333175.259905:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:2421:x1848987613720832:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333175.259914:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333175.259921:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c567fb lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698d3 expref: 238 pid: 6521 timeout: 1379 lvb_type: 0 00010000:00010000:1.0:1763333175.259932:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c567fb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698d3 expref: 238 pid: 6521 timeout: 1379 lvb_type: 0 00010000:00010000:1.0:1763333175.259965:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c567fb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369698d3 expref: 238 pid: 6521 timeout: 1379 lvb_type: 0 00010000:00010000:1.0:1763333175.259979:0:28428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:1.0:1763333175.259983:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c569e5 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19668 initiator: MDT1 00010000:00010000:1.0:1763333175.259991:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c569e5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19668 initiator: MDT1 00010000:00010000:1.0:1763333175.259997:0:28428:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c569e5 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19668 initiator: MDT1 00010000:00010000:1.0:1763333175.260014:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333175.260034:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:2421:x1848987613720832:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 130us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333175.260054:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3067 00010000:00010000:2.0:1763333175.260080:0:19668:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c569e5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333175.260087:0:19668:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c569e5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19668 initiator: MDT1 00000040:00080000:2.0:1763333175.260345:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1423, 88 off120120 00000004:00080000:2.0:1763333175.260373:0:19668:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1279340023197ns, next at 1279713547966ns, rc = 0 00000040:00080000:2.0:1763333175.260413:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1424, 88 off120120 00000004:00080000:2.0:1763333175.260417:0:19668:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1279340068524ns, next at 1280195897991ns, rc = 0 00000040:00080000:2.0:1763333175.260446:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1425, 88 off120208 00000004:00080000:2.0:1763333175.260450:0:19668:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1279340101347ns, next at 1280195897991ns, rc = 0 00000040:00080000:2.0:1763333175.260460:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1424, 88 off120208 00000004:00080000:2.0:1763333175.260463:0:19668:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1279340114457ns, next at 1279713547966ns, rc = 0 00000100:00100000:0.0:1763333175.263080:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333175.263122:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.263239:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613721088 00000100:00100000:1.0:1763333175.263250:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613721088 00002000:00010000:1.0:1763333175.263292:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/573 (0->18446744073709551615) 00002000:00100000:1.0:1763333175.263297:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe472f3b80 with x1848987613721088 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333175.263311:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe472f3b80. 00000100:00100000:1.0:1763333175.263339:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613721216 00000100:00100000:1.0:1763333175.263342:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613721216 00002000:00010000:1.0:1763333175.263387:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/573 (0->18446744073709551615) 00002000:00100000:1.0:1763333175.263390:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe472f0000 with x1848987613721216 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333175.263396:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe472f0000. 00000100:00100000:1.0:1763333175.263414:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1623 00000100:00100000:1.0:1763333175.263422:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:2421:x1848987613721088:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:1.0:1763333175.263596:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x23d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333175.263600:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x23d:0x0] updating lvb mtime from disk: 0 -> 1763333175 00002000:00010000:1.0:1763333175.263603:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x23d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333175.263605:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x23d:0x0] updating lvb ctime from disk: 0 -> 1763333175 00002000:00010000:1.0:1763333175.263607:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x23d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333175.263655:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:2421:x1848987613721088:12345-192.168.204.28@tcp:10:bash.0 Request processed in 233us (596us total) trans 17179871600 rc 0/0 00000100:00100000:2.0:1763333175.263664:0:28430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1624 00000100:00100000:2.0:1763333175.263675:0:28430:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2421:x1848987613721216:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:2.0:1763333175.263769:0:28430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x23d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333175.263773:0:28430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x23d:0x0] updating lvb mtime from disk: 0 -> 1763333175 00002000:00010000:2.0:1763333175.263774:0:28430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x23d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333175.263776:0:28430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x23d:0x0] updating lvb ctime from disk: 0 -> 1763333175 00002000:00010000:2.0:1763333175.263778:0:28430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x23d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333175.263801:0:28430:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2421:x1848987613721216:12345-192.168.204.28@tcp:10:bash.0 Request processed in 129us (679us total) trans 21474838903 rc 0/0 00000100:00100000:1.0:1763333175.264129:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1623 00002000:00010000:1.0:1763333175.264135:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/573 (0->18446744073709551615) 00002000:00100000:1.0:1763333175.264138:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe472f3b80 with x1848987613721088 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333175.264144:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe472f3b80. 00000100:00100000:2.0:1763333175.267632:0:28430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1624 00002000:00010000:2.0:1763333175.267646:0:28430:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/573 (0->18446744073709551615) 00002000:00100000:2.0:1763333175.267651:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe472f0000 with x1848987613721216 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333175.267663:0:28430:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe472f0000. 00000001:00080000:2.0:1763333175.269495:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972336 is committed 00000004:00080000:2.0:1763333175.269506:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 932 committed 00000004:00080000:2.0:1763333175.269519:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 936 committed 00000004:00080000:2.0:1763333175.269533:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 935 committed 00000004:00080000:2.0:1763333175.269535:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 931 committed 00000100:00100000:2.0:1763333175.269713:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe45180a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627268352:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333175.269732:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627268608:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333175.269867:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:0.0:1763333175.269911:0:19668:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d614d968 reply state 00000000428a4252 transno 4294972336 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c569e5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19668 initiator: MDT1 00000100:00100000:2.0:1763333175.269913:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627268608 00000100:00100000:2.0:1763333175.269920:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627268608 00010000:00010000:0.0:1763333175.269935:0:19668:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c569e5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333175.269946:0:19668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:0.0:1763333175.269950:0:19668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1763333175.269955:0:19668:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763333175.269962:0:19668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:0.0:1763333175.269965:0:19668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00000100:00100000:2.0:1763333175.269971:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6569 00010000:00010000:0.0:1763333175.269973:0:19668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c5675a lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1b3:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696989b expref: 236 pid: 8606 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333175.269981:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+37:3653:x1848987627268608:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1763333175.270110:0:28651:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x23a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333175.270114:0:28651:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x23a:0x0] updating lvb mtime from disk: 1763333175 -> 1763333175 00002000:00010000:2.0:1763333175.270116:0:28651:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x23a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333175.270118:0:28651:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x23a:0x0] updating lvb ctime from disk: 1763333175 -> 1763333175 00002000:00010000:2.0:1763333175.270121:0:28651:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x23a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333175.270174:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe45181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627268736:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333175.270190:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00080000:0.0:1763333175.270194:0:19668:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1763333175.270197:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627268480:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333175.270209:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333175.270212:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56868:x1848987613720320:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 13659us (13718us total) trans 4294972336 rc 0/0 00000100:00100000:0.0:1763333175.270231:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3187 00000100:00100000:1.0:1763333175.270234:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333175.270247:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627268736 00000100:00100000:3.0:1763333175.270251:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627268736 00010000:00010000:0.0:1763333175.270264:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c569e5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19668 initiator: MDT1 00000100:00100000:1.0:1763333175.270267:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627268352 00000100:00100000:1.0:1763333175.270272:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627268352 00000100:00100000:3.0:1763333175.270275:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6570 00010000:00010000:0.0:1763333175.270276:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c569e5 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19668 initiator: MDT1 00000100:00100000:3.0:1763333175.270284:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+10:3654:x1848987627268736:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1763333175.270289:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c569e5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19668 initiator: MDT1 00000100:00100000:1.0:1763333175.270297:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6571 00010000:00010000:0.0:1763333175.270301:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700f400 already unused, calling callback (ffffffffc17b3550) 00000100:00100000:1.0:1763333175.270306:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+10:3655:x1848987627268352:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1763333175.270308:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c569e5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333175.270318:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c569e5 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333175.270329:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:0.0:1763333175.270332:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333175.270336:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c569e5 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333175.270343:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c569e5 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19668 initiator: MDT1 00002000:00010000:3.0:1763333175.270386:0:29010:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x23a:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1763333175.270386:0:29013:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x239:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333175.270391:0:29010:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x23a:0x0] updating lvb mtime from disk: 1763333175 -> 1763333175 00002000:00010000:1.0:1763333175.270391:0:29013:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x239:0x0] updating lvb mtime from disk: 1763333175 -> 1763333175 00002000:00010000:3.0:1763333175.270394:0:29010:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x23a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333175.270394:0:29013:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x239:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333175.270397:0:29010:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x23a:0x0] updating lvb ctime from disk: 1763333175 -> 1763333175 00002000:00010000:1.0:1763333175.270397:0:29013:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x239:0x0] updating lvb ctime from disk: 1763333175 -> 1763333175 00002000:00010000:3.0:1763333175.270399:0:29010:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x23a:0x0] updating lvb blocks from disk: 8 -> 8 00002000:00010000:1.0:1763333175.270399:0:29013:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x239:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333175.270431:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+12:3654:x1848987627268736:12345-0@lo:2:osp-syn-0-1.0 Request processed in 148us (223us total) trans 21474838904 rc 0/0 00000100:00100000:1.0:1763333175.270431:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+12:3655:x1848987627268352:12345-0@lo:2:osp-syn-0-1.0 Request processed in 126us (202us total) trans 21474838905 rc 0/0 00000100:00100000:1.0:1763333175.270438:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6571 00000004:00080000:1.0:1763333175.270498:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe45180a80/2, rc 0, transno 21474838905 00000100:00100000:1.0:1763333175.270504:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe45180a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627268352:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333175.271359:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+38:3653:x1848987627268608:12345-0@lo:2:osp-syn-1-1.0 Request processed in 1364us (1477us total) trans 17179871601 rc 0/0 00000100:00100000:3.0:1763333175.272191:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6570 00000004:00080000:3.0:1763333175.272265:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe45181c00/2, rc 0, transno 21474838904 00000100:00100000:3.0:1763333175.272272:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe45181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627268736:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333175.272306:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1763333175.272415:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44e18000/2, rc 0, transno 17179871601 00000100:00100000:3.0:1763333175.272421:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627268608:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333175.272441:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627268480 00000100:00100000:3.0:1763333175.272446:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627268480 00000100:00100000:1.0:1763333175.273040:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6572 00000100:00100000:1.0:1763333175.273053:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+39:3653:x1848987627268480:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333175.273125:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6569 00002000:00010000:1.0:1763333175.273201:0:8407:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x239:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1763333175.273205:0:8407:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x239:0x0] updating lvb mtime from disk: 1763333175 -> 1763333175 00002000:00010000:1.0:1763333175.273207:0:8407:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x239:0x0] updating lvb atime from disk: 1763333174 -> 1763333174 00002000:00010000:1.0:1763333175.273209:0:8407:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x239:0x0] updating lvb ctime from disk: 1763333175 -> 1763333175 00002000:00010000:1.0:1763333175.273212:0:8407:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x239:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1763333175.273282:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+39:3653:x1848987627268480:12345-0@lo:2:osp-syn-1-1.0 Request processed in 233us (974us total) trans 17179871602 rc 0/0 00000100:00100000:1.0:1763333175.273292:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6572 00000004:00080000:0.0:1763333175.273315:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44e1a680/2, rc 0, transno 17179871602 00000100:00100000:0.0:1763333175.273324:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627268480:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333175.274025:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.274753:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613721472 00000100:00100000:2.0:1763333175.274763:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613721472 00000100:00100000:2.0:1763333175.274817:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3188 00000100:00100000:2.0:1763333175.274827:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+235:55917:x1848987613721472:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:2.0:1763333175.275121:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:55917:x1848987613721472:12345-192.168.204.28@tcp:35:bash.0 Request processed in 295us (1098us total) trans 4294972337 rc 0/0 00000100:00100000:2.0:1763333175.275129:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3188 00000100:00100000:0.0:1763333175.279115:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.279190:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613721600 00000100:00100000:3.0:1763333175.279201:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613721600 00000100:00100000:3.0:1763333175.279263:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9333 00000100:00100000:3.0:1763333175.279273:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+236:56868:x1848987613721600:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333175.279296:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333175.279318:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c569f3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969989 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.279404:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c569f3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969989 expref: 237 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.279419:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190400/0xb32e3ef184c569f3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969989 expref: 237 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.279440:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:3.0:1763333175.279443:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763333175.279447:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48190400, rc 0) 00000100:00100000:3.0:1763333175.279531:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56868:x1848987613721600:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 258us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333175.279537:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9333 00000100:00100000:0.0:1763333175.290641:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333175.294198:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.294423:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613721728 00000100:00100000:2.0:1763333175.294436:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613721728 00000100:00100000:2.0:1763333175.294518:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9334 00000100:00100000:2.0:1763333175.294530:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56873:x1848987613721728:12345-192.168.204.28@tcp:101:rm.0 00010000:00010000:2.0:1763333175.294558:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1763333175.294576:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613721984 00000100:00100000:3.0:1763333175.294583:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613721984 00010000:00010000:2.0:1763333175.294584:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c569fa lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969990 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333175.294616:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3189 00000100:00100000:3.0:1763333175.294624:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56868:x1848987613721984:12345-192.168.204.28@tcp:35:lfs.0 00010000:00010000:2.0:1763333175.294665:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56a01 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333175.294680:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56a01 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.294692:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56a01 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.294705:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56a08 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333175.294713:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56a08 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.294719:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56a08 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.294794:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56a0f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333175.294803:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56a0f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.294810:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56a0f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00080000:3.0:1763333175.294839:0:19668:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x1b3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000004:00200000:2.0:1763333175.294840:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b6:0x0]: returning size 5 00000004:00200000:2.0:1763333175.294846:0:6519:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763333175.294865:0:6519:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56a0f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.294877:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56a0f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.294885:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56a01 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000040:00080000:3.0:1763333175.294891:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1425, 64 off120272 00010000:00010000:2.0:1763333175.294891:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56a01 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.294902:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56a01 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.294908:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56a01 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00000040:00080000:3.0:1763333175.294914:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1426, 64 off120272 00010000:00010000:2.0:1763333175.294919:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333175.294924:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56a01 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00000040:00080000:3.0:1763333175.294925:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1427, 64 off120336 00000040:00080000:3.0:1763333175.294936:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1426, 64 off120336 00010000:00010000:2.0:1763333175.294936:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56a01 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.294953:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff621acc00) 00010000:00010000:2.0:1763333175.294956:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333175.294961:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56a01 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.294967:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56a01 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.294981:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56a08 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.294986:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56a08 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.294989:0:19668:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56a16 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19668 initiator: MDT0 00010000:00010000:2.0:1763333175.294993:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56a08 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.295004:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333175.295005:0:19668:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56a16 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333175.295007:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56a08 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.295025:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56a08 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.295030:0:19668:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56a16 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333175.295036:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff621ac300) 00010000:00010000:3.0:1763333175.295039:0:19668:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56a16 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1b3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333175.295041:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333175.295047:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56a08 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.295050:0:19668:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56a16 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1b3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333175.295061:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56a08 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.295063:0:19668:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56a16 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1b3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 19668 initiator: MDT1 00010000:00010000:3.0:1763333175.295087:0:19668:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763333175.295104:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c569fa lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969990 expref: 241 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.295121:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56a0f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969990 expref: 240 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.295127:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b6:0x0].0x0 (ffff92ff42c64200) 00010000:00010000:2.0:1763333175.295130:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333175.295133:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5400, rc 0) 00000100:00100000:2.0:1763333175.295192:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:56873:x1848987613721728:12345-192.168.204.28@tcp:101:rm.0 Request processed in 664us (4561us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333175.295199:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9334 00000100:00100000:3.0:1763333175.295248:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56868:x1848987613721984:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 622us (1059us total) trans 4294972338 rc 0/0 00000100:00100000:3.0:1763333175.295256:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3189 00010000:00010000:2.0:1763333175.295257:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333175.295264:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56a16 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1b3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333175.295270:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48191800 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333175.295274:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56a16 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1b3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333175.295280:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56a16 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1b3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333175.295288:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b3:0x0].0x0 (ffff92fe43b44e00) 00010000:00010000:2.0:1763333175.295290:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1763333175.295294:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56a16 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1b3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333175.295298:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56a16 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1b3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333175.295308:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333175.295310:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333175.295312:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763333175.306500:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.306812:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613722240 00000100:00100000:3.0:1763333175.306822:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613722240 00000100:00100000:3.0:1763333175.306890:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9335 00000100:00100000:3.0:1763333175.306900:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56868:x1848987613722240:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333175.306930:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333175.306953:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c56a1d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969997 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.307074:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56a24 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333175.307088:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56a24 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x1b6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.307100:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56a24 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x1b6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:3.0:1763333175.307112:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b6:0x0]: returning size 5 00010000:00010000:3.0:1763333175.307214:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c56a1d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b6:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969997 expref: 242 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.307231:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56a24 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b6:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969997 expref: 241 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.307240:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b6:0x0].0x0 (ffff92ff42c64200) 00010000:00010000:3.0:1763333175.307242:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1763333175.307245:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a97000, rc 0) 00000100:00100000:3.0:1763333175.307311:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56868:x1848987613722240:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 412us (821us total) trans 4294972339 rc 0/0 00000100:00100000:3.0:1763333175.307318:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9335 00000100:00100000:2.0:1763333175.310307:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.310391:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.310404:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613722624 00000100:00100000:0.0:1763333175.310452:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613722496 00000100:00100000:0.0:1763333175.310462:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613722496 00000100:00100000:0.0:1763333175.310529:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9336 00000100:00100000:3.0:1763333175.310555:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613722624 00000100:00100000:3.0:1763333175.310590:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9337 00000100:00100000:3.0:1763333175.310599:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73166300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:56868:x1848987613722624:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333175.310623:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1763333175.310756:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73165c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56873:x1848987613722496:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:0.0:1763333175.310803:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1763333175.310830:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c569bb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969974 expref: 242 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.310852:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56a0f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969990 expref: 241 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.310865:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56991 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696995f expref: 240 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.310876:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b6:0x0].0x0 (ffff92ff42c64200) 00010000:00010000:0.0:1763333175.310881:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333175.310914:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56a32 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333175.310926:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56a32 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.310936:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56a32 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.310947:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c56a39 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333175.310954:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c56a39 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.310964:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c56a39 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.311041:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56a40 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333175.311051:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56a24 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x1b6:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969997 expref: 239 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.311059:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56a40 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1b6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.311266:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56a47 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696999e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.311335:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c56a4e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333175.311343:0:6521:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56a40 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b6:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.311384:0:6521:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c56a4e lrc: 4/1,0 mode: --/PR res: [0x240000404:0x1b6:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333175.311397:0:6521:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56a40 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1b6:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.311406:0:6521:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c56a4e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b6:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.312984:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56a24 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b6:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969997 expref: 240 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.313002:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56a24 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1b6:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969997 expref: 240 pid: 12741 timeout: 1379 lvb_type: 0 00000100:00100000:0.0:1763333175.313019:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627268864:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333175.313118:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe43aa6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1763333175.318681:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.319176:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613722752 00000100:00100000:3.0:1763333175.319187:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613722752 00010000:00010000:3.0:1763333175.319231:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56a24 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x1b6:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969997 expref: 241 pid: 12741 timeout: 1379 lvb_type: 0 00000100:00100000:3.0:1763333175.319275:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3068 00000100:00100000:3.0:1763333175.319284:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:2421:x1848987613722752:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333175.319298:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333175.319309:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56a24 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x1b6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969997 expref: 241 pid: 12741 timeout: 1379 lvb_type: 0 00010000:00010000:3.0:1763333175.319322:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56a24 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1b6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969997 expref: 241 pid: 12741 timeout: 1379 lvb_type: 0 00010000:00010000:3.0:1763333175.319376:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b6:0x0].0x0 (ffff92ff42c64200) 00010000:00010000:3.0:1763333175.319381:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56a40 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b6:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.319390:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56a40 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b6:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.319397:0:6504:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56a40 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1b6:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.319408:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c56a4e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b6:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333175.319415:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c56a4e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b6:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333175.319420:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c56a4e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b6:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333175.319436:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333175.319491:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:2421:x1848987613722752:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 208us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333175.319498:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3068 00010000:00010000:2.0:1763333175.319597:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56a24 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b6:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969997 expref: 240 pid: 12741 timeout: 1379 lvb_type: 0 00000100:00100000:2.0:1763333175.319611:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627268864:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333175.319631:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56a40 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.319639:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56a40 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.319645:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56a40 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6519 initiator: MDT1 00000004:00080000:2.0:1763333175.319890:0:6519:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x1b6:0x0] is inserted into orphan list, open count = 1 00010000:00010000:2.0:1763333175.319968:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56a40 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.319975:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56a40 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1b6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.319982:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56a40 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1b6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.319991:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700f400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333175.319995:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56a40 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1b6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.320002:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56a40 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1b6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.320011:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b6:0x0].0x0 (ffff92ff42c64200) 00010000:00010000:2.0:1763333175.320013:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763333175.320015:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c56a4e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b6:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.320022:0:6519:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c56a4e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.320027:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c56a4e lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x1b6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.320054:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56a40 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1b6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.320061:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56a40 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1b6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.320074:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56a32 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.320080:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56a32 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.320085:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56a32 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.320091:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56a32 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.320096:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700fe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333175.320099:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56a32 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.320104:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56a32 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.320111:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44b00) 00010000:00010000:2.0:1763333175.320113:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333175.320115:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56a32 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.320121:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56a32 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:2.0:1763333175.320133:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000fe71fd71 reply state 00000000285d893c transno 4294972340 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c56a39 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.320144:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c56a39 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.320149:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b44900) 00010000:00010000:2.0:1763333175.320151:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333175.320154:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763333175.320196:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73165c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56873:x1848987613722496:12345-192.168.204.28@tcp:36:rm.0 Request processed in 9657us (9804us total) trans 4294972340 rc 0/0 00000100:00100000:2.0:1763333175.320202:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9336 00010000:00010000:3.0:1763333175.321475:0:6521:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c56a4e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333175.321488:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c56a4e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:3.0:1763333175.321530:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b6:0x0]: returning size 5 00000004:00200000:3.0:1763333175.321535:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763333175.321552:0:6521:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c56a4e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333175.321587:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56a47 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696999e expref: 241 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.321603:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97800/0xb32e3ef184c56a4e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696999e expref: 240 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.321611:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b6:0x0].0x0 (ffff92ff42c64200) 00010000:00010000:3.0:1763333175.321614:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333175.321617:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a97800, rc 0) 00000100:00100000:3.0:1763333175.321667:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73166300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:56868:x1848987613722624:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 11069us (11368us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333175.321675:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9337 00000100:00100000:0.0:1763333175.330326:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.330446:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613723008 00000100:00100000:3.0:1763333175.330456:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613723008 00000100:00100000:3.0:1763333175.330521:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3190 00000100:00100000:3.0:1763333175.330533:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7ad48050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:56868:x1848987613723008:12345-192.168.204.28@tcp:35:lfs.0 00000004:00080000:3.0:1763333175.330826:0:19668:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x1b6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1763333175.330888:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1427, 64 off120400 00000040:00080000:3.0:1763333175.330914:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1428, 64 off120400 00000040:00080000:3.0:1763333175.330923:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1429, 64 off120464 00000040:00080000:3.0:1763333175.330932:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1428, 64 off120464 00010000:00010000:3.0:1763333175.330995:0:19668:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c56a55 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19668 initiator: MDT0 00010000:00010000:3.0:1763333175.331013:0:19668:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c56a55 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 19668 initiator: MDT1 00010000:00010000:3.0:1763333175.331024:0:19668:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c56a55 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19668 initiator: MDT1 00010000:00010000:3.0:1763333175.331033:0:19668:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c56a55 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1b6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19668 initiator: MDT1 00010000:00010000:3.0:1763333175.331039:0:19668:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c56a55 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1b6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19668 initiator: MDT1 00010000:00010000:3.0:1763333175.331044:0:19668:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c56a55 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1b6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19668 initiator: MDT1 00010000:00010000:3.0:1763333175.331067:0:19668:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763333175.331252:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7ad48050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56868:x1848987613723008:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 720us (934us total) trans 4294972341 rc 0/0 00000100:00100000:3.0:1763333175.331261:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3190 00010000:00010000:0.0:1763333175.331673:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333175.331681:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c56a55 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1b6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333175.331688:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333175.331691:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c56a55 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1b6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333175.331701:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c56a55 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1b6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333175.331725:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b6:0x0].0x0 (ffff92ff42c64200) 00010000:00010000:0.0:1763333175.331728:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763333175.331734:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c56a55 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1b6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333175.331739:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c56a55 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1b6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333175.331750:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333175.331752:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333175.331753:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763333175.334463:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.334657:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613723136 00000100:00100000:3.0:1763333175.334667:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613723136 00000100:00100000:2.0:1763333175.334795:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9338 00000100:00100000:2.0:1763333175.334808:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56874:x1848987613723136:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333175.334829:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333175.334853:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56a5c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369699a5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.334929:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56a63 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333175.334943:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56a63 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.334954:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56a63 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.334965:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56a6a lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333175.334973:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56a6a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.334979:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56a6a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.335023:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56a63 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.335031:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56a63 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.335037:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56a63 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.335043:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56a63 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.335049:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333175.335053:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56a63 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.335060:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56a63 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.335072:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff621acc00) 00010000:00010000:2.0:1763333175.335075:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333175.335079:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56a63 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.335086:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56a63 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.335100:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56a6a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.335106:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56a6a lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.335111:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56a6a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.335115:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333175.335118:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56a6a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.335123:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56a6a lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.335130:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b44900) 00010000:00010000:2.0:1763333175.335132:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333175.335135:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56a6a lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.335141:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56a6a lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.335170:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56a5c lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699a5 expref: 242 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.335181:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff621acc00) 00010000:00010000:2.0:1763333175.335184:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333175.335188:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56a5c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699a5 expref: 242 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.335203:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4000, rc 0) 00000100:00100000:2.0:1763333175.335288:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56874:x1848987613723136:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 482us (836us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333175.335296:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9338 00000100:00100000:1.0:1763333175.343393:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333175.344537:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613723264 00000100:00100000:0.0:1763333175.344552:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613723264 00000100:00100000:0.0:1763333175.344624:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9339 00000100:00100000:0.0:1763333175.344635:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56874:x1848987613723264:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333175.344659:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333175.344681:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56a71 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369699ac expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.344744:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56a78 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333175.344759:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56a78 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.344771:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56a78 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.344786:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56a7f lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333175.344793:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56a7f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.344798:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56a7f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.344837:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56a78 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.344843:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56a78 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.344849:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56a78 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.344856:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56a78 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.344863:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700ee00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333175.344866:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56a78 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.344873:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56a78 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.344884:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44800) 00010000:00010000:0.0:1763333175.344886:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333175.344890:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56a78 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.344896:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56a78 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.344911:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56a7f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.344917:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56a7f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.344923:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56a7f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.344927:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700fe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333175.344929:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56a7f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.344935:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56a7f lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.344940:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b44900) 00010000:00010000:0.0:1763333175.344943:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333175.344945:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56a7f lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.344950:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56a7f lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.344973:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56a71 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699ac expref: 242 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.344982:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44800) 00010000:00010000:0.0:1763333175.344984:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333175.344988:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56a71 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699ac expref: 242 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.345005:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4700f000, rc 0) 00000100:00100000:0.0:1763333175.345076:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56874:x1848987613723264:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 443us (1732us total) trans 0 rc 301/301 00000100:00100000:0.0:1763333175.345084:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9339 00000100:00100000:1.0:1763333175.348253:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.348327:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613723520 00000100:00100000:2.0:1763333175.348339:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613723520 00000100:00100000:2.0:1763333175.348431:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9340 00000100:00100000:2.0:1763333175.348440:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56868:x1848987613723520:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333175.348458:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333175.348489:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56a86 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369699b3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.348564:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56a8d lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333175.348577:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56a8d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.348587:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56a8d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.348599:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56a94 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333175.348606:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56a94 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.348612:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56a94 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.348655:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56a8d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.348662:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56a8d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.348669:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56a8d lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.348675:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56a8d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.348681:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333175.348685:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56a8d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.348692:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56a8d lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.348703:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff621acc00) 00010000:00010000:2.0:1763333175.348706:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333175.348710:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56a8d lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.348715:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56a8d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.348729:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56a94 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.348734:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56a94 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.348739:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56a94 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.348743:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333175.348745:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56a94 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.348750:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56a94 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.348756:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b44900) 00010000:00010000:2.0:1763333175.348758:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333175.348760:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56a94 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.348765:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56a94 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.348795:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56a86 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699b3 expref: 242 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.348804:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff621acc00) 00010000:00010000:2.0:1763333175.348806:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763333175.348810:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56a86 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699b3 expref: 242 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.348828:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4000, rc 0) 00000100:00100000:2.0:1763333175.348898:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56868:x1848987613723520:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 459us (654us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333175.348904:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9340 00000100:00100000:1.0:1763333175.350458:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333175.350537:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613723648 00000100:00100000:0.0:1763333175.350545:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613723648 00000100:00100000:0.0:1763333175.350599:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9341 00000100:00100000:0.0:1763333175.350608:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56874:x1848987613723648:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333175.350625:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333175.350648:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56a9b lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369699ba expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.350714:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c56aa2 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333175.350728:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c56aa2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.350738:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c56aa2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:0.0:1763333175.350784:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1763333175.350789:0:6519:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763333175.350822:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56a9b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699ba expref: 243 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.350840:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c56aa2 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699ba expref: 242 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.350853:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44100) 00010000:00010000:0.0:1763333175.350856:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1763333175.350860:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feb400, rc 0) 00000100:00100000:0.0:1763333175.350903:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:56874:x1848987613723648:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 297us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333175.350910:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9341 00000100:00100000:1.0:1763333175.357593:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.357712:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613723776 00000100:00100000:2.0:1763333175.357725:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613723776 00000100:00100000:2.0:1763333175.357802:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9342 00000100:00100000:2.0:1763333175.357814:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:56874:x1848987613723776:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333175.357836:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333175.357864:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56aa9 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369699c1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.357936:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56ab0 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333175.357951:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56ab0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.357963:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56ab0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.357976:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56ab7 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333175.357982:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56ab7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.357988:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56ab7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.358035:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56ab0 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.358041:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56ab0 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.358048:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56ab0 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.358054:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56ab0 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.358059:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333175.358064:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56ab0 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.358071:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56ab0 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.358082:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44100) 00010000:00010000:2.0:1763333175.358086:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333175.358090:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56ab0 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.358095:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56ab0 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.358107:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56ab7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.358112:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56ab7 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.358117:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56ab7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.358122:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333175.358124:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56ab7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.358129:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56ab7 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.358136:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b44900) 00010000:00010000:2.0:1763333175.358138:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333175.358140:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56ab7 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.358145:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56ab7 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.358169:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56aa9 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699c1 expref: 243 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.358179:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44100) 00010000:00010000:2.0:1763333175.358181:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333175.358185:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56aa9 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699c1 expref: 243 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.358194:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4000, rc 0) 00000100:00100000:2.0:1763333175.358933:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:56874:x1848987613723776:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1117us (1346us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333175.358942:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9342 00000100:00100000:3.0:1763333175.361628:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.361785:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613724032 00000100:00100000:2.0:1763333175.361796:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613724032 00000100:00100000:2.0:1763333175.361849:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9343 00000100:00100000:2.0:1763333175.361859:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:56874:x1848987613724032:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333175.361880:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333175.361884:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763333175.361911:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c56aa2 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699ba expref: 242 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.361933:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44100) 00010000:00010000:2.0:1763333175.361944:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333175.361963:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56abe lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369699c8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.362072:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56ac5 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333175.362084:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56ac5 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.362093:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56ac5 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.362102:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56acc lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333175.362109:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56acc lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.362115:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56acc lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.364436:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56ad3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333175.364461:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56ad3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.364480:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56ad3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:2.0:1763333175.364491:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b8:0x0]: returning size 0 00010000:00010000:2.0:1763333175.364521:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56ac5 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.364527:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56ac5 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.364534:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56ac5 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.364540:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56ac5 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.364545:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333175.364550:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56ac5 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.364567:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56ac5 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.364579:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff621acc00) 00010000:00010000:2.0:1763333175.364582:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333175.364587:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56ac5 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.364593:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56ac5 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000004:00010000:2.0:1763333175.364612:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000eca1f133 reply state 000000000839c1ac transno 4294972342 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56acc lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.364623:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56acc lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.364628:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b44900) 00010000:00010000:2.0:1763333175.364631:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333175.364634:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763333175.364671:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56abe lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699c8 expref: 244 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.364691:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56ad3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699c8 expref: 243 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.364699:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac300) 00010000:00010000:2.0:1763333175.364702:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333175.364704:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48191600, rc 0) 00000100:00100000:2.0:1763333175.364772:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56874:x1848987613724032:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 2914us (3155us total) trans 4294972342 rc 0/0 00000100:00100000:2.0:1763333175.364781:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9343 00000100:00100000:1.0:1763333175.374948:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.375726:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613724416 00000100:00100000:2.0:1763333175.375740:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613724416 00000100:00100000:2.0:1763333175.375808:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9344 00000100:00100000:2.0:1763333175.375819:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56874:x1848987613724416:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333175.375844:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333175.375866:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56ae1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1b8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369699cf expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333175.376025:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.376063:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613724544 00000100:00100000:3.0:1763333175.376069:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613724544 00000100:00100000:3.0:1763333175.376103:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9345 00000100:00100000:3.0:1763333175.376112:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56875:x1848987613724544:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333175.376122:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333175.376133:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56ae8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369699d6 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.376226:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56aef lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333175.376230:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56af6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333175.376244:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56aef lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.376259:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56aef lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:3.0:1763333175.376270:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b8:0x0]: returning size 0 00010000:00010000:2.0:1763333175.376316:0:6521:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56ad3 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699c8 expref: 247 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.376325:0:6521:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56aef lrc: 2/1,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.376333:0:6521:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56af6 lrc: 5/0,1 mode: --/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333175.376407:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56ae8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699d6 expref: 249 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.376428:0:12741:0:(ldlm_lockd.c:1463:ldlm_handle_enqueue()) ### save blocking bits 8 in granted lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56aef lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699d6 expref: 248 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.376440:0:12741:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56aef lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699d6 expref: 248 pid: 12741 timeout: 1379 lvb_type: 0 00010000:00010000:3.0:1763333175.376449:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56aef lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699d6 expref: 248 pid: 12741 timeout: 1379 lvb_type: 0 00010000:00010000:3.0:1763333175.376458:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac300) 00010000:00010000:3.0:1763333175.376461:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333175.376464:0:12741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56af6 lrc: 5/0,1 mode: --/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333175.376481:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96400, rc 0) 00000100:00100000:3.0:1763333175.376542:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:56875:x1848987613724544:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 431us (518us total) trans 4294972343 rc 0/0 00000100:00100000:3.0:1763333175.376551:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9345 00010000:00010000:2.0:1763333175.378959:0:6521:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56aef lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699d6 expref: 247 pid: 12741 timeout: 1379 lvb_type: 0 00010000:00010000:2.0:1763333175.378977:0:6521:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56aef lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699d6 expref: 247 pid: 12741 timeout: 1379 lvb_type: 0 00000100:00100000:2.0:1763333175.378993:0:6521:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff73164000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6521:1848987627268992:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333175.379154:0:6521:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56ad3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699c8 expref: 247 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.379165:0:6521:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56ad3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699c8 expref: 247 pid: 6521 timeout: 1379 lvb_type: 0 00000100:00100000:2.0:1763333175.379174:0:6521:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff73166d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6521:1848987627269120:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333175.379201:0:6521:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff742b93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763333175.379936:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333175.380717:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613724672 00000100:00100000:0.0:1763333175.380728:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613724672 00010000:00010000:0.0:1763333175.380778:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56aef lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699d6 expref: 248 pid: 12741 timeout: 1379 lvb_type: 0 00000100:00100000:0.0:1763333175.380818:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3069 00000100:00100000:0.0:1763333175.380828:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:2418:x1848987613724672:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333175.380843:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333175.380849:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56aef lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699d6 expref: 248 pid: 12741 timeout: 1379 lvb_type: 0 00010000:00010000:0.0:1763333175.380866:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56aef lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699d6 expref: 248 pid: 12741 timeout: 1379 lvb_type: 0 00010000:00010000:0.0:1763333175.380887:0:28428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac300) 00010000:00010000:0.0:1763333175.380892:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56af6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.380902:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333175.380954:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:2418:x1848987613724672:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 129us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333175.380965:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3069 00000100:00100000:1.0:1763333175.383027:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.383184:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613724928 00000100:00100000:2.0:1763333175.383194:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613724928 00010000:00010000:3.0:1763333175.383395:0:6521:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.204.28@tcp) returned -22 from blocking AST (req@000000001b4b39a7 x1848987627268992) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56aef lrc: 1/0,0 mode: --/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699d6 expref: 248 pid: 12741 timeout: 1379 lvb_type: 0 00010000:00010000:3.0:1763333175.383428:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56aef lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699d6 expref: 248 pid: 12741 timeout: 1379 lvb_type: 0 00000100:00100000:3.0:1763333175.383446:0:6521:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff73164000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6521:1848987627268992:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333175.383462:0:6521:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff73166d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6521:1848987627269120:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333175.383500:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac300) 00010000:00010000:3.0:1763333175.383506:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56af6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00000100:00100000:2.0:1763333175.383816:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3191 00000100:00100000:2.0:1763333175.383829:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56875:x1848987613724928:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1763333175.383886:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:3.0:1763333175.383940:0:6521:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56af6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000100:00100000:0.0:1763333175.383973:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613725056 00000100:00100000:0.0:1763333175.383981:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613725056 00010000:00010000:0.0:1763333175.384009:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56ad3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699c8 expref: 249 pid: 6521 timeout: 1379 lvb_type: 0 00000100:00100000:2.0:1763333175.384086:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:56875:x1848987613724928:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 260us (1065us total) trans 4294972344 rc 0/0 00000100:00100000:2.0:1763333175.384094:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3191 00000100:00100000:0.0:1763333175.384204:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3070 00000100:00100000:0.0:1763333175.384215:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff44f08c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:2420:x1848987613725056:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333175.384228:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333175.384236:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56ad3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699c8 expref: 248 pid: 6521 timeout: 1379 lvb_type: 0 00010000:00010000:0.0:1763333175.384248:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56ad3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699c8 expref: 248 pid: 6521 timeout: 1379 lvb_type: 0 00010000:00010000:0.0:1763333175.384268:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56ad3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699c8 expref: 248 pid: 6521 timeout: 1379 lvb_type: 0 00010000:00010000:0.0:1763333175.384280:0:28428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac300) 00010000:00010000:0.0:1763333175.384284:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56af6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.384292:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56af6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.384298:0:28428:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56af6 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.384328:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333175.384381:0:6521:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56af6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000100:00100000:0.0:1763333175.384384:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff44f08c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:2420:x1848987613725056:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 171us (499us total) trans 0 rc 0/0 00010000:00010000:2.0:1763333175.384395:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56af6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000100:00100000:0.0:1763333175.384399:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3070 00000004:00200000:2.0:1763333175.384423:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b8:0x0]: returning size 0 00000004:00080000:2.0:1763333175.384600:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x23f:0x0], index 0: 0 00000004:00080000:2.0:1763333175.384606:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x23f:0x0], index 1: 0 00000004:00080000:2.0:1763333175.384611:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x240:0x0], index 1: 0 00000004:00080000:2.0:1763333175.384616:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x240:0x0], index 0: 0 00010000:00010000:2.0:1763333175.384703:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56af6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.384712:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56af6 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.384719:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56af6 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.384726:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48191800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333175.384731:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56af6 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.384739:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56af6 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.384749:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac300) 00010000:00010000:2.0:1763333175.384752:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333175.384756:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56af6 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.384762:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56af6 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.384855:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56ae1 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699cf expref: 247 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.384865:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac300) 00010000:00010000:2.0:1763333175.384868:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763333175.384872:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56ae1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699cf expref: 247 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.384887:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48190200, rc 0) 00000100:00100000:2.0:1763333175.385116:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56874:x1848987613724416:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 9297us (10177us total) trans 4294972345 rc 301/301 00000100:00100000:2.0:1763333175.385124:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9344 00000100:00100000:3.0:1763333175.387128:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.387214:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.387234:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613725312 00000100:00100000:2.0:1763333175.387244:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613725312 00000100:00100000:2.0:1763333175.387314:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9346 00000100:00100000:2.0:1763333175.387326:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56875:x1848987613725312:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333175.387377:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333175.387409:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56b0b lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369699dd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.387516:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56b12 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333175.387532:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56b12 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.387544:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56b12 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.387555:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56b19 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333175.387562:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56b19 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.387569:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56b19 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.387698:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56b20 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333175.387707:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56b20 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.387714:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56b20 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.387806:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56b12 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.387814:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56b12 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.387821:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56b12 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.387827:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56b12 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.387833:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333175.387837:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56b12 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.387844:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56b12 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.387857:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff621acc00) 00010000:00010000:2.0:1763333175.387860:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333175.387866:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56b12 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.387871:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56b12 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.387885:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56b19 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.387891:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56b19 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.387896:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56b19 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.387901:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333175.387904:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56b19 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.387910:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56b19 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.387920:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b44900) 00010000:00010000:2.0:1763333175.387923:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333175.387926:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56b19 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.387931:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56b19 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.387968:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56b0b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699dd expref: 249 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.387986:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56b20 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699dd expref: 248 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.387994:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac900) 00010000:00010000:2.0:1763333175.387996:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333175.387999:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5e00, rc 0) 00000100:00100000:2.0:1763333175.388068:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:56875:x1848987613725312:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 743us (950us total) trans 4294972346 rc 0/0 00000100:00100000:2.0:1763333175.388077:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9346 00000100:00100000:0.0:1763333175.389455:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613725568 00000100:00100000:0.0:1763333175.389477:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613725568 00000100:00100000:0.0:1763333175.389543:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3192 00000100:00100000:0.0:1763333175.389553:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:56874:x1848987613725568:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333175.389832:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:56874:x1848987613725568:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 279us (2658us total) trans 4294972347 rc 0/0 00000100:00100000:0.0:1763333175.389840:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3192 00000100:00100000:1.0:1763333175.396486:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333175.398585:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613725824 00000100:00100000:0.0:1763333175.398604:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613725824 00000100:00100000:0.0:1763333175.398691:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3193 00000100:00100000:0.0:1763333175.398703:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:56874:x1848987613725824:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333175.398947:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:56874:x1848987613725824:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 246us (2480us total) trans 4294972348 rc 0/0 00000100:00100000:0.0:1763333175.398954:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3193 00000100:00100000:1.0:1763333175.399251:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.399554:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613725952 00000100:00100000:3.0:1763333175.399561:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613725952 00000100:00100000:3.0:1763333175.399592:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6573 00000100:00100000:3.0:1763333175.399600:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:2420:x1848987613725952:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333175.399612:0:28650:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333175.399634:0:28650:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56b2e lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369699e4 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333175.399658:0:28650:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x240:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333175.399674:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333175.399676:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333175.399685:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56b2e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699e4 expref: 31 pid: 28650 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333175.399701:0:28650:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56b2e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699e4 expref: 31 pid: 28650 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333175.399713:0:28650:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96c00, rc 0) 00000100:00100000:3.0:1763333175.399754:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+31:2420:x1848987613725952:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 154us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333175.399761:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6573 00000100:00100000:3.0:1763333175.400525:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.400583:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613726080 00000100:00100000:1.0:1763333175.400589:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613726080 00000100:00100000:1.0:1763333175.400628:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6574 00000100:00100000:1.0:1763333175.400635:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2420:x1848987613726080:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333175.400645:0:8407:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333175.400661:0:8407:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c56b35 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369699eb expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333175.400678:0:8407:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x240:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333175.400689:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333175.400691:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333175.400696:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c56b35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699eb expref: 15 pid: 8407 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333175.400712:0:8407:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c56b35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699eb expref: 15 pid: 8407 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333175.400721:0:8407:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f000, rc 0) 00000100:00100000:1.0:1763333175.400757:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2420:x1848987613726080:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 122us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333175.400763:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6574 00000100:00100000:3.0:1763333175.403321:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.404415:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.404831:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613726336 00000100:00100000:0.0:1763333175.404838:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613726464 00000100:00100000:2.0:1763333175.404842:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613726336 00000100:00100000:0.0:1763333175.404844:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613726464 00000100:00100000:0.0:1763333175.404915:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9347 00000100:00100000:0.0:1763333175.404925:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:56875:x1848987613726464:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333175.404954:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333175.404979:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c56b3c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1b8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369699f9 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.405033:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c56b3c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699f9 expref: 252 pid: 12741 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333175.405047:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9348 00010000:00010000:0.0:1763333175.405050:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c56b3c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699f9 expref: 252 pid: 12741 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333175.405060:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:55917:x1848987613726336:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333175.405070:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac900) 00010000:00010000:2.0:1763333175.405071:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333175.405075:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763333175.405076:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333175.405082:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feba00, rc 0) 00010000:00010000:2.0:1763333175.405097:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56b20 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699dd expref: 252 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.405118:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac900) 00010000:00010000:2.0:1763333175.405122:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333175.405131:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56b43 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x1b8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e369699f2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333175.405139:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:56875:x1848987613726464:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 214us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333175.405148:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9347 00010000:00010000:2.0:1763333175.405868:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56b4a lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333175.405883:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56b4a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1b8:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.405895:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56b4a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1b8:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:2.0:1763333175.405913:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b8:0x0]: returning size 0 00010000:00010000:2.0:1763333175.406048:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56b43 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699f2 expref: 253 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.406063:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56b4a lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1b8:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699f2 expref: 252 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.406070:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac900) 00010000:00010000:2.0:1763333175.406073:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:2.0:1763333175.406075:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4000, rc 0) 00000100:00100000:2.0:1763333175.406118:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:55917:x1848987613726336:12345-192.168.204.28@tcp:101:bash.0 Request processed in 1062us (2807us total) trans 4294972349 rc 0/0 00000100:00100000:2.0:1763333175.406125:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9348 00000100:00100000:3.0:1763333175.412667:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.413020:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613726592 00000100:00100000:1.0:1763333175.413031:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613726592 00000100:00100000:1.0:1763333175.413090:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9349 00000100:00100000:1.0:1763333175.413100:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:55917:x1848987613726592:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333175.413123:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333175.413144:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56b58 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969a00 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.413181:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56b5f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333175.413197:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56b5f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333175.413208:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56b5f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333175.413324:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56b58 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a00 expref: 254 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.413341:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56b5f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a00 expref: 253 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.413395:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac900) 00010000:00010000:1.0:1763333175.413398:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763333175.413403:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f200, rc 0) 00000100:00100000:1.0:1763333175.413473:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:55917:x1848987613726592:12345-192.168.204.28@tcp:101:bash.0 Request processed in 365us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333175.413481:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9349 00000100:00100000:0.0:1763333175.414323:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.414415:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613726848 00000100:00100000:2.0:1763333175.414423:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613726848 00000100:00100000:2.0:1763333175.414457:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3194 00000100:00100000:2.0:1763333175.414475:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:56875:x1848987613726848:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333175.414662:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+254:56875:x1848987613726848:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 198us (342us total) trans 4294972350 rc 0/0 00000100:00100000:2.0:1763333175.414670:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3194 00000100:00100000:3.0:1763333175.416013:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.416144:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613727104 00000100:00100000:2.0:1763333175.416152:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613727104 00000100:00100000:2.0:1763333175.416202:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9350 00000100:00100000:2.0:1763333175.416210:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+254:55917:x1848987613727104:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:2.0:1763333175.416261:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333175.416287:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56b4a lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1b8:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699f2 expref: 254 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.416305:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac900) 00010000:00010000:2.0:1763333175.416310:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333175.416510:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56b66 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333175.416524:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56b66 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.416534:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56b66 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000001:00080000:2.0:1763333175.416576:0:6521:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294972351 00000004:00010000:2.0:1763333175.416600:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f7d45ec8 reply state 00000000f5ce6e00 transno 4294972352 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56b66 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.416612:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56b66 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.416620:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac900) 00010000:00010000:2.0:1763333175.416623:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333175.416626:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763333175.420739:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+256:55917:x1848987613727104:12345-192.168.204.28@tcp:36:bash.0 Request processed in 4513us (4724us total) trans 4294972352 rc 0/0 00000100:00100000:2.0:1763333175.420753:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9350 00000020:00080000:2.0:1763333175.420763:0:6521:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763333175.421525:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.421743:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613727360 00000100:00100000:2.0:1763333175.421753:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613727360 00000100:00100000:2.0:1763333175.421807:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9351 00000100:00100000:2.0:1763333175.421817:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+256:56875:x1848987613727360:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333175.421843:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333175.421869:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56b6d lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969a07 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.421957:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56b74 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333175.421971:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56b74 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.421983:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56b74 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.421994:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56b7b lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333175.422013:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56b7b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.422021:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56b7b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.422136:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56b82 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333175.422146:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56b82 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.422153:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56b82 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:2.0:1763333175.422163:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b8:0x0]: returning size 0 00010000:00010000:2.0:1763333175.422243:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56b74 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.422251:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56b74 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.422258:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56b74 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.422263:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56b74 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.422270:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333175.422273:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56b74 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.422281:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56b74 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.422293:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff621acc00) 00010000:00010000:2.0:1763333175.422296:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333175.422302:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56b74 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.422311:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56b74 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.422325:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56b7b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.422332:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56b7b lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.422337:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56b7b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.422343:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333175.422346:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56b7b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.422383:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56b7b lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.422392:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b44900) 00010000:00010000:2.0:1763333175.422395:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333175.422398:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56b7b lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.422404:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56b7b lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.422441:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56b6d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a07 expref: 259 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.422457:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56b82 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a07 expref: 258 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.422482:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac900) 00010000:00010000:2.0:1763333175.422484:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333175.422486:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48191600, rc 0) 00000100:00100000:2.0:1763333175.422549:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+258:56875:x1848987613727360:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 733us (1026us total) trans 4294972353 rc 0/0 00000100:00100000:2.0:1763333175.422556:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9351 00000100:00100000:0.0:1763333175.427324:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.427437:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613727616 00000100:00100000:1.0:1763333175.427449:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613727616 00000100:00100000:1.0:1763333175.427518:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9352 00000100:00100000:1.0:1763333175.427528:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+258:55917:x1848987613727616:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333175.427555:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333175.427559:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763333175.427586:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c56b3c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699f9 expref: 258 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.427604:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac900) 00010000:00010000:1.0:1763333175.427609:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333175.427622:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56b90 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969a0e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.427666:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56b97 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333175.427679:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56b82 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a07 expref: 258 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.427694:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56b97 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333175.427728:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56b82 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a07 expref: 258 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.427741:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56b82 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a07 expref: 258 pid: 6521 timeout: 1379 lvb_type: 0 00000100:00100000:1.0:1763333175.427756:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4920f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627269248:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333175.427832:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff6be07780 going to sleep for 11 seconds 00000100:00100000:3.0:1763333175.429582:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333175.429681:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613727872 00000100:00100000:0.0:1763333175.429690:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613727872 00000100:00100000:0.0:1763333175.429743:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3195 00000100:00100000:0.0:1763333175.429753:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+259:56875:x1848987613727872:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333175.429972:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+260:56875:x1848987613727872:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 220us (400us total) trans 4294972354 rc 0/0 00000100:00100000:0.0:1763333175.429980:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3195 00000100:00100000:1.0:1763333175.437138:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4920f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627269248:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333175.437179:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56b97 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000100:00100000:3.0:1763333175.443027:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.443509:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.443561:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613728128 00000100:00100000:2.0:1763333175.443575:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613728128 00000100:00100000:2.0:1763333175.443653:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3196 00000100:00100000:2.0:1763333175.443664:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7ad4b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+260:56875:x1848987613728128:12345-192.168.204.28@tcp:33:lfs.0 00000100:00100000:2.0:1763333175.443843:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7ad4b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+260:56875:x1848987613728128:12345-192.168.204.28@tcp:33:lfs.0 Request processed in 180us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333175.443851:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3196 00000100:00100000:0.0:1763333175.444082:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613728000 00000100:00100000:0.0:1763333175.444088:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613728000 00010000:00010000:0.0:1763333175.444116:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56b82 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a07 expref: 260 pid: 6521 timeout: 1379 lvb_type: 0 00000100:00100000:0.0:1763333175.444151:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3071 00000100:00100000:0.0:1763333175.444159:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+260:2421:x1848987613728000:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333175.444173:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333175.444180:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56b82 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a07 expref: 260 pid: 6521 timeout: 1379 lvb_type: 0 00010000:00010000:0.0:1763333175.444191:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56b82 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a07 expref: 260 pid: 6521 timeout: 1379 lvb_type: 0 00010000:00010000:0.0:1763333175.444214:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56b82 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a07 expref: 260 pid: 6521 timeout: 1379 lvb_type: 0 00010000:00010000:0.0:1763333175.444231:0:28428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac900) 00010000:00010000:0.0:1763333175.444237:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56b97 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.444248:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56b97 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.444255:0:28428:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56b97 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.444291:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333175.444314:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56b97 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000100:00100000:0.0:1763333175.444315:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+259:2421:x1848987613728000:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 155us (1297us total) trans 0 rc 0/0 00010000:00010000:2.0:1763333175.444331:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56b97 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000100:00100000:0.0:1763333175.444331:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3071 00000040:00080000:2.0:1763333175.444591:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1430, 88 off120552 00000004:00080000:2.0:1763333175.444600:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1279524250801ns, next at 1280195897991ns, rc = 0 00000040:00080000:2.0:1763333175.444638:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1429, 88 off120552 00000004:00080000:2.0:1763333175.444644:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1279524294728ns, next at 1279713547966ns, rc = 0 00000040:00080000:2.0:1763333175.444675:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1430, 88 off120640 00000004:00080000:2.0:1763333175.444681:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1279524331490ns, next at 1279713547966ns, rc = 0 00000040:00080000:2.0:1763333175.444691:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1431, 88 off120640 00000004:00080000:2.0:1763333175.444695:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1279524346615ns, next at 1280195897991ns, rc = 0 00000001:00080000:2.0:1763333175.447179:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972355 is committed 00000004:00080000:2.0:1763333175.447195:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 938 committed 00000004:00080000:2.0:1763333175.447210:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 934 committed 00000004:00080000:2.0:1763333175.447219:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 933 committed 00000004:00080000:2.0:1763333175.447223:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 937 committed 00010000:00010000:2.0:1763333175.447337:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56b97 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b8:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a0e expref: 241 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.447385:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac900) 00010000:00010000:2.0:1763333175.447389:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763333175.447408:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56b90 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a0e expref: 241 pid: 6519 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1763333175.447428:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56b97 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b8:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a0e expref: 240 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.447495:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac900) 00010000:00010000:2.0:1763333175.447499:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763333175.447502:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f800, rc 0) 00000100:00100000:3.0:1763333175.447515:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44de1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627269760:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763333175.447591:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1763333175.447615:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c56a39 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.447625:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c56a39 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00000100:00100000:3.0:1763333175.447632:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00010000:00010000:0.0:1763333175.447632:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c56a39 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00000100:00100000:3.0:1763333175.447641:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46a6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627269376:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1763333175.447643:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700e400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333175.447651:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c56a39 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.447659:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c56a39 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00000100:00100000:3.0:1763333175.447667:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1763333175.447674:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b44900) 00010000:00010000:0.0:1763333175.447678:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333175.447683:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c56a39 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000100:00100000:3.0:1763333175.447684:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44de2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627269888:0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1763333175.447696:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c56a39 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000100:00100000:3.0:1763333175.447709:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1763333175.447711:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56acc lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.447719:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56acc lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.447725:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56acc lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.447730:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333175.447734:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56acc lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.447740:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56acc lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.447748:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b44900) 00010000:00010000:0.0:1763333175.447751:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333175.447754:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56acc lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.447760:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56acc lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.447776:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56b66 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.447781:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56b66 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.447786:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56b66 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.447790:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4a00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333175.447793:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56b66 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.447798:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56b66 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.447805:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac900) 00010000:00010000:0.0:1763333175.447807:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333175.447809:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56b66 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.447814:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56b66 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1b8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000100:00100000:0.0:1763333175.447832:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46e2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627269632:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763333175.447863:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333175.447898:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1763333175.447904:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627269504:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763333175.447927:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333175.447941:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44de1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627270016:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333175.447959:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333175.447991:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627269760 00000100:00100000:0.0:1763333175.448011:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627269760 00000100:00100000:0.0:1763333175.448056:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627269376 00000100:00100000:0.0:1763333175.448059:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627269376 00000100:00100000:0.0:1763333175.448075:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627269888 00000100:00100000:0.0:1763333175.448078:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627269888 00000100:00100000:0.0:1763333175.448091:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627269632 00000100:00100000:0.0:1763333175.448094:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627269632 00000100:00100000:0.0:1763333175.448105:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627269504 00000100:00100000:0.0:1763333175.448108:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627269504 00000100:00100000:0.0:1763333175.448116:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627270016 00000100:00100000:0.0:1763333175.448117:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627270016 00000100:00100000:0.0:1763333175.448131:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6575 00000100:00100000:0.0:1763333175.448138:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+16:3654:x1848987627269760:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1763333175.448162:0:29013:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:574 count 1 00002000:00010000:0.0:1763333175.448193:0:29013:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x23e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333175.448199:0:29013:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c56b9e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.448212:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333175.448214:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333175.448220:0:29013:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c56b9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.448231:0:29013:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c56b9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.448244:0:29013:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c56b9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.448251:0:29013:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c56b9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.448270:0:29013:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763333175.448528:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+17:3654:x1848987627269760:12345-0@lo:6:osp-syn-0-1.0 Request processed in 389us (936us total) trans 21474838906 rc 0/0 00000100:00100000:0.0:1763333175.448537:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6575 00000100:00100000:0.0:1763333175.448555:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6576 00000100:00100000:0.0:1763333175.448562:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+16:3654:x1848987627269376:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1763333175.448574:0:29013:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:569 count 1 00010000:00010000:0.0:1763333175.448586:0:29013:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c56ba5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.448600:0:29013:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c566e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969878 expref: 14 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.448607:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333175.448608:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333175.448611:0:29013:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c56ba5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.448637:0:29013:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c566e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969878 expref: 14 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.448657:0:29013:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c566e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969878 expref: 14 pid: 29010 timeout: 1379 lvb_type: 0 00000100:00100000:0.0:1763333175.448669:0:29013:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29013:1848987627270144:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333175.448715:0:29013:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff800d30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763333175.448733:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6577 00000100:00100000:0.0:1763333175.448741:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+16:3654:x1848987627269888:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333175.448842:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+17:3654:x1848987627269888:12345-0@lo:2:osp-syn-0-1.0 Request processed in 101us (1132us total) trans 21474838907 rc 0/0 00000100:00100000:0.0:1763333175.448848:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6577 00000100:00100000:0.0:1763333175.448860:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6578 00000100:00100000:0.0:1763333175.448867:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+16:3653:x1848987627269632:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1763333175.448877:0:8404:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:573 count 1 00010000:00010000:0.0:1763333175.448888:0:8404:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c56bac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.448899:0:8404:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe48190c00/0xb32e3ef184c569ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969982 expref: 14 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.448906:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333175.448907:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333175.448910:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c56bac lrc: 4/0,1 mode: --/PW res: [0x280000400:0x23d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.448928:0:8404:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe48190c00/0xb32e3ef184c569ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969982 expref: 14 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.448936:0:8404:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe48190c00/0xb32e3ef184c569ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969982 expref: 14 pid: 28650 timeout: 1379 lvb_type: 0 00000100:00100000:0.0:1763333175.448945:0:8404:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8404:1848987627270272:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333175.448969:0:8404:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff800d3240 going to sleep for 11 seconds 00000100:00100000:0.0:1763333175.448990:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6579 00000100:00100000:0.0:1763333175.448997:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+16:3653:x1848987627269504:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1763333175.449008:0:8406:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:570 count 1 00010000:00010000:0.0:1763333175.449020:0:8406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c56bb3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.449030:0:8406:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56959 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696994a expref: 14 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.449036:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333175.449038:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333175.449040:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c56bb3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.449060:0:8406:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56959 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696994a expref: 14 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.449068:0:8406:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56959 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696994a expref: 14 pid: 29010 timeout: 1379 lvb_type: 0 00000100:00100000:0.0:1763333175.449078:0:8406:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff74034e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8406:1848987627270400:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333175.449102:0:8406:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe46e0e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763333175.449120:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6580 00000100:00100000:0.0:1763333175.449127:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+16:3653:x1848987627270016:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1763333175.449186:0:17605:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x240:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333175.449189:0:17605:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x240:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763333175.449192:0:17605:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x240:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333175.449194:0:17605:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x240:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763333175.449196:0:17605:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x240:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333175.449229:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+17:3653:x1848987627270016:12345-0@lo:2:osp-syn-0-1.0 Request processed in 103us (1269us total) trans 21474838908 rc 0/0 00000100:00100000:0.0:1763333175.449235:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6580 00010000:00010000:0.0:1763333175.449257:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333175.449264:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c56b9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.449271:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feaa00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333175.449275:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c56b9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.449281:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c56b9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.449295:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c56b9e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.449301:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c56b9e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.449324:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333175.449326:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333175.449328:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763333175.449425:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff74034380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627270528:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763333175.449453:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333175.449486:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff74035880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627271040:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333175.449506:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1763333175.449538:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44de1f80/2, rc 0, transno 21474838908 00000100:00100000:0.0:1763333175.449543:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44de1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627270016:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333175.449553:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1763333175.449558:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff74035c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627270912:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763333175.449579:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333175.449598:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627270528 00000100:00100000:0.0:1763333175.449603:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627270528 00000100:00100000:0.0:1763333175.449622:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627271040 00000100:00100000:0.0:1763333175.449624:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627271040 00000100:00100000:0.0:1763333175.449631:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627270912 00000100:00100000:0.0:1763333175.449633:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627270912 00000100:00100000:0.0:1763333175.449644:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6581 00000100:00100000:0.0:1763333175.449649:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74037480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+41:3653:x1848987627270528:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1763333175.449661:0:28600:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:569 count 1 00010000:00010000:0.0:1763333175.449675:0:28600:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c56bba lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.449687:0:28600:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4700e000/0xb32e3ef184c569ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696996d expref: 30 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.449697:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333175.449699:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333175.449701:0:28600:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c56bba lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.449720:0:28600:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe4700e000/0xb32e3ef184c569ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696996d expref: 30 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.449729:0:28600:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe4700e000/0xb32e3ef184c569ad lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696996d expref: 30 pid: 28650 timeout: 1379 lvb_type: 0 00000100:00100000:0.0:1763333175.449742:0:28600:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff74037b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28600:1848987627271296:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333175.449766:0:28600:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe46e0e180 going to sleep for 11 seconds 00000100:00100000:0.0:1763333175.449782:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6582 00000100:00100000:0.0:1763333175.449788:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74035f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+41:3653:x1848987627271040:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333175.449891:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74035f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+42:3653:x1848987627271040:12345-0@lo:2:osp-syn-1-1.0 Request processed in 103us (383us total) trans 17179871603 rc 0/0 00000100:00100000:0.0:1763333175.449897:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6582 00000100:00100000:0.0:1763333175.449909:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6583 00000100:00100000:0.0:1763333175.449915:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74035180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+41:3653:x1848987627270912:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1763333175.449924:0:17605:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:574 count 1 00002000:00010000:0.0:1763333175.449940:0:17605:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x23e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333175.449944:0:17605:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56bc1 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.449955:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333175.449956:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333175.449959:0:17605:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56bc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.449969:0:17605:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56bc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.449976:0:17605:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56bc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.449983:0:17605:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56bc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.449999:0:17605:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763333175.450119:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74035180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+42:3653:x1848987627270912:12345-0@lo:6:osp-syn-1-1.0 Request processed in 204us (538us total) trans 17179871604 rc 0/0 00000100:00100000:0.0:1763333175.450125:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6583 00010000:00010000:0.0:1763333175.450142:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333175.450147:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56bc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.450154:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700f400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333175.450158:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56bc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.450165:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56bc1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.450176:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56bc1 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.450182:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56bc1 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.450194:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333175.450196:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333175.450198:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763333175.450210:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff74035500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627270656:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763333175.450233:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333175.450250:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff74034a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627271168:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333175.450267:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1763333175.450287:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44de2a00/2, rc 0, transno 21474838907 00000100:00100000:0.0:1763333175.450292:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44de2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627269888:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1763333175.450302:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44de1c00/2, rc 0, transno 21474838906 00000100:00100000:0.0:1763333175.450305:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44de1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627269760:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763333175.450313:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763333175.450317:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff74036d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627270784:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763333175.450336:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1763333175.450381:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff74035c00/2, rc 0, transno 17179871604 00000100:00100000:0.0:1763333175.450386:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff74035c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627270912:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1763333175.450393:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff74035880/2, rc 0, transno 17179871603 00000100:00100000:0.0:1763333175.450396:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff74035880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627271040:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333175.450409:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627270656 00000100:00100000:0.0:1763333175.450412:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627270656 00000100:00100000:0.0:1763333175.450427:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627271168 00000100:00100000:0.0:1763333175.450430:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627271168 00000100:00100000:0.0:1763333175.450438:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627270784 00000100:00100000:0.0:1763333175.450440:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627270784 00000100:00100000:0.0:1763333175.450450:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6584 00000100:00100000:0.0:1763333175.450455:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74037100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+44:3654:x1848987627270656:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1763333175.450481:0:17605:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:570 count 1 00010000:00010000:0.0:1763333175.450494:0:17605:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56bc8 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.450505:0:17605:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56960 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969951 expref: 30 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.450511:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333175.450513:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333175.450515:0:17605:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56bc8 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.450532:0:17605:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56960 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969951 expref: 30 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.450541:0:17605:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56960 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969951 expref: 30 pid: 28650 timeout: 1379 lvb_type: 0 00000100:00100000:0.0:1763333175.450550:0:17605:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff74036680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17605:1848987627271424:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333175.450575:0:17605:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe43aa6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1763333175.452757:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:55917:x1848987613727616:12345-192.168.204.28@tcp:101:bash.0 Request processed in 25215us (25427us total) trans 4294972355 rc 0/0 00000100:00100000:2.0:1763333175.452772:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9352 00000100:00100000:2.0:1763333175.452831:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6585 00000100:00100000:2.0:1763333175.452847:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74034000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+44:3654:x1848987627271168:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1763333175.453022:0:28651:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x240:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333175.453026:0:28651:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x240:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1763333175.453028:0:28651:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x240:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333175.453031:0:28651:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x240:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1763333175.453033:0:28651:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x240:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333175.453111:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74034000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+45:3654:x1848987627271168:12345-0@lo:2:osp-syn-1-1.0 Request processed in 271us (2842us total) trans 17179871605 rc 0/0 00000100:00100000:2.0:1763333175.453117:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6585 00000100:00100000:2.0:1763333175.453133:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6586 00000100:00100000:2.0:1763333175.453140:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74036300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+44:3654:x1848987627270784:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1763333175.453155:0:28651:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:573 count 1 00010000:00010000:2.0:1763333175.453175:0:28651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56bcf lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x23d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.453192:0:28651:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c569de lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x23d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696997b expref: 30 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.453200:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333175.453202:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333175.453206:0:28651:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56bcf lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x23d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.453243:0:28651:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c569de lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x23d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696997b expref: 30 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.453256:0:28651:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c569de lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x23d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696997b expref: 30 pid: 29010 timeout: 1379 lvb_type: 0 00000100:00100000:2.0:1763333175.453271:0:28651:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff73164e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28651:1848987627271552:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333175.453322:0:28651:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff44fdfc00 going to sleep for 11 seconds 00000004:00080000:0.0:1763333175.463914:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff74034a80/2, rc 0, transno 17179871605 00000100:00100000:0.0:1763333175.463944:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff74034a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627271168:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333175.464036:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.464077:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.464120:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613728512 00000100:00100000:3.0:1763333175.464133:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613728512 00010000:00010000:3.0:1763333175.464202:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c569de lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x23d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696997b expref: 31 pid: 29010 timeout: 1379 lvb_type: 0 00000100:00100000:3.0:1763333175.464272:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3072 00000100:00100000:3.0:1763333175.464287:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+31:2421:x1848987613728512:12345-192.168.204.28@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1763333175.464296:0:28651:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff73164e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28651:1848987627271552:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333175.464319:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333175.464331:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c569de lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x23d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696997b expref: 31 pid: 29010 timeout: 1379 lvb_type: 0 00010000:00010000:2.0:1763333175.464337:0:28651:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56bcf lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x23d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.464414:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c569de lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x23d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696997b expref: 31 pid: 29010 timeout: 1379 lvb_type: 0 00010000:00010000:3.0:1763333175.464453:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c569de lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x23d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696997b expref: 31 pid: 29010 timeout: 1379 lvb_type: 0 00010000:00010000:3.0:1763333175.464488:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333175.464492:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333175.464500:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56bcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x23d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.464514:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56bcf lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x23d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333175.464533:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:3.0:1763333175.464559:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333175.464590:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613728384 00000100:00100000:2.0:1763333175.464602:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613728384 00010000:00010000:2.0:1763333175.464660:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c566e3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969878 expref: 15 pid: 29010 timeout: 1379 lvb_type: 0 00000100:00100000:3.0:1763333175.464661:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:2421:x1848987613728512:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 373us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333175.464702:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3072 00000100:00100000:3.0:1763333175.464746:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3073 00000100:00100000:3.0:1763333175.464764:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73164e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2421:x1848987613728384:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333175.464778:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333175.464786:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c566e3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x239:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969878 expref: 15 pid: 29010 timeout: 1379 lvb_type: 0 00010000:00010000:3.0:1763333175.464803:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c566e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x239:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969878 expref: 15 pid: 29010 timeout: 1379 lvb_type: 0 00010000:00010000:3.0:1763333175.464831:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333175.464833:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333175.464837:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c56ba5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x239:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.464847:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c56ba5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x239:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.464865:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333175.464895:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73164e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2421:x1848987613728384:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 139us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333175.464903:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3073 00000100:00100000:2.0:1763333175.465053:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.465070:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613728640 00000100:00100000:2.0:1763333175.465074:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613728640 00010000:00010000:2.0:1763333175.465095:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe48190c00/0xb32e3ef184c569ec lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x23d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969982 expref: 15 pid: 28650 timeout: 1379 lvb_type: 0 00000100:00100000:2.0:1763333175.465121:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3074 00000100:00100000:2.0:1763333175.465130:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73166680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2418:x1848987613728640:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333175.465149:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333175.465155:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe48190c00/0xb32e3ef184c569ec lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x23d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969982 expref: 15 pid: 28650 timeout: 1379 lvb_type: 0 00010000:00010000:2.0:1763333175.465168:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe48190c00/0xb32e3ef184c569ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969982 expref: 15 pid: 28650 timeout: 1379 lvb_type: 0 00010000:00010000:2.0:1763333175.465195:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333175.465197:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333175.465202:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c56bac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.465217:0:6506:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c56bac lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x23d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.465236:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333175.465288:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73166680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2418:x1848987613728640:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 158us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333175.465296:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3074 00000100:00100000:2.0:1763333175.465336:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.465382:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613728768 00000100:00100000:2.0:1763333175.465387:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613728768 00010000:00010000:2.0:1763333175.465406:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56959 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696994a expref: 15 pid: 29010 timeout: 1379 lvb_type: 0 00000100:00100000:2.0:1763333175.465426:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3075 00000100:00100000:2.0:1763333175.465434:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73165500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2419:x1848987613728768:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333175.465443:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333175.465448:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56959 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696994a expref: 15 pid: 29010 timeout: 1379 lvb_type: 0 00010000:00010000:2.0:1763333175.465457:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56959 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696994a expref: 15 pid: 29010 timeout: 1379 lvb_type: 0 00010000:00010000:2.0:1763333175.465481:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333175.465483:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333175.465487:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c56bb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.465500:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c56bb3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.465514:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333175.465535:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73165500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2419:x1848987613728768:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 102us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333175.465541:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3075 00000100:00100000:1.0:1763333175.465791:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613728256 00000100:00100000:1.0:1763333175.465799:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613728256 00000100:00100000:1.0:1763333175.465839:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6587 00010000:00010000:0.0:1763333175.465841:0:8406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56959 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696994a expref: 15 pid: 29010 timeout: 1379 lvb_type: 0 00000100:00100000:1.0:1763333175.465852:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:55917:x1848987613728256:12345-192.168.204.28@tcp:101:bash.0 00000100:00100000:0.0:1763333175.465863:0:8406:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff74034e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8406:1848987627270400:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333175.465874:0:28650:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333175.465903:0:8406:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c56bb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.465904:0:28650:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56bd6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969a15 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.465923:0:8406:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c56bb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.465930:0:8406:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c56bb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.465940:0:8406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c56bb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333175.465944:0:28650:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x23f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333175.465949:0:8406:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c56bb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.465964:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333175.465967:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333175.465971:0:8406:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763333175.465978:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56bd6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a15 expref: 15 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.465992:0:28650:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56bd6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a15 expref: 15 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.466004:0:28650:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f600, rc 0) 00000100:00100000:1.0:1763333175.466033:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:55917:x1848987613728256:12345-192.168.204.28@tcp:101:bash.0 Request processed in 186us (2011us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333175.466040:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6587 00010000:00010000:1.0:1763333175.466083:0:29013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c566e3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969878 expref: 14 pid: 29010 timeout: 1379 lvb_type: 0 00000100:00100000:1.0:1763333175.466096:0:29013:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29013:1848987627270144:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333175.466112:0:29013:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c56ba5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.466120:0:29013:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c56ba5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.466128:0:29013:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c56ba5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.466136:0:29013:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c56ba5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.466143:0:29013:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c56ba5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.466165:0:29013:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1763333175.466339:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+18:3654:x1848987627269376:12345-0@lo:6:osp-syn-0-1.0 Request processed in 17775us (18670us total) trans 21474838910 rc 0/0 00000100:00100000:1.0:1763333175.466371:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6576 00000100:00100000:0.0:1763333175.466378:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+18:3653:x1848987627269504:12345-0@lo:6:osp-syn-0-1.0 Request processed in 17353us (18421us total) trans 21474838909 rc 0/0 00000100:00100000:0.0:1763333175.466387:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6579 00010000:00010000:1.0:1763333175.466402:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1763333175.466409:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c56bb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.466412:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333175.466421:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea200 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333175.466421:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c56ba5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.466432:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333175.466436:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c56ba5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.466441:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c56bb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.466446:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c56ba5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.466453:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c56bb3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.466471:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c56ba5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.466476:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c56bb3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.466484:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c56ba5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.466488:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c56bb3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.466511:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333175.466513:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333175.466514:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333175.466517:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333175.466518:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333175.466522:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763333175.466552:0:28600:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff74037b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28600:1848987627271296:192.168.204.28@tcp:104: 00000004:00080000:1.0:1763333175.466561:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe46a6e300/2, rc 0, transno 21474838910 00000100:00100000:1.0:1763333175.466569:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46a6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627269376:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1763333175.466571:0:28600:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c56bba lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.467687:0:8404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe48190c00/0xb32e3ef184c569ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969982 expref: 13 pid: 28650 timeout: 1379 lvb_type: 0 00000100:00100000:0.0:1763333175.467719:0:8404:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8404:1848987627270272:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333175.467742:0:8404:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c56bac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.467752:0:8404:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c56bac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.467759:0:8404:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c56bac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.467767:0:8404:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c56bac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.467774:0:8404:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c56bac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.467802:0:8404:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763333175.467990:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+17:3653:x1848987627269632:12345-0@lo:6:osp-syn-0-1.0 Request processed in 19122us (20124us total) trans 21474838911 rc 0/0 00000100:00100000:0.0:1763333175.467998:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6578 00010000:00010000:0.0:1763333175.469190:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333175.469199:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c56bac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.469209:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea800 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333175.469213:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c56bac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.469224:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c56bac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.469247:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c56bac lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.469254:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c56bac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.469277:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333175.469279:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333175.469281:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763333175.469329:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe46e2ed80/2, rc 0, transno 21474838909 00000100:00100000:0.0:1763333175.469337:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627269504:0@lo:6:osp-syn-0-1.0 00000004:00080000:0.0:1763333175.469376:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe46e2dc00/2, rc 0, transno 21474838911 00000100:00100000:0.0:1763333175.469381:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46e2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627269632:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763333175.469423:0:17605:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff74036680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17605:1848987627271424:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333175.469443:0:17605:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56bc8 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.470149:0:28651:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56bcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.470170:0:28651:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56bcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.470183:0:28651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56bcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.470193:0:28651:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56bcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.470231:0:28651:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763333175.470652:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74036300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+45:3654:x1848987627270784:12345-0@lo:6:osp-syn-1-1.0 Request processed in 17508us (20310us total) trans 17179871606 rc 0/0 00000100:00100000:3.0:1763333175.470670:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6586 00000004:00080000:1.0:1763333175.472032:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff74036d80/2, rc 0, transno 17179871606 00000100:00100000:1.0:1763333175.472048:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff74036d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627270784:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763333175.472126:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.472164:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:0.0:1763333175.473023:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333175.473039:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56bcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.473051:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48190200 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333175.473056:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56bcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.473074:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56bcf lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.473103:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56bcf lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.473112:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56bcf lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.473144:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333175.473147:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333175.473149:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763333175.473155:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613728896 00000100:00100000:3.0:1763333175.473172:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613728896 00000100:00100000:0.0:1763333175.473173:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613729024 00000100:00100000:0.0:1763333175.473185:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613729024 00010000:00010000:0.0:1763333175.473240:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4700e000/0xb32e3ef184c569ad lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696996d expref: 31 pid: 28650 timeout: 1379 lvb_type: 0 00010000:00010000:3.0:1763333175.473243:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56960 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969951 expref: 31 pid: 28650 timeout: 1379 lvb_type: 0 00000100:00100000:0.0:1763333175.474324:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3076 00000100:00100000:0.0:1763333175.474340:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff44f0b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+31:2419:x1848987613729024:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333175.474404:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333175.474412:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe4700e000/0xb32e3ef184c569ad lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696996d expref: 31 pid: 28650 timeout: 1379 lvb_type: 0 00010000:00010000:0.0:1763333175.474428:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe4700e000/0xb32e3ef184c569ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696996d expref: 31 pid: 28650 timeout: 1379 lvb_type: 0 00010000:00010000:0.0:1763333175.474455:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4700e000/0xb32e3ef184c569ad lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696996d expref: 31 pid: 28650 timeout: 1379 lvb_type: 0 00010000:00010000:0.0:1763333175.474477:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333175.474479:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333175.474484:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c56bba lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.474494:0:28428:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c56bba lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333175.474766:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3077 00000100:00100000:1.0:1763333175.474778:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:2418:x1848987613728896:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333175.474787:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333175.474793:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56960 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x23a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969951 expref: 30 pid: 28650 timeout: 1379 lvb_type: 0 00010000:00010000:1.0:1763333175.474803:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56960 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x23a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969951 expref: 30 pid: 28650 timeout: 1379 lvb_type: 0 00010000:00010000:1.0:1763333175.474817:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56960 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x23a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969951 expref: 30 pid: 28650 timeout: 1379 lvb_type: 0 00010000:00010000:1.0:1763333175.474827:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333175.474829:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333175.474832:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56bc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.474839:0:6506:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56bc8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.474863:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333175.474942:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:2418:x1848987613728896:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 166us (2816us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333175.474953:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3077 00010000:00010000:1.0:1763333175.475038:0:17605:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56bc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.475048:0:17605:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56bc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.475057:0:17605:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56bc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.475065:0:17605:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56bc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.475082:0:17605:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763333175.475391:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74037100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+45:3654:x1848987627270656:12345-0@lo:6:osp-syn-1-1.0 Request processed in 24931us (25152us total) trans 17179871607 rc 0/0 00000100:00100000:1.0:1763333175.475401:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6584 00010000:00010000:1.0:1763333175.475445:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333175.475451:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56bc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.475460:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700f000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333175.475473:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56bc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1763333175.475479:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff74035500/2, rc 0, transno 17179871607 00010000:00010000:1.0:1763333175.475485:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56bc8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333175.475499:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff74035500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627270656:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1763333175.475526:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56bc8 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.475534:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56bc8 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.475555:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333175.475557:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333175.475559:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333175.476550:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333175.476618:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff44f0b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+28:2419:x1848987613729024:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 2277us (4446us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333175.476628:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3076 00010000:00010000:2.0:1763333175.476775:0:28600:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c56bba lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.476785:0:28600:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c56bba lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.476794:0:28600:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c56bba lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.476802:0:28600:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c56bba lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.476994:0:28600:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763333175.477648:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74037480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+45:3653:x1848987627270528:12345-0@lo:6:osp-syn-1-1.0 Request processed in 27994us (28190us total) trans 17179871608 rc 0/0 00000100:00100000:1.0:1763333175.477657:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6581 00000004:00080000:2.0:1763333175.477948:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff74034380/2, rc 0, transno 17179871608 00000100:00100000:2.0:1763333175.477956:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff74034380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627270528:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1763333175.478041:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333175.478049:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c56bba lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.478058:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feb400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333175.478062:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c56bba lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.478071:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c56bba lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.478090:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c56bba lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.478098:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c56bba lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.478118:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333175.478120:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333175.478121:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763333175.478896:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.479049:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613729152 00000100:00100000:1.0:1763333175.479058:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613729152 00000100:00100000:1.0:1763333175.479280:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6588 00000100:00100000:1.0:1763333175.479292:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73166a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+28:55917:x1848987613729152:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333175.479313:0:28600:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333175.479333:0:28600:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56bdd lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969a1c expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333175.479376:0:28600:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x23f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333175.479583:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333175.479586:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333175.479597:0:28600:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56bdd lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a1c expref: 29 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.479622:0:28600:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56bdd lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a1c expref: 29 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.479637:0:28600:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e800, rc 0) 00000100:00100000:1.0:1763333175.479714:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73166a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:55917:x1848987613729152:12345-192.168.204.28@tcp:101:bash.0 Request processed in 424us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333175.479721:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6588 00000100:00100000:3.0:1763333175.480114:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.480668:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613729408 00000100:00100000:2.0:1763333175.480677:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613729408 00000100:00100000:2.0:1763333175.480740:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9353 00000100:00100000:2.0:1763333175.480749:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56876:x1848987613729408:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333175.481277:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333175.481301:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56be4 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969a23 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.481573:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56beb lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333175.481588:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56beb lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.481599:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56beb lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.481610:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56bf2 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333175.481615:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56bf2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.481621:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56bf2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.481762:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56bf9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333175.481771:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56bf9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.481777:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56bf9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:2.0:1763333175.481786:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b8:0x0]: returning size 2 00010000:00010000:2.0:1763333175.481868:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56beb lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.481879:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56beb lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.481885:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56beb lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.481891:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56beb lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.481896:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333175.481900:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56beb lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.481907:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56beb lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.481918:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff621acc00) 00010000:00010000:2.0:1763333175.481921:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333175.481925:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56beb lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.481932:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56beb lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.481946:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56bf2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.481953:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56bf2 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.481959:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56bf2 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.481963:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333175.481967:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56bf2 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.481972:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56bf2 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.481978:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff621ac300) 00010000:00010000:2.0:1763333175.481981:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333175.481983:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56bf2 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.481988:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56bf2 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.482037:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56be4 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a23 expref: 240 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.482052:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56bf9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a23 expref: 239 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.482060:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac900) 00010000:00010000:2.0:1763333175.482062:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333175.482065:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4800, rc 0) 00000100:00100000:2.0:1763333175.485627:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56876:x1848987613729408:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 4866us (5500us total) trans 4294972356 rc 0/0 00000100:00100000:2.0:1763333175.485641:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9353 00000100:00100000:0.0:1763333175.486449:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333175.486548:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.486607:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613729536 00000100:00100000:3.0:1763333175.486620:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613729536 00002000:00010000:3.0:1763333175.486663:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/575 (0->18446744073709551615) 00002000:00100000:3.0:1763333175.486668:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff74036680 with x1848987613729536 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333175.486681:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff74036680. 00000100:00100000:3.0:1763333175.486708:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613729664 00000100:00100000:3.0:1763333175.486711:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613729664 00002000:00010000:3.0:1763333175.486723:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/575 (0->18446744073709551615) 00002000:00100000:3.0:1763333175.486726:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff74037b80 with x1848987613729664 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333175.486731:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff74037b80. 00000100:00100000:3.0:1763333175.486749:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1625 00000100:00100000:3.0:1763333175.486757:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74036680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2421:x1848987613729536:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:3.0:1763333175.486944:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x23f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333175.486948:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x23f:0x0] updating lvb mtime from disk: 0 -> 1763333175 00002000:00010000:3.0:1763333175.486951:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x23f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333175.486953:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x23f:0x0] updating lvb ctime from disk: 0 -> 1763333175 00002000:00010000:3.0:1763333175.486955:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x23f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333175.487004:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74036680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2421:x1848987613729536:12345-192.168.204.28@tcp:10:bash.0 Request processed in 248us (559us total) trans 21474838912 rc 0/0 00000100:00100000:3.0:1763333175.487011:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1625 00002000:00010000:3.0:1763333175.487014:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/575 (0->18446744073709551615) 00002000:00100000:3.0:1763333175.487017:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff74036680 with x1848987613729536 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333175.487020:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff74036680. 00000100:00100000:3.0:1763333175.487036:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1626 00000100:00100000:3.0:1763333175.487043:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74037b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:2421:x1848987613729664:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:3.0:1763333175.487127:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x23f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333175.487130:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x23f:0x0] updating lvb mtime from disk: 0 -> 1763333175 00002000:00010000:3.0:1763333175.487132:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x23f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333175.487134:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x23f:0x0] updating lvb ctime from disk: 0 -> 1763333175 00002000:00010000:3.0:1763333175.487136:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x23f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333175.487157:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74037b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:2421:x1848987613729664:12345-192.168.204.28@tcp:10:bash.0 Request processed in 114us (608us total) trans 17179871609 rc 0/0 00000100:00100000:3.0:1763333175.487164:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1626 00002000:00010000:3.0:1763333175.487166:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/575 (0->18446744073709551615) 00002000:00100000:3.0:1763333175.487168:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff74037b80 with x1848987613729664 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333175.487172:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff74037b80. 00000100:00100000:0.0:1763333175.492818:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.492913:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613729920 00000100:00100000:3.0:1763333175.492923:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613729920 00000100:00100000:3.0:1763333175.492986:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3197 00000100:00100000:3.0:1763333175.492997:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56876:x1848987613729920:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333175.493740:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:56876:x1848987613729920:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 741us (927us total) trans 4294972357 rc 0/0 00000100:00100000:3.0:1763333175.493752:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3197 00000100:00100000:1.0:1763333175.496488:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.496607:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613730176 00000100:00100000:2.0:1763333175.496619:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613730176 00000100:00100000:2.0:1763333175.496692:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3198 00000100:00100000:2.0:1763333175.496706:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:55917:x1848987613730176:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:2.0:1763333175.497011:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:55917:x1848987613730176:12345-192.168.204.28@tcp:35:bash.0 Request processed in 308us (531us total) trans 4294972358 rc 0/0 00000100:00100000:2.0:1763333175.497018:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3198 00000100:00100000:1.0:1763333175.502025:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.502603:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613730432 00000100:00100000:2.0:1763333175.502618:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613730432 00000100:00100000:2.0:1763333175.502696:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9354 00000100:00100000:2.0:1763333175.502707:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56876:x1848987613730432:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333175.502733:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333175.502757:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56c07 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969a2a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.502877:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56c0e lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333175.502894:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56bf9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a23 expref: 242 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.502903:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56c0e lrc: 4/0,1 mode: --/CW res: [0x240000404:0x1b8:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.502940:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56bf9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a23 expref: 242 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.502953:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56bf9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a23 expref: 242 pid: 6519 timeout: 1379 lvb_type: 0 00000100:00100000:2.0:1763333175.502967:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff73165f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627271680:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333175.503071:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff44fdfc00 going to sleep for 11 seconds 00000100:00100000:0.0:1763333175.508630:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.508934:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613730560 00000100:00100000:1.0:1763333175.508945:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613730560 00010000:00010000:1.0:1763333175.508992:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56bf9 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a23 expref: 243 pid: 6519 timeout: 1379 lvb_type: 0 00000100:00100000:1.0:1763333175.509041:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3078 00000100:00100000:1.0:1763333175.509062:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:2420:x1848987613730560:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333175.509080:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333175.509088:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56bf9 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a23 expref: 243 pid: 6519 timeout: 1379 lvb_type: 0 00010000:00010000:1.0:1763333175.509101:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56bf9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a23 expref: 243 pid: 6519 timeout: 1379 lvb_type: 0 00010000:00010000:1.0:1763333175.509126:0:28428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac900) 00010000:00010000:1.0:1763333175.509131:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56c0e lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1b8:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333175.509142:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56c0e lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1b8:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333175.509149:0:28428:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56c0e lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x1b8:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333175.509169:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333175.509228:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:2420:x1848987613730560:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 178us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333175.509236:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3078 00010000:00010000:3.0:1763333175.513709:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56bf9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a23 expref: 242 pid: 6519 timeout: 1379 lvb_type: 0 00000100:00100000:3.0:1763333175.513732:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff73165f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627271680:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333175.513758:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56c0e lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1b8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.513767:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56c0e lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1b8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.513772:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56c0e lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1b8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:3.0:1763333175.513799:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b8:0x0]: returning size 5 00010000:00010000:3.0:1763333175.513963:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56c07 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a2a expref: 243 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.513980:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56c0e lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1b8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a2a expref: 242 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.513990:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac900) 00010000:00010000:3.0:1763333175.513993:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1763333175.513997:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5c00, rc 0) 00000100:00100000:3.0:1763333175.514070:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:56876:x1848987613730432:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 11364us (12053us total) trans 4294972359 rc 0/0 00000100:00100000:3.0:1763333175.514079:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9354 00000100:00100000:3.0:1763333175.515429:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.515588:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613730688 00000100:00100000:2.0:1763333175.515597:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613730688 00000100:00100000:2.0:1763333175.515658:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9355 00000100:00100000:2.0:1763333175.515667:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:56877:x1848987613730688:12345-192.168.204.28@tcp:101:rm.0 00010000:00010000:2.0:1763333175.515687:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333175.515713:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56c1c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969a31 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.515813:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56c23 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333175.515826:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56c23 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.515837:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56c23 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.515855:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56c2a lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333175.515861:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56c2a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.515870:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56c2a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.515956:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56c31 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333175.516117:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56c0e lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x1b8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a2a expref: 243 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.516127:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56c31 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.516175:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56c0e lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1b8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a2a expref: 243 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.516188:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56c0e lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1b8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a2a expref: 243 pid: 6519 timeout: 1379 lvb_type: 0 00000100:00100000:2.0:1763333175.516203:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff73167100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627271808:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333175.516849:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff44fdfc00 going to sleep for 11 seconds 00000100:00100000:1.0:1763333175.518512:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.518798:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613730816 00000100:00100000:3.0:1763333175.518808:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613730816 00000100:00100000:3.0:1763333175.518877:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9356 00000100:00100000:0.0:1763333175.518884:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.518892:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56876:x1848987613730816:12345-192.168.204.28@tcp:101:lfs.0 00000100:00100000:0.0:1763333175.518911:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613730944 00000100:00100000:0.0:1763333175.518917:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613730944 00010000:00010000:3.0:1763333175.518918:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333175.518943:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56c38 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1b8:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969a38 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.518946:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56c0e lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x1b8:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a2a expref: 245 pid: 6519 timeout: 1379 lvb_type: 0 00000100:00100000:0.0:1763333175.518972:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3079 00000100:00100000:0.0:1763333175.518979:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:2420:x1848987613730944:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333175.518994:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333175.519001:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56c0e lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x1b8:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a2a expref: 245 pid: 6519 timeout: 1379 lvb_type: 0 00010000:00010000:0.0:1763333175.519014:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56c0e lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1b8:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a2a expref: 245 pid: 6519 timeout: 1379 lvb_type: 0 00010000:00010000:0.0:1763333175.519036:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac900) 00010000:00010000:0.0:1763333175.519041:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56c31 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.519062:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56c31 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.519069:0:6506:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56c31 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.519089:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333175.519138:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:2420:x1848987613730944:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 159us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333175.519146:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3079 00010000:00010000:3.0:1763333175.519520:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c56c3f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333175.519530:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c56c3f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333175.519539:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c56c3f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:3.0:1763333175.519565:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b8:0x0]: returning size 5 00000004:00200000:3.0:1763333175.519570:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763333175.519587:0:6521:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c56c3f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333175.519611:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56c38 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b8:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a38 expref: 246 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.519669:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c56c3f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a38 expref: 245 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.519677:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac900) 00010000:00010000:3.0:1763333175.519680:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333175.519683:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96e00, rc 0) 00000100:00100000:3.0:1763333175.519726:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56876:x1848987613730816:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 838us (1221us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333175.519732:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9356 00010000:00010000:2.0:1763333175.519795:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56c0e lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1b8:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a2a expref: 244 pid: 6519 timeout: 1379 lvb_type: 0 00000100:00100000:2.0:1763333175.519809:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff73167100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627271808:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333175.519832:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56c31 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.519840:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56c31 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.519845:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56c31 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:2.0:1763333175.519867:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b8:0x0]: returning size 5 00000004:00200000:2.0:1763333175.519870:0:6519:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763333175.519881:0:6519:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56c31 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.519891:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56c31 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.519902:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56c23 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.519909:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56c23 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.519915:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56c23 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.519921:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56c23 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.519926:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333175.519930:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56c23 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.519937:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56c23 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.519946:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff621acc00) 00010000:00010000:2.0:1763333175.519948:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333175.519952:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56c23 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.519958:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56c23 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.519967:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56c2a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.519972:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56c2a lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.519978:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56c2a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.519982:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4a00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333175.519985:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56c2a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.519990:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56c2a lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.519995:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff621ac300) 00010000:00010000:2.0:1763333175.519997:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333175.519999:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56c2a lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.520004:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56c2a lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.520028:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56c1c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a31 expref: 244 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.520038:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56c31 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a31 expref: 243 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.520044:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac900) 00010000:00010000:2.0:1763333175.520046:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333175.520048:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5400, rc 0) 00000100:00100000:2.0:1763333175.520075:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:56877:x1848987613730688:12345-192.168.204.28@tcp:101:rm.0 Request processed in 4410us (4653us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333175.520082:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9355 00000100:00100000:0.0:1763333175.525324:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.525517:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613731200 00000100:00100000:2.0:1763333175.525529:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613731200 00000100:00100000:2.0:1763333175.525830:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9357 00000100:00100000:2.0:1763333175.525842:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:56877:x1848987613731200:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:2.0:1763333175.525913:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1763333175.525941:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56b97 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b8:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a0e expref: 243 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.525962:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56c31 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a31 expref: 242 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.525976:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56b5f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a00 expref: 241 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.525986:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac900) 00010000:00010000:2.0:1763333175.525991:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333175.526020:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56c46 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333175.526031:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56c46 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.526041:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56c46 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.526052:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56c4d lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333175.526058:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56c4d lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.526063:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56c4d lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.526150:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56c54 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333175.526163:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c56c3f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a38 expref: 240 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.526170:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56c54 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.526207:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c56c3f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a38 expref: 240 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.526222:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c56c3f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a38 expref: 240 pid: 6521 timeout: 1379 lvb_type: 0 00000100:00100000:2.0:1763333175.526240:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff73167100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627271936:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333175.526338:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff44fdfc00 going to sleep for 11 seconds 00000100:00100000:1.0:1763333175.528293:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.542761:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613731456 00000100:00100000:3.0:1763333175.542779:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613731456 00000100:00100000:2.0:1763333175.543088:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9358 00000100:00100000:2.0:1763333175.543100:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56876:x1848987613731456:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333175.543125:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333175.543149:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56c5b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969a3f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.543266:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c56c62 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333175.543281:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c56c62 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b8:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.543293:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c56c62 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b8:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:2.0:1763333175.543311:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b8:0x0]: returning size 5 00010000:00010000:2.0:1763333175.543452:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56c5b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a3f expref: 244 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.543484:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c56c62 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1b8:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a3f expref: 243 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.543494:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac900) 00010000:00010000:2.0:1763333175.543497:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763333175.543501:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48190e00, rc 0) 00000100:00100000:1.0:1763333175.543555:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.543562:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:56876:x1848987613731456:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 462us (15276us total) trans 4294972360 rc 0/0 00000100:00100000:2.0:1763333175.543571:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9358 00000100:00100000:1.0:1763333175.543585:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613731584 00000100:00100000:1.0:1763333175.543590:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613731584 00010000:00010000:1.0:1763333175.543612:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c56c3f lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a38 expref: 243 pid: 6521 timeout: 1379 lvb_type: 0 00000100:00100000:2.0:1763333175.543626:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff73167100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627271936:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333175.543640:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3080 00010000:00010000:2.0:1763333175.543649:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56c54 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000100:00100000:1.0:1763333175.543649:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:2421:x1848987613731584:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333175.543662:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333175.543670:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c56c3f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a38 expref: 243 pid: 6521 timeout: 1379 lvb_type: 0 00010000:00010000:1.0:1763333175.543681:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c56c3f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a38 expref: 243 pid: 6521 timeout: 1379 lvb_type: 0 00010000:00010000:1.0:1763333175.543696:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c56c3f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a38 expref: 243 pid: 6521 timeout: 1379 lvb_type: 0 00010000:00010000:1.0:1763333175.543706:0:28428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac900) 00010000:00010000:1.0:1763333175.543710:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56c54 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333175.543718:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56c54 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333175.543723:0:28428:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56c54 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333175.543752:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333175.543776:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:2421:x1848987613731584:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 130us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333175.543783:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3080 00010000:00010000:2.0:1763333175.544059:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56c54 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.544066:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56c54 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00080000:2.0:1763333175.544296:0:6519:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x1b8:0x0] is inserted into orphan list, open count = 2 00010000:00010000:2.0:1763333175.544409:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56c54 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.544417:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56c54 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.544427:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56c54 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.544434:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48190200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333175.544437:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56c54 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.544445:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56c54 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.544455:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac900) 00010000:00010000:2.0:1763333175.544458:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763333175.544472:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56c54 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.544479:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56c54 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.544493:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56c46 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.544500:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56c46 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.544506:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56c46 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.544511:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56c46 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.544515:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333175.544517:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56c46 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.544526:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56c46 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.544533:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff621ac400) 00010000:00010000:2.0:1763333175.544535:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333175.544538:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56c46 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.544544:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56c46 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:2.0:1763333175.544558:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000031f7c714 reply state 000000003969a012 transno 4294972361 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56c4d lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.544568:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56c4d lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.544573:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff621ac200) 00010000:00010000:2.0:1763333175.544575:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333175.544578:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763333175.544722:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:56877:x1848987613731200:12345-192.168.204.28@tcp:36:rm.0 Request processed in 18881us (19407us total) trans 4294972361 rc 0/0 00000100:00100000:1.0:1763333175.544730:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9357 00000100:00100000:1.0:1763333175.554982:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.555048:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613731712 00000100:00100000:2.0:1763333175.555060:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613731712 00000100:00100000:2.0:1763333175.555127:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9359 00000100:00100000:2.0:1763333175.555137:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:56876:x1848987613731712:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333175.555162:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333175.555180:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56c70 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1b8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969a46 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.555236:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56c70 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a46 expref: 244 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.555256:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56c70 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a46 expref: 244 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.555273:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac900) 00010000:00010000:2.0:1763333175.555277:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333175.555280:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48190200, rc 0) 00000100:00100000:2.0:1763333175.555340:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56876:x1848987613731712:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 204us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333175.555382:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9359 00000100:00100000:2.0:1763333175.558182:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.558295:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613731840 00000100:00100000:1.0:1763333175.558304:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613731840 00000100:00100000:1.0:1763333175.558399:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6589 00000100:00100000:1.0:1763333175.558410:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73167100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2420:x1848987613731840:12345-192.168.204.28@tcp:1:lfs.0 00010000:00010000:1.0:1763333175.558457:0:28600:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56c77 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.558490:0:28600:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56bd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a15 expref: 14 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.558504:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333175.558507:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333175.558510:0:28600:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56c77 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.558548:0:28600:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56bd6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a15 expref: 14 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.558564:0:28600:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56bd6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a15 expref: 14 pid: 28650 timeout: 1379 lvb_type: 0 00000100:00100000:1.0:1763333175.558579:0:28600:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7dcfce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28600:1848987627272064:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333175.558651:0:28600:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff6be07e40 going to sleep for 11 seconds 00000100:00100000:1.0:1763333175.563231:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333175.563342:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613731968 00000100:00100000:0.0:1763333175.563390:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613731968 00000100:00100000:0.0:1763333175.563472:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9360 00000100:00100000:0.0:1763333175.563483:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56878:x1848987613731968:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333175.563505:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333175.563528:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56c7e lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969a4d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.563602:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56c85 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333175.563618:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56c85 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.563629:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56c85 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.563641:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c56c8c lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333175.563654:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c56c8c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.563660:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c56c8c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.563708:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56c85 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.563716:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56c85 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.563722:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56c85 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.563729:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56c85 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.563734:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700ee00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333175.563739:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56c85 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.563745:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56c85 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.563757:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44200) 00010000:00010000:0.0:1763333175.563760:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333175.563765:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56c85 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.563771:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56c85 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.563784:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c56c8c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.563790:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c56c8c lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.563797:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c56c8c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.563802:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700e400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333175.563805:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c56c8c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.563810:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c56c8c lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.563816:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff621ac200) 00010000:00010000:0.0:1763333175.563819:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333175.563822:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c56c8c lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.563827:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c56c8c lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.563855:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56c7e lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a4d expref: 245 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.563864:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44200) 00010000:00010000:0.0:1763333175.563866:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333175.563870:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56c7e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a4d expref: 245 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.563882:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4700fe00, rc 0) 00000100:00100000:0.0:1763333175.563935:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56878:x1848987613731968:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 454us (714us total) trans 0 rc 301/301 00000100:00100000:0.0:1763333175.563943:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9360 00000100:00100000:2.0:1763333175.565676:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.565766:0:28430:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613732096 00000100:00100000:3.0:1763333175.565777:0:28430:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613732096 00002000:00100000:3.0:1763333175.565821:0:28430:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x280000400:0x23f:0x0] (0->4) req@ffff92ff73165180 x1848987613732096/t0(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:486/0 lens 496/0 e 0 to 0 dl 1763333186 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763333175.565834:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff73165180 with x1848987613732096 ext(0->4) 00010000:00010000:3.0:1763333175.565843:0:28430:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56bd6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a15 expref: 15 pid: 28650 timeout: 1379 lvb_type: 0 00010000:00010000:3.0:1763333175.565860:0:28430:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56bd6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a15 expref: 15 pid: 28650 timeout: 1379 lvb_type: 0 00002000:00010000:3.0:1763333175.565876:0:28430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff92ff73165180 00000100:00100000:3.0:1763333175.565904:0:28430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 107 00000100:00100000:3.0:1763333175.565913:0:28430:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73165180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2420:x1848987613732096:12345-192.168.204.28@tcp:4:bash.0 00000100:00100000:3.0:1763333175.566652:0:28430:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73165180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2420:x1848987613732096:12345-192.168.204.28@tcp:4:bash.0 Request processed in 737us (982us total) trans 21474838913 rc 0/0 00000100:00100000:3.0:1763333175.566661:0:28430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 107 00002000:00100000:3.0:1763333175.566668:0:28430:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x280000400:0x23f:0x0] (0->4) req@ffff92ff73165180 x1848987613732096/t21474838913(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:486/0 lens 496/448 e 0 to 0 dl 1763333186 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763333175.566677:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff73165180 with x1848987613732096 ext(0->4) 00010000:00010000:3.0:1763333175.566683:0:28430:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56bd6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a15 expref: 17 pid: 28650 timeout: 1379 lvb_type: 0 00010000:00010000:3.0:1763333175.566697:0:28430:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56bd6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a15 expref: 17 pid: 28650 timeout: 1379 lvb_type: 0 00002000:00010000:3.0:1763333175.566703:0:28430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff92ff73165180 00000100:00100000:1.0:1763333175.566820:0:28600:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7dcfce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28600:1848987627272064:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333175.566846:0:28600:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56c77 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333175.569981:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.570028:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333175.570633:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613732224 00000100:00100000:0.0:1763333175.570645:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613732224 00010000:00010000:0.0:1763333175.570692:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56bd6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a15 expref: 17 pid: 28650 timeout: 1379 lvb_type: 0 00000100:00100000:0.0:1763333175.570739:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3081 00000100:00100000:0.0:1763333175.570750:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2421:x1848987613732224:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333175.570765:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1763333175.570784:0:6506:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x23f:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:0.0:1763333175.570788:0:6506:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x23f:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1763333175.570793:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56bd6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a15 expref: 17 pid: 28650 timeout: 1379 lvb_type: 0 00010000:00010000:0.0:1763333175.570807:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56bd6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a15 expref: 17 pid: 28650 timeout: 1379 lvb_type: 0 00010000:00010000:0.0:1763333175.570830:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56bd6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a15 expref: 17 pid: 28650 timeout: 1379 lvb_type: 0 00010000:00010000:0.0:1763333175.570847:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333175.570850:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333175.570855:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56c77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.570867:0:6506:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56c77 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.570911:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333175.570941:0:28600:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56c77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333175.570980:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2421:x1848987613732224:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 231us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333175.570988:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3081 00010000:00010000:3.0:1763333175.571009:0:28600:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56c77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.571032:0:28600:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56c77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.571041:0:28600:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56c77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.571050:0:28600:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56c77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.571057:0:28600:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fe00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333175.571062:0:28600:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56c77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.571071:0:28600:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56c77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.571089:0:28600:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56c77 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.571097:0:28600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56c77 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333175.571172:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73167100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2420:x1848987613731840:12345-192.168.204.28@tcp:1:lfs.0 Request processed in 12761us (12999us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333175.571181:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6589 00000100:00100000:2.0:1763333175.572089:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613732352 00000100:00100000:2.0:1763333175.572097:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613732352 00000100:00100000:2.0:1763333175.572144:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9361 00000100:00100000:2.0:1763333175.572153:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56878:x1848987613732352:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333175.572169:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333175.572192:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56c93 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969a54 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.572257:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56c9a lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333175.572280:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56c9a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.572289:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56c9a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.572303:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56ca1 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333175.572310:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56ca1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.572316:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56ca1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.572378:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56c9a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.572385:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56c9a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.572391:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56c9a lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.572397:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56c9a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.572401:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48190c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333175.572405:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56c9a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.572410:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56c9a lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.572421:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff621ac400) 00010000:00010000:2.0:1763333175.572423:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333175.572427:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56c9a lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.572433:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56c9a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.572446:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56ca1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.572451:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56ca1 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.572456:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56ca1 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.572460:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48191600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333175.572472:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56ca1 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.572479:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56ca1 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.572486:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff621ac200) 00010000:00010000:2.0:1763333175.572488:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333175.572491:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56ca1 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.572496:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c56ca1 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.572521:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56c93 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a54 expref: 245 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.572530:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff621ac400) 00010000:00010000:2.0:1763333175.572531:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333175.572534:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56c93 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a54 expref: 245 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.572550:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48191800, rc 0) 00000100:00100000:2.0:1763333175.572604:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56878:x1848987613732352:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 452us (2575us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333175.572611:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9361 00000100:00100000:2.0:1763333175.578156:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333175.578275:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613732608 00000100:00100000:0.0:1763333175.578285:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613732608 00000100:00100000:0.0:1763333175.578383:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9362 00000100:00100000:0.0:1763333175.578394:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73165880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56876:x1848987613732608:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:0.0:1763333175.578444:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333175.578480:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c56c70 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a46 expref: 244 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.578498:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac900) 00010000:00010000:0.0:1763333175.578503:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333175.578531:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56ca8 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333175.578543:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56ca8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.578552:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56ca8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000040:00080000:0.0:1763333175.578784:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1432, 88 off120728 00000004:00080000:0.0:1763333175.578792:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1279658442899ns, next at 1280195897991ns, rc = 0 00000040:00080000:0.0:1763333175.578832:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1431, 88 off120728 00000004:00080000:0.0:1763333175.578837:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1279658487843ns, next at 1279713547966ns, rc = 0 00000040:00080000:0.0:1763333175.578853:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1432, 88 off120816 00000004:00080000:0.0:1763333175.578858:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1279658508704ns, next at 1279713547966ns, rc = 0 00000040:00080000:0.0:1763333175.578867:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1433, 88 off120816 00000004:00080000:0.0:1763333175.578870:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1279658521513ns, next at 1280195897991ns, rc = 0 00000100:00100000:3.0:1763333175.583783:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.584777:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613732736 00000100:00100000:2.0:1763333175.584789:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613732736 00000100:00100000:2.0:1763333175.584866:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9363 00000100:00100000:2.0:1763333175.584877:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50049500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56878:x1848987613732736:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333175.584901:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333175.584924:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56caf lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969a5b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.585000:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56cb6 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333175.585014:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56cb6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.585026:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56cb6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:2.0:1763333175.585506:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1763333175.585513:0:6519:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1763333175.585552:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56caf lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a5b expref: 247 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.585574:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56cb6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a5b expref: 246 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.585585:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff621ac400) 00010000:00010000:2.0:1763333175.585588:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1763333175.585592:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4000, rc 0) 00000100:00100000:2.0:1763333175.585716:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50049500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56878:x1848987613732736:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 841us (1958us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333175.585725:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9363 00000001:00080000:2.0:1763333175.588962:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972362 is committed 00000004:00080000:2.0:1763333175.588980:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 940 committed 00000004:00080000:2.0:1763333175.588993:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 936 committed 00000004:00080000:2.0:1763333175.589006:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 935 committed 00000004:00080000:2.0:1763333175.589008:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 939 committed 00000100:00100000:1.0:1763333175.589285:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1763333175.589310:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7dcfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627272192:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333175.589417:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333175.589495:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42f0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627272320:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333175.589520:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333175.589557:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627272192 00000100:00100000:1.0:1763333175.589565:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627272192 00000100:00100000:1.0:1763333175.589618:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627272320 00000100:00100000:1.0:1763333175.589621:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627272320 00000100:00100000:1.0:1763333175.589642:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6590 00000100:00100000:1.0:1763333175.589651:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+18:3654:x1848987627272192:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333175.589858:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+19:3654:x1848987627272192:12345-0@lo:2:osp-syn-0-1.0 Request processed in 207us (440us total) trans 21474838914 rc 0/0 00000100:00100000:1.0:1763333175.589865:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6590 00000100:00100000:1.0:1763333175.589885:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6591 00000100:00100000:1.0:1763333175.589890:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+18:3652:x1848987627272320:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1763333175.589953:0:28600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x240:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333175.589957:0:28600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x240:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763333175.589959:0:28600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x240:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333175.589962:0:28600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x240:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763333175.589964:0:28600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x240:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333175.589993:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+19:3652:x1848987627272320:12345-0@lo:2:osp-syn-0-1.0 Request processed in 102us (471us total) trans 21474838915 rc 0/0 00000100:00100000:1.0:1763333175.589999:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6591 00000004:00080000:1.0:1763333175.590041:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe42f0d180/2, rc 0, transno 21474838915 00000100:00100000:1.0:1763333175.590046:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42f0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627272320:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333175.590054:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763333175.590059:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7400d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627272448:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333175.590079:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333175.590111:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7400df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627272576:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333175.590130:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1763333175.590144:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7dcfed80/2, rc 0, transno 21474838914 00000100:00100000:1.0:1763333175.590148:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7dcfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627272192:0@lo:2:osp-syn-0-1.0 00000004:00010000:1.0:1763333175.590188:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ba4c2a35 reply state 000000003c46759f transno 4294972362 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56ca8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333175.590207:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56ca8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333175.590215:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac900) 00010000:00010000:1.0:1763333175.590218:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1763333175.590222:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1763333175.590296:0:6521:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1763333175.590307:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73165880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56876:x1848987613732608:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 11914us (12159us total) trans 4294972362 rc 0/0 00000100:00100000:1.0:1763333175.590315:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9362 00010000:00010000:0.0:1763333175.590513:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56ca8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.590522:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56ca8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.590529:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56ca8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.590536:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700fe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333175.590540:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56ca8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.590548:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56ca8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.590561:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac900) 00010000:00010000:0.0:1763333175.590563:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333175.590567:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56ca8 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.590572:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56ca8 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00000100:00100000:0.0:1763333175.590601:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627272448 00000100:00100000:0.0:1763333175.590606:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627272448 00000100:00100000:0.0:1763333175.590632:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627272576 00000100:00100000:0.0:1763333175.590635:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627272576 00000100:00100000:0.0:1763333175.590653:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6592 00000100:00100000:0.0:1763333175.590660:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+46:3652:x1848987627272448:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1763333175.590763:0:8404:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x23f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333175.590766:0:8404:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x23f:0x0] updating lvb mtime from disk: 1763333175 -> 1763333175 00002000:00010000:0.0:1763333175.590769:0:8404:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x23f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333175.590772:0:8404:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x23f:0x0] updating lvb ctime from disk: 1763333175 -> 1763333175 00002000:00010000:0.0:1763333175.590774:0:8404:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x23f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333175.590814:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+47:3652:x1848987627272448:12345-0@lo:2:osp-syn-1-1.0 Request processed in 154us (733us total) trans 17179871610 rc 0/0 00000100:00100000:0.0:1763333175.590821:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6592 00000100:00100000:0.0:1763333175.590834:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6593 00000100:00100000:0.0:1763333175.590840:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+46:3654:x1848987627272576:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1763333175.590889:0:8404:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x240:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333175.590892:0:8404:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x240:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763333175.590894:0:8404:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x240:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333175.590896:0:8404:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x240:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763333175.590898:0:8404:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x240:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333175.590925:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+47:3654:x1848987627272576:12345-0@lo:2:osp-syn-1-1.0 Request processed in 86us (793us total) trans 17179871611 rc 0/0 00000100:00100000:0.0:1763333175.590931:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6593 00000004:00080000:0.0:1763333175.590959:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7400d880/2, rc 0, transno 17179871610 00000100:00100000:0.0:1763333175.590964:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7400d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627272448:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1763333175.590981:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7400df80/2, rc 0, transno 17179871611 00000100:00100000:0.0:1763333175.590985:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7400df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627272576:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1763333175.591047:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56c4d lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.591056:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56c4d lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.591061:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56c4d lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.591066:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333175.591069:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56c4d lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.591075:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56c4d lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.591085:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff621ac200) 00010000:00010000:3.0:1763333175.591088:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333175.591092:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56c4d lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.591098:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56c4d lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000100:00100000:3.0:1763333175.594115:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.594225:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613732864 00000100:00100000:2.0:1763333175.594237:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613732864 00000100:00100000:2.0:1763333175.594308:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9364 00000100:00100000:2.0:1763333175.594320:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50048700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56876:x1848987613732864:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333175.594573:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333175.594600:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56cbd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1b8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969a62 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.594659:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56cbd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a62 expref: 238 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.594674:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56cbd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a62 expref: 238 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.594691:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac900) 00010000:00010000:2.0:1763333175.594694:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333175.594698:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5e00, rc 0) 00000100:00100000:2.0:1763333175.594762:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50048700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56876:x1848987613732864:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 444us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333175.594769:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9364 00000100:00100000:2.0:1763333175.596657:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.596699:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613732992 00000100:00100000:1.0:1763333175.596709:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613732992 00000100:00100000:1.0:1763333175.596776:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9365 00000100:00100000:1.0:1763333175.596787:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73165f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56878:x1848987613732992:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333175.596805:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333175.596826:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56cc4 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969a69 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.596896:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56ccb lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333175.596910:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56ccb lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333175.596922:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56ccb lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333175.596940:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56cd2 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333175.596947:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56cd2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333175.596953:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56cd2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333175.597001:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56ccb lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333175.597007:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56ccb lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333175.597013:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56ccb lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333175.597018:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56ccb lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333175.597024:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333175.597029:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56ccb lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333175.597036:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56ccb lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333175.597047:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff621ac400) 00010000:00010000:1.0:1763333175.597050:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333175.597054:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56ccb lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333175.597059:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56ccb lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333175.597074:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56cd2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333175.597079:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56cd2 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333175.597084:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56cd2 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333175.597088:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333175.597091:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56cd2 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333175.597097:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56cd2 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333175.597103:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff62250e00) 00010000:00010000:1.0:1763333175.597106:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333175.597109:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56cd2 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333175.597114:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56cd2 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333175.597144:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56cc4 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a69 expref: 239 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.597154:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff621ac400) 00010000:00010000:1.0:1763333175.597156:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333175.597160:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56cc4 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a69 expref: 239 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.597174:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7fc00, rc 0) 00000100:00100000:1.0:1763333175.597233:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73165f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56878:x1848987613732992:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 448us (586us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333175.597241:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9365 00000100:00100000:3.0:1763333175.601664:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.603898:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.604403:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613733248 00000100:00100000:1.0:1763333175.604414:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613733248 00000100:00100000:2.0:1763333175.604424:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613733376 00000100:00100000:2.0:1763333175.604441:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613733376 00000100:00100000:1.0:1763333175.604480:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9366 00000100:00100000:2.0:1763333175.604493:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9367 00000100:00100000:1.0:1763333175.604494:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5004b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56876:x1848987613733248:12345-192.168.204.28@tcp:101:lfs.0 00000100:00100000:2.0:1763333175.604508:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5004bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56878:x1848987613733376:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333175.604518:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333175.604518:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333175.604522:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763333175.604540:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56cd9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969a70 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.604548:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56cb6 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a5b expref: 239 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.604567:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff621ac400) 00010000:00010000:2.0:1763333175.604577:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333175.604587:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56ce0 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969a77 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.604610:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56ce7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333175.604624:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56ce7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333175.604635:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56ce7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.604668:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56cee lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333175.604679:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56cee lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00000004:00200000:1.0:1763333175.604680:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b8:0x0]: returning size 5 00000004:00200000:1.0:1763333175.604688:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1763333175.604691:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56cee lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.604705:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56cf5 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00000004:00010000:1.0:1763333175.604708:0:6521:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56ce7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.604725:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56cf5 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.604732:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56cf5 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333175.604739:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56cd9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a70 expref: 241 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.604759:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56ce7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a70 expref: 240 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.604766:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac900) 00010000:00010000:1.0:1763333175.604770:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1763333175.604773:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f200, rc 0) 00000100:00100000:1.0:1763333175.604844:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5004b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:56876:x1848987613733248:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 355us (3197us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333175.604852:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9366 00010000:00010000:2.0:1763333175.605165:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56cfc lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333175.605175:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56cfc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.605183:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56cfc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:2.0:1763333175.605192:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b9:0x0]: returning size 0 00010000:00010000:2.0:1763333175.605218:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56cee lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.605225:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56cee lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.605231:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56cee lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.605238:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56cee lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.605243:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333175.605247:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56cee lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.605253:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56cee lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.605266:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff621acc00) 00010000:00010000:2.0:1763333175.605268:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333175.605272:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56cee lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.605278:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56cee lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:2.0:1763333175.605288:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006da12bd5 reply state 0000000030731ad5 transno 4294972363 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56cf5 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.605298:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56cf5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.605304:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff621ac300) 00010000:00010000:2.0:1763333175.605305:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333175.605308:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763333175.605331:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56ce0 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a77 expref: 241 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.605376:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56cfc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a77 expref: 240 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.605383:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b9:0x0].0x0 (ffff92ff621acf00) 00010000:00010000:2.0:1763333175.605386:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333175.605388:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4a00, rc 0) 00000100:00100000:2.0:1763333175.605432:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5004bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56878:x1848987613733376:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 929us (1545us total) trans 4294972363 rc 0/0 00000100:00100000:2.0:1763333175.605439:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9367 00000100:00100000:3.0:1763333175.610607:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.610672:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613733632 00000100:00100000:2.0:1763333175.610684:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613733632 00000100:00100000:2.0:1763333175.610759:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9368 00000100:00100000:2.0:1763333175.610771:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5004aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56878:x1848987613733632:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333175.610793:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333175.610814:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56d0a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1b9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969a7e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.610944:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56d11 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333175.610960:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56cfc lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1b9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a77 expref: 242 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.610968:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56d11 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1b9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.611003:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56cfc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a77 expref: 242 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.611016:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56cfc lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1b9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a77 expref: 242 pid: 6519 timeout: 1379 lvb_type: 0 00000100:00100000:2.0:1763333175.611030:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff73164e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627272704:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333175.611136:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff50ece840 going to sleep for 11 seconds 00000100:00100000:2.0:1763333175.614165:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.614273:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613733760 00000100:00100000:1.0:1763333175.614281:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613733760 00000100:00100000:1.0:1763333175.614336:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6594 00000100:00100000:1.0:1763333175.614345:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2421:x1848987613733760:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333175.614399:0:28651:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333175.614423:0:28651:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56d18 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969a85 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333175.614469:0:28651:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x23f:0x0] initial LVB size: 5, mtime: 0x691a5437, atime: 0x0, ctime: 0x691a5437, blocks: 0x8 00010000:00010000:1.0:1763333175.614491:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333175.614494:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333175.614508:0:28651:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56d18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a85 expref: 16 pid: 28651 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333175.614527:0:28651:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56d18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a85 expref: 16 pid: 28651 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333175.614548:0:28651:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f800, rc 0) 00000100:00100000:1.0:1763333175.614613:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2421:x1848987613733760:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 269us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333175.614620:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6594 00000100:00100000:0.0:1763333175.616208:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff73164e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627272704:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333175.616247:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56d11 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000100:00100000:2.0:1763333175.616588:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333175.617052:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613733888 00000100:00100000:0.0:1763333175.617061:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613733888 00010000:00010000:0.0:1763333175.617097:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56cfc lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1b9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a77 expref: 243 pid: 6519 timeout: 1379 lvb_type: 0 00000100:00100000:0.0:1763333175.617141:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3082 00000100:00100000:0.0:1763333175.617150:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73165500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:2421:x1848987613733888:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333175.617166:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333175.617174:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56cfc lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1b9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a77 expref: 243 pid: 6519 timeout: 1379 lvb_type: 0 00010000:00010000:0.0:1763333175.617186:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56cfc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a77 expref: 243 pid: 6519 timeout: 1379 lvb_type: 0 00010000:00010000:0.0:1763333175.617208:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56cfc lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a77 expref: 243 pid: 6519 timeout: 1379 lvb_type: 0 00010000:00010000:0.0:1763333175.617223:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b9:0x0].0x0 (ffff92ff621acf00) 00010000:00010000:0.0:1763333175.617228:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56d11 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.617236:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56d11 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.617243:0:6506:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56d11 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1b9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.617276:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333175.617333:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73165500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:2421:x1848987613733888:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 184us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333175.617341:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3082 00010000:00010000:2.0:1763333175.617651:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56d11 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.617660:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56d11 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:2.0:1763333175.617684:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b9:0x0]: returning size 0 00000004:00080000:2.0:1763333175.617852:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x241:0x0], index 1: 0 00000004:00080000:2.0:1763333175.617859:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x241:0x0], index 0: 0 00000004:00080000:2.0:1763333175.617865:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x242:0x0], index 0: 0 00000004:00080000:2.0:1763333175.617869:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x242:0x0], index 1: 0 00010000:00010000:2.0:1763333175.618777:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56d11 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.618790:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56d11 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1b9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.618797:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56d11 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1b9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.618803:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333175.618808:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56d11 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1b9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.618815:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56d11 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1b9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.618832:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b9:0x0].0x0 (ffff92ff621acf00) 00010000:00010000:2.0:1763333175.618834:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333175.618838:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56d11 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1b9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.618843:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56d11 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1b9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.618904:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56d0a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1b9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a7e expref: 242 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.618918:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b9:0x0].0x0 (ffff92ff621acf00) 00010000:00010000:2.0:1763333175.622105:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763333175.622121:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56d0a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a7e expref: 242 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.622153:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5c00, rc 0) 00000100:00100000:2.0:1763333175.622253:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5004aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56878:x1848987613733632:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 11483us (11656us total) trans 4294972364 rc 301/301 00000100:00100000:2.0:1763333175.622263:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9368 00000100:00100000:2.0:1763333175.629097:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333175.629324:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613734144 00000100:00100000:0.0:1763333175.629336:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613734144 00000100:00100000:0.0:1763333175.629470:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3199 00000100:00100000:0.0:1763333175.629485:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73166d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56878:x1848987613734144:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333175.631596:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73166d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:56878:x1848987613734144:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 2103us (2498us total) trans 4294972365 rc 0/0 00000100:00100000:0.0:1763333175.631613:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3199 00000100:00100000:3.0:1763333175.636497:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333175.638506:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613734400 00000100:00100000:0.0:1763333175.638527:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613734400 00000100:00100000:0.0:1763333175.638620:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3200 00000100:00100000:0.0:1763333175.638633:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:56878:x1848987613734400:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333175.638937:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:56878:x1848987613734400:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 307us (2453us total) trans 4294972366 rc 0/0 00000100:00100000:0.0:1763333175.638945:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3200 00000100:00100000:3.0:1763333175.654423:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.654565:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613734656 00000100:00100000:2.0:1763333175.654578:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613734656 00000100:00100000:2.0:1763333175.654659:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9369 00000100:00100000:2.0:1763333175.654673:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:55917:x1848987613734656:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333175.654705:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333175.654733:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56d26 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969a8c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.654886:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56d2d lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333175.654900:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56d2d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.654911:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56d2d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.654922:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56d34 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333175.654930:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56d34 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.654937:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56d34 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.654999:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56d3b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333175.655007:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56d3b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.655014:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56d3b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:2.0:1763333175.655023:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b9:0x0]: returning size 0 00010000:00010000:2.0:1763333175.655108:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56d2d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.655117:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56d2d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.655123:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56d2d lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.655130:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56d2d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.655137:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333175.655141:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56d2d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.655148:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56d2d lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.655166:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff621acf00) 00010000:00010000:2.0:1763333175.655169:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333175.655174:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56d2d lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.655180:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56d2d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.655193:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56d34 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.655199:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56d34 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.655204:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56d34 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.655210:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4a00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333175.655212:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56d34 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.655218:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56d34 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.655225:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff621ac300) 00010000:00010000:2.0:1763333175.655227:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333175.655230:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56d34 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.655235:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56d34 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.655273:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56d26 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a8c expref: 246 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.655290:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56d3b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a8c expref: 245 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.655297:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b9:0x0].0x0 (ffff92ff621acc00) 00010000:00010000:2.0:1763333175.655299:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333175.655302:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4400, rc 0) 00000100:00100000:2.0:1763333175.655415:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:55917:x1848987613734656:12345-192.168.204.28@tcp:101:bash.0 Request processed in 745us (1004us total) trans 4294972367 rc 0/0 00000100:00100000:2.0:1763333175.655423:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9369 00000100:00100000:2.0:1763333175.661527:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333175.662914:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613734784 00000100:00100000:0.0:1763333175.662927:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613734784 00000100:00100000:0.0:1763333175.663019:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9370 00000100:00100000:0.0:1763333175.663030:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73164000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:55917:x1848987613734784:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333175.663055:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333175.663080:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56d49 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1b9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969a93 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.663118:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c56d50 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333175.663139:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c56d50 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.663151:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c56d50 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.663305:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56d49 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a93 expref: 247 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.663324:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c56d50 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a93 expref: 246 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.663335:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b9:0x0].0x0 (ffff92ff621acc00) 00010000:00010000:0.0:1763333175.663339:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763333175.663343:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4700e400, rc 0) 00000100:00100000:1.0:1763333175.666430:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73164000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:55917:x1848987613734784:12345-192.168.204.28@tcp:101:bash.0 Request processed in 3390us (4902us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333175.666442:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9370 00000100:00100000:3.0:1763333175.671980:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.672073:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.672428:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613734912 00000100:00100000:1.0:1763333175.672438:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613734912 00000100:00100000:1.0:1763333175.672502:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6595 00000100:00100000:1.0:1763333175.672512:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4960b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2421:x1848987613734912:12345-192.168.204.28@tcp:23:lfs.0 00000100:00100000:1.0:1763333175.672644:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4960b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2421:x1848987613734912:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 133us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333175.672652:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6595 00000100:00100000:2.0:1763333175.674859:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613735168 00000100:00100000:2.0:1763333175.674875:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613735168 00000100:00100000:2.0:1763333175.674955:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9371 00000100:00100000:2.0:1763333175.674964:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:55917:x1848987613735168:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:2.0:1763333175.675022:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333175.675054:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56d3b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a8c expref: 246 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.675075:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b9:0x0].0x0 (ffff92ff621acc00) 00010000:00010000:2.0:1763333175.675080:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333175.675290:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56d57 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1b9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333175.675304:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56d57 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.675316:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56d57 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000100:00100000:0.0:1763333175.675324:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000001:00080000:2.0:1763333175.675405:0:6519:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294972368 00000004:00010000:2.0:1763333175.675441:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000bbf666a1 reply state 00000000bf3bd2f9 transno 4294972369 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56d57 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.675452:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56d57 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1b9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.675458:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b9:0x0].0x0 (ffff92ff621acc00) 00010000:00010000:2.0:1763333175.675468:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333175.675471:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763333175.675559:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:55917:x1848987613735168:12345-192.168.204.28@tcp:36:bash.0 Request processed in 595us (3484us total) trans 4294972369 rc 0/0 00000100:00100000:2.0:1763333175.675566:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9371 00000020:00080000:2.0:1763333175.675571:0:6519:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763333175.676845:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613735296 00000100:00100000:0.0:1763333175.676860:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613735296 00000100:00100000:1.0:1763333175.677014:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6596 00000100:00100000:1.0:1763333175.677023:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2418:x1848987613735296:12345-192.168.204.28@tcp:23:lfs.0 00000100:00100000:1.0:1763333175.677129:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2418:x1848987613735296:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 107us (1809us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333175.677136:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6596 00000100:00100000:0.0:1763333175.679670:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.679718:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613735424 00000100:00100000:2.0:1763333175.679727:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613735424 00000100:00100000:2.0:1763333175.679787:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9372 00000100:00100000:2.0:1763333175.679798:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:55917:x1848987613735424:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333175.679822:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333175.679843:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56d5e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969a9a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.679901:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56d5e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a9a expref: 249 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.679916:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56d5e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a9a expref: 249 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.679935:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b9:0x0].0x0 (ffff92ff621acc00) 00010000:00010000:2.0:1763333175.679938:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333175.679942:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4a00, rc 0) 00000100:00100000:2.0:1763333175.681271:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:55917:x1848987613735424:12345-192.168.204.28@tcp:101:bash.0 Request processed in 1469us (1603us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333175.681280:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9372 00000100:00100000:2.0:1763333175.685598:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333175.686169:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613735552 00000100:00100000:0.0:1763333175.686180:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613735552 00000100:00100000:0.0:1763333175.686263:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1627 00000100:00100000:0.0:1763333175.686274:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73164700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2421:x1848987613735552:12345-192.168.204.28@tcp:3:lfs.0 00010000:00010000:0.0:1763333175.686314:0:28427:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56d65 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.686330:0:28427:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333175.686333:0:28427:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333175.686339:0:28427:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56d65 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.686381:0:28427:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56d65 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.686527:0:28427:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56d65 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.686535:0:28427:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56d65 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.686543:0:28427:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56d65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.686549:0:28427:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700fe00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333175.686553:0:28427:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56d65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.686562:0:28427:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56d65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.686580:0:28427:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56d65 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.686587:0:28427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56d65 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333175.686666:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73164700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2421:x1848987613735552:12345-192.168.204.28@tcp:3:lfs.0 Request processed in 394us (1077us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1763333175.686676:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1627 00000100:00100000:2.0:1763333175.686765:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333175.691388:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613735808 00000100:00100000:0.0:1763333175.691404:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613735808 00000100:00100000:0.0:1763333175.691512:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9373 00000100:00100000:0.0:1763333175.691525:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:55917:x1848987613735808:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333175.691550:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333175.691553:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763333175.691582:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56d5e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a9a expref: 249 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.691607:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b9:0x0].0x0 (ffff92ff621acc00) 00010000:00010000:0.0:1763333175.691612:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333175.691628:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56d6c lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969aa1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.691684:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e000/0xb32e3ef184c56d73 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333175.691699:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e000/0xb32e3ef184c56d73 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.691709:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e000/0xb32e3ef184c56d73 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000040:00080000:0.0:1763333175.691942:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1433, 88 off120904 00000004:00080000:0.0:1763333175.691950:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1279771601174ns, next at 1279713547966ns, rc = 0 00000040:00080000:0.0:1763333175.691995:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1434, 88 off120904 00000004:00080000:0.0:1763333175.692001:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1279771651446ns, next at 1280195897991ns, rc = 0 00000040:00080000:0.0:1763333175.692024:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1435, 88 off120992 00000004:00080000:0.0:1763333175.692028:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1279771679143ns, next at 1280195897991ns, rc = 0 00000040:00080000:0.0:1763333175.692039:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1434, 88 off120992 00000004:00080000:0.0:1763333175.692043:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1279771694238ns, next at 1279713547966ns, rc = 0 00000100:00100000:3.0:1763333175.695031:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333175.695089:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613735936 00000100:00100000:0.0:1763333175.695101:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613735936 00000100:00100000:0.0:1763333175.695169:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9374 00000100:00100000:0.0:1763333175.695181:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:56876:x1848987613735936:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333175.695204:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333175.695328:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56d7a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969aa8 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.695391:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56d81 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333175.695412:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56d81 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333175.695426:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56d81 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333175.695552:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56d7a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969aa8 expref: 253 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.695569:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fc00/0xb32e3ef184c56d81 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969aa8 expref: 252 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.695577:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac900) 00010000:00010000:1.0:1763333175.695580:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763333175.695584:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7fc00, rc 0) 00000100:00100000:1.0:1763333175.696847:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:56876:x1848987613735936:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1660us (1816us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333175.696858:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9374 00000001:00080000:1.0:1763333175.702869:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972370 is committed 00000004:00080000:1.0:1763333175.702887:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 938 committed 00000004:00080000:1.0:1763333175.702908:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 942 committed 00000004:00080000:1.0:1763333175.702924:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 941 committed 00000004:00080000:1.0:1763333175.702928:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 937 committed 00010000:00010000:0.0:1763333175.703018:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56cf5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.703032:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56cf5 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.703040:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56cf5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.703047:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333175.703053:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56cf5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.703061:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56cf5 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.703079:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff621ac300) 00010000:00010000:0.0:1763333175.703083:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333175.703088:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56cf5 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.703095:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56cf5 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000100:00100000:2.0:1763333175.703100:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1763333175.703122:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56d57 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00000100:00100000:2.0:1763333175.703128:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe45180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627272832:0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1763333175.703140:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56d57 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.703146:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56d57 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.703152:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333175.703155:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56d57 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.703160:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56d57 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.703169:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b9:0x0].0x0 (ffff92ff621acc00) 00010000:00010000:0.0:1763333175.703171:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333175.703174:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56d57 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.703188:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56d57 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1b9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000100:00100000:2.0:1763333175.703203:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333175.703253:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77b17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627272960:0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1763333175.703264:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e000/0xb32e3ef184c56d73 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969aa1 expref: 242 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.703274:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b9:0x0].0x0 (ffff92ff621acc00) 00000100:00100000:2.0:1763333175.703277:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1763333175.703279:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763333175.703295:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56d6c lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1b9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969aa1 expref: 242 pid: 6519 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1763333175.703312:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e000/0xb32e3ef184c56d73 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969aa1 expref: 241 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333175.703316:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627272832 00000100:00100000:2.0:1763333175.703323:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627272832 00010000:00010000:0.0:1763333175.703377:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b9:0x0].0x0 (ffff92ff621acc00) 00010000:00010000:0.0:1763333175.703381:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763333175.703384:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4700e000, rc 0) 00000100:00100000:2.0:1763333175.703389:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627272960 00000100:00100000:2.0:1763333175.703393:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627272960 00000100:00100000:2.0:1763333175.703414:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6597 00000100:00100000:2.0:1763333175.703422:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+48:3654:x1848987627272832:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333175.703440:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:55917:x1848987613735808:12345-192.168.204.28@tcp:101:bash.0 Request processed in 11917us (16675us total) trans 4294972370 rc 0/0 00000100:00100000:0.0:1763333175.703450:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9373 00000100:00100000:3.0:1763333175.703600:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1763333175.703606:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+49:3654:x1848987627272832:12345-0@lo:2:osp-syn-1-1.0 Request processed in 182us (402us total) trans 17179871612 rc 0/0 00000100:00100000:3.0:1763333175.703613:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe49609880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627273088:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333175.703618:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6597 00000100:00100000:2.0:1763333175.703636:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6598 00000100:00100000:2.0:1763333175.703645:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+48:3652:x1848987627272960:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333175.703652:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333175.703685:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627273088 00000100:00100000:3.0:1763333175.703690:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627273088 00000100:00100000:3.0:1763333175.703719:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6599 00000100:00100000:3.0:1763333175.703726:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4960bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+19:3652:x1848987627273088:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333175.703735:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+49:3652:x1848987627272960:12345-0@lo:2:osp-syn-1-1.0 Request processed in 91us (459us total) trans 17179871613 rc 0/0 00000100:00100000:2.0:1763333175.703742:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6598 00000100:00100000:2.0:1763333175.703773:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4960b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627273216:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333175.703800:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333175.703837:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4960bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+20:3652:x1848987627273088:12345-0@lo:2:osp-syn-0-1.0 Request processed in 110us (186us total) trans 21474838916 rc 0/0 00000004:00080000:2.0:1763333175.703838:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe45180e00/2, rc 0, transno 17179871612 00000100:00100000:2.0:1763333175.703847:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe45180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627272832:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333175.703849:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6599 00000100:00100000:3.0:1763333175.703867:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627273216 00000100:00100000:3.0:1763333175.703871:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627273216 00000100:00100000:3.0:1763333175.703903:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6600 00000100:00100000:3.0:1763333175.703910:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+20:3654:x1848987627273216:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333175.703991:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+21:3654:x1848987627273216:12345-0@lo:2:osp-syn-0-1.0 Request processed in 81us (190us total) trans 21474838917 rc 0/0 00000100:00100000:3.0:1763333175.703998:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6600 00000004:00080000:3.0:1763333175.704027:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe49609880/2, rc 0, transno 21474838916 00000100:00100000:3.0:1763333175.704032:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe49609880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627273088:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1763333175.704041:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff77b17b80/2, rc 0, transno 17179871613 00000100:00100000:3.0:1763333175.704044:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77b17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627272960:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763333175.704071:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4960b100/2, rc 0, transno 21474838917 00000100:00100000:3.0:1763333175.704075:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4960b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627273216:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333175.709157:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333175.709528:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.710708:0:28430:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613736064 00000100:00100000:2.0:1763333175.710723:0:28430:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613736064 00000100:00100000:2.0:1763333175.710822:0:28430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1628 00000100:00100000:2.0:1763333175.710834:0:28430:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4960b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:2421:x1848987613736064:12345-192.168.204.28@tcp:4:lfs.0 00010000:00010000:2.0:1763333175.710875:0:28430:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56d88 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.710895:0:28430:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56b2e lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699e4 expref: 30 pid: 28650 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333175.710904:0:28430:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333175.710907:0:28430:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333175.710911:0:28430:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56d88 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.710950:0:28430:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56b2e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699e4 expref: 30 pid: 28650 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333175.710964:0:28430:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56b2e lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699e4 expref: 30 pid: 28650 timeout: 1379 lvb_type: 1 00000100:00100000:2.0:1763333175.710978:0:28430:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77b16a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:28430:1848987627273344:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333175.711089:0:28430:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff44fdfc00 going to sleep for 11 seconds 00000100:00100000:1.0:1763333175.711308:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613736192 00000100:00100000:1.0:1763333175.711314:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613736192 00000100:00100000:1.0:1763333175.711380:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6601 00000100:00100000:1.0:1763333175.711389:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+31:55917:x1848987613736192:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333175.711399:0:29013:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333175.711416:0:29013:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56d8f lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969aaf expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333175.711447:0:29013:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x241:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333175.711475:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333175.711477:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333175.711486:0:29013:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56d8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969aaf expref: 32 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.711500:0:29013:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56d8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969aaf expref: 32 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.711512:0:29013:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7fe00, rc 0) 00000100:00100000:1.0:1763333175.711543:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+32:55917:x1848987613736192:12345-192.168.204.28@tcp:101:bash.0 Request processed in 155us (2017us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333175.711550:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6601 00000100:00100000:3.0:1763333175.725824:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.725865:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.726110:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613736448 00000100:00100000:1.0:1763333175.726119:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613736448 00000100:00100000:1.0:1763333175.726181:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6602 00000100:00100000:1.0:1763333175.726190:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49608380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:55917:x1848987613736448:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333175.726209:0:8406:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333175.726232:0:8406:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56d96 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969ab6 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333175.726257:0:8406:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x241:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333175.726278:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333175.726281:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333175.726289:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56d96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ab6 expref: 17 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.726305:0:8406:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56d96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ab6 expref: 17 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.726318:0:8406:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f600, rc 0) 00000100:00100000:1.0:1763333175.726407:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49608380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:55917:x1848987613736448:12345-192.168.204.28@tcp:101:bash.0 Request processed in 218us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333175.726415:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6602 00000100:00100000:0.0:1763333175.726549:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613736320 00000100:00100000:0.0:1763333175.726554:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613736320 00010000:00010000:0.0:1763333175.726579:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56b2e lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699e4 expref: 32 pid: 28650 timeout: 1379 lvb_type: 1 00000100:00100000:0.0:1763333175.726613:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3083 00000100:00100000:0.0:1763333175.726621:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49608a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+32:2421:x1848987613736320:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333175.726632:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333175.726648:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56b2e lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x240:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699e4 expref: 32 pid: 28650 timeout: 1379 lvb_type: 1 00010000:00010000:0.0:1763333175.726659:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56b2e lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x240:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699e4 expref: 32 pid: 28650 timeout: 1379 lvb_type: 1 00010000:00010000:0.0:1763333175.726680:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333175.726682:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333175.726686:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56d88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x240:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.726700:0:6506:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56d88 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x240:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.726719:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333175.726741:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49608a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+32:2421:x1848987613736320:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 122us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333175.726747:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3083 00010000:00010000:2.0:1763333175.726923:0:28430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56b2e lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699e4 expref: 31 pid: 28650 timeout: 1379 lvb_type: 1 00000100:00100000:2.0:1763333175.726938:0:28430:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77b16a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_014:lustre-OST0001_UUID:28430:1848987627273344:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333175.726958:0:28430:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56d88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.726967:0:28430:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56d88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.726973:0:28430:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56d88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1763333175.730766:0:26035:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871614 is committed 00000001:00080000:1.0:1763333175.730786:0:26035:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871613 is committed 00000100:00100000:0.0:1763333175.731952:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333175.731984:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613736576 00000100:00100000:0.0:1763333175.731995:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613736576 00002000:00010000:0.0:1763333175.732038:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/577 (0->18446744073709551615) 00002000:00100000:0.0:1763333175.732043:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7400d500 with x1848987613736576 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333175.732056:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff7400d500. 00000100:00100000:0.0:1763333175.732085:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1629 00000100:00100000:0.0:1763333175.732096:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2420:x1848987613736576:12345-192.168.204.28@tcp:10:bash.0 00000100:00100000:1.0:1763333175.732238:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00002000:00010000:3.0:1763333175.732366:0:28430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x240:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:3.0:1763333175.732371:0:28430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x240:0x0] updating lvb mtime from disk: 0 -> 1763333176 00002000:00010000:3.0:1763333175.732374:0:28430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x240:0x0] updating lvb ctime from disk: 0 -> 1763333176 00002000:00010000:3.0:1763333175.732377:0:28430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x240:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1763333175.732392:0:28430:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56d88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.732403:0:28430:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56d88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.732412:0:28430:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56d88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.732420:0:28430:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333175.732425:0:28430:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56d88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.732534:0:28430:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56d88 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.732554:0:28430:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56d88 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.732562:0:28430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56d88 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333175.732646:0:28430:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4960b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2421:x1848987613736064:12345-192.168.204.28@tcp:4:lfs.0 Request processed in 21813us (23498us total) trans 17179871614 rc 0/0 00000100:00100000:3.0:1763333175.732654:0:28430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1628 00000100:00100000:3.0:1763333175.732674:0:28430:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613736704 00000100:00100000:3.0:1763333175.732678:0:28430:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613736704 00002000:00010000:3.0:1763333175.732692:0:28430:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/577 (0->18446744073709551615) 00002000:00100000:3.0:1763333175.732696:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe438aa680 with x1848987613736704 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333175.732702:0:28430:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe438aa680. 00000100:00100000:3.0:1763333175.732720:0:28430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1630 00000100:00100000:3.0:1763333175.732726:0:28430:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2420:x1848987613736704:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:3.0:1763333175.732859:0:28430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x241:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333175.732862:0:28430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x241:0x0] updating lvb mtime from disk: 0 -> 1763333175 00002000:00010000:3.0:1763333175.732864:0:28430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x241:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333175.732866:0:28430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x241:0x0] updating lvb ctime from disk: 0 -> 1763333175 00002000:00010000:3.0:1763333175.732868:0:28430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x241:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333175.732891:0:28430:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2420:x1848987613736704:12345-192.168.204.28@tcp:10:bash.0 Request processed in 165us (654us total) trans 21474838918 rc 0/0 00000100:00100000:3.0:1763333175.732902:0:28430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1630 00002000:00010000:3.0:1763333175.732905:0:28430:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/577 (0->18446744073709551615) 00002000:00100000:3.0:1763333175.732908:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe438aa680 with x1848987613736704 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333175.732912:0:28430:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe438aa680. 00002000:00010000:0.0:1763333175.733233:0:28427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x241:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333175.733236:0:28427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x241:0x0] updating lvb mtime from disk: 0 -> 1763333175 00002000:00010000:0.0:1763333175.733239:0:28427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x241:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333175.733240:0:28427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x241:0x0] updating lvb ctime from disk: 0 -> 1763333175 00002000:00010000:0.0:1763333175.733242:0:28427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x241:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333175.733284:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2420:x1848987613736576:12345-192.168.204.28@tcp:10:bash.0 Request processed in 1189us (1338us total) trans 17179871615 rc 0/0 00000100:00100000:0.0:1763333175.733291:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1629 00002000:00010000:0.0:1763333175.733295:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/577 (0->18446744073709551615) 00002000:00100000:0.0:1763333175.733297:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7400d500 with x1848987613736576 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333175.733303:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff7400d500. 00000100:00100000:1.0:1763333175.749874:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.750246:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613736960 00000100:00100000:3.0:1763333175.750256:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613736960 00000100:00100000:3.0:1763333175.750315:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3201 00000100:00100000:3.0:1763333175.750325:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:55917:x1848987613736960:12345-192.168.204.28@tcp:35:bash.0 00000001:00080000:3.0:1763333175.750592:0:19668:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294972371 00000100:00100000:3.0:1763333175.750693:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:55917:x1848987613736960:12345-192.168.204.28@tcp:35:bash.0 Request processed in 369us (829us total) trans 4294972372 rc 0/0 00000100:00100000:3.0:1763333175.750701:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3201 00000020:00080000:3.0:1763333175.750706:0:19668:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763333175.758914:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333175.760147:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613737216 00000100:00100000:0.0:1763333175.760158:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613737216 00000100:00100000:0.0:1763333175.760279:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9375 00000100:00100000:0.0:1763333175.760292:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:56876:x1848987613737216:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:0.0:1763333175.760367:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333175.760396:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56ce7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b8:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a70 expref: 243 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.760416:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac900) 00010000:00010000:0.0:1763333175.760422:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333175.760515:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56d9d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1b8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333175.760532:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56d9d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.760542:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56d9d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00010000:0.0:1763333175.760667:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007fb01f15 reply state 0000000041a29b64 transno 4294972373 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56d9d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.760681:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56d9d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.760687:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac900) 00010000:00010000:0.0:1763333175.760689:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333175.760692:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763333175.760807:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56876:x1848987613737216:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 517us (1902us total) trans 4294972373 rc 0/0 00000100:00100000:0.0:1763333175.760818:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9375 00000100:00100000:3.0:1763333175.765565:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.765853:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613737344 00000100:00100000:2.0:1763333175.765863:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613737344 00000100:00100000:2.0:1763333175.765922:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9376 00000100:00100000:2.0:1763333175.765932:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4960aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56879:x1848987613737344:12345-192.168.204.28@tcp:101:rm.0 00010000:00010000:2.0:1763333175.765960:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333175.765986:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56da4 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969abd expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.766058:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56dab lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333175.766073:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56dab lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.766084:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56dab lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.766098:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56db2 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333175.766105:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56db2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.766112:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56db2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.766198:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56db9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1b9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333175.766208:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56db9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.766215:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56db9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:2.0:1763333175.766258:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1b9:0x0]: returning size 5 00000004:00200000:2.0:1763333175.766262:0:8606:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763333175.766281:0:8606:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56db9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.766292:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56db9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1b9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.766302:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56dab lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.766308:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56dab lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.766314:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56dab lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.766320:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56dab lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.766330:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4a00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333175.766334:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56dab lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.766340:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56dab lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.766373:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff61a46400) 00010000:00010000:2.0:1763333175.766376:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333175.766381:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56dab lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.766387:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56dab lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.766401:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56db2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.766407:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56db2 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.766412:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56db2 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.766416:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333175.766419:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56db2 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.766423:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56db2 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.766429:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff61a46900) 00010000:00010000:2.0:1763333175.766431:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333175.766434:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56db2 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.766439:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56db2 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.766478:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56da4 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969abd expref: 246 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.766495:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56db9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1b9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969abd expref: 245 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.766502:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b9:0x0].0x0 (ffff92ff621acc00) 00010000:00010000:2.0:1763333175.766504:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333175.766506:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4000, rc 0) 00000100:00100000:2.0:1763333175.766572:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4960aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56879:x1848987613737344:12345-192.168.204.28@tcp:101:rm.0 Request processed in 641us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333175.766579:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9376 00000100:00100000:1.0:1763333175.770200:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.770279:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613737472 00000100:00100000:3.0:1763333175.770289:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613737472 00000100:00100000:3.0:1763333175.770373:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6603 00000100:00100000:3.0:1763333175.770383:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:56876:x1848987613737472:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333175.770401:0:29013:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333175.770423:0:29013:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56dc0 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969ac4 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333175.770467:0:29013:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x240:0x0] initial LVB size: 4096, mtime: 0x691a5438, atime: 0x0, ctime: 0x691a5438, blocks: 0x8 00010000:00010000:3.0:1763333175.770491:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333175.770494:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333175.770502:0:29013:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56dc0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ac4 expref: 15 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.770519:0:29013:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56dc0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ac4 expref: 15 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.770532:0:29013:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96400, rc 0) 00000100:00100000:3.0:1763333175.770591:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:56876:x1848987613737472:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 209us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333175.770597:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6603 00000100:00100000:1.0:1763333175.776070:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333175.776158:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613737728 00000100:00100000:0.0:1763333175.776169:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613737728 00000100:00100000:0.0:1763333175.776233:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9377 00000100:00100000:0.0:1763333175.776244:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56879:x1848987613737728:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:0.0:1763333175.776311:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1763333175.776342:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e000/0xb32e3ef184c56d73 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969aa1 expref: 245 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.776402:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56db9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969abd expref: 244 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.776417:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c56d50 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1b9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a93 expref: 243 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.776437:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b9:0x0].0x0 (ffff92ff621acc00) 00010000:00010000:0.0:1763333175.776450:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333175.776486:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56dc7 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333175.776499:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56dc7 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.776508:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56dc7 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.776518:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56dce lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333175.776524:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56dce lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.776531:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56dce lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.776629:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56dd5 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333175.776637:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56dd5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.776644:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56dd5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000040:00080000:0.0:1763333175.776894:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1435, 64 off121056 00000004:00080000:0.0:1763333175.776902:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1279856552938ns, next at 1280856550572ns, rc = 0 00000040:00080000:0.0:1763333175.776923:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1436, 64 off121056 00000040:00080000:0.0:1763333175.776933:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1437, 64 off121120 00000040:00080000:0.0:1763333175.776942:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1436, 64 off121120 00010000:00010000:0.0:1763333175.776990:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56ddc lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1b9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333175.776999:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56ddc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.777007:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56ddc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.777014:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56ddc lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1b9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.777020:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56ddc lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1b9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.777026:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56ddc lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1b9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.777043:0:6519:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763333175.777060:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56dd5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.777065:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56dd5 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1b9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.777071:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56dd5 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1b9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.777076:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700f000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333175.777080:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56dd5 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1b9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.777086:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56dd5 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1b9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.777094:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b9:0x0].0x0 (ffff92fe43b44400) 00010000:00010000:0.0:1763333175.777097:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1763333175.777101:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56dd5 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1b9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.777106:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56dd5 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1b9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.777216:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56dc7 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.777223:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56dc7 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.777228:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56dc7 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.777238:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56dc7 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.777242:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700ee00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333175.777244:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56dc7 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.777249:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56dc7 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.777256:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44b00) 00010000:00010000:0.0:1763333175.777259:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333175.777262:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56dc7 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.777267:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56dc7 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:0.0:1763333175.777280:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f4ee3c30 reply state 00000000f2f9ceaa transno 4294972374 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56dce lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.777290:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56dce lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.777296:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b44100) 00010000:00010000:0.0:1763333175.777298:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333175.777301:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763333175.777397:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56879:x1848987613737728:12345-192.168.204.28@tcp:36:rm.0 Request processed in 1153us (1337us total) trans 4294972374 rc 0/0 00000100:00100000:0.0:1763333175.777405:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9377 00010000:00010000:1.0:1763333175.777485:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333175.777491:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56ddc lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1b9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333175.777497:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48193400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333175.777500:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56ddc lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1b9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333175.777507:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56ddc lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1b9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333175.777515:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b9:0x0].0x0 (ffff92fe43b44400) 00010000:00010000:1.0:1763333175.777518:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1763333175.777521:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56ddc lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1b9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333175.777525:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56ddc lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1b9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333175.777539:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333175.777541:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333175.777542:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763333175.779071:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.779119:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613737856 00000100:00100000:1.0:1763333175.779128:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613737856 00000100:00100000:1.0:1763333175.779187:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6604 00000100:00100000:1.0:1763333175.779196:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e0f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:56876:x1848987613737856:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333175.779215:0:8406:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333175.779233:0:8406:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c56de3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969acb expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.779262:0:8406:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c56b35 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699eb expref: 19 pid: 8407 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333175.779271:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333175.779273:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333175.779277:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c56de3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969acb expref: 19 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.779313:0:8406:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c56b35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699eb expref: 19 pid: 8407 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333175.779326:0:8406:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c56b35 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699eb expref: 19 pid: 8407 timeout: 1379 lvb_type: 1 00000100:00100000:1.0:1763333175.779343:0:8406:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e07800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8406:1848987627273472:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333175.779475:0:8406:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff6be07e40 going to sleep for 11 seconds 00000100:00100000:2.0:1763333175.786254:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.786615:0:8406:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e07800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8406:1848987627273472:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333175.786649:0:8406:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c56de3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969acb expref: 19 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.786670:0:8406:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e000, rc 0) 00000100:00100000:1.0:1763333175.786718:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e0f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:56876:x1848987613737856:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 7524us (7655us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333175.786728:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6604 00000100:00100000:3.0:1763333175.787142:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613737984 00000100:00100000:3.0:1763333175.787150:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613737984 00010000:00010000:3.0:1763333175.787180:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c56b35 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699eb expref: 19 pid: 8407 timeout: 1379 lvb_type: 1 00000100:00100000:3.0:1763333175.787214:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3084 00000100:00100000:3.0:1763333175.787223:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff44f09450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2420:x1848987613737984:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333175.787237:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333175.787255:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c56b35 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x240:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699eb expref: 19 pid: 8407 timeout: 1379 lvb_type: 1 00010000:00010000:3.0:1763333175.787267:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c56b35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x240:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699eb expref: 19 pid: 8407 timeout: 1379 lvb_type: 1 00010000:00010000:3.0:1763333175.787287:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c56b35 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x240:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e369699eb expref: 19 pid: 8407 timeout: 1379 lvb_type: 1 00010000:00010000:3.0:1763333175.787300:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333175.787302:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333175.787308:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c56de3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969acb expref: 18 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.787317:0:28428:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c56de3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969acb expref: 18 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.787378:0:28428:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c56de3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969acb expref: 18 pid: 8406 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333175.787393:0:28428:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe49608000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:28428:1848987627273600:192.168.204.28@tcp:105: 00000100:00100000:3.0:1763333175.787456:0:28428:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff49c92a80 going to sleep for 11 seconds 00000100:00100000:2.0:1763333175.794667:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.794704:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333175.794773:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613738112 00000100:00100000:0.0:1763333175.794783:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613738112 00000100:00100000:1.0:1763333175.794814:0:28428:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe49608000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:28428:1848987627273600:192.168.204.28@tcp:105: 00002000:00010000:0.0:1763333175.794825:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/576 (5->18446744073709551615) 00002000:00100000:0.0:1763333175.794829:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff77b16a00 with x1848987613738112 ext(5->18446744073709551615) 00010000:00010000:1.0:1763333175.794838:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:0.0:1763333175.794840:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff77b16a00. 00000100:00100000:0.0:1763333175.794874:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613738240 00000100:00100000:0.0:1763333175.794877:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613738240 00002000:00010000:0.0:1763333175.794890:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/576 (0->18446744073709551615) 00002000:00100000:0.0:1763333175.794892:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff77b14000 with x1848987613738240 ext(0->18446744073709551615) 00000100:00100000:1.0:1763333175.794896:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff44f09450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2420:x1848987613737984:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 7673us (8653us total) trans 0 rc 0/0 00002000:00010000:0.0:1763333175.794898:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff77b14000. 00000100:00100000:1.0:1763333175.794906:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3084 00000100:00100000:0.0:1763333175.794914:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1631 00000100:00100000:0.0:1763333175.794922:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2421:x1848987613738112:12345-192.168.204.28@tcp:10:lfs.0 00000100:00100000:2.0:1763333175.795185:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1632 00000100:00100000:2.0:1763333175.795195:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2420:x1848987613738240:12345-192.168.204.28@tcp:10:lfs.0 00002000:00010000:0.0:1763333175.795238:0:28427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x240:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:0.0:1763333175.795242:0:28427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x240:0x0] updating lvb mtime from disk: 1763333176 -> 1763333176 00002000:00010000:0.0:1763333175.795245:0:28427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x240:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333175.795247:0:28427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x240:0x0] updating lvb ctime from disk: 1763333176 -> 1763333176 00002000:00010000:0.0:1763333175.795249:0:28427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x240:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1763333175.795292:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2421:x1848987613738112:12345-192.168.204.28@tcp:10:lfs.0 Request processed in 369us (634us total) trans 17179871616 rc 0/0 00002000:00010000:2.0:1763333175.795299:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x240:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1763333175.795299:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1631 00002000:00010000:2.0:1763333175.795301:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x240:0x0] updating lvb mtime from disk: 0 -> 1763333176 00002000:00010000:0.0:1763333175.795302:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/576 (5->18446744073709551615) 00002000:00010000:2.0:1763333175.795303:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x240:0x0] updating lvb atime from disk: 0 -> 0 00002000:00100000:0.0:1763333175.795305:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff77b16a00 with x1848987613738112 ext(5->18446744073709551615) 00002000:00010000:2.0:1763333175.795306:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x240:0x0] updating lvb ctime from disk: 0 -> 1763333176 00002000:00010000:2.0:1763333175.795308:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x240:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1763333175.795310:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff77b16a00. 00000100:00100000:2.0:1763333175.795329:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2420:x1848987613738240:12345-192.168.204.28@tcp:10:lfs.0 Request processed in 137us (624us total) trans 21474838919 rc 0/0 00000100:00100000:2.0:1763333175.795336:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1632 00002000:00010000:2.0:1763333175.795338:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/576 (0->18446744073709551615) 00002000:00100000:2.0:1763333175.795341:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff77b14000 with x1848987613738240 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333175.795378:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff77b14000. 00000100:00100000:2.0:1763333175.802900:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.804547:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613738496 00000100:00100000:3.0:1763333175.804563:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613738496 00000100:00100000:3.0:1763333175.804642:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9378 00000100:00100000:3.0:1763333175.804653:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56876:x1848987613738496:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:3.0:1763333175.804749:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56dea lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1b8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333175.804768:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56dea lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.804780:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56dea lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00010000:3.0:1763333175.804895:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f81c4813 reply state 00000000b8bb825e transno 4294972375 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56dea lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.804909:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56dea lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.804921:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac900) 00010000:00010000:3.0:1763333175.804923:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763333175.804928:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763333175.805188:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56876:x1848987613738496:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 535us (2298us total) trans 4294972375 rc 0/0 00000100:00100000:3.0:1763333175.805196:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9378 00000100:00100000:1.0:1763333175.808174:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.808230:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613738624 00000100:00100000:3.0:1763333175.808240:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613738624 00000100:00100000:3.0:1763333175.808309:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9379 00000100:00100000:3.0:1763333175.808319:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56880:x1848987613738624:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333175.808340:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333175.808405:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c56df1 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969ad2 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.808583:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56df8 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333175.808599:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56df8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.808612:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56df8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.808623:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c56dff lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333175.808630:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c56dff lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.808635:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c56dff lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.808686:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56df8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.808693:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56df8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.808699:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56df8 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.808705:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56df8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.808711:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333175.808715:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56df8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.808723:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56df8 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.808736:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff8016fb00) 00010000:00010000:3.0:1763333175.808739:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333175.808743:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56df8 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.808749:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c56df8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.808763:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c56dff lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.808768:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c56dff lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.808773:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c56dff lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.808778:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333175.808781:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c56dff lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.808786:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c56dff lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.808791:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b44100) 00010000:00010000:3.0:1763333175.808793:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333175.808796:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c56dff lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.808800:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c56dff lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.808832:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c56df1 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ad2 expref: 247 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.808843:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff8016fb00) 00010000:00010000:3.0:1763333175.808845:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333175.808848:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c56df1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ad2 expref: 247 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.808862:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96000, rc 0) 00000100:00100000:3.0:1763333175.808928:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56880:x1848987613738624:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 610us (765us total) trans 0 rc 301/301 00000100:00100000:3.0:1763333175.808936:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9379 00000100:00100000:1.0:1763333175.813919:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.813966:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.813995:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613738752 00000100:00100000:2.0:1763333175.814007:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613738752 00000100:00100000:2.0:1763333175.814077:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6605 00000100:00100000:2.0:1763333175.814089:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:56876:x1848987613738752:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333175.814109:0:8406:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333175.814129:0:8406:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56e06 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969ad9 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333175.814143:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613738880 00000100:00100000:3.0:1763333175.814147:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613738880 00010000:00010000:2.0:1763333175.814161:0:8406:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56d18 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a85 expref: 20 pid: 28651 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333175.814169:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333175.814172:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333175.814176:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56e06 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ad9 expref: 20 pid: 8406 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333175.814186:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9380 00000100:00100000:3.0:1763333175.814192:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56880:x1848987613738880:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333175.814206:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333175.814213:0:8406:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56d18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a85 expref: 20 pid: 28651 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333175.814221:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c56e0d lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969ae0 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.814226:0:8406:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56d18 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a85 expref: 20 pid: 28651 timeout: 1379 lvb_type: 1 00000100:00100000:2.0:1763333175.814243:0:8406:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77b16680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8406:1848987627273728:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333175.814281:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56e14 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333175.814293:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56e14 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.814304:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56e14 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.814313:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c56e1b lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333175.814320:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c56e1b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.814326:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c56e1b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000100:00100000:2.0:1763333175.814332:0:8406:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff44fdfc00 going to sleep for 11 seconds 00010000:00010000:3.0:1763333175.814382:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56e14 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.814389:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56e14 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.814395:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56e14 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.814400:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56e14 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.814406:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff4139a000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333175.814410:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56e14 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.814417:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56e14 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.814591:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff8016f400) 00010000:00010000:3.0:1763333175.814594:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333175.814599:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56e14 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.814606:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56e14 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.814619:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c56e1b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.814630:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c56e1b lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.814635:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c56e1b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.814640:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff4139a800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333175.814643:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c56e1b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.814649:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c56e1b lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.814658:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b44100) 00010000:00010000:3.0:1763333175.814661:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333175.814665:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c56e1b lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.814670:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c56e1b lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.814699:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c56e0d lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ae0 expref: 247 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.814709:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff8016f400) 00010000:00010000:3.0:1763333175.814711:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333175.814714:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c56e0d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ae0 expref: 247 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.814727:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a97200, rc 0) 00000100:00100000:2.0:1763333175.816193:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56880:x1848987613738880:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1993us (2218us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333175.816206:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9380 00000100:00100000:1.0:1763333175.822068:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.822291:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613739008 00000100:00100000:3.0:1763333175.822301:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613739008 00010000:00010000:3.0:1763333175.822339:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56d18 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a85 expref: 21 pid: 28651 timeout: 1379 lvb_type: 1 00000100:00100000:3.0:1763333175.822401:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3085 00000100:00100000:3.0:1763333175.822411:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2420:x1848987613739008:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333175.822647:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333175.822672:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56d18 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x23f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a85 expref: 21 pid: 28651 timeout: 1379 lvb_type: 1 00010000:00010000:3.0:1763333175.822687:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56d18 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a85 expref: 21 pid: 28651 timeout: 1379 lvb_type: 1 00010000:00010000:3.0:1763333175.822713:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333175.822716:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333175.822724:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56e06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ad9 expref: 21 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.822733:0:28428:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56e06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ad9 expref: 21 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.822774:0:28428:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56e06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ad9 expref: 21 pid: 8406 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333175.822789:0:28428:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe49608700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:28428:1848987627273856:192.168.204.28@tcp:105: 00000100:00100000:3.0:1763333175.822883:0:28428:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff49c92780 going to sleep for 11 seconds 00010000:00010000:2.0:1763333175.823059:0:8406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56d18 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x23f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a85 expref: 21 pid: 28651 timeout: 1379 lvb_type: 1 00000100:00100000:2.0:1763333175.823073:0:8406:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77b16680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8406:1848987627273728:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333175.823101:0:8406:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56e06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ad9 expref: 20 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.823112:0:8406:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4a00, rc 0) 00000100:00100000:2.0:1763333175.823140:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:56876:x1848987613738752:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 9054us (9231us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333175.823148:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6605 00000100:00100000:1.0:1763333175.824948:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.824988:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613739136 00000100:00100000:2.0:1763333175.824997:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613739136 00000100:00100000:2.0:1763333175.825058:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9381 00000100:00100000:2.0:1763333175.825068:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56880:x1848987613739136:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333175.825089:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333175.825113:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56e22 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969ae7 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.825179:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56e29 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333175.825192:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56e29 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.825204:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56e29 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:2.0:1763333175.825251:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1763333175.825256:0:12741:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1763333175.825886:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56e22 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ae7 expref: 248 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.825904:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56e29 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ae7 expref: 247 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.825912:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff61a46400) 00010000:00010000:2.0:1763333175.825915:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1763333175.825919:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4000, rc 0) 00000100:00100000:2.0:1763333175.825977:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56880:x1848987613739136:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 910us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333175.825985:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9381 00000100:00100000:3.0:1763333175.829170:0:28428:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe49608700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:28428:1848987627273856:192.168.204.28@tcp:105: 00010000:00010000:3.0:1763333175.829199:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333175.830066:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2420:x1848987613739008:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 7651us (8003us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333175.830080:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3085 00000100:00100000:1.0:1763333175.833343:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.834097:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613739264 00000100:00100000:2.0:1763333175.834110:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613739264 00000100:00100000:2.0:1763333175.834176:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6606 00000100:00100000:2.0:1763333175.834186:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2421:x1848987613739264:12345-192.168.204.28@tcp:2:lfs.0 00002000:00010000:2.0:1763333175.834362:0:8406:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x23f:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1763333175.834368:0:8406:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x23f:0x0] updating lvb mtime from disk: 1763333175 -> 1763333175 00002000:00010000:2.0:1763333175.834370:0:8406:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x23f:0x0] updating lvb atime from disk: 0 -> 1763333175 00002000:00010000:2.0:1763333175.834372:0:8406:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x23f:0x0] updating lvb ctime from disk: 1763333175 -> 1763333176 00002000:00010000:2.0:1763333175.834375:0:8406:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x23f:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1763333175.834379:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.834441:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2421:x1848987613739264:12345-192.168.204.28@tcp:2:lfs.0 Request processed in 256us (1108us total) trans 21474838920 rc 0/0 00000100:00100000:2.0:1763333175.834449:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6606 00000100:00100000:3.0:1763333175.835673:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613739392 00000100:00100000:3.0:1763333175.835685:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613739392 00000100:00100000:0.0:1763333175.836469:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9382 00000100:00100000:0.0:1763333175.836485:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56880:x1848987613739392:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333175.836503:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333175.836522:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c56e30 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969aee expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.836583:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c56e37 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333175.836596:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c56e37 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.836606:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c56e37 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.836615:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c56e3e lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333175.836621:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c56e3e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.836627:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c56e3e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.836668:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c56e37 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.836674:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c56e37 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.836679:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c56e37 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.836684:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c56e37 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.836691:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48192200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333175.836695:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c56e37 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.836702:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c56e37 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.836713:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff61a46400) 00010000:00010000:0.0:1763333175.836716:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333175.836720:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c56e37 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.836726:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c56e37 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.836739:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c56e3e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.836745:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c56e3e lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.836749:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c56e3e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.836754:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48193c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333175.836756:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c56e3e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.836762:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c56e3e lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.836768:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b44100) 00010000:00010000:0.0:1763333175.836770:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333175.836773:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c56e3e lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.836777:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c56e3e lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.836802:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c56e30 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969aee expref: 248 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.836811:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff61a46400) 00010000:00010000:0.0:1763333175.836813:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333175.836817:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c56e30 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969aee expref: 248 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.836825:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48192400, rc 0) 00000100:00100000:0.0:1763333175.836888:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56880:x1848987613739392:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 410us (2508us total) trans 0 rc 301/301 00000100:00100000:0.0:1763333175.836895:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9382 00000100:00100000:0.0:1763333175.842029:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.842376:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613739648 00000100:00100000:3.0:1763333175.842389:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613739648 00000100:00100000:1.0:1763333175.842533:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.842609:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613739904 00000100:00100000:2.0:1763333175.842614:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613739904 00000100:00100000:2.0:1763333175.842656:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9383 00000100:00100000:2.0:1763333175.842675:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:56880:x1848987613739904:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333175.842697:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333175.842700:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763333175.842727:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56e29 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ae7 expref: 248 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.842748:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff61a46400) 00010000:00010000:2.0:1763333175.842757:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333175.842770:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56e45 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969af5 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.842866:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56e4c lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333175.842878:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56e4c lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.842888:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56e4c lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.842902:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56e53 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333175.842909:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56e53 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.842915:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56e53 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.843292:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56e5a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333175.843301:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56e5a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.843307:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56e5a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:2.0:1763333175.843316:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1bb:0x0]: returning size 0 00010000:00010000:2.0:1763333175.843337:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56e4c lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.843344:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56e4c lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.843374:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56e4c lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.843381:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56e4c lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.843388:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333175.843392:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56e4c lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.843399:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56e4c lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.843407:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff61a46900) 00010000:00010000:2.0:1763333175.843409:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333175.843413:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56e4c lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.843419:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56e4c lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000004:00010000:2.0:1763333175.843429:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a2298625 reply state 00000000fb34b90d transno 4294972376 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56e53 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.843438:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56e53 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333175.843444:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b44100) 00010000:00010000:2.0:1763333175.843446:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333175.843449:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763333175.843481:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56e45 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969af5 expref: 250 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.843496:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56e5a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969af5 expref: 249 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.843503:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bb:0x0].0x0 (ffff92ff61a46700) 00010000:00010000:2.0:1763333175.843505:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333175.843507:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5c00, rc 0) 00000100:00100000:2.0:1763333175.843563:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:56880:x1848987613739904:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 890us (1031us total) trans 4294972376 rc 0/0 00000100:00100000:2.0:1763333175.843574:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9383 00000100:00100000:0.0:1763333175.846812:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3202 00000100:00100000:0.0:1763333175.846846:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7ad4b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:56876:x1848987613739648:12345-192.168.204.28@tcp:35:lfs.0 00000004:00010000:0.0:1763333175.846922:0:35317:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x240000404:0x1b8:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c56c62 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1b8:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a3f expref: 249 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.846983:0:35317:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56e68 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 35317 initiator: MDT0 00010000:00010000:0.0:1763333175.846997:0:35317:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56cbd lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a62 expref: 249 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.847007:0:35317:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56e68 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 35317 initiator: MDT1 00010000:00010000:0.0:1763333175.847040:0:35317:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56cbd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a62 expref: 249 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.847057:0:35317:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56cbd lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a62 expref: 249 pid: 6521 timeout: 1379 lvb_type: 0 00000100:00100000:0.0:1763333175.847070:0:35317:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7400fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:35317:1848987627273984:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333175.847140:0:35317:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe46e0e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763333175.851488:0:35317:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7400fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:35317:1848987627273984:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333175.851525:0:35317:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56e68 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 35317 initiator: MDT1 00000100:00100000:3.0:1763333175.851887:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.851940:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.851977:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613740032 00000100:00100000:2.0:1763333175.851985:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613740032 00010000:00010000:2.0:1763333175.852021:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56cbd lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a62 expref: 250 pid: 6521 timeout: 1379 lvb_type: 0 00000100:00100000:2.0:1763333175.852055:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3086 00000100:00100000:3.0:1763333175.852063:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613740288 00000100:00100000:2.0:1763333175.852065:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49608700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:2421:x1848987613740032:12345-192.168.204.28@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1763333175.852067:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613740288 00010000:00010000:2.0:1763333175.852081:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333175.852087:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56cbd lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a62 expref: 251 pid: 6521 timeout: 1379 lvb_type: 0 00000100:00100000:3.0:1763333175.852098:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9384 00010000:00010000:2.0:1763333175.852099:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56cbd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a62 expref: 251 pid: 6521 timeout: 1379 lvb_type: 0 00000100:00100000:3.0:1763333175.852104:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:56880:x1848987613740288:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333175.852121:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333175.852123:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56cbd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a62 expref: 251 pid: 6521 timeout: 1379 lvb_type: 0 00010000:00010000:3.0:1763333175.852137:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c56e6f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969afc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.852138:0:28428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac900) 00010000:00010000:2.0:1763333175.852143:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56e68 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 35317 initiator: MDT1 00010000:00010000:2.0:1763333175.852152:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56e68 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 35317 initiator: MDT1 00010000:00010000:2.0:1763333175.852163:0:28428:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56e68 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 35317 initiator: MDT1 00010000:00010000:2.0:1763333175.852186:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333175.852236:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49608700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:2421:x1848987613740032:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 172us (351us total) trans 0 rc 0/0 00010000:00010000:3.0:1763333175.852239:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56e76 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00000100:00100000:2.0:1763333175.852243:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3086 00010000:00010000:3.0:1763333175.852250:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56e5a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969af5 expref: 251 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.852258:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56e76 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.852269:0:35317:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56e68 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 35317 initiator: MDT1 00010000:00010000:2.0:1763333175.852275:0:35317:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56e68 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 35317 initiator: MDT1 00010000:00010000:3.0:1763333175.852283:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56e5a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969af5 expref: 250 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.852294:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56e5a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969af5 expref: 250 pid: 12741 timeout: 1379 lvb_type: 0 00000100:00100000:3.0:1763333175.852308:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe49608a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627274112:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333175.852383:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff49c92780 going to sleep for 11 seconds 00000040:00080000:2.0:1763333175.852523:0:35317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1438, 88 off121208 00000004:00080000:2.0:1763333175.852532:0:35317:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1279932182331ns, next at 1280195897991ns, rc = 0 00000040:00080000:2.0:1763333175.852570:0:35317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1437, 88 off121208 00000004:00080000:2.0:1763333175.852576:0:35317:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1279932226788ns, next at 1280856550572ns, rc = 0 00000040:00080000:2.0:1763333175.852602:0:35317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1438, 88 off121296 00000004:00080000:2.0:1763333175.852607:0:35317:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1279932257820ns, next at 1280856550572ns, rc = 0 00000040:00080000:2.0:1763333175.852617:0:35317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1439, 88 off121296 00000004:00080000:2.0:1763333175.852620:0:35317:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1279932270967ns, next at 1280195897991ns, rc = 0 00000100:00100000:2.0:1763333175.855839:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe49608a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627274112:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333175.855870:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56e76 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000001:00080000:0.0:1763333175.857182:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972377 is committed 00000004:00080000:0.0:1763333175.857194:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 944 committed 00000004:00080000:0.0:1763333175.857211:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 941 committed 00000004:00080000:0.0:1763333175.857220:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 940 committed 00000004:00080000:0.0:1763333175.857223:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 943 committed 00000004:00080000:0.0:1763333175.857231:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 939 committed 00000100:00100000:0.0:1763333175.857319:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7400f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627274368:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763333175.857408:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333175.857450:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7400f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627274752:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333175.857483:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333175.857518:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1763333175.857525:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77b17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627274624:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763333175.857547:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333175.857565:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627275136:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333175.857585:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333175.857614:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7400c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627274496:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763333175.857634:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333175.857648:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7400ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627275008:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333175.857666:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333175.857681:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1763333175.857687:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627274240:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763333175.857707:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333175.857723:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627274880:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333175.857741:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333175.857767:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627274368 00000100:00100000:0.0:1763333175.857773:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627274368 00000100:00100000:0.0:1763333175.857817:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627274752 00000100:00100000:0.0:1763333175.857820:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627274752 00000100:00100000:0.0:1763333175.857835:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627274624 00000100:00100000:0.0:1763333175.857839:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627274624 00000100:00100000:0.0:1763333175.857849:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627275136 00000100:00100000:0.0:1763333175.857852:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627275136 00000100:00100000:0.0:1763333175.857858:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627274496 00000100:00100000:0.0:1763333175.857861:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627274496 00000100:00100000:0.0:1763333175.857869:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627275008 00000100:00100000:0.0:1763333175.857871:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627275008 00000100:00100000:0.0:1763333175.857878:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627274240 00000100:00100000:0.0:1763333175.857884:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627274240 00000100:00100000:0.0:1763333175.857891:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627274880 00000100:00100000:0.0:1763333175.857894:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627274880 00000100:00100000:0.0:1763333175.857907:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6607 00000100:00100000:0.0:1763333175.857915:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+8:3655:x1848987627274368:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1763333175.857942:0:28651:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:577 count 1 00000100:00100000:2.0:1763333175.858124:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6608 00000100:00100000:2.0:1763333175.858135:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+8:3655:x1848987627274752:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1763333175.858288:0:8404:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x23f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333175.858292:0:8404:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x23f:0x0] updating lvb mtime from disk: 1763333175 -> 1763333175 00002000:00010000:2.0:1763333175.858295:0:8404:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x23f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333175.858297:0:8404:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x23f:0x0] updating lvb ctime from disk: 1763333175 -> 1763333175 00002000:00010000:2.0:1763333175.858299:0:8404:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x23f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333175.858365:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+9:3655:x1848987627274752:12345-0@lo:2:osp-syn-1-1.0 Request processed in 214us (862us total) trans 17179871617 rc 0/0 00000100:00100000:2.0:1763333175.858373:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6608 00010000:00010000:3.0:1763333175.858380:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56d9d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.858389:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56d9d lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00000100:00100000:2.0:1763333175.858390:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6609 00000100:00100000:2.0:1763333175.858397:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+24:3655:x1848987627274624:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1763333175.858399:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56d9d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.858405:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700fe00 already unused, calling callback (ffffffffc17b3550) 00002000:00080000:2.0:1763333175.858409:0:8404:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:578 count 1 00010000:00010000:3.0:1763333175.858410:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56d9d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.858421:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56d9d lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00002000:00010000:2.0:1763333175.858436:0:8404:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x242:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333175.858437:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac900) 00010000:00010000:3.0:1763333175.858440:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333175.858442:0:8404:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe48190200/0xb32e3ef184c56e7d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.858446:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56d9d lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.858452:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56d9d lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1b8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.858454:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333175.858467:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333175.858472:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe48190200/0xb32e3ef184c56e7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.858479:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56dce lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.858484:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56dce lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.858484:0:8404:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe48190200/0xb32e3ef184c56e7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.858490:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56dce lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.858493:0:8404:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe48190200/0xb32e3ef184c56e7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.858496:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700f400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333175.858499:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56dce lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.858500:0:8404:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe48190200/0xb32e3ef184c56e7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.858505:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56dce lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.858512:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b44100) 00010000:00010000:3.0:1763333175.858514:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333175.858517:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56dce lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.858523:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56dce lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.858523:0:8404:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763333175.858532:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56dea lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.858537:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56dea lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.858542:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56dea lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.858546:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333175.858549:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56dea lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.858553:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56dea lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.858560:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac900) 00010000:00010000:3.0:1763333175.858562:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333175.858565:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56dea lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.858570:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56dea lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1b8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.858579:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56e53 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.858584:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56e53 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.858589:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56e53 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.858597:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333175.858599:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56e53 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.858604:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56e53 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.858610:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b44100) 00010000:00010000:3.0:1763333175.858613:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333175.858616:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56e53 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.858621:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56e53 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000100:00100000:3.0:1763333175.858654:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6610 00000100:00100000:3.0:1763333175.858678:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+25:3655:x1848987627275136:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333175.858679:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+25:3655:x1848987627274624:12345-0@lo:6:osp-syn-0-1.0 Request processed in 282us (1130us total) trans 21474838921 rc 0/0 00000100:00100000:2.0:1763333175.858685:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6609 00000100:00100000:2.0:1763333175.858697:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6611 00000100:00100000:2.0:1763333175.858703:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+8:3653:x1848987627274496:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1763333175.858715:0:8404:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:578 count 1 00002000:00010000:2.0:1763333175.858730:0:8404:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x242:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763333175.858735:0:8404:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56e84 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333175.858739:0:29010:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x240:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333175.858741:0:29010:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x240:0x0] updating lvb mtime from disk: 1763333176 -> 1763333176 00010000:00010000:2.0:1763333175.858743:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00002000:00010000:3.0:1763333175.858744:0:29010:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x240:0x0] updating lvb atime from disk: 0 -> 0 00010000:00010000:2.0:1763333175.858745:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00002000:00010000:3.0:1763333175.858746:0:29010:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x240:0x0] updating lvb ctime from disk: 1763333176 -> 1763333176 00002000:00010000:3.0:1763333175.858748:0:29010:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x240:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:2.0:1763333175.858748:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56e84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.858757:0:8404:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56e84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.858765:0:8404:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56e84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.858771:0:8404:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56e84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333175.858777:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+25:3655:x1848987627275136:12345-0@lo:2:osp-syn-0-1.0 Request processed in 101us (1190us total) trans 21474838922 rc 0/0 00000100:00100000:3.0:1763333175.858783:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6610 00010000:00010000:2.0:1763333175.858786:0:8404:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1763333175.858795:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6612 00000100:00100000:3.0:1763333175.858801:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+8:3653:x1848987627275008:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1763333175.858847:0:29010:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x240:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1763333175.858850:0:29010:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x240:0x0] updating lvb mtime from disk: 1763333176 -> 1763333176 00002000:00010000:3.0:1763333175.858853:0:29010:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x240:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333175.858854:0:29010:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x240:0x0] updating lvb ctime from disk: 1763333176 -> 1763333176 00002000:00010000:3.0:1763333175.858857:0:29010:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x240:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763333175.858888:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+10:3653:x1848987627275008:12345-0@lo:2:osp-syn-1-1.0 Request processed in 87us (1220us total) trans 17179871619 rc 0/0 00000100:00100000:2.0:1763333175.858889:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+10:3653:x1848987627274496:12345-0@lo:6:osp-syn-1-1.0 Request processed in 187us (1255us total) trans 17179871618 rc 0/0 00000100:00100000:3.0:1763333175.858895:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6612 00010000:00010000:0.0:1763333175.859654:0:28651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56e8b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x241:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.859672:0:28651:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56d8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x241:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969aaf expref: 15 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.859680:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333175.859682:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333175.859685:0:28651:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56e8b lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x241:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.859719:0:28651:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56d8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x241:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969aaf expref: 15 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.859731:0:28651:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56d8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x241:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969aaf expref: 15 pid: 29013 timeout: 1379 lvb_type: 0 00000100:00100000:0.0:1763333175.859746:0:28651:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff74039500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28651:1848987627275264:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333175.859819:0:28651:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe46e0e3c0 going to sleep for 11 seconds 00000004:00010000:0.0:1763333175.859861:0:35317:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e89deed1 reply state 00000000b451d095 transno 4294972377 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56e68 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35317 initiator: MDT1 00010000:00010000:0.0:1763333175.859876:0:35317:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56e68 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35317 initiator: MDT1 00010000:00010000:0.0:1763333175.859884:0:35317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac900) 00010000:00010000:0.0:1763333175.859887:0:35317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1763333175.859890:0:35317:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763333175.859897:0:35317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac900) 00010000:00010000:0.0:1763333175.859898:0:35317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763333175.859903:0:35317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c56c62 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1b8:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a3f expref: 240 pid: 6521 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333175.860167:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6611 00000100:00100000:2.0:1763333175.860190:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6613 00000100:00100000:2.0:1763333175.860199:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7403b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+24:3653:x1848987627274240:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1763333175.860216:0:8404:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:577 count 1 00010000:00010000:2.0:1763333175.860228:0:8404:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe48191600/0xb32e3ef184c56e92 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x241:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.860240:0:8404:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56d96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x241:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ab6 expref: 19 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.860246:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333175.860248:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333175.860250:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe48191600/0xb32e3ef184c56e92 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x241:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.860269:0:8404:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56d96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x241:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ab6 expref: 19 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.860279:0:8404:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56d96 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x241:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ab6 expref: 19 pid: 8406 timeout: 1379 lvb_type: 0 00000100:00100000:2.0:1763333175.860288:0:8404:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77b14700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8404:1848987627275392:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333175.860317:0:8404:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff742b93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763333175.860343:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6614 00000100:00100000:2.0:1763333175.860377:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74038700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+24:3653:x1848987627274880:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:2.0:1763333175.860491:0:17605:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x23f:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1763333175.860494:0:17605:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x23f:0x0] updating lvb mtime from disk: 1763333175 -> 1763333175 00002000:00010000:2.0:1763333175.860497:0:17605:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x23f:0x0] updating lvb atime from disk: 1763333175 -> 1763333175 00002000:00010000:2.0:1763333175.860499:0:17605:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x23f:0x0] updating lvb ctime from disk: 1763333176 -> 1763333176 00002000:00010000:2.0:1763333175.860501:0:17605:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x23f:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1763333175.860547:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74038700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+25:3653:x1848987627274880:12345-0@lo:2:osp-syn-0-1.0 Request processed in 172us (2804us total) trans 21474838923 rc 0/0 00000100:00100000:2.0:1763333175.860553:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6614 00010000:00010000:2.0:1763333175.860577:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1763333175.860584:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe48190200/0xb32e3ef184c56e7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.860592:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48190200 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333175.860595:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe48190200/0xb32e3ef184c56e7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.860604:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe48190200/0xb32e3ef184c56e7d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.860618:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe48190200/0xb32e3ef184c56e7d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.860625:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe48190200/0xb32e3ef184c56e7d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.860642:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333175.860647:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56e84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.860653:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48191800 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333175.860656:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56e84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.860663:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56e84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.860674:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56e84 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.860680:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c56e84 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.860692:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333175.860693:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333175.860695:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333175.860703:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763333175.860738:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff77b17100/2, rc 0, transno 21474838921 00000100:00100000:2.0:1763333175.860745:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77b17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627274624:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1763333175.860756:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff77b14e00/2, rc 0, transno 21474838922 00000100:00100000:2.0:1763333175.860759:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627275136:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333175.860770:0:3655:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179871613 gen 2 00000004:00080000:2.0:1763333175.860775:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe438a9180, transno 17179871557 00000004:00080000:2.0:1763333175.860788:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe438a9880, transno 17179871558 00000004:00080000:2.0:1763333175.860790:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe438a9c00, transno 17179871559 00000004:00080000:2.0:1763333175.860793:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe438abb80, transno 17179871560 00000004:00080000:2.0:1763333175.860796:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46e2df80, transno 17179871561 00000004:00080000:2.0:1763333175.860798:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46e2d500, transno 17179871562 00000004:00080000:2.0:1763333175.860800:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46e2c380, transno 17179871563 00000004:00080000:2.0:1763333175.860803:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46e2ea00, transno 17179871564 00000004:00080000:2.0:1763333175.860806:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe43998380, transno 17179871566 00000004:00080000:2.0:1763333175.860808:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe43999c00, transno 17179871567 00000004:00080000:2.0:1763333175.860810:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe43998000, transno 17179871568 00000004:00080000:2.0:1763333175.860812:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4399b800, transno 17179871569 00000004:00080000:2.0:1763333175.860815:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff77a3e680, transno 17179871572 00000004:00080000:2.0:1763333175.860818:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff77a3c700, transno 17179871573 00000004:00080000:2.0:1763333175.860820:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe43999880, transno 17179871574 00000004:00080000:2.0:1763333175.860822:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4399bb80, transno 17179871575 00000004:00080000:2.0:1763333175.860825:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7dcff800, transno 17179871579 00000004:00080000:2.0:1763333175.860827:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7dcfc000, transno 17179871580 00000004:00080000:2.0:1763333175.860829:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7dcfdc00, transno 17179871581 00000004:00080000:2.0:1763333175.860831:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7dcff480, transno 17179871582 00000004:00080000:2.0:1763333175.860834:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4920d500, transno 17179871583 00000004:00080000:2.0:1763333175.860836:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44de1500, transno 17179871584 00000004:00080000:2.0:1763333175.860838:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4920ed80, transno 17179871585 00000004:00080000:2.0:1763333175.860841:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4920ea00, transno 17179871586 00000004:00080000:2.0:1763333175.860843:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46a6c380, transno 17179871589 00000004:00080000:2.0:1763333175.860846:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46a6f480, transno 17179871590 00000004:00080000:2.0:1763333175.860848:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46a6d500, transno 17179871591 00000004:00080000:2.0:1763333175.860850:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46a6df80, transno 17179871592 00000004:00080000:2.0:1763333175.860853:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46e2d180, transno 17179871595 00000004:00080000:2.0:1763333175.860855:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46e2e300, transno 17179871596 00000004:00080000:2.0:1763333175.860857:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46e2f480, transno 17179871598 00000004:00080000:2.0:1763333175.860860:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46e2ce00, transno 17179871599 00000004:00080000:2.0:1763333175.860863:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44e18000, transno 17179871601 00000004:00080000:2.0:1763333175.860865:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44e1a680, transno 17179871602 00000004:00080000:2.0:1763333175.860868:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff74035880, transno 17179871603 00000004:00080000:2.0:1763333175.860870:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff74035c00, transno 17179871604 00000004:00080000:2.0:1763333175.860873:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff74034a80, transno 17179871605 00000004:00080000:2.0:1763333175.860875:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff74036d80, transno 17179871606 00000004:00080000:2.0:1763333175.860878:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff74035500, transno 17179871607 00000004:00080000:2.0:1763333175.860881:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff74034380, transno 17179871608 00000004:00080000:2.0:1763333175.860884:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7400d880, transno 17179871610 00000004:00080000:2.0:1763333175.860887:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7400df80, transno 17179871611 00000004:00080000:2.0:1763333175.860890:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe45180e00, transno 17179871612 00000004:00080000:2.0:1763333175.860892:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff77b17b80, transno 17179871613 00000100:00100000:2.0:1763333175.860898:0:3655:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff92ff7400f480 x1848987627274752/t17179871617(17179871617) o2->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763333191 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1763333175.860907:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7400f480/2, rc 0, transno 17179871617 00000100:00100000:2.0:1763333175.860911:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7400f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627274752:0@lo:2:osp-syn-1-1.0 00010000:00080000:0.0:1763333175.861087:0:35317:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1763333175.861102:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7ad4b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:56876:x1848987613739648:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 14275us (19081us total) trans 4294972377 rc 0/0 00000100:00100000:0.0:1763333175.861110:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3202 00010000:00010000:0.0:1763333175.861165:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56e68 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35317 initiator: MDT1 00010000:00010000:0.0:1763333175.861174:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56e68 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35317 initiator: MDT1 00010000:00010000:0.0:1763333175.861180:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56e68 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35317 initiator: MDT1 00010000:00010000:0.0:1763333175.861184:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48193400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333175.861187:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56e68 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35317 initiator: MDT1 00010000:00010000:0.0:1763333175.861192:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56e68 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35317 initiator: MDT1 00010000:00010000:0.0:1763333175.861203:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac900) 00010000:00010000:0.0:1763333175.861206:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333175.861210:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56e68 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35317 initiator: MDT1 00010000:00010000:0.0:1763333175.861215:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56e68 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35317 initiator: MDT1 00000100:00100000:0.0:1763333175.861366:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000004:00080000:3.0:1763333175.863484:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff77b15c00/2, rc 0, transno 21474838923 00000100:00100000:3.0:1763333175.863497:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627274880:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1763333175.863514:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7400c700/2, rc 0, transno 17179871618 00000100:00100000:3.0:1763333175.863520:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7400c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627274496:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1763333175.863530:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7400ca80/2, rc 0, transno 17179871619 00000100:00100000:3.0:1763333175.863533:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7400ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627275008:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333175.863605:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613740416 00000100:00100000:3.0:1763333175.863612:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613740416 00010000:00010000:3.0:1763333175.863648:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56e5a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969af5 expref: 239 pid: 12741 timeout: 1379 lvb_type: 0 00000100:00100000:3.0:1763333175.863690:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3087 00000100:00100000:3.0:1763333175.863699:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74038a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:2418:x1848987613740416:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333175.863714:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333175.863721:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56e5a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969af5 expref: 239 pid: 12741 timeout: 1379 lvb_type: 0 00010000:00010000:3.0:1763333175.863732:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56e5a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969af5 expref: 239 pid: 12741 timeout: 1379 lvb_type: 0 00010000:00010000:3.0:1763333175.863759:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56e5a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969af5 expref: 239 pid: 12741 timeout: 1379 lvb_type: 0 00010000:00010000:3.0:1763333175.863775:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bb:0x0].0x0 (ffff92ff61a46700) 00010000:00010000:3.0:1763333175.863780:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56e76 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.863791:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56e76 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.863798:0:6506:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56e76 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.863826:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333175.863884:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74038a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:2418:x1848987613740416:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 185us (2517us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333175.863892:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3087 00010000:00010000:3.0:1763333175.864032:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56e76 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.864042:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56e76 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:3.0:1763333175.864071:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1bb:0x0]: returning size 0 00000004:00080000:3.0:1763333175.864291:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x243:0x0], index 0: 0 00000004:00080000:3.0:1763333175.864299:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x243:0x0], index 1: 0 00000004:00080000:3.0:1763333175.864304:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x244:0x0], index 1: 0 00000004:00080000:3.0:1763333175.864309:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x244:0x0], index 0: 0 00010000:00010000:3.0:1763333175.864472:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56e76 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.864481:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56e76 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.864488:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56e76 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.864494:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff4139a000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333175.864499:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56e76 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.864507:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56e76 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.864518:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bb:0x0].0x0 (ffff92ff61a46700) 00010000:00010000:3.0:1763333175.864521:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763333175.864525:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56e76 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.864531:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56e76 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333175.864591:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c56e6f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969afc expref: 238 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.864601:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bb:0x0].0x0 (ffff92ff61a46700) 00010000:00010000:3.0:1763333175.864603:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763333175.864607:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c56e6f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969afc expref: 238 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.864623:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff4139a800, rc 0) 00000100:00100000:3.0:1763333175.864670:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56880:x1848987613740288:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 12564us (12728us total) trans 4294972378 rc 301/301 00000100:00100000:3.0:1763333175.864679:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9384 00000004:00080000:2.0:1763333175.865054:0:9836:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 4 in progress, 1 in flight, 44 done 00000100:00100000:3.0:1763333175.867534:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.867627:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.867680:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.867707:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613740800 00000100:00100000:3.0:1763333175.867716:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613740800 00010000:00010000:3.0:1763333175.867811:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56d96 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x241:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ab6 expref: 20 pid: 8406 timeout: 1379 lvb_type: 0 00000100:00100000:0.0:1763333175.867838:0:28651:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff74039500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28651:1848987627275264:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333175.867839:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613740672 00000100:00100000:3.0:1763333175.867842:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613740672 00010000:00010000:3.0:1763333175.867855:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56d8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x241:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969aaf expref: 16 pid: 29013 timeout: 1379 lvb_type: 0 00000100:00100000:3.0:1763333175.867874:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3088 00010000:00010000:0.0:1763333175.867877:0:28651:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56e8b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x241:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333175.867882:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4960b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2421:x1848987613740800:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333175.867896:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333175.867902:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56d96 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x241:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ab6 expref: 20 pid: 8406 timeout: 1379 lvb_type: 0 00000100:00100000:0.0:1763333175.867903:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3089 00000100:00100000:0.0:1763333175.867909:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4960bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2421:x1848987613740672:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333175.867913:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56d96 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x241:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ab6 expref: 20 pid: 8406 timeout: 1379 lvb_type: 0 00010000:00010000:0.0:1763333175.867920:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333175.867924:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56d8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x241:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969aaf expref: 16 pid: 29013 timeout: 1379 lvb_type: 0 00010000:00010000:0.0:1763333175.867932:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56d8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x241:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969aaf expref: 16 pid: 29013 timeout: 1379 lvb_type: 0 00010000:00010000:3.0:1763333175.867936:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333175.867938:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333175.867945:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe48191600/0xb32e3ef184c56e92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x241:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.867945:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56d8f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x241:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969aaf expref: 16 pid: 29013 timeout: 1379 lvb_type: 0 00010000:00010000:0.0:1763333175.867956:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333175.867957:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333175.867960:0:6506:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe48191600/0xb32e3ef184c56e92 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x241:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.867960:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56e8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x241:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.867968:0:28428:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56e8b lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x241:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.867978:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333175.867981:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333175.868049:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613740544 00000100:00100000:2.0:1763333175.868054:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613740544 00000100:00100000:2.0:1763333175.868089:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9385 00000100:00100000:2.0:1763333175.868096:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+237:56876:x1848987613740544:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333175.868116:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333175.868134:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56ea0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1b8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969b03 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.868184:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56ea0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b03 expref: 238 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.868196:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190c00/0xb32e3ef184c56ea0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1b8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b03 expref: 238 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.868218:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac900) 00010000:00010000:2.0:1763333175.868222:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333175.868225:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48190c00, rc 0) 00010000:00010000:1.0:1763333175.868497:0:8404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56d96 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x241:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ab6 expref: 20 pid: 8406 timeout: 1379 lvb_type: 0 00000100:00100000:1.0:1763333175.868515:0:8404:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77b14700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8404:1848987627275392:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333175.868529:0:8404:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe48191600/0xb32e3ef184c56e92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.868537:0:8404:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe48191600/0xb32e3ef184c56e92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.868543:0:8404:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe48191600/0xb32e3ef184c56e92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.868553:0:8404:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe48191600/0xb32e3ef184c56e92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.868560:0:8404:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe48191600/0xb32e3ef184c56e92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.868578:0:8404:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763333175.871260:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7403b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+25:3653:x1848987627274240:12345-0@lo:6:osp-syn-0-1.0 Request processed in 11053us (13541us total) trans 21474838924 rc 0/0 00000100:00100000:3.0:1763333175.871289:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4960b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2421:x1848987613740800:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 3404us (3659us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333175.871302:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3088 00000100:00100000:0.0:1763333175.871418:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4960bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2421:x1848987613740672:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 3505us (3734us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333175.871468:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56876:x1848987613740544:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 3362us (3933us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333175.871476:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9385 00010000:00010000:3.0:1763333175.871557:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333175.871565:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe48191600/0xb32e3ef184c56e92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.871577:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48191600 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333175.871581:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe48191600/0xb32e3ef184c56e92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.871592:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe48191600/0xb32e3ef184c56e92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.871612:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe48191600/0xb32e3ef184c56e92 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.871619:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe48191600/0xb32e3ef184c56e92 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333175.871620:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:3.0:1763333175.871641:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333175.871643:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333175.871645:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333175.871650:0:28651:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56e8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.871659:0:28651:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56e8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.871668:0:28651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56e8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.871676:0:28651:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56e8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.871692:0:28651:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1763333175.871704:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff77b16680/2, rc 0, transno 21474838924 00000100:00100000:3.0:1763333175.871710:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627274240:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1763333175.871733:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333175.871738:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56e8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.871744:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700f000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333175.871747:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56e8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.871754:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56e8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.871765:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56e8b lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.871771:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f000/0xb32e3ef184c56e8b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.871782:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333175.871784:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333175.871785:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763333175.871805:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613741056 00000100:00100000:3.0:1763333175.871812:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613741056 00000100:00100000:3.0:1763333175.871851:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3203 00000100:00100000:3.0:1763333175.871859:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56880:x1848987613741056:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333175.871901:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+9:3655:x1848987627274368:12345-0@lo:6:osp-syn-1-1.0 Request processed in 13986us (14492us total) trans 17179871620 rc 0/0 00000100:00100000:2.0:1763333175.871909:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6607 00000004:00080000:2.0:1763333175.871941:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7400f100/2, rc 0, transno 17179871620 00000100:00100000:2.0:1763333175.871946:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7400f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627274368:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763333175.872143:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56880:x1848987613741056:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 284us (522us total) trans 4294972379 rc 0/0 00000100:00100000:2.0:1763333175.872151:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3203 00000100:00100000:0.0:1763333175.872247:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3089 00000100:00100000:1.0:1763333175.872617:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6613 00000100:00100000:2.0:1763333175.876762:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333175.876866:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613741312 00000100:00100000:0.0:1763333175.876876:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613741312 00000100:00100000:0.0:1763333175.877011:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3204 00000100:00100000:0.0:1763333175.877024:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56876:x1848987613741312:12345-192.168.204.28@tcp:35:lfs.0 00000004:00080000:0.0:1763333175.877277:0:35317:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x1b8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1763333175.877343:0:35317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1440, 64 off121360 00000040:00080000:0.0:1763333175.877563:0:35317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1439, 64 off121360 00000040:00080000:0.0:1763333175.877575:0:35317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1440, 64 off121424 00000040:00080000:0.0:1763333175.877584:0:35317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1441, 64 off121424 00010000:00010000:0.0:1763333175.877645:0:35317:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e000/0xb32e3ef184c56ea7 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1b8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35317 initiator: MDT0 00010000:00010000:0.0:1763333175.877666:0:35317:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e000/0xb32e3ef184c56ea7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 35317 initiator: MDT1 00010000:00010000:0.0:1763333175.877677:0:35317:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e000/0xb32e3ef184c56ea7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1b8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 35317 initiator: MDT1 00010000:00010000:0.0:1763333175.877685:0:35317:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e000/0xb32e3ef184c56ea7 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1b8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 35317 initiator: MDT1 00010000:00010000:0.0:1763333175.877691:0:35317:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e000/0xb32e3ef184c56ea7 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1b8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 35317 initiator: MDT1 00010000:00010000:0.0:1763333175.877697:0:35317:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e000/0xb32e3ef184c56ea7 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1b8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 35317 initiator: MDT1 00010000:00010000:0.0:1763333175.878128:0:35317:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763333175.878389:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333175.878396:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e000/0xb32e3ef184c56ea7 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1b8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 35317 initiator: MDT1 00010000:00010000:2.0:1763333175.878403:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700e000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333175.878407:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e000/0xb32e3ef184c56ea7 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1b8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 35317 initiator: MDT1 00010000:00010000:2.0:1763333175.878413:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e000/0xb32e3ef184c56ea7 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1b8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 35317 initiator: MDT1 00010000:00010000:2.0:1763333175.878425:0:8422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1b8:0x0].0x0 (ffff92ff621ac900) 00010000:00010000:2.0:1763333175.878429:0:8422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1763333175.878433:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e000/0xb32e3ef184c56ea7 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1b8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 35317 initiator: MDT1 00010000:00010000:2.0:1763333175.878439:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e000/0xb32e3ef184c56ea7 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1b8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 35317 initiator: MDT1 00010000:00010000:2.0:1763333175.878451:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333175.878453:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333175.878455:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763333175.878893:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.878941:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613741568 00000100:00100000:1.0:1763333175.878957:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613741568 00000100:00100000:1.0:1763333175.879006:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3205 00000100:00100000:1.0:1763333175.879016:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56880:x1848987613741568:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1763333175.879253:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:56880:x1848987613741568:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 238us (363us total) trans 4294972381 rc 0/0 00000100:00100000:1.0:1763333175.879269:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3205 00000100:00100000:0.0:1763333175.879402:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56876:x1848987613741312:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 2380us (2648us total) trans 4294972380 rc 0/0 00000100:00100000:0.0:1763333175.879410:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3204 00000100:00100000:2.0:1763333175.884286:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.884487:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613741824 00000100:00100000:3.0:1763333175.884498:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613741824 00000100:00100000:3.0:1763333175.884567:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9386 00000100:00100000:3.0:1763333175.884579:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56876:x1848987613741824:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333175.884610:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333175.884637:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c56eae lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969b0a expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.884722:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56eb5 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333175.884736:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56eb5 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.884746:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56eb5 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.884759:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56ebc lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333175.884765:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56ebc lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.884771:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56ebc lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.884905:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c56ec3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333175.884913:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c56ec3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.884920:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c56ec3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:3.0:1763333175.884934:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1bb:0x0]: returning size 0 00010000:00010000:3.0:1763333175.885037:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56eb5 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.885044:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56eb5 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.885050:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56eb5 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.885056:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56eb5 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.885061:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff4139a000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333175.885066:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56eb5 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.885072:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56eb5 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.885084:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff8016f400) 00010000:00010000:3.0:1763333175.885087:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333175.885091:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56eb5 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.885097:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a000/0xb32e3ef184c56eb5 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.885113:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56ebc lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.885120:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56ebc lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.885129:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56ebc lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.885133:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333175.885136:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56ebc lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.885140:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56ebc lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.885146:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff8016fb00) 00010000:00010000:3.0:1763333175.885148:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333175.885150:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56ebc lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.885155:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c56ebc lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333175.885194:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4139a800/0xb32e3ef184c56eae lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b0a expref: 244 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.885209:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c56ec3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b0a expref: 243 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.885216:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bb:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:3.0:1763333175.885218:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333175.885220:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a97200, rc 0) 00000100:00100000:3.0:1763333175.885301:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:56876:x1848987613741824:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 723us (1023us total) trans 4294972382 rc 0/0 00000100:00100000:3.0:1763333175.885309:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9386 00010000:00010000:2.0:1763333175.889054:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763333175.890432:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.890536:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333175.890647:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613742080 00000100:00100000:0.0:1763333175.890658:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613742080 00000100:00100000:0.0:1763333175.890705:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613742208 00000100:00100000:0.0:1763333175.890709:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613742208 00000100:00100000:0.0:1763333175.890731:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9387 00000100:00100000:0.0:1763333175.890741:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56876:x1848987613742080:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333175.890770:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333175.890792:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c56ed1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969b18 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.890899:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56ed8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333175.890914:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56ed8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.890925:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56ed8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:0.0:1763333175.890967:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1bb:0x0]: returning size 0 00000004:00200000:0.0:1763333175.890971:0:6519:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763333175.890990:0:6519:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56ed8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.891022:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700e400/0xb32e3ef184c56ed1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b18 expref: 246 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.891040:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56ed8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b18 expref: 245 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.891049:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bb:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:0.0:1763333175.891053:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333175.891057:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4700f400, rc 0) 00000100:00100000:0.0:1763333175.891115:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56876:x1848987613742080:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 376us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333175.891122:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9387 00000100:00100000:0.0:1763333175.891142:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9388 00000100:00100000:0.0:1763333175.891150:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:55917:x1848987613742208:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333175.891157:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333175.891159:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763333175.891173:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c56ec3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b0a expref: 244 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.891183:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bb:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:0.0:1763333175.891187:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333175.891193:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56edf lrc: 2/0,0 mode: --/CW res: [0x240000404:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969b11 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.891251:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56ee6 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333175.891261:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56ed8 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b18 expref: 244 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.891268:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56ee6 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.891298:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56ed8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b18 expref: 244 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.891310:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56ed8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b18 expref: 244 pid: 6519 timeout: 1379 lvb_type: 0 00000100:00100000:0.0:1763333175.891323:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff74039500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627275520:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333175.891407:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4869d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763333175.896534:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333175.896563:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333175.896642:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333175.896666:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613742592 00000100:00100000:0.0:1763333175.896675:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613742592 00010000:00010000:0.0:1763333175.896715:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56ed8 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b18 expref: 245 pid: 6519 timeout: 1379 lvb_type: 0 00000100:00100000:0.0:1763333175.896753:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3090 00000100:00100000:0.0:1763333175.896762:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74039180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:2419:x1848987613742592:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333175.896777:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333175.896783:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56ed8 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b18 expref: 245 pid: 6519 timeout: 1379 lvb_type: 0 00010000:00010000:0.0:1763333175.896794:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56ed8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b18 expref: 245 pid: 6519 timeout: 1379 lvb_type: 0 00010000:00010000:0.0:1763333175.896815:0:28428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bb:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:0.0:1763333175.896819:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56ee6 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.896829:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56ee6 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.896835:0:28428:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56ee6 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333175.896852:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333175.896912:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74039180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:2419:x1848987613742592:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 150us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333175.896919:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3090 00000100:00100000:1.0:1763333175.897066:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613742336 00000100:00100000:1.0:1763333175.897071:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613742336 00000100:00100000:1.0:1763333175.897101:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613742464 00000100:00100000:1.0:1763333175.897104:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613742464 00000100:00100000:1.0:1763333175.897124:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6615 00000100:00100000:1.0:1763333175.897131:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7403a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2421:x1848987613742336:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333175.897146:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333175.897165:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56eed lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969b1f expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333175.897188:0:8404:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x244:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333175.897204:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333175.897206:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333175.897213:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56eed lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b1f expref: 16 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333175.897228:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56eed lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b1f expref: 16 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333175.897239:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f600, rc 0) 00010000:00010000:2.0:1763333175.897572:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c56ed8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b18 expref: 244 pid: 6519 timeout: 1379 lvb_type: 0 00000100:00100000:2.0:1763333175.897592:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff74039500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627275520:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333175.897618:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56ee6 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.897727:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56ee6 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.897733:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56ee6 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:2.0:1763333175.897763:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1bb:0x0]: returning size 0 00010000:00010000:2.0:1763333175.897915:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c56edf lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b11 expref: 245 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.897928:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56ee6 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b11 expref: 244 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.897935:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bb:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:2.0:1763333175.897937:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1763333175.897940:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4700ee00, rc 0) 00000100:00100000:3.0:1763333175.898108:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6616 00000100:00100000:3.0:1763333175.898119:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74039c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2421:x1848987613742464:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333175.898128:0:28651:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333175.898140:0:28651:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97000/0xb32e3ef184c56efb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969b26 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333175.898154:0:28651:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x244:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333175.898163:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333175.898165:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333175.898169:0:28651:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97000/0xb32e3ef184c56efb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b26 expref: 20 pid: 28651 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333175.898180:0:28651:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97000/0xb32e3ef184c56efb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b26 expref: 20 pid: 28651 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333175.898188:0:28651:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a97000, rc 0) 00000100:00100000:1.0:1763333175.898868:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7403a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2421:x1848987613742336:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1733us (2339us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333175.898877:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6615 00000100:00100000:3.0:1763333175.898969:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74039c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2421:x1848987613742464:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 852us (2404us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333175.898975:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6616 00000100:00100000:2.0:1763333175.899714:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:55917:x1848987613742208:12345-192.168.204.28@tcp:101:bash.0 Request processed in 8561us (9173us total) trans 4294972383 rc 0/0 00000100:00100000:2.0:1763333175.899722:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9388 00000100:00100000:0.0:1763333175.904551:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333175.904894:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.905802:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613742720 00000100:00100000:2.0:1763333175.905814:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613742720 00000100:00100000:2.0:1763333175.905862:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613742848 00000100:00100000:2.0:1763333175.905865:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613742848 00000100:00100000:2.0:1763333175.905903:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9389 00000100:00100000:2.0:1763333175.905914:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7403b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:55917:x1848987613742720:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333175.905940:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333175.905963:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56f02 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969b2d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.905999:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56f09 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333175.906012:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56f09 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.906023:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56f09 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333175.906131:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56f02 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b2d expref: 247 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.906149:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56f09 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b2d expref: 246 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.906157:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bb:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:2.0:1763333175.906160:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763333175.906163:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4400, rc 0) 00000100:00100000:2.0:1763333175.906220:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7403b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:55917:x1848987613742720:12345-192.168.204.28@tcp:101:bash.0 Request processed in 308us (1681us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333175.906227:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9389 00000100:00100000:2.0:1763333175.906246:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9390 00000100:00100000:2.0:1763333175.906252:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56876:x1848987613742848:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333175.906259:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333175.906268:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56f10 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969b34 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.906293:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56f10 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b34 expref: 246 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.906303:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56f10 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b34 expref: 246 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.906318:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bb:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:2.0:1763333175.906321:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333175.906323:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5400, rc 0) 00000100:00100000:2.0:1763333175.906371:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56876:x1848987613742848:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 119us (1478us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333175.906377:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9390 00000100:00100000:0.0:1763333175.909568:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333175.909618:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.909655:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613743104 00000100:00100000:1.0:1763333175.910057:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613743360 00000100:00100000:1.0:1763333175.910067:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613743360 00000100:00100000:1.0:1763333175.910117:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9391 00000100:00100000:1.0:1763333175.910125:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:55917:x1848987613743360:12345-192.168.204.28@tcp:36:bash.0 00000100:00100000:2.0:1763333175.910239:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613743104 00000100:00100000:2.0:1763333175.910290:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3206 00000100:00100000:2.0:1763333175.910297:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:56876:x1848987613743104:12345-192.168.204.28@tcp:35:lfs.0 00010000:00010000:1.0:1763333175.910386:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56f17 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333175.910406:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56f17 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333175.910416:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56f17 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000100:00100000:2.0:1763333175.910474:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:56876:x1848987613743104:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 176us (915us total) trans 4294972385 rc 0/0 00000001:00080000:1.0:1763333175.910474:0:8606:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294972384 00000100:00100000:2.0:1763333175.910482:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3206 00000004:00010000:1.0:1763333175.910499:0:8606:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009028ef5a reply state 00000000981165f9 transno 4294972386 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56f17 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333175.910511:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56f17 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333175.910518:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bb:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:1.0:1763333175.910520:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333175.910524:0:8606:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763333175.910570:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:55917:x1848987613743360:12345-192.168.204.28@tcp:36:bash.0 Request processed in 445us (952us total) trans 4294972386 rc 0/0 00000100:00100000:1.0:1763333175.910577:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9391 00000020:00080000:1.0:1763333175.910580:0:8606:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763333175.914419:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333175.914807:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613743616 00000100:00100000:0.0:1763333175.914819:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613743616 00000100:00100000:0.0:1763333175.914888:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9392 00000100:00100000:0.0:1763333175.914898:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:56876:x1848987613743616:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333175.914924:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333175.914961:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c56f1e lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969b3b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.915049:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c56f25 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333175.915063:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c56f25 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.915074:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c56f25 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.915086:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c56f2c lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333175.915093:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c56f2c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.915098:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c56f2c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.915214:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56f33 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333175.915228:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56f33 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.915234:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56f33 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:0.0:1763333175.915244:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1bb:0x0]: returning size 0 00010000:00010000:0.0:1763333175.915323:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c56f25 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.915331:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c56f25 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.915337:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c56f25 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.915343:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c56f25 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.915372:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48193c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333175.915377:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c56f25 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.915384:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c56f25 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.915396:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12100) 00010000:00010000:0.0:1763333175.915399:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333175.915403:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c56f25 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.915409:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c56f25 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.915426:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c56f2c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.915432:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c56f2c lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.915437:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c56f2c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.915442:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48192400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333175.915445:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c56f2c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.915450:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c56f2c lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.915466:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe44e12f00) 00010000:00010000:0.0:1763333175.915469:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333175.915472:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c56f2c lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.915477:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c56f2c lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.915516:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c56f1e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b3b expref: 253 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.915530:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56f33 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b3b expref: 252 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.915536:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bb:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:0.0:1763333175.915539:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1763333175.915542:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48193400, rc 0) 00000100:00100000:0.0:1763333175.915611:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:56876:x1848987613743616:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 714us (1203us total) trans 4294972387 rc 0/0 00000100:00100000:0.0:1763333175.915618:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9392 00000100:00100000:3.0:1763333175.916036:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.916123:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613743872 00000100:00100000:1.0:1763333175.916129:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613743872 00000100:00100000:1.0:1763333175.916171:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9393 00000100:00100000:1.0:1763333175.916179:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:55917:x1848987613743872:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333175.916191:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333175.916194:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763333175.916212:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56f10 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b34 expref: 252 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.916224:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bb:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:1.0:1763333175.916227:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333175.916235:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56f41 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969b42 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.916261:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56f48 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333175.916270:0:8606:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56f33 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b3b expref: 252 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.916277:0:8606:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56f48 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1bb:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333175.916306:0:8606:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56f33 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b3b expref: 252 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.916319:0:8606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56f33 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b3b expref: 252 pid: 6521 timeout: 1379 lvb_type: 0 00000100:00100000:1.0:1763333175.916332:0:8606:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e04700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627275648:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333175.916416:0:8606:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff800d3240 going to sleep for 11 seconds 00000100:00100000:1.0:1763333175.920098:0:8606:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e04700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627275648:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333175.920130:0:8606:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56f48 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1bb:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000100:00100000:2.0:1763333175.920429:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.920486:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613744128 00000100:00100000:3.0:1763333175.920495:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613744128 00000100:00100000:3.0:1763333175.920554:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3207 00000100:00100000:3.0:1763333175.920564:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:56876:x1848987613744128:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333175.920799:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+254:56876:x1848987613744128:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 235us (370us total) trans 4294972388 rc 0/0 00000100:00100000:3.0:1763333175.920811:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3207 00000100:00100000:3.0:1763333175.923997:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.924654:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.924732:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613744384 00000100:00100000:1.0:1763333175.924744:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613744384 00000100:00100000:1.0:1763333175.924794:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3208 00000100:00100000:1.0:1763333175.924804:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc00050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+254:56876:x1848987613744384:12345-192.168.204.28@tcp:33:lfs.0 00000100:00100000:1.0:1763333175.924963:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc00050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+254:56876:x1848987613744384:12345-192.168.204.28@tcp:33:lfs.0 Request processed in 160us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333175.924970:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3208 00000100:00100000:0.0:1763333175.925108:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613744256 00000100:00100000:0.0:1763333175.925113:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613744256 00010000:00010000:0.0:1763333175.925137:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56f33 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b3b expref: 254 pid: 6521 timeout: 1379 lvb_type: 0 00000100:00100000:0.0:1763333175.925170:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3091 00000100:00100000:0.0:1763333175.925175:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff44f09850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+254:2419:x1848987613744256:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333175.925185:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333175.925190:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56f33 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b3b expref: 254 pid: 6521 timeout: 1379 lvb_type: 0 00010000:00010000:0.0:1763333175.925201:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56f33 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b3b expref: 254 pid: 6521 timeout: 1379 lvb_type: 0 00010000:00010000:0.0:1763333175.925223:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56f33 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b3b expref: 254 pid: 6521 timeout: 1379 lvb_type: 0 00010000:00010000:0.0:1763333175.925239:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bb:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:0.0:1763333175.925245:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56f48 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1bb:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.925255:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56f48 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bb:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.925266:0:6504:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56f48 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1bb:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.925298:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333175.925320:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff44f09850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:2419:x1848987613744256:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 144us (1399us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333175.925326:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3091 00010000:00010000:2.0:1763333175.925628:0:8606:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56f48 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bb:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.925637:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56f48 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bb:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000040:00080000:2.0:1763333175.925875:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1442, 88 off121512 00000004:00080000:2.0:1763333175.925884:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1280005534883ns, next at 1280195897991ns, rc = 0 00000040:00080000:2.0:1763333175.925923:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1441, 88 off121512 00000004:00080000:2.0:1763333175.925929:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1280005579649ns, next at 1280856550572ns, rc = 0 00000040:00080000:2.0:1763333175.925969:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1442, 88 off121600 00000004:00080000:2.0:1763333175.925974:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1280005624639ns, next at 1280856550572ns, rc = 0 00000040:00080000:2.0:1763333175.925984:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1443, 88 off121600 00000004:00080000:2.0:1763333175.925987:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1280005638259ns, next at 1280195897991ns, rc = 0 00000001:00080000:0.0:1763333175.933688:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972389 is committed 00000004:00080000:0.0:1763333175.933705:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 946 committed 00000004:00080000:0.0:1763333175.933717:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 943 committed 00000004:00080000:0.0:1763333175.933725:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 942 committed 00000004:00080000:0.0:1763333175.933727:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 945 committed 00010000:00010000:2.0:1763333175.933814:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56f17 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.933828:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56f17 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.933836:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56f17 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.933842:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333175.933846:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56f17 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.933854:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56f17 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.933870:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bb:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:2.0:1763333175.933873:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333175.933878:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56f17 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.933884:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56f17 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.933951:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56f48 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1bb:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b42 expref: 241 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.933960:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bb:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:2.0:1763333175.933962:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763333175.933978:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56f41 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b42 expref: 241 pid: 8606 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1763333175.933992:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56f48 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1bb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b42 expref: 240 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.934023:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bb:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:2.0:1763333175.934025:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763333175.934028:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f800, rc 0) 00000100:00100000:2.0:1763333175.934113:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:55917:x1848987613743872:12345-192.168.204.28@tcp:101:bash.0 Request processed in 17933us (18075us total) trans 4294972389 rc 0/0 00000100:00100000:2.0:1763333175.934122:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9393 00000100:00100000:1.0:1763333175.934311:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627276160:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333175.934392:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333175.934426:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1763333175.934432:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627275776:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763333175.934453:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333175.934493:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627276160 00000100:00100000:1.0:1763333175.934500:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627276160 00000100:00100000:1.0:1763333175.934536:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627275776 00000100:00100000:1.0:1763333175.934540:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627275776 00000100:00100000:1.0:1763333175.934559:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6617 00000100:00100000:1.0:1763333175.934567:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+10:3654:x1848987627276160:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1763333175.934721:0:28650:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x244:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333175.934725:0:28650:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x244:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763333175.934727:0:28650:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x244:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333175.934729:0:28650:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x244:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763333175.934731:0:28650:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x244:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333175.934763:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+11:3654:x1848987627276160:12345-0@lo:2:osp-syn-1-1.0 Request processed in 195us (369us total) trans 17179871621 rc 0/0 00000100:00100000:1.0:1763333175.934770:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6617 00000100:00100000:1.0:1763333175.934783:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6618 00000100:00100000:1.0:1763333175.934789:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+10:3654:x1848987627275776:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763333175.934805:0:28650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:575 count 1 00010000:00010000:1.0:1763333175.934821:0:28650:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56f4f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.934837:0:28650:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56bdd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a1c expref: 15 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.934845:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333175.934847:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333175.934851:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56f4f lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.934878:0:28650:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56bdd lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a1c expref: 15 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.934891:0:28650:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56bdd lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a1c expref: 15 pid: 28600 timeout: 1380 lvb_type: 0 00000100:00100000:1.0:1763333175.934901:0:28650:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff50049180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28650:1848987627276288:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333175.934944:0:28650:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff800d30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763333175.934964:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627275904:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763333175.934989:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333175.935008:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763333175.935013:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627276032:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333175.935032:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333175.935053:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627275904 00000100:00100000:1.0:1763333175.935056:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627275904 00000100:00100000:1.0:1763333175.935077:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627276032 00000100:00100000:1.0:1763333175.935080:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627276032 00000100:00100000:1.0:1763333175.935098:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6619 00000100:00100000:1.0:1763333175.935104:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+12:3652:x1848987627275904:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763333175.935115:0:8611:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:576 count 1 00010000:00010000:1.0:1763333175.935126:0:8611:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c56f56 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.935138:0:8611:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56dc0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ac4 expref: 15 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.935145:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333175.935146:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333175.935149:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c56f56 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.935168:0:8611:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56dc0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ac4 expref: 15 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.935177:0:8611:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56dc0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ac4 expref: 15 pid: 29013 timeout: 1380 lvb_type: 0 00000100:00100000:1.0:1763333175.935187:0:8611:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7569dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8611:1848987627276416:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333175.935211:0:8611:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff6be07780 going to sleep for 11 seconds 00000100:00100000:1.0:1763333175.935227:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6620 00000100:00100000:1.0:1763333175.935234:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+12:3652:x1848987627276032:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333175.935314:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+13:3652:x1848987627276032:12345-0@lo:2:osp-syn-1-1.0 Request processed in 80us (280us total) trans 17179871622 rc 0/0 00000100:00100000:1.0:1763333175.935321:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6620 00000004:00080000:1.0:1763333175.935388:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44e06680/2, rc 0, transno 17179871622 00000100:00100000:1.0:1763333175.935394:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627276032:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1763333175.935417:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44e04e00/2, rc 0, transno 17179871621 00000100:00100000:1.0:1763333175.935423:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627276160:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333175.937945:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe49608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627276544:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763333175.938029:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333175.938075:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1763333175.938082:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe49608a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627276928:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333175.938104:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333175.938180:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4960b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627276672:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763333175.938208:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333175.938239:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1763333175.938244:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4960bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627276800:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333175.938264:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333175.938770:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627276544 00000100:00100000:2.0:1763333175.938779:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627276544 00000100:00100000:2.0:1763333175.938827:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627276928 00000100:00100000:2.0:1763333175.938831:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627276928 00000100:00100000:2.0:1763333175.938847:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627276672 00000100:00100000:2.0:1763333175.938851:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627276672 00000100:00100000:2.0:1763333175.938867:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627276800 00000100:00100000:2.0:1763333175.938869:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627276800 00000100:00100000:2.0:1763333175.938889:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6621 00000100:00100000:2.0:1763333175.938898:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+28:3655:x1848987627276544:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1763333175.938925:0:28651:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:575 count 1 00010000:00010000:2.0:1763333175.938954:0:28651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56f5d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.938975:0:28651:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56e06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ad9 expref: 19 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.938984:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333175.938986:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333175.938990:0:28651:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56f5d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.939019:0:28651:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56e06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ad9 expref: 19 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.939030:0:28651:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56e06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ad9 expref: 19 pid: 8406 timeout: 1380 lvb_type: 0 00000100:00100000:2.0:1763333175.939041:0:28651:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77b16300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28651:1848987627277056:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333175.939105:0:28651:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff742b9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1763333175.939124:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6622 00000100:00100000:2.0:1763333175.939132:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+28:3655:x1848987627276928:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:2.0:1763333175.939278:0:28600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x244:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333175.939282:0:28600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x244:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1763333175.939284:0:28600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x244:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333175.939286:0:28600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x244:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1763333175.939288:0:28600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x244:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333175.939336:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+29:3655:x1848987627276928:12345-0@lo:2:osp-syn-0-1.0 Request processed in 204us (1230us total) trans 21474838925 rc 0/0 00000100:00100000:2.0:1763333175.939343:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6622 00000100:00100000:2.0:1763333175.939386:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6623 00000100:00100000:2.0:1763333175.939393:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+28:3652:x1848987627276672:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1763333175.939405:0:28600:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:576 count 1 00010000:00010000:2.0:1763333175.939416:0:28600:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56f64 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.939427:0:28600:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c56de3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969acb expref: 19 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.939434:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333175.939435:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333175.939438:0:28600:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56f64 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.939468:0:28600:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c56de3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969acb expref: 19 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.939476:0:28600:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c56de3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969acb expref: 19 pid: 8406 timeout: 1380 lvb_type: 0 00000100:00100000:2.0:1763333175.939486:0:28600:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77b14a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28600:1848987627277184:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333175.939517:0:28600:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff50ece840 going to sleep for 11 seconds 00000100:00100000:2.0:1763333175.939535:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6624 00000100:00100000:2.0:1763333175.939542:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+28:3652:x1848987627276800:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333175.939616:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+29:3652:x1848987627276800:12345-0@lo:2:osp-syn-0-1.0 Request processed in 74us (1350us total) trans 21474838926 rc 0/0 00000100:00100000:2.0:1763333175.939622:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6624 00000004:00080000:2.0:1763333175.939658:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe49608a80/2, rc 0, transno 21474838925 00000100:00100000:2.0:1763333175.939664:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe49608a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627276928:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1763333175.940035:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4960bb80/2, rc 0, transno 21474838926 00000100:00100000:0.0:1763333175.940041:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4960bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627276800:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333175.944826:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.944850:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.944877:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.944999:0:28650:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff50049180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28650:1848987627276288:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333175.945033:0:28650:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56f4f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333175.945065:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613744768 00000100:00100000:1.0:1763333175.945072:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613744768 00000100:00100000:1.0:1763333175.945137:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6625 00000100:00100000:1.0:1763333175.945147:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:55917:x1848987613744768:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333175.945164:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333175.945185:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56f6b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969b49 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333175.945207:0:8404:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x243:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333175.945227:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333175.945230:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333175.945239:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56f6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b49 expref: 21 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.945257:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56f6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b49 expref: 21 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.945275:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7ec00, rc 0) 00000100:00100000:1.0:1763333175.945325:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:55917:x1848987613744768:12345-192.168.204.28@tcp:101:bash.0 Request processed in 179us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333175.945332:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6625 00000100:00100000:0.0:1763333175.945559:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613744640 00000100:00100000:0.0:1763333175.945564:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613744640 00010000:00010000:0.0:1763333175.945590:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56dc0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ac4 expref: 16 pid: 29013 timeout: 1380 lvb_type: 0 00000100:00100000:0.0:1763333175.945625:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613744512 00000100:00100000:0.0:1763333175.945628:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613744512 00010000:00010000:0.0:1763333175.945641:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56bdd lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a1c expref: 17 pid: 28600 timeout: 1380 lvb_type: 0 00000100:00100000:0.0:1763333175.945670:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3092 00000100:00100000:0.0:1763333175.945678:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2419:x1848987613744640:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333175.945688:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333175.945693:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56dc0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x240:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ac4 expref: 17 pid: 29013 timeout: 1380 lvb_type: 0 00010000:00010000:0.0:1763333175.945703:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56dc0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x240:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ac4 expref: 17 pid: 29013 timeout: 1380 lvb_type: 0 00010000:00010000:0.0:1763333175.945724:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333175.945726:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333175.945730:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c56f56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x240:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.945739:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c56f56 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x240:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.945757:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333175.945784:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2419:x1848987613744640:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 107us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333175.945791:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3092 00000100:00100000:0.0:1763333175.945807:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3093 00000100:00100000:0.0:1763333175.945814:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2419:x1848987613744512:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333175.945823:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333175.945828:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56bdd lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x23f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a1c expref: 16 pid: 28600 timeout: 1380 lvb_type: 0 00010000:00010000:0.0:1763333175.945838:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56bdd lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x23f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a1c expref: 16 pid: 28600 timeout: 1380 lvb_type: 0 00010000:00010000:0.0:1763333175.945852:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c56bdd lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x23f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969a1c expref: 16 pid: 28600 timeout: 1380 lvb_type: 0 00010000:00010000:0.0:1763333175.945864:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333175.945866:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333175.945869:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56f4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.945876:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56f4f lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.945893:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333175.945913:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2419:x1848987613744512:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 100us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333175.945919:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3093 00010000:00010000:1.0:1763333175.947147:0:28650:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56f4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.947163:0:28650:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56f4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.947174:0:28650:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56f4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.947182:0:28650:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56f4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.947214:0:28650:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763333175.947504:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+13:3654:x1848987627275776:12345-0@lo:6:osp-syn-1-1.0 Request processed in 12712us (13047us total) trans 17179871623 rc 0/0 00000100:00100000:1.0:1763333175.947513:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6618 00000004:00080000:0.0:1763333175.947752:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44e04700/2, rc 0, transno 17179871623 00000100:00100000:0.0:1763333175.947760:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627275776:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1763333175.947828:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333175.947836:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56f4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.947844:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f200 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333175.947848:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56f4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.947857:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56f4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.947875:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56f4f lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.947882:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c56f4f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.947899:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333175.947901:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333175.947903:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763333175.948271:0:28600:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77b14a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28600:1848987627277184:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333175.948292:0:28600:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56f64 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333175.948481:0:28651:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77b16300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28651:1848987627277056:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333175.948501:0:28651:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56f5d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333175.949847:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.949883:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.949941:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.950017:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613745152 00000100:00100000:3.0:1763333175.950027:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613745152 00010000:00010000:3.0:1763333175.950063:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56e06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ad9 expref: 21 pid: 8406 timeout: 1380 lvb_type: 0 00000100:00100000:3.0:1763333175.950090:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613745280 00000100:00100000:3.0:1763333175.950092:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613745280 00010000:00010000:3.0:1763333175.950102:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c56de3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969acb expref: 22 pid: 8406 timeout: 1380 lvb_type: 0 00000100:00100000:3.0:1763333175.950119:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3094 00000100:00100000:3.0:1763333175.950126:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2420:x1848987613745152:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333175.950139:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333175.950144:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56e06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ad9 expref: 22 pid: 8406 timeout: 1380 lvb_type: 0 00010000:00010000:3.0:1763333175.950155:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56e06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ad9 expref: 22 pid: 8406 timeout: 1380 lvb_type: 0 00010000:00010000:3.0:1763333175.950177:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c56e06 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ad9 expref: 22 pid: 8406 timeout: 1380 lvb_type: 0 00010000:00010000:3.0:1763333175.950192:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333175.950194:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333175.950203:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56f5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.950218:0:28428:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56f5d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.950243:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333175.950287:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2420:x1848987613745152:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 161us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333175.950294:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3094 00000100:00100000:3.0:1763333175.950310:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3095 00000100:00100000:3.0:1763333175.950315:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2420:x1848987613745280:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333175.950322:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333175.950326:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c56de3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969acb expref: 20 pid: 8406 timeout: 1380 lvb_type: 0 00010000:00010000:3.0:1763333175.950335:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c56de3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969acb expref: 20 pid: 8406 timeout: 1380 lvb_type: 0 00010000:00010000:3.0:1763333175.950375:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c56de3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x240:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969acb expref: 20 pid: 8406 timeout: 1380 lvb_type: 0 00010000:00010000:3.0:1763333175.950384:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333175.950386:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333175.950389:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56f64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.950396:0:28428:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56f64 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.950411:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333175.950427:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2420:x1848987613745280:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 112us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333175.950433:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3095 00010000:00010000:3.0:1763333175.950466:0:28600:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56f64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.950475:0:28600:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56f64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.950484:0:28600:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56f64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.950490:0:28600:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56f64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.950503:0:28600:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763333175.950577:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613745024 00000100:00100000:0.0:1763333175.950581:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613745024 00000100:00100000:0.0:1763333175.950614:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9394 00000100:00100000:0.0:1763333175.950619:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:56881:x1848987613745024:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333175.950638:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333175.950657:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56f72 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969b50 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.950723:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c56f79 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333175.950735:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c56f79 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.950743:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c56f79 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.950755:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c56f80 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333175.950761:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c56f80 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.950766:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c56f80 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.950868:0:8611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c56dc0 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ac4 expref: 14 pid: 29013 timeout: 1380 lvb_type: 0 00010000:00010000:0.0:1763333175.950879:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c56f87 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00000100:00100000:2.0:1763333175.950880:0:8611:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7569dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8611:1848987627276416:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333175.950888:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c56f87 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.950895:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c56f87 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.950898:0:8611:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c56f56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.950906:0:8611:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c56f56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1763333175.950909:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1bb:0x0]: returning size 2 00010000:00010000:2.0:1763333175.950911:0:8611:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c56f56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.950918:0:8611:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c56f56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.950925:0:8611:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c56f56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.950943:0:8611:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1763333175.951045:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c56f79 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.951052:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c56f79 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.951061:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c56f79 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.951067:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c56f79 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.951072:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48192400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333175.951075:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c56f79 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.951082:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c56f79 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.951090:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355700) 00010000:00010000:0.0:1763333175.951093:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333175.951096:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c56f79 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.951102:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c56f79 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.951110:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c56f80 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.951115:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c56f80 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.951124:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c56f80 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.951128:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48193c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333175.951131:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c56f80 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.951135:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c56f80 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.951140:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355300) 00010000:00010000:0.0:1763333175.951142:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333175.951144:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c56f80 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.951148:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c56f80 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.951179:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56f72 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b50 expref: 243 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.951190:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c56f87 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b50 expref: 242 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.951196:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bb:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:0.0:1763333175.951198:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1763333175.951200:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48192200, rc 0) 00000100:00100000:0.0:1763333175.951223:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:56881:x1848987613745024:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 603us (1381us total) trans 4294972390 rc 0/0 00000100:00100000:0.0:1763333175.951228:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9394 00010000:00010000:1.0:1763333175.951499:0:28651:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56f5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.951510:0:28651:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56f5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.951517:0:28651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56f5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.951523:0:28651:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56f5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.951538:0:28651:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1763333175.954314:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+30:3652:x1848987627276672:12345-0@lo:6:osp-syn-0-1.0 Request processed in 14910us (16094us total) trans 21474838928 rc 0/0 00000100:00100000:3.0:1763333175.954333:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6623 00010000:00010000:3.0:1763333175.954405:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1763333175.954414:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56f64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.954425:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333175.954430:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56f64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.954442:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56f64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.954476:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56f64 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.954484:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5400/0xb32e3ef184c56f64 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1763333175.954570:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4960b480/2, rc 0, transno 21474838928 00000100:00100000:0.0:1763333175.954577:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4960b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627276672:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763333175.954635:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:3.0:1763333175.956051:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1763333175.956062:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c56f56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.956074:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333175.956077:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c56f56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.956086:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c56f56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.956104:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c56f56 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.956111:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c56f56 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.956134:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333175.956139:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56f5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333175.956449:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+29:3655:x1848987627276544:12345-0@lo:6:osp-syn-0-1.0 Request processed in 17548us (18415us total) trans 21474838927 rc 0/0 00000100:00100000:1.0:1763333175.956468:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6621 00000100:00100000:1.0:1763333175.956498:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613745408 00000100:00100000:1.0:1763333175.956504:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613745408 00000100:00100000:1.0:1763333175.956545:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6626 00000100:00100000:1.0:1763333175.956553:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:55917:x1848987613745408:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333175.956569:0:28651:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333175.956587:0:28651:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56f95 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969b57 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333175.956606:0:28651:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x243:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333175.956623:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333175.956625:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333175.956635:0:28651:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56f95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b57 expref: 15 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.956653:0:28651:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56f95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b57 expref: 15 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333175.956673:0:28651:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7fe00, rc 0) 00000100:00100000:1.0:1763333175.956715:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:55917:x1848987613745408:12345-192.168.204.28@tcp:101:bash.0 Request processed in 162us (2081us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333175.956722:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6626 00000100:00100000:2.0:1763333175.956794:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+13:3652:x1848987627275904:12345-0@lo:6:osp-syn-1-1.0 Request processed in 21689us (21802us total) trans 17179871624 rc 0/0 00000100:00100000:2.0:1763333175.956802:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6619 00010000:00010000:2.0:1763333175.956820:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333175.956827:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763333175.956855:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44e06300/2, rc 0, transno 17179871624 00000100:00100000:2.0:1763333175.956861:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627275904:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1763333175.957213:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe49608700/2, rc 0, transno 21474838927 00000100:00100000:0.0:1763333175.957224:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe49608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627276544:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1763333175.957772:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4800 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333175.957777:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56f5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.957786:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56f5d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.957802:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56f5d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.957809:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56f5d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333175.957829:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333175.957831:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333175.957833:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763333175.958818:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.959149:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613745664 00000100:00100000:2.0:1763333175.959164:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613745664 00000100:00100000:2.0:1763333175.959229:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3209 00000100:00100000:2.0:1763333175.959239:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:56881:x1848987613745664:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333175.959552:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:56881:x1848987613745664:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 313us (738us total) trans 4294972391 rc 0/0 00000100:00100000:2.0:1763333175.959560:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3209 00000100:00100000:1.0:1763333175.960829:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.960872:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.960940:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613745792 00000100:00100000:3.0:1763333175.961102:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613745920 00000100:00100000:3.0:1763333175.961108:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613745920 00002000:00010000:3.0:1763333175.961140:0:16635:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/579 (0->18446744073709551615) 00002000:00100000:3.0:1763333175.961145:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7569ce00 with x1848987613745920 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333175.961157:0:16635:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff7569ce00. 00000100:00100000:3.0:1763333175.961191:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1633 00000100:00100000:3.0:1763333175.961200:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2420:x1848987613745920:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:3.0:1763333175.961394:0:16635:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x243:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333175.961398:0:16635:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x243:0x0] updating lvb mtime from disk: 0 -> 1763333176 00002000:00010000:3.0:1763333175.961401:0:16635:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x243:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333175.961403:0:16635:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x243:0x0] updating lvb ctime from disk: 0 -> 1763333176 00002000:00010000:3.0:1763333175.961406:0:16635:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x243:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333175.961449:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2420:x1848987613745920:12345-192.168.204.28@tcp:10:bash.0 Request processed in 250us (575us total) trans 17179871625 rc 0/0 00000100:00100000:3.0:1763333175.961472:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1633 00002000:00010000:3.0:1763333175.961476:0:16635:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/579 (0->18446744073709551615) 00002000:00100000:3.0:1763333175.961479:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7569ce00 with x1848987613745920 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333175.961484:0:16635:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff7569ce00. 00000100:00100000:2.0:1763333175.961541:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613745792 00002000:00010000:2.0:1763333175.961561:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/579 (0->18446744073709551615) 00002000:00100000:2.0:1763333175.961566:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7569d500 with x1848987613745792 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333175.961572:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7569d500. 00000100:00100000:2.0:1763333175.961596:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1634 00000100:00100000:2.0:1763333175.961604:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2420:x1848987613745792:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:2.0:1763333175.961692:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x243:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333175.961696:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x243:0x0] updating lvb mtime from disk: 0 -> 1763333176 00002000:00010000:2.0:1763333175.961699:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x243:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333175.961701:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x243:0x0] updating lvb ctime from disk: 0 -> 1763333176 00002000:00010000:2.0:1763333175.961704:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x243:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333175.961727:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2420:x1848987613745792:12345-192.168.204.28@tcp:10:bash.0 Request processed in 124us (903us total) trans 21474838929 rc 0/0 00000100:00100000:2.0:1763333175.961735:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1634 00002000:00010000:2.0:1763333175.961738:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/579 (0->18446744073709551615) 00002000:00100000:2.0:1763333175.961741:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7569d500 with x1848987613745792 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333175.961746:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7569d500. 00000100:00100000:3.0:1763333175.966306:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333175.966499:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613746048 00000100:00100000:0.0:1763333175.966510:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613746048 00000100:00100000:0.0:1763333175.966579:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9395 00000100:00100000:0.0:1763333175.966590:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:56881:x1848987613746048:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333175.966613:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333175.966637:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99200/0xb32e3ef184c56f9c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969b5e expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.966705:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a98600/0xb32e3ef184c56fa3 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333175.966719:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a98600/0xb32e3ef184c56fa3 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.966729:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a98600/0xb32e3ef184c56fa3 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.966741:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99800/0xb32e3ef184c56faa lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333175.966747:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99800/0xb32e3ef184c56faa lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.966753:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99800/0xb32e3ef184c56faa lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.966824:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99000/0xb32e3ef184c56fb1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333175.966833:0:8606:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56ee6 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b11 expref: 244 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.966842:0:8606:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99000/0xb32e3ef184c56fb1 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333175.966872:0:8606:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56ee6 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b11 expref: 244 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.966883:0:8606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56ee6 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b11 expref: 244 pid: 6519 timeout: 1380 lvb_type: 0 00000100:00100000:0.0:1763333175.966896:0:8606:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe469a3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627277312:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333175.971541:0:8606:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4869d900 going to sleep for 11 seconds 00000100:00100000:2.0:1763333175.975896:0:8606:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe469a3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627277312:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333175.975929:0:8606:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99000/0xb32e3ef184c56fb1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000100:00100000:3.0:1763333175.977769:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.977880:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613746304 00000100:00100000:1.0:1763333175.977890:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613746304 00000100:00100000:1.0:1763333175.977956:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3210 00000100:00100000:1.0:1763333175.977969:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:44391:x1848987613746304:12345-192.168.204.28@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1763333175.978403:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:44391:x1848987613746304:12345-192.168.204.28@tcp:35:ldlm_bl.0 Request processed in 434us (641us total) trans 4294972392 rc 0/0 00000100:00100000:1.0:1763333175.978412:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3210 00000100:00100000:0.0:1763333175.983002:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333175.983120:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613746432 00000100:00100000:3.0:1763333175.983129:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613746432 00010000:00010000:3.0:1763333175.983169:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56ee6 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b11 expref: 246 pid: 6519 timeout: 1380 lvb_type: 0 00000100:00100000:3.0:1763333175.983209:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3096 00000100:00100000:3.0:1763333175.983217:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:2420:x1848987613746432:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333175.983232:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333175.983238:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56ee6 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b11 expref: 246 pid: 6519 timeout: 1380 lvb_type: 0 00010000:00010000:3.0:1763333175.983250:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56ee6 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b11 expref: 246 pid: 6519 timeout: 1380 lvb_type: 0 00010000:00010000:3.0:1763333175.983278:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c56ee6 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b11 expref: 246 pid: 6519 timeout: 1380 lvb_type: 0 00010000:00010000:3.0:1763333175.983294:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bb:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:3.0:1763333175.983300:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99000/0xb32e3ef184c56fb1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333175.983310:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99000/0xb32e3ef184c56fb1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333175.983317:0:6504:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99000/0xb32e3ef184c56fb1 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333175.983376:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333175.983439:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:2420:x1848987613746432:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 222us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333175.983448:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3096 00010000:00010000:2.0:1763333175.983629:0:8606:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99000/0xb32e3ef184c56fb1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.983638:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99000/0xb32e3ef184c56fb1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:2.0:1763333175.983694:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1bb:0x0]: returning size 5 00000004:00200000:2.0:1763333175.983699:0:8606:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763333175.983722:0:8606:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99000/0xb32e3ef184c56fb1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.983736:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99000/0xb32e3ef184c56fb1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.983746:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a98600/0xb32e3ef184c56fa3 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.983753:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a98600/0xb32e3ef184c56fa3 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.983760:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a98600/0xb32e3ef184c56fa3 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.983765:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a98600/0xb32e3ef184c56fa3 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.983771:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff73a98600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333175.983775:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a98600/0xb32e3ef184c56fa3 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.983782:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a98600/0xb32e3ef184c56fa3 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.983791:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355700) 00010000:00010000:2.0:1763333175.983794:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333175.983798:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a98600/0xb32e3ef184c56fa3 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.983804:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a98600/0xb32e3ef184c56fa3 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.983815:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99800/0xb32e3ef184c56faa lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.983821:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99800/0xb32e3ef184c56faa lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.983827:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99800/0xb32e3ef184c56faa lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.983831:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff73a99800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333175.983834:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99800/0xb32e3ef184c56faa lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.983844:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99800/0xb32e3ef184c56faa lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.983851:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355300) 00010000:00010000:2.0:1763333175.983853:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333175.983856:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99800/0xb32e3ef184c56faa lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.983861:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99800/0xb32e3ef184c56faa lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.983894:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99200/0xb32e3ef184c56f9c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b5e expref: 245 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.983909:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99000/0xb32e3ef184c56fb1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b5e expref: 244 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.983915:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bb:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:2.0:1763333175.983917:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333175.983920:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff73a99000, rc 0) 00000100:00100000:2.0:1763333175.983968:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56881:x1848987613746048:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 17380us (17672us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333175.983976:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9395 00000100:00100000:1.0:1763333175.991700:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.991803:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613746560 00000100:00100000:2.0:1763333175.991817:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613746560 00000100:00100000:2.0:1763333175.991889:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9396 00000100:00100000:2.0:1763333175.991900:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56882:x1848987613746560:12345-192.168.204.28@tcp:101:rm.0 00010000:00010000:2.0:1763333175.991927:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333175.991965:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56fb8 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969b65 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.992058:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56fbf lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333175.992076:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56fbf lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.992091:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56fbf lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.992104:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56fc6 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333175.992111:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56fc6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.992117:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56fc6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.992214:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56fcd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333175.992223:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56fcd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.992231:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56fcd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:2.0:1763333175.992280:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1bb:0x0]: returning size 5 00000004:00200000:2.0:1763333175.992286:0:8606:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763333175.992311:0:8606:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56fcd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.992325:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56fcd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.992335:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56fbf lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.992342:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56fbf lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.992373:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56fbf lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.992380:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56fbf lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.992386:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333175.992390:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56fbf lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.992399:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56fbf lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.992411:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff61a46a00) 00010000:00010000:2.0:1763333175.992414:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333175.992418:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56fbf lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.992424:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c56fbf lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.992437:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56fc6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.992442:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56fc6 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.992447:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56fc6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.992451:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333175.992463:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56fc6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.992470:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56fc6 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.992478:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff61a46b00) 00010000:00010000:2.0:1763333175.992480:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333175.992483:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56fc6 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.992489:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c56fc6 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333175.992521:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c56fb8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b65 expref: 246 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.992535:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56fcd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b65 expref: 245 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333175.992542:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bb:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:2.0:1763333175.992544:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333175.992546:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4800, rc 0) 00000100:00100000:2.0:1763333175.992625:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56882:x1848987613746560:12345-192.168.204.28@tcp:101:rm.0 Request processed in 726us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333175.992633:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9396 00000100:00100000:3.0:1763333175.993189:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333175.993447:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613746816 00000100:00100000:0.0:1763333175.993462:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613746816 00000100:00100000:0.0:1763333175.993505:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9397 00000100:00100000:0.0:1763333175.993513:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56881:x1848987613746816:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333175.993527:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333175.993542:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c56fd4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969b6c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.993627:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56fdb lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333175.993643:0:6521:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99000/0xb32e3ef184c56fb1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b5e expref: 246 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.993651:0:6521:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56fcd lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b65 expref: 246 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.993659:0:6521:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56fdb lrc: 5/0,1 mode: --/CW res: [0x240000404:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333175.993695:0:6521:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56fcd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b65 expref: 246 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.993708:0:6521:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56fcd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b65 expref: 246 pid: 8606 timeout: 1380 lvb_type: 0 00000100:00100000:0.0:1763333175.993721:0:6521:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe469a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6521:1848987627277440:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333175.993795:0:6521:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99000/0xb32e3ef184c56fb1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b5e expref: 246 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333175.993803:0:6521:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99000/0xb32e3ef184c56fb1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b5e expref: 246 pid: 8606 timeout: 1380 lvb_type: 0 00000100:00100000:0.0:1763333175.993811:0:6521:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe469a2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6521:1848987627277568:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333175.993834:0:6521:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4869d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763333175.997022:0:6521:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe469a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6521:1848987627277440:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333175.997037:0:6521:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe469a2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6521:1848987627277568:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333175.997069:0:6521:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56fdb lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000100:00100000:1.0:1763333175.998583:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333175.998852:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333175.999490:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613746944 00000100:00100000:2.0:1763333175.999502:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613746944 00010000:00010000:2.0:1763333175.999558:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99000/0xb32e3ef184c56fb1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b5e expref: 247 pid: 8606 timeout: 1380 lvb_type: 0 00000100:00100000:2.0:1763333175.999615:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613747072 00000100:00100000:2.0:1763333175.999621:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613747072 00010000:00010000:2.0:1763333175.999634:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56fcd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b65 expref: 248 pid: 8606 timeout: 1380 lvb_type: 0 00000100:00100000:2.0:1763333175.999663:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3097 00000100:00100000:2.0:1763333175.999673:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:2419:x1848987613746944:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333175.999692:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333175.999700:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99000/0xb32e3ef184c56fb1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b5e expref: 248 pid: 8606 timeout: 1380 lvb_type: 0 00010000:00010000:2.0:1763333175.999713:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99000/0xb32e3ef184c56fb1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b5e expref: 248 pid: 8606 timeout: 1380 lvb_type: 0 00010000:00010000:2.0:1763333175.999741:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99000/0xb32e3ef184c56fb1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b5e expref: 248 pid: 8606 timeout: 1380 lvb_type: 0 00010000:00010000:2.0:1763333175.999758:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bb:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:2.0:1763333175.999763:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56fdb lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.999772:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56fdb lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.999778:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333175.999835:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:2419:x1848987613746944:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 162us (1262us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333175.999847:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3097 00000100:00100000:2.0:1763333175.999865:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3098 00000100:00100000:2.0:1763333175.999872:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff44f0a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:2421:x1848987613747072:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333175.999883:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333175.999889:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56fcd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b65 expref: 246 pid: 8606 timeout: 1380 lvb_type: 0 00010000:00010000:2.0:1763333175.999898:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56fcd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b65 expref: 246 pid: 8606 timeout: 1380 lvb_type: 0 00010000:00010000:2.0:1763333175.999911:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c56fcd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b65 expref: 246 pid: 8606 timeout: 1380 lvb_type: 0 00010000:00010000:2.0:1763333175.999921:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bb:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:2.0:1763333175.999924:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56fdb lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.999932:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56fdb lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.999939:0:6505:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56fdb lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333175.999976:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333175.999996:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff44f0a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:2421:x1848987613747072:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 125us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333176.000003:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3098 00010000:00010000:0.0:1763333176.000259:0:6521:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56fdb lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333176.000267:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56fdb lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:0.0:1763333176.000292:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1bb:0x0]: returning size 5 00010000:00010000:0.0:1763333176.000474:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c56fd4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b6c expref: 246 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.000489:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56fdb lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b6c expref: 245 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.000496:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bb:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:0.0:1763333176.000499:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1763333176.000502:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48193400, rc 0) 00000100:00100000:0.0:1763333176.000541:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56881:x1848987613746816:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 7028us (7354us total) trans 4294972393 rc 0/0 00000100:00100000:0.0:1763333176.000549:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9397 00000100:00100000:1.0:1763333176.001734:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.006053:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613747200 00000100:00100000:0.0:1763333176.006068:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613747200 00000100:00100000:0.0:1763333176.006149:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9398 00000100:00100000:0.0:1763333176.006161:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56882:x1848987613747200:12345-192.168.204.28@tcp:101:rm.0 00010000:00010000:0.0:1763333176.006184:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333176.006209:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c56fe9 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969b73 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.006303:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c56ff0 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333176.006319:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c56ff0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333176.006331:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c56ff0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333176.006344:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c56ff7 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333176.006376:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c56ff7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333176.006384:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c56ff7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333176.006473:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c56ffe lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333176.006486:0:6521:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56fdb lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b6c expref: 246 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.006496:0:6521:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c56ffe lrc: 4/1,0 mode: --/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:0.0:1763333176.006535:0:6521:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56fdb lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b6c expref: 246 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.006550:0:6521:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56fdb lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b6c expref: 246 pid: 6521 timeout: 1380 lvb_type: 0 00000100:00100000:0.0:1763333176.006571:0:6521:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe469a2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6521:1848987627277696:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333176.006658:0:6521:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4869d900 going to sleep for 11 seconds 00000100:00080000:0.0:1763333176.006675:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1763333176.011239:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333176.013290:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613747456 00000100:00100000:2.0:1763333176.013303:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613747456 00000100:00100000:2.0:1763333176.013385:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9399 00000100:00100000:2.0:1763333176.013397:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56881:x1848987613747456:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333176.013423:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333176.013426:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763333176.013441:0:8606:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56fdb lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b6c expref: 247 pid: 6521 timeout: 1380 lvb_type: 0 00010000:00010000:2.0:1763333176.013475:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bb:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:2.0:1763333176.013481:0:8606:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c56ffe lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333176.013491:0:8606:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c56ffe lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333176.013498:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c56ffe lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT1 00010000:00010000:2.0:1763333176.013521:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333176.013536:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c57005 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969b7a expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.013639:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5700c lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333176.013650:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5700c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1bb:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333176.013658:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5700c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1bb:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:2.0:1763333176.013670:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1bb:0x0]: returning size 5 00010000:00010000:2.0:1763333176.013770:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c57005 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b7a expref: 250 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.013788:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5700c lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1bb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b7a expref: 249 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.013795:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bb:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:2.0:1763333176.013797:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763333176.013800:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5e00, rc 0) 00000100:00100000:2.0:1763333176.013855:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:56881:x1848987613747456:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 461us (2627us total) trans 4294972394 rc 0/0 00000100:00100000:2.0:1763333176.013863:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9399 00010000:00010000:3.0:1763333176.013966:0:6521:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.204.28@tcp) returned -22 from blocking AST (req@00000000964c5e5f x1848987627277696) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56fdb lrc: 1/0,0 mode: --/CW res: [0x240000404:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b6c expref: 248 pid: 6521 timeout: 1380 lvb_type: 0 00010000:00010000:3.0:1763333176.013981:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c56fdb lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b6c expref: 248 pid: 6521 timeout: 1380 lvb_type: 0 00000100:00100000:3.0:1763333176.013991:0:6521:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe469a2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6521:1848987627277696:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333176.014012:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bb:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:3.0:1763333176.014017:0:6521:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c56ffe lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333176.014026:0:6521:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c56ffe lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333176.014030:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c56ffe lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:3.0:1763333176.014053:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1bb:0x0]: returning size 5 00000004:00200000:3.0:1763333176.014057:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763333176.014068:0:6521:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c56ffe lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333176.014077:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c56ffe lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333176.014088:0:6521:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c56ff0 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333176.014094:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c56ff0 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333176.014100:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c56ff0 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333176.014107:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c56ff0 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333176.014113:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4742f400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333176.014117:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c56ff0 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333176.014123:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c56ff0 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333176.014131:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355000) 00010000:00010000:3.0:1763333176.014134:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333176.014137:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c56ff0 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333176.014142:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c56ff0 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333176.014151:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c56ff7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333176.014157:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c56ff7 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333176.014162:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c56ff7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333176.014167:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4742fa00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333176.014169:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c56ff7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333176.014175:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c56ff7 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333176.014181:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355b00) 00010000:00010000:3.0:1763333176.014184:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333176.014186:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c56ff7 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333176.014192:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c56ff7 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 00010000:00010000:3.0:1763333176.014219:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c56fe9 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b73 expref: 248 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.014237:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c56ffe lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b73 expref: 247 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.014242:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bb:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:3.0:1763333176.014244:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333176.014247:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4742fc00, rc 0) 00000100:00100000:3.0:1763333176.014271:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56882:x1848987613747200:12345-192.168.204.28@tcp:101:rm.0 Request processed in 8113us (12543us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333176.014278:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9398 00000100:00100000:0.0:1763333176.017829:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.018709:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333176.018785:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613747584 00000100:00100000:3.0:1763333176.018796:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613747584 00000100:00100000:3.0:1763333176.018872:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6627 00000100:00100000:3.0:1763333176.018883:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2420:x1848987613747584:12345-192.168.204.28@tcp:1:lfs.0 00010000:00010000:3.0:1763333176.018933:0:28600:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c5701a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x243:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1763333176.019113:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1763333176.019209:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613747840 00000100:00100000:1.0:1763333176.019214:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613747840 00000100:00100000:1.0:1763333176.019382:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9400 00000100:00100000:1.0:1763333176.019391:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56882:x1848987613747840:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:1.0:1763333176.019437:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:1.0:1763333176.019472:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5700c lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1bb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b7a expref: 247 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.019496:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c56f48 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1bb:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b42 expref: 246 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.019509:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c56ffe lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b73 expref: 245 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.019522:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c56f87 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b50 expref: 244 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.019534:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c56f09 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1bb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b2d expref: 243 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.019546:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bb:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:1.0:1763333176.019555:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333176.019578:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c57021 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333176.019590:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c57021 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.019600:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c57021 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.019612:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c57028 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333176.019623:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c57028 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.019629:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c57028 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.019713:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5702f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333176.019722:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5702f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.019730:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5702f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00080000:1.0:1763333176.019941:0:12741:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x1bb:0x0] is inserted into orphan list, open count = 2 00010000:00010000:1.0:1763333176.020034:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5702f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.020043:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5702f lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1bb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.020050:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5702f lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1bb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.020056:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333176.020061:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5702f lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1bb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.020068:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5702f lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1bb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.020078:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bb:0x0].0x0 (ffff92ff4ad5e700) 00010000:00010000:1.0:1763333176.020082:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763333176.020087:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5702f lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1bb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.020093:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5702f lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1bb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.020109:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c57021 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.020115:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c57021 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.020121:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c57021 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.020126:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c57021 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.020131:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333176.020134:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c57021 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.020140:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c57021 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.020147:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff4ad5e300) 00010000:00010000:1.0:1763333176.020149:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333176.020152:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c57021 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.020158:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c57021 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000004:00010000:1.0:1763333176.020169:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000772be9fc reply state 000000007d59028f transno 4294972395 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c57028 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.020179:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c57028 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.020186:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff4ad5ed00) 00010000:00010000:1.0:1763333176.020189:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333176.020191:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763333176.020264:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56882:x1848987613747840:12345-192.168.204.28@tcp:36:rm.0 Request processed in 873us (1557us total) trans 4294972395 rc 0/0 00000100:00100000:1.0:1763333176.020272:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9400 00010000:00010000:3.0:1763333176.020939:0:28600:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56f6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b49 expref: 20 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.020950:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333176.020952:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333176.020957:0:28600:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c5701a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x243:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.020993:0:28600:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56f6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b49 expref: 20 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.021014:0:28600:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56f6b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b49 expref: 20 pid: 8404 timeout: 1380 lvb_type: 0 00000100:00100000:3.0:1763333176.021028:0:28600:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77a3c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28600:1848987627277824:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333176.021097:0:28600:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff49c92e40 going to sleep for 11 seconds 00000100:00100000:0.0:1763333176.026718:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.026797:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613747968 00000100:00100000:1.0:1763333176.026808:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613747968 00002000:00100000:1.0:1763333176.026861:0:16635:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x243:0x0] (0->4) req@ffff92fe469a1880 x1848987613747968/t0(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:487/0 lens 496/0 e 0 to 0 dl 1763333187 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763333176.026873:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe469a1880 with x1848987613747968 ext(0->4) 00010000:00010000:1.0:1763333176.026882:0:16635:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56f6b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b49 expref: 21 pid: 8404 timeout: 1380 lvb_type: 0 00010000:00010000:1.0:1763333176.026898:0:16635:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56f6b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b49 expref: 21 pid: 8404 timeout: 1380 lvb_type: 0 00002000:00010000:1.0:1763333176.026906:0:16635:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff92fe469a1880 00000100:00100000:1.0:1763333176.026943:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 108 00000100:00100000:1.0:1763333176.026952:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2421:x1848987613747968:12345-192.168.204.28@tcp:4:bash.0 00000100:00100000:3.0:1763333176.027701:0:28600:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77a3c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28600:1848987627277824:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333176.027729:0:28600:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c5701a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x243:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333176.027841:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2421:x1848987613747968:12345-192.168.204.28@tcp:4:bash.0 Request processed in 887us (1132us total) trans 21474838930 rc 0/0 00000100:00100000:1.0:1763333176.027852:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 108 00002000:00100000:1.0:1763333176.027862:0:16635:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000400:0x243:0x0] (0->4) req@ffff92fe469a1880 x1848987613747968/t21474838930(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:487/0 lens 496/448 e 0 to 0 dl 1763333187 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763333176.027873:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe469a1880 with x1848987613747968 ext(0->4) 00010000:00010000:1.0:1763333176.027880:0:16635:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56f6b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b49 expref: 23 pid: 8404 timeout: 1380 lvb_type: 0 00010000:00010000:1.0:1763333176.027894:0:16635:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56f6b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b49 expref: 23 pid: 8404 timeout: 1380 lvb_type: 0 00002000:00010000:1.0:1763333176.027901:0:16635:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff92fe469a1880 00000100:00100000:2.0:1763333176.037615:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333176.037704:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613748096 00000100:00100000:3.0:1763333176.037716:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613748096 00010000:00010000:3.0:1763333176.037762:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56f6b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b49 expref: 23 pid: 8404 timeout: 1380 lvb_type: 0 00000100:00100000:3.0:1763333176.037804:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3099 00000100:00100000:3.0:1763333176.037813:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2419:x1848987613748096:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333176.037829:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1763333176.037848:0:6504:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x243:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:3.0:1763333176.037851:0:6504:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x243:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1763333176.037857:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56f6b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b49 expref: 23 pid: 8404 timeout: 1380 lvb_type: 0 00010000:00010000:3.0:1763333176.037871:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56f6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b49 expref: 23 pid: 8404 timeout: 1380 lvb_type: 0 00010000:00010000:3.0:1763333176.037901:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c56f6b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x243:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b49 expref: 23 pid: 8404 timeout: 1380 lvb_type: 0 00010000:00010000:3.0:1763333176.037918:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333176.037920:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333176.037925:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c5701a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.037936:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c5701a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.038067:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333176.038123:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2419:x1848987613748096:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 310us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333176.038131:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3099 00010000:00010000:1.0:1763333176.038212:0:28600:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c5701a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.038222:0:28600:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c5701a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.038243:0:28600:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c5701a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.038251:0:28600:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c5701a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.038259:0:28600:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c5701a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.038266:0:28600:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333176.038270:0:28600:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c5701a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.038279:0:28600:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c5701a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.038291:0:28600:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c5701a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.038298:0:28600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c5701a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333176.038341:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2420:x1848987613747584:12345-192.168.204.28@tcp:1:lfs.0 Request processed in 19461us (20524us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333176.038394:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6627 00000100:00100000:0.0:1763333176.048250:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.048509:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613748352 00000100:00100000:1.0:1763333176.048519:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613748352 00000100:00100000:1.0:1763333176.048573:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9401 00000100:00100000:1.0:1763333176.048581:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56881:x1848987613748352:12345-192.168.204.28@tcp:36:lfs.0 00000100:00100000:1.0:1763333176.048694:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56881:x1848987613748352:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 113us (454us total) trans 0 rc -116/-116 00000100:00100000:1.0:1763333176.048701:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9401 00000100:00100000:0.0:1763333176.048802:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.048821:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613748480 00000100:00100000:0.0:1763333176.048824:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613748480 00000100:00100000:0.0:1763333176.048848:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9402 00000100:00100000:0.0:1763333176.048854:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56883:x1848987613748480:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333176.048864:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333176.048886:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c57036 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969b81 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.048940:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c5703d lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333176.049437:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c5703d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.049451:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c5703d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.049473:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c57044 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333176.049480:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c57044 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.049487:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c57044 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.049528:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c5703d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.049535:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c5703d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.049540:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c5703d lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.049545:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c5703d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.049550:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4742fc00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333176.049554:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c5703d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.049561:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c5703d lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.049572:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355c00) 00010000:00010000:0.0:1763333176.049574:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333176.049578:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c5703d lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.049584:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c5703d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.049595:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c57044 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.049600:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c57044 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.049606:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c57044 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.049610:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4742fa00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333176.049613:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c57044 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.049618:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c57044 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.049624:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff4ad5ed00) 00010000:00010000:0.0:1763333176.049626:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333176.049629:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c57044 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.049634:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c57044 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.049662:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c57036 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b81 expref: 245 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.049673:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355c00) 00010000:00010000:0.0:1763333176.049675:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333176.049679:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c57036 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b81 expref: 245 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.049692:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4742e000, rc 0) 00000100:00100000:0.0:1763333176.050487:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56883:x1848987613748480:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1628us (1681us total) trans 0 rc 301/301 00000100:00100000:0.0:1763333176.050496:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9402 00000100:00100000:3.0:1763333176.050778:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333176.051665:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613748736 00000100:00100000:2.0:1763333176.051677:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613748736 00000100:00100000:1.0:1763333176.052008:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3211 00000100:00100000:0.0:1763333176.052095:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56881:x1848987613748736:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333176.052314:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56881:x1848987613748736:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 296us (1535us total) trans 4294972396 rc 0/0 00000100:00100000:0.0:1763333176.052321:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3211 00000100:00100000:0.0:1763333176.055600:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.055679:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.057061:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613748864 00000100:00100000:1.0:1763333176.057081:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613748864 00000100:00100000:1.0:1763333176.057169:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9403 00000100:00100000:1.0:1763333176.057181:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56883:x1848987613748864:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333176.057212:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333176.057245:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c5704b lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969b88 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.057344:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c57052 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333176.057388:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c57052 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.057401:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c57052 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.057416:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c57059 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333176.057424:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c57059 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.057431:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c57059 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.057493:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c57052 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.057501:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c57052 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.057507:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c57052 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.057514:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c57052 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.057520:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333176.057525:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c57052 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.057533:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c57052 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.057545:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff4ad5e500) 00010000:00010000:1.0:1763333176.057549:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333176.057554:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c57052 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.057560:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c57052 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.057573:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c57059 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.057578:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c57059 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.057583:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c57059 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.057588:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333176.057590:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c57059 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.057595:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c57059 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.057601:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff4ad5ed00) 00010000:00010000:1.0:1763333176.057603:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333176.057606:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c57059 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.057611:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c57059 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.057640:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c5704b lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b88 expref: 246 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.057651:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff4ad5e500) 00010000:00010000:1.0:1763333176.057653:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333176.057656:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c5704b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b88 expref: 246 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.057670:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f800, rc 0) 00000100:00100000:1.0:1763333176.057754:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56883:x1848987613748864:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 575us (2161us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333176.057762:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9403 00000100:00100000:2.0:1763333176.057843:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613749120 00000100:00100000:2.0:1763333176.057848:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613749120 00000100:00100000:2.0:1763333176.057886:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3212 00000100:00100000:2.0:1763333176.057893:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56881:x1848987613749120:12345-192.168.204.28@tcp:35:lfs.0 00000004:00080000:2.0:1763333176.058082:0:35317:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x1bb:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1763333176.058142:0:35317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1444, 64 off121664 00000040:00080000:2.0:1763333176.058166:0:35317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1443, 64 off121664 00000040:00080000:2.0:1763333176.058176:0:35317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1444, 64 off121728 00000040:00080000:2.0:1763333176.058186:0:35317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1445, 64 off121728 00010000:00010000:2.0:1763333176.058234:0:35317:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57060 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35317 initiator: MDT0 00010000:00010000:2.0:1763333176.058242:0:35317:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57060 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1bb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 35317 initiator: MDT1 00010000:00010000:2.0:1763333176.058250:0:35317:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57060 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1bb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35317 initiator: MDT1 00010000:00010000:2.0:1763333176.058256:0:35317:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57060 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1bb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35317 initiator: MDT1 00010000:00010000:2.0:1763333176.058261:0:35317:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57060 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1bb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35317 initiator: MDT1 00010000:00010000:2.0:1763333176.058266:0:35317:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57060 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1bb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35317 initiator: MDT1 00010000:00010000:2.0:1763333176.058289:0:35317:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763333176.058405:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333176.058414:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57060 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1bb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35317 initiator: MDT1 00010000:00010000:0.0:1763333176.058421:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4a00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333176.058425:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57060 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1bb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35317 initiator: MDT1 00010000:00010000:0.0:1763333176.058432:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57060 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1bb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 35317 initiator: MDT1 00010000:00010000:0.0:1763333176.058442:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bb:0x0].0x0 (ffff92ff61a46a00) 00010000:00010000:0.0:1763333176.058445:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763333176.058448:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57060 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1bb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35317 initiator: MDT1 00010000:00010000:0.0:1763333176.058464:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57060 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1bb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35317 initiator: MDT1 00010000:00010000:0.0:1763333176.058482:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333176.058486:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333176.058488:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763333176.058501:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56881:x1848987613749120:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 607us (2819us total) trans 4294972397 rc 0/0 00000100:00100000:2.0:1763333176.058510:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3212 00000100:00100000:0.0:1763333176.069916:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333176.070589:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613749248 00000100:00100000:3.0:1763333176.070602:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613749248 00000100:00100000:3.0:1763333176.070669:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9404 00000100:00100000:3.0:1763333176.070680:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56883:x1848987613749248:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333176.070700:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333176.070721:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c57067 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969b8f expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.070785:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5706e lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333176.070801:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5706e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.070811:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5706e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:3.0:1763333176.070862:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1763333176.070867:0:8606:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1763333176.070897:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c57067 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b8f expref: 248 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.070913:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5706e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b8f expref: 247 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.070922:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff8016ff00) 00010000:00010000:3.0:1763333176.070925:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1763333176.070927:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96c00, rc 0) 00000100:00100000:3.0:1763333176.070985:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56883:x1848987613749248:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 307us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333176.070992:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9404 00000100:00100000:2.0:1763333176.081136:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333176.081215:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613749376 00000100:00100000:3.0:1763333176.081225:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613749376 00000100:00100000:3.0:1763333176.081291:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9405 00000100:00100000:3.0:1763333176.081302:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56883:x1848987613749376:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333176.081327:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333176.081390:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c57075 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969b96 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.081474:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c5707c lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333176.081489:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c5707c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.081500:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c5707c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.081512:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c57083 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333176.081519:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c57083 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.081525:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c57083 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.081567:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c5707c lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.081574:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c5707c lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.081581:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c5707c lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.081588:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c5707c lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.081594:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333176.081598:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c5707c lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.081606:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c5707c lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.081621:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff8016ff00) 00010000:00010000:3.0:1763333176.081624:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333176.081629:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c5707c lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.081635:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c5707c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.081648:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c57083 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.081653:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c57083 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.081659:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c57083 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.081663:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333176.081666:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c57083 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.081671:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c57083 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.081678:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff4ad5ed00) 00010000:00010000:3.0:1763333176.081681:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333176.081684:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c57083 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.081689:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c57083 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.081715:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c57075 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b96 expref: 248 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.081726:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff8016ff00) 00010000:00010000:3.0:1763333176.081728:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333176.081732:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c57075 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b96 expref: 248 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.081741:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96e00, rc 0) 00000100:00100000:3.0:1763333176.081791:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56883:x1848987613749376:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 491us (666us total) trans 0 rc 301/301 00000100:00100000:3.0:1763333176.081799:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9405 00000100:00100000:0.0:1763333176.089206:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.089300:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613749632 00000100:00100000:1.0:1763333176.089310:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613749632 00000100:00100000:1.0:1763333176.089398:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9406 00000100:00100000:1.0:1763333176.089408:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56883:x1848987613749632:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333176.089429:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333176.089433:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763333176.089492:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5706e lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b8f expref: 247 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.089515:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff8016ff00) 00010000:00010000:1.0:1763333176.089526:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333176.089543:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c5708a lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969b9d expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.089652:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c57091 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333176.089665:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c57091 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.089675:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c57091 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.089685:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c57098 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333176.089692:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c57098 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.089698:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c57098 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.090132:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5709f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333176.090143:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5709f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.090150:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5709f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:1.0:1763333176.090159:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1bc:0x0]: returning size 0 00010000:00010000:1.0:1763333176.090184:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c57091 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.090191:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c57091 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.090197:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c57091 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.090203:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c57091 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.090210:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333176.090215:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c57091 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.090222:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c57091 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.090231:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff4ad5e500) 00010000:00010000:1.0:1763333176.090234:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333176.090237:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c57091 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.090243:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c57091 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000004:00010000:1.0:1763333176.090253:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003de8d46f reply state 0000000006ff3899 transno 4294972398 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c57098 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.090263:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c57098 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.090268:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff4ad5ed00) 00010000:00010000:1.0:1763333176.090271:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333176.090273:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763333176.090299:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c5708a lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b9d expref: 249 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.090315:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5709f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b9d expref: 248 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.090323:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff4ad5ea00) 00010000:00010000:1.0:1763333176.090325:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333176.090328:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e000, rc 0) 00000100:00100000:1.0:1763333176.090473:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:56883:x1848987613749632:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1066us (1275us total) trans 4294972398 rc 0/0 00000100:00100000:1.0:1763333176.090482:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9406 00000100:00100000:0.0:1763333176.097759:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.097814:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.097920:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613750016 00000100:00100000:1.0:1763333176.097931:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613750016 00000100:00100000:1.0:1763333176.098002:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613750144 00000100:00100000:1.0:1763333176.098007:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613750144 00000100:00100000:1.0:1763333176.098043:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9407 00000100:00100000:1.0:1763333176.098053:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74038a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:56883:x1848987613750016:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333176.098078:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333176.098098:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c570ad lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969ba4 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.098209:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c570b4 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333176.098224:0:12741:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5709f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b9d expref: 251 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.098234:0:12741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c570b4 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00000100:00100000:2.0:1763333176.098254:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9408 00000100:00100000:2.0:1763333176.098267:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:56884:x1848987613750144:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333176.098270:0:12741:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5709f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b9d expref: 251 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.098280:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333176.098288:0:12741:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5709f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b9d expref: 251 pid: 12741 timeout: 1380 lvb_type: 0 00010000:00010000:2.0:1763333176.098294:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c570bb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969bab expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333176.098322:0:12741:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7569e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627277952:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333176.098400:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c570c2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333176.098411:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c570c2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.098423:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c570c2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:2.0:1763333176.098435:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1bc:0x0]: returning size 0 00000100:00100000:1.0:1763333176.098464:0:12741:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff742b9c00 going to sleep for 11 seconds 00010000:00010000:2.0:1763333176.098522:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c570c2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.098530:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c570c2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.098536:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c570c2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.098542:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333176.098546:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c570c2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.098553:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c570c2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.098564:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff4ad5ea00) 00010000:00010000:2.0:1763333176.098567:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1763333176.098572:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c570c2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.098578:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c570c2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.098617:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c570bb lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bab expref: 253 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.098626:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff4ad5ea00) 00010000:00010000:2.0:1763333176.098629:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763333176.098633:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c570bb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bab expref: 253 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.098646:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4400, rc 0) 00000100:00100000:2.0:1763333176.098677:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:56884:x1848987613750144:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 414us (862us total) trans 4294972399 rc 301/301 00000100:00100000:2.0:1763333176.098685:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9408 00000100:00100000:2.0:1763333176.103880:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.104080:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613750400 00000100:00100000:1.0:1763333176.104092:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613750400 00000100:00100000:0.0:1763333176.104243:0:12741:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7569e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627277952:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333176.104269:0:12741:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c570b4 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000100:00100000:2.0:1763333176.104844:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.105163:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613750528 00000100:00100000:0.0:1763333176.105169:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613750528 00010000:00010000:0.0:1763333176.105206:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5709f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b9d expref: 253 pid: 12741 timeout: 1380 lvb_type: 0 00000100:00100000:0.0:1763333176.105251:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3100 00000100:00100000:0.0:1763333176.105261:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:2420:x1848987613750528:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333176.105278:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333176.105285:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5709f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b9d expref: 253 pid: 12741 timeout: 1380 lvb_type: 0 00010000:00010000:0.0:1763333176.105298:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5709f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b9d expref: 253 pid: 12741 timeout: 1380 lvb_type: 0 00010000:00010000:0.0:1763333176.105320:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5709f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b9d expref: 253 pid: 12741 timeout: 1380 lvb_type: 0 00010000:00010000:0.0:1763333176.105336:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff4ad5ea00) 00010000:00010000:0.0:1763333176.105341:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c570b4 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.105371:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c570b4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.105379:0:6506:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c570b4 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.105409:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333176.105474:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:2420:x1848987613750528:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 214us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333176.105482:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3100 00010000:00010000:0.0:1763333176.105607:0:12741:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c570b4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.105615:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c570b4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:0.0:1763333176.105641:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1bc:0x0]: returning size 0 00000100:00100000:1.0:1763333176.105798:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3213 00000100:00100000:1.0:1763333176.105810:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:56884:x1848987613750400:12345-192.168.204.28@tcp:35:lfs.0 00000004:00080000:0.0:1763333176.105832:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x245:0x0], index 1: 0 00000004:00080000:0.0:1763333176.105842:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x245:0x0], index 0: 0 00000004:00080000:0.0:1763333176.105849:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x246:0x0], index 0: 0 00000004:00080000:0.0:1763333176.105853:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x246:0x0], index 1: 0 00010000:00010000:0.0:1763333176.105971:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c570b4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.105980:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c570b4 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.105986:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c570b4 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.105991:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333176.105995:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c570b4 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.106002:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c570b4 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.106016:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff4ad5ea00) 00010000:00010000:0.0:1763333176.106019:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333176.106024:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c570b4 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000100:00100000:1.0:1763333176.106025:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:56884:x1848987613750400:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 217us (2152us total) trans 4294972401 rc 0/0 00010000:00010000:0.0:1763333176.106040:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c570b4 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000100:00100000:1.0:1763333176.106043:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3213 00010000:00010000:0.0:1763333176.106082:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c570ad lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ba4 expref: 252 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.106092:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff4ad5ea00) 00010000:00010000:0.0:1763333176.106094:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763333176.106098:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c570ad lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ba4 expref: 252 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.106112:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f800, rc 0) 00000100:00100000:0.0:1763333176.106148:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74038a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:56883:x1848987613750016:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 8097us (8401us total) trans 4294972400 rc 301/301 00000100:00100000:0.0:1763333176.106155:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9407 00000100:00100000:1.0:1763333176.113344:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.113432:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333176.113516:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613751040 00000100:00100000:3.0:1763333176.113527:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613751040 00000100:00100000:3.0:1763333176.113586:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3214 00000100:00100000:3.0:1763333176.113596:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc03450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:56883:x1848987613751040:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333176.113893:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc03450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:56883:x1848987613751040:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 296us (458us total) trans 4294972402 rc 0/0 00000100:00100000:3.0:1763333176.113901:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3214 00000100:00100000:2.0:1763333176.114385:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613750784 00000100:00100000:2.0:1763333176.114390:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613750784 00000100:00100000:2.0:1763333176.114420:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9409 00000100:00100000:2.0:1763333176.114427:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:56884:x1848987613750784:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333176.114437:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333176.114469:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c570d7 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969bb2 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.114528:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c570de lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333176.114542:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c570de lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.114553:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c570de lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.114563:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c570e5 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333176.114571:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c570e5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.114582:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c570e5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.114665:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c570ec lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333176.114673:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c570ec lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.114680:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c570ec lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:2.0:1763333176.114690:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1bc:0x0]: returning size 0 00010000:00010000:2.0:1763333176.114735:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c570de lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.114742:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c570de lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.114748:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c570de lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.114754:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c570de lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.114760:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333176.114763:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c570de lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.114771:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c570de lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.114783:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff61a46b00) 00010000:00010000:2.0:1763333176.114786:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333176.114790:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c570de lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.114797:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c570de lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.114808:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c570e5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.114814:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c570e5 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.114827:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c570e5 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.114832:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333176.114835:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c570e5 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.114840:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c570e5 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.114846:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff4ad5ed00) 00010000:00010000:2.0:1763333176.114848:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333176.114851:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c570e5 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.114856:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c570e5 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.114883:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c570d7 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bb2 expref: 255 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.114898:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c570ec lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bb2 expref: 254 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.114906:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff61a46900) 00010000:00010000:2.0:1763333176.114908:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333176.114911:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4000, rc 0) 00000100:00100000:2.0:1763333176.114957:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+254:56884:x1848987613750784:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 529us (1622us total) trans 4294972403 rc 0/0 00000100:00100000:2.0:1763333176.114963:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9409 00000100:00100000:1.0:1763333176.122278:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.122320:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.122401:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613751296 00000100:00100000:0.0:1763333176.122413:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613751296 00000100:00100000:1.0:1763333176.122475:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.122486:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3215 00000100:00100000:0.0:1763333176.122497:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+254:56883:x1848987613751296:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333176.122543:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613751424 00000100:00100000:3.0:1763333176.122549:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613751424 00000100:00100000:3.0:1763333176.122584:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613751552 00000100:00100000:3.0:1763333176.122587:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613751552 00000100:00100000:3.0:1763333176.122619:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6628 00000100:00100000:3.0:1763333176.122626:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2418:x1848987613751424:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333176.122638:0:28600:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333176.122663:0:28600:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96e00/0xb32e3ef184c570fa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969bb9 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333176.122692:0:28600:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x246:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333176.122708:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333176.122710:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333176.122718:0:28600:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96e00/0xb32e3ef184c570fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bb9 expref: 22 pid: 28600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333176.122733:0:28600:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96e00/0xb32e3ef184c570fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bb9 expref: 22 pid: 28600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333176.122745:0:28600:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96e00, rc 0) 00000100:00100000:0.0:1763333176.122749:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+255:56883:x1848987613751296:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 251us (479us total) trans 4294972404 rc 0/0 00000100:00100000:0.0:1763333176.122759:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3215 00000100:00100000:3.0:1763333176.122773:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2418:x1848987613751424:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 146us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333176.122780:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6628 00000100:00100000:3.0:1763333176.122796:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6629 00000100:00100000:3.0:1763333176.122802:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2418:x1848987613751552:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333176.122808:0:28600:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333176.122819:0:28600:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c57101 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969bc0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333176.122832:0:28600:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x246:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333176.122882:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333176.122885:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333176.122889:0:28600:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c57101 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bc0 expref: 17 pid: 28600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333176.122900:0:28600:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c57101 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bc0 expref: 17 pid: 28600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333176.122983:0:28600:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96400, rc 0) 00000100:00080000:2.0:1763333176.123001:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1763333176.123033:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2418:x1848987613751552:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 229us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333176.123040:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6629 00000100:00100000:0.0:1763333176.128248:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.128299:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333176.129054:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613751808 00000100:00100000:3.0:1763333176.129065:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613751808 00000100:00100000:3.0:1763333176.129124:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613751936 00000100:00100000:3.0:1763333176.129128:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613751936 00000100:00100000:3.0:1763333176.129162:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9410 00000100:00100000:3.0:1763333176.129174:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+256:55917:x1848987613751808:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333176.129204:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333176.129208:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763333176.129240:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c570ec lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bb2 expref: 256 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.129262:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff61a46900) 00010000:00010000:3.0:1763333176.129275:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333176.129292:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c57108 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969bc7 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.129483:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c5710f lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333176.129498:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c5710f lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1bc:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.129508:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c5710f lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1bc:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:3.0:1763333176.129523:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1bc:0x0]: returning size 0 00010000:00010000:3.0:1763333176.129647:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c57108 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bc7 expref: 258 pid: 8606 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333176.129834:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9411 00000100:00100000:0.0:1763333176.129848:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+257:56884:x1848987613751936:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333176.129858:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333176.129868:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c5711d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969bce expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.129898:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c5711d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bce expref: 258 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.129911:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c5711d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bce expref: 258 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.129926:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:0.0:1763333176.129930:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333176.129932:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4742f400, rc 0) 00000100:00100000:0.0:1763333176.130012:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+258:56884:x1848987613751936:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 169us (1712us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333176.130020:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9411 00010000:00010000:3.0:1763333176.130582:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c5710f lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1bc:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bc7 expref: 257 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.130591:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:3.0:1763333176.130593:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:3.0:1763333176.130596:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a97200, rc 0) 00000100:00100000:3.0:1763333176.130626:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+257:55917:x1848987613751808:12345-192.168.204.28@tcp:101:bash.0 Request processed in 1455us (2390us total) trans 4294972405 rc 0/0 00000100:00100000:3.0:1763333176.130633:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9410 00000100:00100000:0.0:1763333176.133609:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333176.133689:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613752192 00000100:00100000:2.0:1763333176.133704:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613752192 00000100:00100000:2.0:1763333176.133773:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3216 00000100:00100000:2.0:1763333176.133786:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+257:56884:x1848987613752192:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333176.134067:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+258:56884:x1848987613752192:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 283us (471us total) trans 4294972406 rc 0/0 00000100:00100000:2.0:1763333176.134074:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3216 00000100:00100000:0.0:1763333176.134822:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333176.134890:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613752320 00000100:00100000:2.0:1763333176.134896:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613752320 00000100:00100000:2.0:1763333176.134939:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9412 00000100:00100000:2.0:1763333176.134948:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+258:55917:x1848987613752320:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333176.134965:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333176.134999:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57124 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969bd5 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.135035:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5712b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333176.135052:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5712b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.135065:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5712b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.135159:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57124 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bd5 expref: 260 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.135178:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5712b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bd5 expref: 259 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.135186:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:2.0:1763333176.135189:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763333176.135193:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5c00, rc 0) 00000100:00100000:2.0:1763333176.135238:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+259:55917:x1848987613752320:12345-192.168.204.28@tcp:101:bash.0 Request processed in 291us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333176.135246:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9412 00000100:00100000:1.0:1763333176.141538:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333176.141655:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613752832 00000100:00100000:2.0:1763333176.141670:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613752832 00000100:00100000:2.0:1763333176.141741:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9413 00000100:00100000:2.0:1763333176.141752:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+259:55917:x1848987613752832:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:2.0:1763333176.141811:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333176.141841:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c5710f lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1bc:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bc7 expref: 259 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.141861:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:2.0:1763333176.141867:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333176.142065:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57132 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333176.142084:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57132 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.142093:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57132 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000001:00080000:2.0:1763333176.142134:0:12741:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294972407 00000004:00010000:2.0:1763333176.142154:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000eaddaa32 reply state 000000005e71c5b4 transno 4294972408 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57132 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.142165:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57132 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.142171:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:2.0:1763333176.142173:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333176.142176:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763333176.145327:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+261:55917:x1848987613752832:12345-192.168.204.28@tcp:36:bash.0 Request processed in 3559us (3781us total) trans 4294972408 rc 0/0 00000100:00100000:2.0:1763333176.145343:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9413 00000020:00080000:2.0:1763333176.145368:0:12741:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763333176.145613:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333176.147837:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613752576 00000100:00100000:2.0:1763333176.147857:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613752576 00000100:00100000:2.0:1763333176.147948:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9414 00000100:00100000:2.0:1763333176.147959:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+261:56884:x1848987613752576:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333176.147981:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333176.148005:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57139 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969bdc expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.148096:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57140 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333176.148114:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57140 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.148126:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57140 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.148139:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c57147 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333176.148146:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c57147 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.148152:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c57147 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.148262:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5714e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333176.148271:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5714e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.148278:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5714e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:2.0:1763333176.148288:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1bc:0x0]: returning size 0 00010000:00010000:2.0:1763333176.148414:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57140 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.148421:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57140 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.148427:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57140 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.148433:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57140 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.148440:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333176.148444:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57140 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.148462:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57140 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.148476:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff61a46b00) 00010000:00010000:2.0:1763333176.148479:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333176.148484:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57140 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.148490:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57140 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.148502:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c57147 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.148507:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c57147 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.148512:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c57147 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.148517:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333176.148519:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c57147 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.148525:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c57147 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.148532:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff4ad5ed00) 00010000:00010000:2.0:1763333176.148534:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333176.148538:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c57147 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.148543:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c57147 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.148577:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57139 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bdc expref: 264 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.148592:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5714e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bdc expref: 263 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.148599:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:2.0:1763333176.148601:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333176.148604:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4a00, rc 0) 00000100:00100000:2.0:1763333176.148681:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+263:56884:x1848987613752576:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 724us (3068us total) trans 4294972409 rc 0/0 00000100:00100000:2.0:1763333176.148688:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9414 00000100:00100000:1.0:1763333176.151788:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.152276:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613753088 00000100:00100000:0.0:1763333176.152287:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613753088 00000100:00100000:0.0:1763333176.152376:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9415 00000100:00100000:0.0:1763333176.152389:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+263:55917:x1848987613753088:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333176.152412:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333176.152417:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763333176.152443:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c5711d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bce expref: 263 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.152474:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:0.0:1763333176.152481:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333176.152495:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c5715c lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969be3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.152547:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c57163 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333176.152561:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5714e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bdc expref: 263 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.152571:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c57163 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.152607:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5714e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bdc expref: 263 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.152620:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5714e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bdc expref: 263 pid: 12741 timeout: 1380 lvb_type: 0 00000100:00100000:0.0:1763333176.152633:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42ef9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627278080:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333176.152722:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4869d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763333176.155269:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42ef9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627278080:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333176.155300:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c57163 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000100:00100000:1.0:1763333176.156712:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.156789:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613753344 00000100:00100000:0.0:1763333176.156799:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613753344 00000100:00100000:0.0:1763333176.156863:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3217 00000100:00100000:0.0:1763333176.156874:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+264:56884:x1848987613753344:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333176.157165:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+265:56884:x1848987613753344:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 292us (458us total) trans 4294972410 rc 0/0 00000100:00100000:0.0:1763333176.157174:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3217 00000100:00100000:1.0:1763333176.161331:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.161503:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333176.161581:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613753472 00000100:00100000:2.0:1763333176.161592:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613753472 00000100:00100000:2.0:1763333176.161649:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3218 00000100:00100000:2.0:1763333176.161661:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+265:56884:x1848987613753472:12345-192.168.204.28@tcp:33:lfs.0 00000100:00100000:2.0:1763333176.161822:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+265:56884:x1848987613753472:12345-192.168.204.28@tcp:33:lfs.0 Request processed in 163us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333176.161830:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3218 00000100:00100000:3.0:1763333176.162407:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613753600 00000100:00100000:3.0:1763333176.162413:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613753600 00010000:00010000:3.0:1763333176.162439:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5714e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bdc expref: 265 pid: 12741 timeout: 1380 lvb_type: 0 00000100:00100000:3.0:1763333176.162483:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3101 00000100:00100000:3.0:1763333176.162491:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4399b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+265:2420:x1848987613753600:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333176.162505:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333176.162510:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5714e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bdc expref: 265 pid: 12741 timeout: 1380 lvb_type: 0 00010000:00010000:3.0:1763333176.162523:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5714e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bdc expref: 265 pid: 12741 timeout: 1380 lvb_type: 0 00010000:00010000:3.0:1763333176.162551:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5714e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bdc expref: 265 pid: 12741 timeout: 1380 lvb_type: 0 00010000:00010000:3.0:1763333176.162566:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:3.0:1763333176.162572:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c57163 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333176.162581:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c57163 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333176.162588:0:6504:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c57163 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333176.162612:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333176.162647:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4399b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+264:2420:x1848987613753600:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 156us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333176.162654:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3101 00010000:00010000:1.0:1763333176.162848:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c57163 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.162857:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c57163 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000040:00080000:1.0:1763333176.164637:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1445, 88 off121816 00000004:00080000:1.0:1763333176.164650:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1280244300270ns, next at 1280856550572ns, rc = 0 00000040:00080000:1.0:1763333176.164692:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1446, 88 off121816 00000004:00080000:1.0:1763333176.164697:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1280244348100ns, next at 1280195897991ns, rc = 0 00000040:00080000:1.0:1763333176.164714:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1447, 88 off121904 00000004:00080000:1.0:1763333176.164719:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1280244369867ns, next at 1280195897991ns, rc = 0 00000040:00080000:1.0:1763333176.164728:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1446, 88 off121904 00000004:00080000:1.0:1763333176.164732:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1280244382565ns, next at 1280856550572ns, rc = 0 00000001:00080000:0.0:1763333176.170479:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972411 is committed 00000004:00080000:0.0:1763333176.170493:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 945 committed 00010000:00010000:3.0:1763333176.170504:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c57028 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00000004:00080000:0.0:1763333176.170510:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 948 committed 00000004:00080000:0.0:1763333176.170527:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 947 committed 00000004:00080000:0.0:1763333176.170530:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 944 committed 00000100:00100000:0.0:1763333176.170603:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe43999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627278208:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763333176.170623:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4399bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627278336:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1763333176.170685:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c57028 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.170693:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c57028 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.170699:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333176.170703:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c57028 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.170711:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c57028 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.170729:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff4ad5ed00) 00010000:00010000:3.0:1763333176.170732:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333176.170736:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c57028 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.170742:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c57028 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.170762:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c57098 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.170766:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c57098 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.170771:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c57098 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.170775:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333176.170778:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c57098 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.170782:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c57098 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.170787:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff4ad5ed00) 00010000:00010000:3.0:1763333176.170789:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333176.170791:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c57098 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.170796:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c57098 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.170810:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57132 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.170816:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57132 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.170821:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57132 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.170825:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333176.170827:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57132 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.170832:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57132 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.170838:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:3.0:1763333176.170840:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333176.170842:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57132 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.170846:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57132 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000100:00100000:2.0:1763333176.173790:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4399b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627278464:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333176.176411:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333176.176498:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627278720:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763333176.176540:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333176.176565:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1763333176.176573:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe43999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627278592:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333176.176597:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333176.176614:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46e2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627279104:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333176.176634:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333176.176635:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627278208 00000100:00100000:3.0:1763333176.176645:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627278208 00000100:00100000:0.0:1763333176.176674:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627278720 00000100:00100000:0.0:1763333176.176680:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627278720 00000100:00100000:3.0:1763333176.176700:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627278592 00000100:00100000:3.0:1763333176.176705:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627278592 00000100:00100000:0.0:1763333176.176723:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627279104 00000100:00100000:0.0:1763333176.176728:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627279104 00000100:00100000:3.0:1763333176.176733:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6630 00000100:00100000:3.0:1763333176.176744:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+14:3655:x1848987627278208:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763333176.176760:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6631 00002000:00080000:3.0:1763333176.176771:0:28651:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:579 count 1 00000100:00100000:0.0:1763333176.176772:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+30:3655:x1848987627278720:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1763333176.176790:0:28650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:579 count 1 00010000:00010000:3.0:1763333176.176798:0:28651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c5716a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x243:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.176823:0:28651:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56f95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x243:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b57 expref: 16 pid: 28651 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763333176.176829:0:28650:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x243:0x0] initial LVB size: 5, mtime: 0x691a5438, atime: 0x0, ctime: 0x691a5438, blocks: 0x8 00010000:00010000:3.0:1763333176.176832:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333176.176835:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333176.176842:0:28651:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c5716a lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x243:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.176842:0:28650:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c57171 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.176863:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333176.176865:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333176.176871:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c57171 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.176882:0:28651:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56f95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x243:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b57 expref: 16 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.176885:0:28650:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c57171 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.176904:0:28651:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56f95 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x243:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b57 expref: 16 pid: 28651 timeout: 1380 lvb_type: 0 00010000:00010000:0.0:1763333176.176904:0:28650:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c57171 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.176927:0:28650:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c57171 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333176.176929:0:28651:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77a3ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28651:1848987627279232:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333176.176967:0:28650:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763333176.177045:0:28651:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff49c92540 going to sleep for 11 seconds 00000100:00080000:3.0:1763333176.177061:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1763333176.177065:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1763333176.177080:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6632 00000100:00100000:3.0:1763333176.177089:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+14:3655:x1848987627278592:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1763333176.177195:0:8407:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x246:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333176.177199:0:8407:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x246:0x0] updating lvb mtime from disk: 0 -> 0 00000100:00100000:2.0:1763333176.177199:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1763333176.177201:0:8407:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x246:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333176.177204:0:8407:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x246:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763333176.177206:0:8407:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x246:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333176.177227:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46e2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627278976:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333176.177247:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+15:3655:x1848987627278592:12345-0@lo:2:osp-syn-1-1.0 Request processed in 160us (649us total) trans 17179871626 rc 0/0 00000100:00100000:2.0:1763333176.177251:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333176.177256:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6632 00000100:00100000:3.0:1763333176.177272:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627278464 00000100:00100000:2.0:1763333176.177273:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763333176.177275:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627278464 00000100:00100000:2.0:1763333176.177280:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46e2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627278848:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763333176.177290:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627278976 00000100:00100000:0.0:1763333176.177290:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+31:3655:x1848987627278720:12345-0@lo:6:osp-syn-0-1.0 Request processed in 518us (746us total) trans 21474838931 rc 0/0 00000100:00100000:3.0:1763333176.177294:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627278976 00000100:00100000:0.0:1763333176.177303:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6631 00000100:00100000:2.0:1763333176.177309:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333176.177325:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627278848 00000100:00100000:0.0:1763333176.177330:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627278848 00000100:00100000:3.0:1763333176.177765:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6633 00000100:00100000:3.0:1763333176.177774:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+32:3655:x1848987627279104:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1763333176.177836:0:8407:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x246:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333176.177839:0:8407:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x246:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763333176.177841:0:8407:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x246:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333176.177843:0:8407:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x246:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763333176.177845:0:8407:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x246:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333176.177870:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+33:3655:x1848987627279104:12345-0@lo:2:osp-syn-0-1.0 Request processed in 98us (1236us total) trans 21474838932 rc 0/0 00000100:00100000:3.0:1763333176.177876:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6633 00000100:00100000:3.0:1763333176.177889:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6634 00000100:00100000:3.0:1763333176.177894:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+15:3653:x1848987627278464:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333176.177960:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+16:3653:x1848987627278464:12345-0@lo:2:osp-syn-1-1.0 Request processed in 66us (762us total) trans 17179871627 rc 0/0 00000100:00100000:3.0:1763333176.177965:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6634 00000100:00100000:3.0:1763333176.177976:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6635 00000100:00100000:3.0:1763333176.177981:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+32:3653:x1848987627278976:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333176.178258:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333176.178581:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6636 00000100:00100000:0.0:1763333176.178586:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627278336 00000100:00100000:2.0:1763333176.178594:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+32:3653:x1848987627278848:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763333176.178594:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627278336 00002000:00080000:2.0:1763333176.178614:0:17605:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:580 count 1 00000100:00100000:0.0:1763333176.178627:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6637 00010000:00010000:2.0:1763333176.178632:0:17605:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c57178 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x244:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333176.178638:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+16:3652:x1848987627278336:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1763333176.178655:0:17605:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97000/0xb32e3ef184c56efb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x244:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b26 expref: 21 pid: 28651 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1763333176.178657:0:28650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:580 count 1 00010000:00010000:2.0:1763333176.178668:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333176.178670:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333176.178674:0:17605:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c57178 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x244:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.178677:0:28650:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c5717f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x244:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.178694:0:28650:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56eed lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x244:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b1f expref: 16 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333176.178701:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333176.178703:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333176.178705:0:17605:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97000/0xb32e3ef184c56efb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x244:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b26 expref: 21 pid: 28651 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333176.178708:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c5717f lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x244:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.178723:0:17605:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97000/0xb32e3ef184c56efb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x244:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b26 expref: 21 pid: 28651 timeout: 1380 lvb_type: 1 00000100:00100000:2.0:1763333176.178737:0:17605:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7400d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17605:1848987627279360:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333176.178741:0:28650:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56eed lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x244:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b1f expref: 16 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333176.178754:0:28650:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56eed lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x244:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b1f expref: 16 pid: 8404 timeout: 1380 lvb_type: 1 00000100:00100000:0.0:1763333176.178766:0:28650:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42ef8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28650:1848987627279488:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333176.178798:0:17605:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff6b0c2540 going to sleep for 11 seconds 00000100:00100000:0.0:1763333176.178802:0:28650:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe487770c0 going to sleep for 11 seconds 00010000:00010000:2.0:1763333176.178855:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c57163 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1bc:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969be3 expref: 240 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.178868:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:2.0:1763333176.178871:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763333176.178886:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c5715c lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969be3 expref: 240 pid: 6519 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1763333176.178902:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c57163 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1bc:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969be3 expref: 239 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.178929:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:2.0:1763333176.178932:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763333176.178934:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4742e000, rc 0) 00000100:00100000:2.0:1763333176.178960:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:55917:x1848987613753088:12345-192.168.204.28@tcp:101:bash.0 Request processed in 26575us (27183us total) trans 4294972411 rc 0/0 00000100:00100000:2.0:1763333176.178968:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9415 00000004:00080000:2.0:1763333176.179286:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4399b480/2, rc 0, transno 17179871627 00000100:00100000:2.0:1763333176.179293:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4399b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627278464:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333176.180394:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+33:3653:x1848987627278976:12345-0@lo:2:osp-syn-0-1.0 Request processed in 2407us (3137us total) trans 21474838933 rc 0/0 00000100:00100000:3.0:1763333176.180403:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6635 00000004:00080000:3.0:1763333176.180448:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe46e2d180/2, rc 0, transno 21474838933 00000100:00100000:3.0:1763333176.180463:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46e2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627278976:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1763333176.182480:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe43999f80/2, rc 0, transno 17179871626 00000100:00100000:3.0:1763333176.182494:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe43999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627278592:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763333176.182505:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe46e2e300/2, rc 0, transno 21474838932 00000100:00100000:3.0:1763333176.182508:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46e2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627279104:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1763333176.182516:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe46e2c380/2, rc 0, transno 21474838931 00000100:00100000:3.0:1763333176.182519:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627278720:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1763333176.182937:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333176.182946:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c57171 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.182957:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4742f400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333176.182961:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c57171 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.182972:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c57171 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.183005:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c57171 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.183014:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c57171 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.183035:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333176.183036:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333176.183038:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763333176.183274:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333176.183426:0:28651:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77a3ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28651:1848987627279232:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333176.183446:0:28651:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c5716a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x243:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333176.183663:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613753728 00000100:00100000:0.0:1763333176.183670:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613753728 00010000:00010000:0.0:1763333176.183704:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56f95 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x243:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b57 expref: 17 pid: 28651 timeout: 1380 lvb_type: 0 00000100:00100000:0.0:1763333176.183731:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3102 00000100:00100000:0.0:1763333176.183739:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4399a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2421:x1848987613753728:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333176.183754:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333176.183759:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56f95 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x243:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b57 expref: 17 pid: 28651 timeout: 1380 lvb_type: 0 00010000:00010000:0.0:1763333176.183769:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56f95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x243:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b57 expref: 17 pid: 28651 timeout: 1380 lvb_type: 0 00010000:00010000:0.0:1763333176.183785:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c56f95 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x243:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b57 expref: 17 pid: 28651 timeout: 1380 lvb_type: 0 00010000:00010000:0.0:1763333176.183796:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333176.183797:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333176.183802:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c5716a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x243:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.183811:0:6506:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c5716a lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x243:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.184065:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333176.184115:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4399a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2421:x1848987613753728:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 376us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333176.184122:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3102 00010000:00010000:1.0:1763333176.184156:0:28651:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c5716a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.184164:0:28651:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c5716a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.184173:0:28651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c5716a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.184179:0:28651:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c5716a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.184527:0:28651:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763333176.184753:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+17:3655:x1848987627278208:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8011us (8348us total) trans 17179871628 rc 0/0 00000100:00100000:1.0:1763333176.184767:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6630 00000004:00080000:0.0:1763333176.184848:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe43999880/2, rc 0, transno 17179871628 00000100:00100000:0.0:1763333176.184854:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe43999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627278208:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1763333176.184941:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333176.184948:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c5716a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.184955:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333176.184959:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c5716a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.184967:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c5716a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.184979:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c5716a lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.184996:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c5716a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.185012:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333176.185014:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333176.185016:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763333176.185831:0:17605:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7400d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17605:1848987627279360:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333176.185853:0:17605:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c57178 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x244:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333176.185909:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.186152:0:28650:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42ef8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28650:1848987627279488:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333176.186169:0:28650:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c5717f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x244:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333176.186278:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333176.186690:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613753856 00000100:00100000:3.0:1763333176.186696:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613753856 00010000:00010000:3.0:1763333176.186728:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56eed lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x244:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b1f expref: 16 pid: 8404 timeout: 1380 lvb_type: 1 00000100:00100000:2.0:1763333176.186787:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613753984 00000100:00100000:2.0:1763333176.186790:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613753984 00010000:00010000:2.0:1763333176.186806:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97000/0xb32e3ef184c56efb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x244:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b26 expref: 22 pid: 28651 timeout: 1380 lvb_type: 1 00000100:00100000:3.0:1763333176.186946:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3103 00000100:00100000:3.0:1763333176.186954:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43999180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2420:x1848987613753856:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333176.186967:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333176.186971:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56eed lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x244:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b1f expref: 16 pid: 8404 timeout: 1380 lvb_type: 1 00010000:00010000:3.0:1763333176.186981:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56eed lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x244:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b1f expref: 16 pid: 8404 timeout: 1380 lvb_type: 1 00000100:00100000:1.0:1763333176.187094:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3104 00000100:00100000:1.0:1763333176.187102:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4399b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2418:x1848987613753984:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333176.187111:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333176.187115:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97000/0xb32e3ef184c56efb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x244:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b26 expref: 22 pid: 28651 timeout: 1380 lvb_type: 1 00010000:00010000:1.0:1763333176.187125:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97000/0xb32e3ef184c56efb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x244:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b26 expref: 22 pid: 28651 timeout: 1380 lvb_type: 1 00010000:00010000:1.0:1763333176.187144:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97000/0xb32e3ef184c56efb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x244:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b26 expref: 22 pid: 28651 timeout: 1380 lvb_type: 1 00010000:00010000:1.0:1763333176.187157:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333176.187159:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333176.187164:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c57178 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x244:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.187173:0:28428:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c57178 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x244:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.187208:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333176.187251:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4399b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2418:x1848987613753984:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 150us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333176.187261:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3104 00010000:00010000:0.0:1763333176.187698:0:17605:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c57178 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.187708:0:17605:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c57178 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.187718:0:17605:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c57178 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.187726:0:17605:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c57178 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.187746:0:17605:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763333176.188435:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c56eed lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x244:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969b1f expref: 16 pid: 8404 timeout: 1380 lvb_type: 1 00010000:00010000:3.0:1763333176.188449:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333176.188462:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333176.188467:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c5717f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x244:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.188476:0:6506:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c5717f lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x244:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.188511:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333176.188562:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43999180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2420:x1848987613753856:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 1607us (2652us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333176.188572:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3103 00010000:00010000:1.0:1763333176.188832:0:28650:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c5717f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.188842:0:28650:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c5717f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.188850:0:28650:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c5717f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.188856:0:28650:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c5717f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.188880:0:28650:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1763333176.189008:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+17:3652:x1848987627278336:12345-0@lo:6:osp-syn-1-1.0 Request processed in 10373us (10751us total) trans 17179871629 rc 0/0 00000100:00100000:1.0:1763333176.189017:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6637 00000004:00080000:1.0:1763333176.189062:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4399bb80/2, rc 0, transno 17179871629 00000100:00100000:1.0:1763333176.189068:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4399bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627278336:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1763333176.189148:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1763333176.189155:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c57178 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.189163:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4800 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333176.189167:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c57178 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.189180:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c57178 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.189194:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c57178 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.189201:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c57178 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.189217:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333176.189221:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c5717f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.189226:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4742fa00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333176.189229:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c5717f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.189235:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c5717f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.189244:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c5717f lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.189250:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c5717f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.189266:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333176.189268:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333176.189269:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763333176.189431:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+33:3653:x1848987627278848:12345-0@lo:6:osp-syn-0-1.0 Request processed in 10841us (12124us total) trans 21474838934 rc 0/0 00000100:00100000:0.0:1763333176.189439:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6636 00010000:00010000:0.0:1763333176.189492:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763333176.189749:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe46e2ea00/2, rc 0, transno 21474838934 00000100:00100000:3.0:1763333176.189755:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46e2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627278848:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763333176.191333:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.191837:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613754112 00000100:00100000:0.0:1763333176.191848:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613754112 00000100:00100000:0.0:1763333176.191910:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6638 00000100:00100000:0.0:1763333176.191920:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43998700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:55917:x1848987613754112:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333176.191938:0:17605:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333176.191960:0:17605:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c57186 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969bea expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763333176.192115:0:17605:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x245:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333176.192141:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333176.192144:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333176.192153:0:17605:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c57186 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bea expref: 16 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.192170:0:17605:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c57186 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bea expref: 16 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.192182:0:17605:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4742f400, rc 0) 00000100:00100000:0.0:1763333176.192242:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43998700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:55917:x1848987613754112:12345-192.168.204.28@tcp:101:bash.0 Request processed in 324us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333176.192250:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6638 00000100:00100000:2.0:1763333176.193842:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.196427:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613754240 00000100:00100000:1.0:1763333176.196442:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613754240 00000100:00100000:0.0:1763333176.197156:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6639 00000100:00100000:0.0:1763333176.197171:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e0f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:55917:x1848987613754240:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333176.197190:0:17605:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333176.197212:0:17605:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c5718d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969bf1 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763333176.197232:0:17605:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x245:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333176.197253:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333176.197255:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333176.197264:0:17605:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c5718d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bf1 expref: 22 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.197278:0:17605:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c5718d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bf1 expref: 22 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.197290:0:17605:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4742fc00, rc 0) 00000100:00100000:0.0:1763333176.197381:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e0f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:55917:x1848987613754240:12345-192.168.204.28@tcp:101:bash.0 Request processed in 215us (3546us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333176.197388:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6639 00000100:00100000:2.0:1763333176.203136:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333176.203968:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.204798:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613754496 00000100:00100000:1.0:1763333176.204810:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613754496 00000100:00100000:1.0:1763333176.204874:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9416 00000100:00100000:1.0:1763333176.204886:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56885:x1848987613754496:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333176.204916:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333176.204941:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57194 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969bf8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.205031:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5719b lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333176.205045:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5719b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.205067:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5719b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.205080:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c571a2 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333176.205087:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c571a2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.205094:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c571a2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.205209:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c571a9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333176.205219:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c571a9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.205226:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c571a9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:1.0:1763333176.205236:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1bc:0x0]: returning size 2 00010000:00010000:1.0:1763333176.205328:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5719b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.205340:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5719b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.205346:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5719b lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.205373:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5719b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.205379:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feaa00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333176.205383:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5719b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.205390:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5719b lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.205403:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff4ad5e500) 00010000:00010000:1.0:1763333176.205407:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333176.205411:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5719b lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.205418:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5719b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.205431:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c571a2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.205437:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c571a2 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.205442:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c571a2 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.205447:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feba00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333176.205462:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c571a2 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.205468:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c571a2 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.205475:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff4ad5e300) 00010000:00010000:1.0:1763333176.205477:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333176.205480:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c571a2 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.205486:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c571a2 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.205529:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57194 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bf8 expref: 242 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.205546:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c571a9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bf8 expref: 241 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.205553:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:1.0:1763333176.205556:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333176.205559:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea800, rc 0) 00000100:00100000:1.0:1763333176.205624:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56885:x1848987613754496:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 740us (2499us total) trans 4294972412 rc 0/0 00000100:00100000:1.0:1763333176.205632:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9416 00000100:00100000:0.0:1763333176.207265:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613754624 00000100:00100000:0.0:1763333176.207277:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613754624 00002000:00010000:0.0:1763333176.207324:0:16635:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/581 (0->18446744073709551615) 00002000:00100000:0.0:1763333176.207329:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff77a3ea00 with x1848987613754624 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333176.207342:0:16635:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff77a3ea00. 00000100:00100000:0.0:1763333176.207397:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1635 00000100:00100000:0.0:1763333176.207408:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2418:x1848987613754624:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:0.0:1763333176.207603:0:16635:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x245:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333176.207607:0:16635:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x245:0x0] updating lvb mtime from disk: 0 -> 1763333176 00002000:00010000:0.0:1763333176.207610:0:16635:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x245:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333176.207612:0:16635:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x245:0x0] updating lvb ctime from disk: 0 -> 1763333176 00002000:00010000:0.0:1763333176.207614:0:16635:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x245:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333176.207679:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2418:x1848987613754624:12345-192.168.204.28@tcp:10:bash.0 Request processed in 274us (3714us total) trans 17179871630 rc 0/0 00000100:00100000:0.0:1763333176.207686:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1635 00002000:00010000:0.0:1763333176.207690:0:16635:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/581 (0->18446744073709551615) 00002000:00100000:0.0:1763333176.207692:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff77a3ea00 with x1848987613754624 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333176.207696:0:16635:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff77a3ea00. 00000100:00100000:3.0:1763333176.210665:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333176.210702:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.210769:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613755008 00000100:00100000:0.0:1763333176.210778:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613755008 00000100:00100000:0.0:1763333176.210836:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3219 00000100:00100000:0.0:1763333176.210845:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56885:x1848987613755008:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1763333176.211144:0:28429:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613754752 00000100:00100000:1.0:1763333176.211149:0:28429:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613754752 00002000:00010000:1.0:1763333176.211174:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/581 (0->18446744073709551615) 00002000:00100000:1.0:1763333176.211179:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff77a3c380 with x1848987613754752 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333176.211191:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff77a3c380. 00000100:00100000:1.0:1763333176.211211:0:28429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1636 00000100:00100000:1.0:1763333176.211219:0:28429:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2418:x1848987613754752:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:1.0:1763333176.211378:0:28429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x245:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333176.211382:0:28429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x245:0x0] updating lvb mtime from disk: 0 -> 1763333176 00002000:00010000:1.0:1763333176.211384:0:28429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x245:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333176.211386:0:28429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x245:0x0] updating lvb ctime from disk: 0 -> 1763333176 00002000:00010000:1.0:1763333176.211388:0:28429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x245:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333176.212211:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:56885:x1848987613755008:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 1362us (1502us total) trans 4294972413 rc 0/0 00000100:00100000:0.0:1763333176.212221:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3219 00000100:00100000:1.0:1763333176.212301:0:28429:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2418:x1848987613754752:12345-192.168.204.28@tcp:10:bash.0 Request processed in 1082us (1644us total) trans 21474838935 rc 0/0 00000100:00100000:1.0:1763333176.212308:0:28429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1636 00002000:00010000:1.0:1763333176.212313:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/581 (0->18446744073709551615) 00002000:00100000:1.0:1763333176.212316:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff77a3c380 with x1848987613754752 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333176.212323:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff77a3c380. 00000100:00100000:2.0:1763333176.218915:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.219638:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613755264 00000100:00100000:0.0:1763333176.219653:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613755264 00000100:00100000:0.0:1763333176.219722:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3220 00000100:00100000:0.0:1763333176.219733:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc03050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:55917:x1848987613755264:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:0.0:1763333176.221202:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc03050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:55917:x1848987613755264:12345-192.168.204.28@tcp:35:bash.0 Request processed in 1462us (2288us total) trans 4294972414 rc 0/0 00000100:00100000:0.0:1763333176.221215:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3220 00000100:00100000:3.0:1763333176.234104:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333176.234858:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613755520 00000100:00100000:2.0:1763333176.234869:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613755520 00000100:00100000:2.0:1763333176.234941:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9417 00000100:00100000:2.0:1763333176.234951:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:56886:x1848987613755520:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333176.234978:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333176.234999:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c571b7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969bff expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.235105:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c571be lrc: 3/1,0 mode: --/CR res: [0x240000404:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333176.235122:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c571be lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x1bc:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.235134:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c571be lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x1bc:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:2.0:1763333176.235146:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1bc:0x0]: returning size 5 00010000:00010000:2.0:1763333176.235265:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c571b7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bff expref: 246 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.235283:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c571be lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1bc:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bff expref: 245 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.235296:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:2.0:1763333176.235299:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1763333176.235302:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4400, rc 0) 00000100:00100000:2.0:1763333176.235401:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56886:x1848987613755520:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 451us (1306us total) trans 4294972415 rc 0/0 00000100:00100000:2.0:1763333176.235408:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9417 00000100:00100000:3.0:1763333176.241561:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.241671:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613755776 00000100:00100000:1.0:1763333176.241684:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613755776 00000100:00100000:1.0:1763333176.242511:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9418 00000100:00100000:1.0:1763333176.242527:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56886:x1848987613755776:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333176.242554:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333176.242581:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c571cc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969c06 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.242704:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c571d3 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333176.242720:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c571a9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bf8 expref: 246 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.242734:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c571d3 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x1bc:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.242768:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c571a9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bf8 expref: 246 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.242781:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c571a9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bf8 expref: 246 pid: 6519 timeout: 1380 lvb_type: 0 00000100:00100000:1.0:1763333176.242796:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4399a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627279616:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333176.242889:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff742b93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763333176.246759:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.247661:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4399a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627279616:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333176.247688:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c571d3 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1bc:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000100:00100000:0.0:1763333176.247747:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613755904 00000100:00100000:0.0:1763333176.247755:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613755904 00010000:00010000:0.0:1763333176.247794:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c571a9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bf8 expref: 247 pid: 6519 timeout: 1380 lvb_type: 0 00000100:00100000:0.0:1763333176.247832:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3105 00000100:00100000:0.0:1763333176.247843:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff44f08850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:2420:x1848987613755904:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333176.247859:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333176.247867:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c571a9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bf8 expref: 247 pid: 6519 timeout: 1380 lvb_type: 0 00010000:00010000:0.0:1763333176.247879:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c571a9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bf8 expref: 247 pid: 6519 timeout: 1380 lvb_type: 0 00010000:00010000:0.0:1763333176.247903:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c571a9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bf8 expref: 247 pid: 6519 timeout: 1380 lvb_type: 0 00010000:00010000:0.0:1763333176.247919:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:0.0:1763333176.247925:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c571d3 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1bc:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.247934:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c571d3 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1bc:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.247943:0:6506:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c571d3 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x1bc:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.247989:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333176.248044:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff44f08850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:2420:x1848987613755904:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 203us (1295us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333176.248052:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3105 00010000:00010000:2.0:1763333176.248173:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c571d3 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1bc:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.248181:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c571d3 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1bc:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:2.0:1763333176.248206:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1bc:0x0]: returning size 5 00010000:00010000:2.0:1763333176.248333:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c571cc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c06 expref: 247 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.248387:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c571d3 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1bc:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c06 expref: 246 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.248395:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:2.0:1763333176.248398:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1763333176.248400:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feba00, rc 0) 00000100:00100000:2.0:1763333176.248441:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56886:x1848987613755776:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 5919us (6892us total) trans 4294972416 rc 0/0 00000100:00100000:2.0:1763333176.248447:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9418 00000100:00100000:3.0:1763333176.251599:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333176.251791:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333176.252207:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613756032 00000100:00100000:2.0:1763333176.252218:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613756032 00000100:00100000:0.0:1763333176.252281:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613756160 00000100:00100000:0.0:1763333176.252284:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613756160 00000100:00100000:0.0:1763333176.252325:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9419 00000100:00100000:0.0:1763333176.252335:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56886:x1848987613756032:12345-192.168.204.28@tcp:101:lfs.0 00000100:00100000:3.0:1763333176.252427:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9420 00000100:00100000:3.0:1763333176.252437:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56887:x1848987613756160:12345-192.168.204.28@tcp:101:rm.0 00010000:00010000:0.0:1763333176.252482:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333176.252504:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c571e1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969c0d expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.252604:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c571e8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333176.252621:0:12741:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c571d3 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x1bc:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c06 expref: 248 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.252629:0:12741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c571e8 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.252662:0:12741:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c571d3 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1bc:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c06 expref: 248 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.252676:0:12741:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c571d3 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1bc:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c06 expref: 248 pid: 6519 timeout: 1380 lvb_type: 0 00000100:00100000:0.0:1763333176.252689:0:12741:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42ef9180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627279744:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333176.252815:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333176.252830:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c571ef lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969c14 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.252866:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c571f6 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333176.252875:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c571f6 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.252886:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c571f6 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.252897:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c571fd lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333176.252902:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c571fd lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.252908:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c571fd lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.252987:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c57204 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333176.252995:0:8606:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c57204 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.253002:0:8606:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c57204 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000100:00100000:1.0:1763333176.259318:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333176.259388:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613756288 00000100:00100000:3.0:1763333176.259400:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613756288 00010000:00010000:3.0:1763333176.259444:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c571d3 lrc: 6/0,0 mode: CW/CW res: [0x240000404:0x1bc:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c06 expref: 250 pid: 6519 timeout: 1380 lvb_type: 0 00000100:00100000:3.0:1763333176.259505:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3106 00000100:00100000:3.0:1763333176.259515:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4399a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:2418:x1848987613756288:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333176.259532:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333176.259540:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c571d3 lrc: 6/0,0 mode: CW/CW res: [0x240000404:0x1bc:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c06 expref: 250 pid: 6519 timeout: 1380 lvb_type: 0 00010000:00010000:3.0:1763333176.261078:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c571d3 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x1bc:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c06 expref: 250 pid: 6519 timeout: 1380 lvb_type: 0 00010000:00010000:3.0:1763333176.261113:0:28428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:3.0:1763333176.261119:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c571e8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.261131:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c571e8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.261139:0:28428:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c571e8 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.261147:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c57204 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.261153:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c57204 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.261159:0:28428:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c57204 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.261191:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333176.261268:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4399a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:2418:x1848987613756288:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 1754us (1961us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333176.261278:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3106 00010000:00010000:1.0:1763333176.261556:0:8606:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c57204 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.261566:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c57204 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:1.0:1763333176.261628:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1bc:0x0]: returning size 5 00000004:00200000:1.0:1763333176.261633:0:8606:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763333176.261658:0:8606:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c57204 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.261673:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c57204 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.261691:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c571f6 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.261698:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c571f6 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.261704:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c571f6 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.261711:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c571f6 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.261717:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333176.261722:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c571f6 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.261730:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c571f6 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.261741:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff8016f400) 00010000:00010000:1.0:1763333176.261744:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333176.261748:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c571f6 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.261753:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c571f6 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.261771:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c571fd lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.261776:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c571fd lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.261781:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c571fd lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.261785:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333176.261788:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c571fd lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.261793:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c571fd lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.261800:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff8016fb00) 00010000:00010000:1.0:1763333176.261802:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333176.261805:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c571fd lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.261810:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c571fd lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.261850:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c571ef lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c14 expref: 250 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.261867:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c57204 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c14 expref: 249 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.261874:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:1.0:1763333176.261877:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333176.261879:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f600, rc 0) 00000100:00100000:1.0:1763333176.261930:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:56887:x1848987613756160:12345-192.168.204.28@tcp:101:rm.0 Request processed in 9495us (10138us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333176.261937:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9420 00000100:00100000:0.0:1763333176.263589:0:12741:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff6b0c2540 going to sleep for 11 seconds 00010000:00010000:0.0:1763333176.263635:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c571d3 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1bc:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c06 expref: 248 pid: 6519 timeout: 1380 lvb_type: 0 00000100:00100000:0.0:1763333176.263655:0:12741:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42ef9180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627279744:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333176.263681:0:12741:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c571e8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.263691:0:12741:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c571e8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.263696:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c571e8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:0.0:1763333176.263740:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1bc:0x0]: returning size 5 00000004:00200000:0.0:1763333176.263744:0:12741:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763333176.263761:0:12741:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c571e8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.263792:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c571e1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c0d expref: 248 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.263805:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c571e8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c0d expref: 247 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.263818:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:0.0:1763333176.263822:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333176.263825:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48192200, rc 0) 00000100:00100000:0.0:1763333176.263873:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56886:x1848987613756032:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 11539us (12533us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333176.263881:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9419 00000100:00100000:3.0:1763333176.270891:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333176.271596:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.272547:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613756416 00000100:00100000:1.0:1763333176.272561:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613756416 00000100:00100000:1.0:1763333176.272650:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 410 00000100:00100000:1.0:1763333176.272661:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:2419:x1848987613756416:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333176.272680:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333176.272707:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192200/0xb32e3ef184c571e8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c0d expref: 247 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.272727:0:28428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:1.0:1763333176.272733:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333176.272803:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:2419:x1848987613756416:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 144us (2461us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333176.272811:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 410 00000100:00100000:0.0:1763333176.273800:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613756672 00000100:00100000:0.0:1763333176.273814:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613756672 00000100:00100000:1.0:1763333176.274579:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3221 00000100:00100000:1.0:1763333176.274590:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56887:x1848987613756672:12345-192.168.204.28@tcp:35:rm.0 00000100:00100000:1.0:1763333176.274970:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56887:x1848987613756672:12345-192.168.204.28@tcp:35:rm.0 Request processed in 379us (3374us total) trans 4294972417 rc 0/0 00000100:00100000:1.0:1763333176.274979:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3221 00000100:00100000:2.0:1763333176.277760:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.279257:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613756928 00000100:00100000:0.0:1763333176.279271:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613756928 00000100:00100000:0.0:1763333176.279342:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9421 00000100:00100000:0.0:1763333176.279368:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56886:x1848987613756928:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333176.279389:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333176.279410:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c5720b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969c1b expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.279560:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c57212 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333176.279576:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c57212 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1bc:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.279588:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c57212 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1bc:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:0.0:1763333176.279600:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1bc:0x0]: returning size 5 00010000:00010000:0.0:1763333176.279721:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c5720b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c1b expref: 250 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.279746:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c57212 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1bc:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c1b expref: 249 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.279754:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:0.0:1763333176.279757:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763333176.279761:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48193400, rc 0) 00000100:00100000:0.0:1763333176.279836:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:56886:x1848987613756928:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 484us (2085us total) trans 4294972418 rc 0/0 00000100:00100000:0.0:1763333176.279844:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9421 00000100:00100000:3.0:1763333176.280840:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.281006:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613757184 00000100:00100000:1.0:1763333176.281015:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613757184 00000100:00100000:1.0:1763333176.281075:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9422 00000100:00100000:1.0:1763333176.281085:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:56887:x1848987613757184:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:1.0:1763333176.281143:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1763333176.281172:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c571be lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1bc:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bff expref: 249 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.281195:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c57163 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1bc:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969be3 expref: 248 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.281213:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c57204 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c14 expref: 247 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.281224:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5712b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bd5 expref: 246 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.281232:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:1.0:1763333176.281237:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333176.281266:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57220 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333176.281278:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57220 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.281287:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57220 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.281299:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57227 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333176.281305:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57227 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.281311:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57227 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.281461:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5722e lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333176.281470:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5722e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.281480:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5722e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00080000:1.0:1763333176.281734:0:8606:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x1bc:0x0] is inserted into orphan list, open count = 2 00010000:00010000:1.0:1763333176.281839:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5722e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.281847:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5722e lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.281854:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5722e lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.281861:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333176.281865:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5722e lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.281873:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5722e lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.281882:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:1.0:1763333176.281885:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763333176.281890:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5722e lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.281896:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5722e lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.281909:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57220 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.281915:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57220 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.281925:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57220 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.281930:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57220 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.281934:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feba00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333176.281937:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57220 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.281942:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57220 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.281948:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff4ad5e500) 00010000:00010000:1.0:1763333176.281950:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333176.281953:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57220 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.281958:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57220 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000004:00010000:1.0:1763333176.281971:0:8606:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001811dc62 reply state 000000008e97c1fe transno 4294972419 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57227 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.281981:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57227 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.281987:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff4ad5e300) 00010000:00010000:1.0:1763333176.281989:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333176.281992:0:8606:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763333176.282074:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56887:x1848987613757184:12345-192.168.204.28@tcp:36:rm.0 Request processed in 988us (1239us total) trans 4294972419 rc 0/0 00000100:00100000:1.0:1763333176.282084:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9422 00000100:00100000:3.0:1763333176.285991:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.286213:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613757312 00000100:00100000:0.0:1763333176.286224:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613757312 00000100:00100000:0.0:1763333176.286287:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9423 00000100:00100000:0.0:1763333176.286298:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56886:x1848987613757312:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333176.286326:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333176.286378:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c57235 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969c22 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.286442:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c57235 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c22 expref: 248 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.286466:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c57235 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c22 expref: 248 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.286486:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:0.0:1763333176.286489:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333176.286494:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48192400, rc 0) 00000100:00100000:0.0:1763333176.286547:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:56886:x1848987613757312:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 252us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333176.286554:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9423 00000100:00100000:3.0:1763333176.293828:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.293890:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613757440 00000100:00100000:1.0:1763333176.293903:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613757440 00000100:00100000:1.0:1763333176.293981:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6640 00000100:00100000:1.0:1763333176.294000:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2421:x1848987613757440:12345-192.168.204.28@tcp:1:lfs.0 00010000:00010000:1.0:1763333176.294059:0:28650:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5723c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.294086:0:28650:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c57186 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bea expref: 17 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.294095:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333176.294098:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333176.294102:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5723c lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.294145:0:28650:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c57186 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bea expref: 17 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.294159:0:28650:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c57186 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bea expref: 17 pid: 17605 timeout: 1380 lvb_type: 0 00000100:00100000:1.0:1763333176.294172:0:28650:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4399b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28650:1848987627279872:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333176.294251:0:28650:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff742b9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1763333176.297941:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.297958:0:28650:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4399b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28650:1848987627279872:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333176.298001:0:28650:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5723c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333176.300602:0:28429:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613757568 00000100:00100000:0.0:1763333176.300624:0:28429:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613757568 00002000:00100000:0.0:1763333176.300701:0:28429:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x2c0000400:0x245:0x0] (0->4) req@ffff92fe469a3b80 x1848987613757568/t0(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:487/0 lens 496/0 e 0 to 0 dl 1763333187 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763333176.300713:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe469a3b80 with x1848987613757568 ext(0->4) 00010000:00010000:0.0:1763333176.300723:0:28429:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c57186 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bea expref: 18 pid: 17605 timeout: 1380 lvb_type: 0 00010000:00010000:0.0:1763333176.300743:0:28429:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c57186 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bea expref: 18 pid: 17605 timeout: 1380 lvb_type: 0 00002000:00010000:0.0:1763333176.300752:0:28429:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92fe469a3b80 00000100:00100000:0.0:1763333176.300798:0:28429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 109 00000100:00100000:0.0:1763333176.300808:0:28429:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2420:x1848987613757568:12345-192.168.204.28@tcp:4:bash.0 00000100:00100000:2.0:1763333176.303806:0:28429:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2420:x1848987613757568:12345-192.168.204.28@tcp:4:bash.0 Request processed in 2985us (5861us total) trans 17179871631 rc 0/0 00000100:00100000:2.0:1763333176.303824:0:28429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 109 00002000:00100000:2.0:1763333176.303838:0:28429:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x2c0000400:0x245:0x0] (0->4) req@ffff92fe469a3b80 x1848987613757568/t17179871631(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:487/0 lens 496/448 e 0 to 0 dl 1763333187 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763333176.303848:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe469a3b80 with x1848987613757568 ext(0->4) 00010000:00010000:2.0:1763333176.303858:0:28429:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c57186 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bea expref: 20 pid: 17605 timeout: 1380 lvb_type: 0 00010000:00010000:2.0:1763333176.303880:0:28429:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c57186 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bea expref: 20 pid: 17605 timeout: 1380 lvb_type: 0 00002000:00010000:2.0:1763333176.303888:0:28429:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92fe469a3b80 00000100:00100000:3.0:1763333176.307303:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333176.307410:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613757696 00000100:00100000:2.0:1763333176.307427:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613757696 00010000:00010000:2.0:1763333176.307488:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c57186 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bea expref: 20 pid: 17605 timeout: 1380 lvb_type: 0 00000100:00100000:1.0:1763333176.308307:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3107 00000100:00100000:1.0:1763333176.308324:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2420:x1848987613757696:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333176.308343:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1763333176.308399:0:28428:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x245:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:1.0:1763333176.308403:0:28428:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x245:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1763333176.308409:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c57186 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bea expref: 20 pid: 17605 timeout: 1380 lvb_type: 0 00010000:00010000:1.0:1763333176.308422:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c57186 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bea expref: 20 pid: 17605 timeout: 1380 lvb_type: 0 00010000:00010000:1.0:1763333176.308456:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c57186 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bea expref: 20 pid: 17605 timeout: 1380 lvb_type: 0 00010000:00010000:1.0:1763333176.308474:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333176.308476:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333176.308482:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5723c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.308491:0:28428:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5723c lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.308530:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333176.308603:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2420:x1848987613757696:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 285us (1308us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333176.308611:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3107 00010000:00010000:0.0:1763333176.308713:0:28650:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5723c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.308723:0:28650:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5723c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.308744:0:28650:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5723c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.308752:0:28650:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5723c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.308759:0:28650:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5723c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.308766:0:28650:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feaa00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333176.308770:0:28650:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5723c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.308779:0:28650:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5723c lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.308792:0:28650:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5723c lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.308800:0:28650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5723c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333176.308860:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2421:x1848987613757440:12345-192.168.204.28@tcp:1:lfs.0 Request processed in 14862us (15050us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333176.308869:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6640 00000100:00100000:3.0:1763333176.311813:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.311899:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613757952 00000100:00100000:0.0:1763333176.311911:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613757952 00000100:00100000:0.0:1763333176.311992:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9424 00000100:00100000:0.0:1763333176.312003:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:56886:x1848987613757952:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:0.0:1763333176.312057:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333176.312082:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c57235 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c22 expref: 248 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.312101:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:0.0:1763333176.312105:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333176.312133:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c57243 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333176.312146:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c57243 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.312155:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c57243 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000040:00080000:0.0:1763333176.312395:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1447, 88 off121992 00000004:00080000:0.0:1763333176.312403:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1280392054022ns, next at 1280856550572ns, rc = 0 00000040:00080000:0.0:1763333176.312466:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1448, 88 off121992 00000004:00080000:0.0:1763333176.312472:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1280392122862ns, next at 1280195897991ns, rc = 0 00000040:00080000:0.0:1763333176.312500:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1449, 88 off122080 00000004:00080000:0.0:1763333176.312506:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1280392156672ns, next at 1280195897991ns, rc = 0 00000040:00080000:0.0:1763333176.312516:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1448, 88 off122080 00000004:00080000:0.0:1763333176.312521:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1280392171594ns, next at 1280856550572ns, rc = 0 00000001:00080000:2.0:1763333176.317612:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972420 is committed 00000004:00080000:2.0:1763333176.317631:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 947 committed 00010000:00010000:0.0:1763333176.317641:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57227 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00000004:00080000:2.0:1763333176.317650:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 950 committed 00010000:00010000:0.0:1763333176.317659:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57227 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.317668:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57227 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00000004:00080000:2.0:1763333176.317670:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 949 committed 00000004:00080000:2.0:1763333176.317676:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 946 committed 00010000:00010000:0.0:1763333176.317679:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333176.317688:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57227 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.317698:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57227 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.317720:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff4ad5e300) 00010000:00010000:0.0:1763333176.317724:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333176.317730:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57227 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.317737:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57227 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000004:00010000:0.0:1763333176.317810:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000796312e4 reply state 0000000003616920 transno 4294972420 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c57243 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.317825:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c57243 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.317834:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:0.0:1763333176.317836:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1763333176.317840:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763333176.317932:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1763333176.317953:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4399b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627280000:0@lo:2:osp-syn-1-1.0 00010000:00080000:0.0:1763333176.317973:0:12741:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1763333176.317987:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56886:x1848987613757952:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 5984us (6182us total) trans 4294972420 rc 0/0 00000100:00100000:0.0:1763333176.317998:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9424 00000100:00100000:1.0:1763333176.318013:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333176.318057:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4399a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627280128:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333176.318080:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333176.318126:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627280000 00000100:00100000:1.0:1763333176.318134:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627280000 00000100:00100000:0.0:1763333176.318151:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627280128 00000100:00100000:0.0:1763333176.318158:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627280128 00000100:00100000:1.0:1763333176.318179:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6641 00000100:00100000:1.0:1763333176.318189:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4399b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+18:3654:x1848987627280000:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333176.318194:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6642 00000100:00100000:0.0:1763333176.318205:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43999180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+18:3652:x1848987627280128:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1763333176.318331:0:17605:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x246:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333176.318335:0:17605:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x246:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763333176.318338:0:17605:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x246:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333176.318340:0:17605:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x246:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763333176.318343:0:17605:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x246:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333176.318416:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43999180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+20:3652:x1848987627280128:12345-0@lo:2:osp-syn-1-1.0 Request processed in 213us (334us total) trans 17179871633 rc 0/0 00000100:00100000:0.0:1763333176.318423:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6642 00010000:00010000:3.0:1763333176.318520:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c57243 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.318529:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c57243 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.318535:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c57243 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.318541:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48193c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333176.318544:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c57243 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.318551:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c57243 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.318562:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:3.0:1763333176.318565:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763333176.318568:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c57243 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.318573:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c57243 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000100:00100000:0.0:1763333176.318659:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe469a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627280384:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333176.318665:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe469a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627280256:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333176.318700:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333176.318735:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333176.318820:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627280384 00000100:00100000:0.0:1763333176.318825:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627280384 00000100:00100000:1.0:1763333176.319176:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4399b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+19:3654:x1848987627280000:12345-0@lo:2:osp-syn-1-1.0 Request processed in 989us (1163us total) trans 17179871632 rc 0/0 00000100:00100000:1.0:1763333176.319184:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6641 00000100:00100000:1.0:1763333176.319201:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627280256 00000100:00100000:1.0:1763333176.319205:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627280256 00000100:00100000:1.0:1763333176.319229:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6643 00000100:00100000:1.0:1763333176.319236:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+34:3654:x1848987627280384:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333176.319271:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6644 00000100:00100000:3.0:1763333176.319282:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50065180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+34:3653:x1848987627280256:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1763333176.319318:0:28650:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x246:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333176.319322:0:28650:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x246:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763333176.319324:0:28650:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x246:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333176.319326:0:28650:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x246:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763333176.319328:0:28650:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x246:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1763333176.319377:0:28600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x245:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1763333176.319379:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+36:3654:x1848987627280384:12345-0@lo:2:osp-syn-0-1.0 Request processed in 143us (680us total) trans 21474838936 rc 0/0 00002000:00010000:3.0:1763333176.319382:0:28600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x245:0x0] updating lvb mtime from disk: 1763333176 -> 1763333176 00002000:00010000:3.0:1763333176.319390:0:28600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x245:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:1.0:1763333176.319394:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6643 00002000:00010000:3.0:1763333176.319397:0:28600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x245:0x0] updating lvb ctime from disk: 1763333176 -> 1763333176 00002000:00010000:3.0:1763333176.319401:0:28600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x245:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00080000:1.0:1763333176.319464:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4399a300/2, rc 0, transno 17179871633 00000100:00100000:1.0:1763333176.319471:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4399a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627280128:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333176.319608:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50065180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+35:3653:x1848987627280256:12345-0@lo:2:osp-syn-0-1.0 Request processed in 328us (873us total) trans 21474838937 rc 0/0 00000100:00100000:3.0:1763333176.319616:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6644 00000004:00080000:3.0:1763333176.319643:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe469a0380/2, rc 0, transno 21474838937 00000100:00100000:3.0:1763333176.319648:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe469a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627280256:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1763333176.320135:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe469a2a00/2, rc 0, transno 21474838936 00000100:00100000:2.0:1763333176.320141:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe469a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627280384:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1763333176.320150:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4399b800/2, rc 0, transno 17179871632 00000100:00100000:2.0:1763333176.320153:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4399b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627280000:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333176.325891:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333176.325979:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.327279:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613758208 00000100:00100000:1.0:1763333176.327292:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613758208 00000100:00100000:1.0:1763333176.327366:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613758080 00000100:00100000:1.0:1763333176.327369:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613758080 00000100:00100000:1.0:1763333176.327391:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9425 00000100:00100000:1.0:1763333176.327400:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50064700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56886:x1848987613758208:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333176.327426:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333176.327456:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5724a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969c30 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.327517:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5724a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c30 expref: 240 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.327532:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5724a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c30 expref: 240 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.327551:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:1.0:1763333176.327554:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763333176.327558:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feba00, rc 0) 00000100:00100000:1.0:1763333176.327619:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50064700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:56886:x1848987613758208:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 219us (1738us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333176.327626:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9425 00000100:00100000:1.0:1763333176.327646:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9426 00000100:00100000:1.0:1763333176.327652:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50065c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56888:x1848987613758080:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333176.327659:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333176.327670:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c57251 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969c29 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.327719:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57258 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333176.327728:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57258 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.327736:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57258 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.327746:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5725f lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333176.327752:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5725f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.327757:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5725f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.327794:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57258 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.327800:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57258 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.327805:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57258 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.327811:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57258 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.327816:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333176.327819:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57258 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.327826:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57258 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.327837:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff4ad5e500) 00010000:00010000:1.0:1763333176.327840:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333176.327843:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57258 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.327848:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57258 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.327859:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5725f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.327863:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5725f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.327868:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5725f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.327873:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feaa00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333176.327875:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5725f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.327880:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5725f lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.327885:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff4ad5e700) 00010000:00010000:1.0:1763333176.327887:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333176.327889:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5725f lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.327893:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5725f lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.327916:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c57251 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c29 expref: 240 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.327925:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff4ad5e500) 00010000:00010000:1.0:1763333176.327927:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333176.327930:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c57251 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c29 expref: 240 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.327939:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea800, rc 0) 00000100:00100000:1.0:1763333176.327957:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50065c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56888:x1848987613758080:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 306us (1978us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333176.327963:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9426 00000100:00100000:3.0:1763333176.333774:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.334922:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613758336 00000100:00100000:0.0:1763333176.334934:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613758336 00000100:00100000:3.0:1763333176.335737:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333176.335859:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613758464 00000100:00100000:2.0:1763333176.335866:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613758464 00000100:00100000:2.0:1763333176.335935:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9427 00000100:00100000:2.0:1763333176.335947:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50065500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:56888:x1848987613758464:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333176.335973:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333176.336005:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57266 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969c3e expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.336088:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5726d lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333176.336105:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5726d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.336118:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5726d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.336130:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57274 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333176.336136:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57274 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.336143:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57274 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.336182:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5726d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.336189:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5726d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.336195:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5726d lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.336202:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5726d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.336207:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333176.336211:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5726d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.336218:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5726d lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.336230:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff61a46b00) 00010000:00010000:2.0:1763333176.336234:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333176.336238:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5726d lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.336243:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5726d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.336257:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57274 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.336263:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57274 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.336269:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57274 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.336273:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4a00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333176.336276:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57274 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.336282:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57274 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.336293:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff61a46400) 00010000:00010000:2.0:1763333176.336295:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333176.336298:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57274 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.336303:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57274 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.336334:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57266 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c3e expref: 241 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.336345:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff61a46b00) 00010000:00010000:2.0:1763333176.336386:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333176.336392:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57266 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c3e expref: 241 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.336405:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5c00, rc 0) 00000100:00100000:1.0:1763333176.336423:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9428 00000100:00100000:1.0:1763333176.336435:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50067b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:56886:x1848987613758336:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333176.336445:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333176.336467:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5727b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969c37 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333176.336480:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50065500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56888:x1848987613758464:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 534us (748us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333176.336489:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9427 00010000:00010000:1.0:1763333176.336535:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57282 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333176.336545:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57282 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333176.336552:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57282 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00000004:00200000:1.0:1763333176.336593:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1bc:0x0]: returning size 5 00000004:00200000:1.0:1763333176.336597:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763333176.336613:0:6521:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57282 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 00010000:00010000:1.0:1763333176.336634:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5727b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c37 expref: 241 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.336645:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57282 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c37 expref: 240 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.336651:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:1.0:1763333176.336654:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1763333176.336657:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feaa00, rc 0) 00000100:00100000:1.0:1763333176.336693:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50067b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:56886:x1848987613758336:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 262us (2930us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333176.336700:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9428 00000100:00100000:3.0:1763333176.342890:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333176.343477:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613758592 00000100:00100000:2.0:1763333176.343488:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613758592 00000100:00100000:2.0:1763333176.343554:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9429 00000100:00100000:2.0:1763333176.343564:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:56888:x1848987613758592:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333176.343584:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333176.343606:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57289 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969c45 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333176.343644:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:2.0:1763333176.343698:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57290 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333176.343712:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57290 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.343724:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57290 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:2.0:1763333176.343773:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1763333176.343779:0:6519:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1763333176.343815:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57289 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c45 expref: 242 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.343833:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57290 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c45 expref: 241 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.343842:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff61a46400) 00010000:00010000:2.0:1763333176.343846:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1763333176.343849:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4400, rc 0) 00000100:00100000:2.0:1763333176.343920:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56888:x1848987613758592:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 357us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333176.343934:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9429 00000100:00100000:0.0:1763333176.346695:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613758720 00000100:00100000:0.0:1763333176.346710:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613758720 00000100:00100000:1.0:1763333176.347001:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6645 00000100:00100000:1.0:1763333176.347012:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50064e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2421:x1848987613758720:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333176.347030:0:17605:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333176.347053:0:17605:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57297 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969c4c expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333176.347076:0:17605:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x245:0x0] initial LVB size: 5, mtime: 0x691a5438, atime: 0x0, ctime: 0x691a5438, blocks: 0x8 00010000:00010000:1.0:1763333176.347094:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333176.347096:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333176.347106:0:17605:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57297 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c4c expref: 19 pid: 17605 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333176.347121:0:17605:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57297 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c4c expref: 19 pid: 17605 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333176.347139:0:17605:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feb400, rc 0) 00000100:00100000:1.0:1763333176.347207:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50064e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2421:x1848987613758720:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 197us (3564us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333176.347215:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6645 00000100:00100000:1.0:1763333176.348312:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333176.348458:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613758848 00000100:00100000:2.0:1763333176.348466:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613758848 00000100:00100000:2.0:1763333176.348518:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9430 00000100:00100000:2.0:1763333176.348527:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56888:x1848987613758848:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333176.348542:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333176.348560:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5729e lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969c53 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.348620:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c572a5 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333176.348634:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c572a5 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.348645:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c572a5 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.348660:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c572ac lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333176.348667:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c572ac lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.348672:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c572ac lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.348714:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c572a5 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.348720:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c572a5 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.348726:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c572a5 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.348732:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c572a5 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.348738:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333176.348742:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c572a5 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.348749:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c572a5 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.348760:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff61a46400) 00010000:00010000:2.0:1763333176.348763:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333176.348767:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c572a5 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.348773:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c572a5 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.349743:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c572ac lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.349757:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c572ac lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.349764:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c572ac lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.349769:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333176.349773:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c572ac lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.349779:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c572ac lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.349797:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff61a46200) 00010000:00010000:2.0:1763333176.349800:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333176.349805:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c572ac lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.349811:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c572ac lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.349857:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5729e lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c53 expref: 242 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.349872:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff61a46400) 00010000:00010000:2.0:1763333176.349875:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333176.349887:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5729e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c53 expref: 242 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.349898:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4800, rc 0) 00000100:00100000:2.0:1763333176.352603:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56888:x1848987613758848:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 4061us (4278us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333176.352618:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9430 00000100:00100000:3.0:1763333176.355756:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.356687:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613759104 00000100:00100000:0.0:1763333176.356699:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613759104 00000100:00100000:1.0:1763333176.357391:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9431 00000100:00100000:1.0:1763333176.357405:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50066a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56888:x1848987613759104:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333176.357426:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333176.357429:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763333176.357469:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57290 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c45 expref: 241 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.357492:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff61a46400) 00010000:00010000:1.0:1763333176.357503:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333176.357520:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c572b3 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969c5a expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.357634:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c572ba lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333176.357649:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c572ba lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.357660:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c572ba lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.357672:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c572c1 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333176.357680:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c572c1 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.357686:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c572c1 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.358107:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f800/0xb32e3ef184c572c8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1bd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333176.358116:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f800/0xb32e3ef184c572c8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.358123:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f800/0xb32e3ef184c572c8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:1.0:1763333176.358131:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1bd:0x0]: returning size 0 00010000:00010000:1.0:1763333176.358153:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c572ba lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.358160:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c572ba lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.358165:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c572ba lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.358171:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c572ba lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.358176:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333176.358180:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c572ba lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.358187:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c572ba lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.358198:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff4ad5e900) 00010000:00010000:1.0:1763333176.358201:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333176.358205:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c572ba lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.358210:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c572ba lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000004:00010000:1.0:1763333176.358220:0:8606:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005db245cb reply state 00000000fea689fc transno 4294972421 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c572c1 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.358230:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c572c1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.358236:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff4ad5eb00) 00010000:00010000:1.0:1763333176.358238:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333176.358240:0:8606:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763333176.358266:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c572b3 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c5a expref: 243 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.358281:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f800/0xb32e3ef184c572c8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c5a expref: 242 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.358287:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bd:0x0].0x0 (ffff92ff4ad5e300) 00010000:00010000:1.0:1763333176.358290:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333176.358292:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff4148f800, rc 0) 00000100:00100000:1.0:1763333176.358394:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50066a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:56888:x1848987613759104:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 994us (2647us total) trans 4294972421 rc 0/0 00000100:00100000:1.0:1763333176.358402:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9431 00000100:00100000:3.0:1763333176.361085:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.361330:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613759360 00000100:00100000:1.0:1763333176.361342:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613759360 00000100:00100000:1.0:1763333176.361427:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9432 00000100:00100000:1.0:1763333176.361437:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:56888:x1848987613759360:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333176.361469:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333176.361489:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c572d6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1bd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969c61 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.361592:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c572dd lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1bd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333176.361608:0:8606:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f800/0xb32e3ef184c572c8 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c5a expref: 244 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.361618:0:8606:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c572dd lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1bd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.361652:0:8606:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f800/0xb32e3ef184c572c8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c5a expref: 244 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.361664:0:8606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f800/0xb32e3ef184c572c8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c5a expref: 244 pid: 8606 timeout: 1380 lvb_type: 0 00000100:00100000:1.0:1763333176.361676:0:8606:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe43998000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627280512:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333176.362950:0:8606:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe487770c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763333176.380589:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.380682:0:8606:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe43998000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627280512:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333176.380710:0:8606:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c572dd lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1bd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000100:00100000:2.0:1763333176.381781:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613759488 00000100:00100000:2.0:1763333176.381794:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613759488 00010000:00010000:2.0:1763333176.381841:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f800/0xb32e3ef184c572c8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c5a expref: 245 pid: 8606 timeout: 1380 lvb_type: 0 00000100:00100000:2.0:1763333176.381895:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3108 00000100:00100000:2.0:1763333176.381905:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:2420:x1848987613759488:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333176.381937:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333176.381945:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f800/0xb32e3ef184c572c8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1bd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c5a expref: 245 pid: 8606 timeout: 1380 lvb_type: 0 00010000:00010000:2.0:1763333176.381959:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f800/0xb32e3ef184c572c8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c5a expref: 245 pid: 8606 timeout: 1380 lvb_type: 0 00010000:00010000:2.0:1763333176.381983:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f800/0xb32e3ef184c572c8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1bd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c5a expref: 245 pid: 8606 timeout: 1380 lvb_type: 0 00010000:00010000:2.0:1763333176.382002:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bd:0x0].0x0 (ffff92ff4ad5e300) 00010000:00010000:2.0:1763333176.382007:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c572dd lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1bd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333176.382016:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c572dd lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333176.382023:0:6506:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c572dd lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1bd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333176.382042:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333176.382105:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:2420:x1848987613759488:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 201us (1528us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333176.382113:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3108 00010000:00010000:2.0:1763333176.382138:0:8606:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c572dd lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333176.382146:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c572dd lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:2.0:1763333176.382168:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1bd:0x0]: returning size 0 00000004:00080000:2.0:1763333176.383272:0:8606:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x247:0x0], index 0: 0 00000004:00080000:2.0:1763333176.383290:0:8606:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x247:0x0], index 1: 0 00000004:00080000:2.0:1763333176.383296:0:8606:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x248:0x0], index 1: 0 00000004:00080000:2.0:1763333176.383300:0:8606:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x248:0x0], index 0: 0 00010000:00010000:2.0:1763333176.383492:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c572dd lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333176.383501:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c572dd lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1bd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333176.383512:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c572dd lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1bd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333176.383518:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff4148ee00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333176.383522:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c572dd lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1bd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333176.383531:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c572dd lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1bd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333176.383544:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bd:0x0].0x0 (ffff92ff4ad5e300) 00010000:00010000:2.0:1763333176.383547:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333176.383551:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c572dd lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1bd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333176.383557:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c572dd lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1bd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333176.383621:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c572d6 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1bd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c61 expref: 244 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.383631:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bd:0x0].0x0 (ffff92ff4ad5e300) 00010000:00010000:2.0:1763333176.383633:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763333176.383636:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c572d6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1bd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c61 expref: 244 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.383649:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff4148e200, rc 0) 00000100:00100000:2.0:1763333176.384549:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:56888:x1848987613759360:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 23107us (23465us total) trans 4294972422 rc 301/301 00000100:00100000:2.0:1763333176.384560:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9432 00000100:00100000:3.0:1763333176.390925:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333176.392934:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613759744 00000100:00100000:2.0:1763333176.392948:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613759744 00000100:00100000:2.0:1763333176.393017:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3222 00000100:00100000:2.0:1763333176.393030:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:56888:x1848987613759744:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333176.393370:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56888:x1848987613759744:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 323us (2433us total) trans 4294972423 rc 0/0 00000100:00100000:2.0:1763333176.393379:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3222 00000100:00100000:0.0:1763333176.396178:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.396276:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333176.396337:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613760128 00000100:00100000:2.0:1763333176.396434:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613760128 00000100:00100000:1.0:1763333176.396535:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3223 00000100:00100000:1.0:1763333176.396550:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56888:x1848987613760128:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1763333176.396801:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56888:x1848987613760128:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 255us (524us total) trans 4294972424 rc 0/0 00000100:00100000:1.0:1763333176.396810:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3223 00000100:00100000:3.0:1763333176.400335:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613759872 00000100:00100000:3.0:1763333176.400390:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613759872 00000100:00100000:3.0:1763333176.400458:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6646 00000100:00100000:3.0:1763333176.400468:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2419:x1848987613759872:12345-192.168.204.28@tcp:23:lfs.0 00000100:00100000:0.0:1763333176.400523:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42ef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1848987627280640:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1763333176.400653:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe43998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627280768:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1763333176.402148:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2419:x1848987613759872:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 1675us (5973us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333176.402162:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6646 00000100:00100000:0.0:1763333176.402164:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333176.402197:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7400c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5e37baad-59e1-47e8-a7d1-7559d772e0ab:3653:1848987627280896:0@lo:400:kworker.0 00000100:00100000:0.0:1763333176.402242:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7400e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1848987627281152:0@lo:400:kworker.0 00000100:00100000:3.0:1763333176.402243:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333176.402281:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333176.402285:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7400f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1848987627281408:0@lo:400:kworker.0 00000100:00100000:0.0:1763333176.402305:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4684d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1848987627281664:0@lo:400:kworker.0 00000100:00100000:3.0:1763333176.402317:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333176.402336:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333176.402375:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4684f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1848987627281920:0@lo:400:kworker.0 00000100:00100000:0.0:1763333176.402405:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4684ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1848987627282176:0@lo:400:kworker.0 00000100:00100000:3.0:1763333176.402411:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333176.402439:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1763333176.402441:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333176.402457:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7400c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1848987627281280:0@lo:400:kworker.0 00000100:00100000:0.0:1763333176.402476:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1763333176.402485:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7400fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627281024:0@lo:400:kworker.0 00000100:00100000:3.0:1763333176.402490:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333176.402518:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4684ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1848987627281792:0@lo:400:kworker.0 00000100:00100000:0.0:1763333176.402524:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333176.402552:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7400d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1848987627281536:0@lo:400:kworker.0 00000100:00100000:3.0:1763333176.402553:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333176.402585:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333176.402591:0:32350:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627280896 00000100:00100000:3.0:1763333176.402598:0:32350:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627280896 00000100:00100000:0.0:1763333176.402606:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4684fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1848987627282048:0@lo:400:kworker.0 00000100:00100000:0.0:1763333176.402635:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333176.402640:0:32350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1763333176.402650:0:32350:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e37baad-59e1-47e8-a7d1-7559d772e0ab+23:3653:x1848987627280896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1763333176.402697:0:32350:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e37baad-59e1-47e8-a7d1-7559d772e0ab+23:3653:x1848987627280896:12345-0@lo:400:kworker.0 Request processed in 49us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333176.402701:0:7798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627280640 00000100:00100000:3.0:1763333176.402705:0:32350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1763333176.402707:0:7798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627280640 00000100:00100000:3.0:1763333176.402739:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627281152 00000100:00100000:0.0:1763333176.402742:0:7798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627281024 00000100:00100000:3.0:1763333176.402744:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627281152 00000100:00100000:0.0:1763333176.402748:0:7798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627281024 00000100:00100000:3.0:1763333176.402770:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627281408 00000100:00100000:0.0:1763333176.402772:0:7798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627281792 00000100:00100000:3.0:1763333176.402774:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627281408 00000100:00100000:0.0:1763333176.402779:0:7798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627281792 00000100:00100000:0.0:1763333176.402797:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1418 00000100:00100000:3.0:1763333176.402805:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627281664 00000100:00100000:0.0:1763333176.402807:0:7798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3655:x1848987627280640:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1763333176.402809:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627281664 00000100:00100000:3.0:1763333176.402826:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627282176 00000100:00100000:3.0:1763333176.402829:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627282176 00000004:00000024:0.0:1763333176.402841:0:7798:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445949440 avail 1299709952 00000100:00100000:3.0:1763333176.402842:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627281280 00000100:00100000:3.0:1763333176.402846:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627281280 00000100:00100000:3.0:1763333176.402857:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627281536 00000100:00100000:3.0:1763333176.402860:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627281536 00000100:00100000:3.0:1763333176.402876:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1491 00000100:00100000:3.0:1763333176.402884:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1848987627281152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1763333176.402890:0:7798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3655:x1848987627280640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333176.402899:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1418 00000100:00100000:3.0:1763333176.402920:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1848987627281152:12345-0@lo:400:kworker.0 Request processed in 36us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333176.402921:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1419 00000100:00100000:3.0:1763333176.402931:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1491 00000100:00100000:0.0:1763333176.402935:0:7798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3655:x1848987627281024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1763333176.402947:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1492 00000100:00100000:0.0:1763333176.402972:0:7798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3655:x1848987627281024:12345-0@lo:400:kworker.0 Request processed in 39us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333176.402979:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1419 00000100:00100000:0.0:1763333176.402992:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1420 00000100:00100000:0.0:1763333176.402997:0:7798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1848987627281792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1763333176.403024:0:7798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1848987627281792:12345-0@lo:400:kworker.0 Request processed in 27us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333176.403033:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1420 00000100:00100000:3.0:1763333176.403155:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1848987627281408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1763333176.403183:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1848987627281408:12345-0@lo:400:kworker.0 Request processed in 31us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333176.403214:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333176.403244:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42efbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627282304:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1763333176.403273:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333176.403278:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333176.403305:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627282304 00000100:00100000:2.0:1763333176.403309:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627282304 00000100:00100000:1.0:1763333176.403323:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613760384 00000100:00100000:1.0:1763333176.403329:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613760384 00000100:00100000:2.0:1763333176.403334:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1421 00000100:00100000:2.0:1763333176.403345:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3652:x1848987627282304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1763333176.403381:0:6525:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445888000 avail 1299648512 00000100:00100000:2.0:1763333176.403434:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3652:x1848987627282304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333176.403440:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1421 00000100:00100000:2.0:1763333176.403473:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627280768 00000100:00100000:2.0:1763333176.403482:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627280768 00000100:00100000:2.0:1763333176.403516:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 780 00000100:00100000:2.0:1763333176.403522:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+19:3652:x1848987627280768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1763333176.403540:0:8408:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 484927680 pending 28672 free 3919179776 avail 3687571456 00000100:00100000:2.0:1763333176.403576:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+19:3652:x1848987627280768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333176.403585:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 780 00000100:00100000:0.0:1763333176.404135:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1493 00000100:00100000:0.0:1763333176.404151:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1848987627281664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1763333176.404158:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1492 00000100:00100000:3.0:1763333176.404181:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1494 00000100:00100000:3.0:1763333176.404191:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1848987627282176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1763333176.404197:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1848987627281664:12345-0@lo:400:kworker.0 Request processed in 52us (1859us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333176.404206:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1493 00000100:00100000:0.0:1763333176.404225:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1495 00000100:00100000:0.0:1763333176.404234:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1848987627281280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1763333176.404238:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1848987627282176:12345-0@lo:400:kworker.0 Request processed in 48us (1796us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333176.404247:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1494 00000100:00100000:3.0:1763333176.404267:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1496 00000100:00100000:0.0:1763333176.404274:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1848987627281280:12345-0@lo:400:kworker.0 Request processed in 41us (1786us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333176.404279:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1848987627281536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1763333176.404286:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1495 00000100:00100000:0.0:1763333176.404312:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627281920 00000100:00100000:0.0:1763333176.404316:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627281920 00000100:00100000:3.0:1763333176.404320:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1848987627281536:12345-0@lo:400:kworker.0 Request processed in 44us (1733us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333176.404328:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1496 00000100:00100000:0.0:1763333176.404379:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 903 00000100:00080000:3.0:1763333176.404381:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1763333176.404388:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1763333176.404392:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3653:x1848987627281920:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1763333176.404393:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1763333176.404433:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627282048 00000100:00100000:0.0:1763333176.404434:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3653:x1848987627281920:12345-0@lo:400:kworker.0 Request processed in 46us (2024us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333176.404440:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627282048 00000100:00100000:0.0:1763333176.404444:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 903 00000100:00100000:0.0:1763333176.404495:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 904 00000100:00100000:0.0:1763333176.404503:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3655:x1848987627282048:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1763333176.404511:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1763333176.404540:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3655:x1848987627282048:12345-0@lo:400:kworker.0 Request processed in 38us (1907us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333176.404545:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7400c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1848987627281280:0@lo:400:kworker.0 00000100:00100000:0.0:1763333176.404551:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 904 00000100:00100000:3.0:1763333176.404571:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4684ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1848987627281792:0@lo:400:kworker.0 00000100:00100000:3.0:1763333176.404590:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7400c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5e37baad-59e1-47e8-a7d1-7559d772e0ab:3653:1848987627280896:0@lo:400:kworker.0 00000100:00100000:0.0:1763333176.404593:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7400fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627281024:0@lo:400:kworker.0 00000100:00100000:3.0:1763333176.404608:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7400f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1848987627281408:0@lo:400:kworker.0 00000100:00100000:0.0:1763333176.404619:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7400d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1848987627281536:0@lo:400:kworker.0 00000100:00100000:3.0:1763333176.404626:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4684f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1848987627281920:0@lo:400:kworker.0 00000100:00100000:0.0:1763333176.404638:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4684fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1848987627282048:0@lo:400:kworker.0 00000100:00100000:0.0:1763333176.404655:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7400e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1848987627281152:0@lo:400:kworker.0 00000100:00100000:0.0:1763333176.404666:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4684d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1848987627281664:0@lo:400:kworker.0 00000100:00100000:0.0:1763333176.404677:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4684ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1848987627282176:0@lo:400:kworker.0 00000100:00100000:0.0:1763333176.404692:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42ef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1848987627280640:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1763333176.405090:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42efbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627282304:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1763333176.405107:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe43998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627280768:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1763333176.406175:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9433 00000100:00100000:2.0:1763333176.406216:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:55917:x1848987613760384:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333176.406236:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333176.406259:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c572eb lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969c68 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.406419:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c572f2 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333176.406433:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c572f2 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.406443:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c572f2 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.406465:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c572f9 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333176.406473:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c572f9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.406479:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c572f9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.406538:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57300 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1bd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333176.406547:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57300 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.406554:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57300 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:2.0:1763333176.408430:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1bd:0x0]: returning size 0 00010000:00010000:3.0:1763333176.410219:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c572f2 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.410236:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c572f2 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.410243:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c572f2 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.410250:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c572f2 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.410257:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333176.410261:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c572f2 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.410268:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c572f2 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.410284:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff61a46200) 00010000:00010000:3.0:1763333176.410287:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333176.410292:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c572f2 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.410298:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c572f2 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.410316:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c572f9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.410322:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c572f9 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.410326:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c572f9 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.410331:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333176.410334:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c572f9 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.410340:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c572f9 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.410385:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff4ad5eb00) 00010000:00010000:3.0:1763333176.410389:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333176.410392:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c572f9 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.410397:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c572f9 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.410463:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c572eb lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c68 expref: 248 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.410491:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57300 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c68 expref: 247 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.410500:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bd:0x0].0x0 (ffff92ff61a46b00) 00010000:00010000:3.0:1763333176.410503:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333176.410506:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4a00, rc 0) 00000100:00100000:3.0:1763333176.410577:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:55917:x1848987613760384:12345-192.168.204.28@tcp:101:bash.0 Request processed in 4390us (7303us total) trans 4294972425 rc 0/0 00000100:00100000:3.0:1763333176.410588:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9433 00000100:00100000:2.0:1763333176.413946:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333176.414111:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613760512 00000100:00100000:3.0:1763333176.414122:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613760512 00000100:00100000:3.0:1763333176.414182:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6647 00000100:00100000:3.0:1763333176.414192:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2418:x1848987613760512:12345-192.168.204.28@tcp:23:lfs.0 00000100:00100000:3.0:1763333176.414370:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2418:x1848987613760512:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 179us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333176.414377:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6647 00000100:00100000:0.0:1763333176.418526:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333176.418609:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613760640 00000100:00100000:3.0:1763333176.418621:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613760640 00000100:00100000:3.0:1763333176.418680:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9434 00000100:00100000:3.0:1763333176.418692:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:55917:x1848987613760640:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333176.418716:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333176.418736:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5730e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1bd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969c6f expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.418769:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c57315 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1bd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333176.418786:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c57315 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.418797:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c57315 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.418923:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5730e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1bd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c6f expref: 249 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.418941:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c57315 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c6f expref: 248 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.418949:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bd:0x0].0x0 (ffff92ff61a46b00) 00010000:00010000:3.0:1763333176.418953:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763333176.418957:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7fe00, rc 0) 00000100:00100000:3.0:1763333176.419025:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:55917:x1848987613760640:12345-192.168.204.28@tcp:101:bash.0 Request processed in 335us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333176.419034:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9434 00000100:00100000:0.0:1763333176.424016:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333176.424076:0:28429:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613760768 00000100:00100000:2.0:1763333176.424088:0:28429:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613760768 00000100:00100000:2.0:1763333176.424617:0:28429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1637 00000100:00100000:2.0:1763333176.424629:0:28429:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2421:x1848987613760768:12345-192.168.204.28@tcp:3:lfs.0 00010000:00010000:2.0:1763333176.424665:0:28429:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5731c lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.424679:0:28429:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333176.424681:0:28429:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333176.424687:0:28429:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5731c lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.424699:0:28429:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5731c lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333176.424882:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.424936:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613761024 00000100:00100000:1.0:1763333176.424941:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613761024 00000100:00100000:1.0:1763333176.424988:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9435 00000100:00100000:1.0:1763333176.424995:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:55917:x1848987613761024:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:1.0:1763333176.425032:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333176.427685:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57300 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c68 expref: 248 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.427716:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bd:0x0].0x0 (ffff92ff61a46b00) 00010000:00010000:1.0:1763333176.427722:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333176.427816:0:28429:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5731c lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.427827:0:28429:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5731c lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.427835:0:28429:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5731c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.427847:0:28429:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5c00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333176.427851:0:28429:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5731c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.427860:0:28429:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5731c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.427876:0:28429:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5731c lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.427883:0:28429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5731c lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333176.427966:0:28429:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2421:x1848987613760768:12345-192.168.204.28@tcp:3:lfs.0 Request processed in 3338us (3959us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1763333176.427976:0:28429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1637 00010000:00010000:1.0:1763333176.428203:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c57323 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1bd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333176.428220:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c57323 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1bd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.428229:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c57323 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1bd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000001:00080000:1.0:1763333176.428277:0:6519:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294972426 00000004:00010000:1.0:1763333176.428301:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b1a608a9 reply state 000000002209d4dc transno 4294972427 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c57323 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1bd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.428313:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c57323 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1bd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.428319:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bd:0x0].0x0 (ffff92ff61a46b00) 00010000:00010000:1.0:1763333176.428321:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333176.428324:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763333176.428424:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:55917:x1848987613761024:12345-192.168.204.28@tcp:36:bash.0 Request processed in 3428us (3541us total) trans 4294972427 rc 0/0 00000100:00100000:1.0:1763333176.428431:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9435 00000020:00080000:1.0:1763333176.428435:0:6519:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763333176.432343:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.432529:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613761152 00000100:00100000:1.0:1763333176.432541:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613761152 00000100:00100000:1.0:1763333176.432610:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9436 00000100:00100000:1.0:1763333176.432620:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74038700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:55917:x1848987613761152:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333176.432645:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333176.432667:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c5732a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1bd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969c76 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.432721:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c5732a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1bd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c76 expref: 251 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.432738:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c5732a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1bd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c76 expref: 251 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.432757:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bd:0x0].0x0 (ffff92ff61a46b00) 00010000:00010000:1.0:1763333176.432761:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763333176.432765:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff4148e200, rc 0) 00000100:00100000:1.0:1763333176.434659:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74038700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:55917:x1848987613761152:12345-192.168.204.28@tcp:101:bash.0 Request processed in 2028us (2316us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333176.434673:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9436 00000100:00100000:3.0:1763333176.434739:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.435408:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613761280 00000100:00100000:1.0:1763333176.435418:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613761280 00000100:00100000:1.0:1763333176.435477:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9437 00000100:00100000:1.0:1763333176.435487:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:56886:x1848987613761280:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333176.435507:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333176.435528:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c57331 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969c7d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.435564:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f800/0xb32e3ef184c57338 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333176.435580:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f800/0xb32e3ef184c57338 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.435591:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f800/0xb32e3ef184c57338 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.435705:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c57331 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c7d expref: 253 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.435722:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148f800/0xb32e3ef184c57338 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c7d expref: 252 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.435730:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:1.0:1763333176.435734:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763333176.435737:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff4148f800, rc 0) 00000100:00100000:1.0:1763333176.435786:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:56886:x1848987613761280:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 301us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333176.435792:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9437 00000100:00100000:3.0:1763333176.440421:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.440510:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613761536 00000100:00100000:3.0:1763333176.440516:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.440523:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613761536 00000100:00100000:0.0:1763333176.440608:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9438 00000100:00100000:0.0:1763333176.440621:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:55917:x1848987613761536:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333176.440645:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333176.440649:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763333176.440679:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c5732a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1bd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c76 expref: 252 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.440701:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bd:0x0].0x0 (ffff92ff61a46b00) 00010000:00010000:0.0:1763333176.440709:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333176.440724:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c5733f lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1bd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969c84 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.440781:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c57346 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1bd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333176.440796:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c57346 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bd:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.440807:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c57346 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bd:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000040:00080000:0.0:1763333176.441097:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1450, 88 off122168 00000004:00080000:0.0:1763333176.441106:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1280520756036ns, next at 1280195897991ns, rc = 0 00000040:00080000:0.0:1763333176.441148:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1449, 88 off122168 00000004:00080000:0.0:1763333176.441153:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1280520804226ns, next at 1280856550572ns, rc = 0 00000040:00080000:0.0:1763333176.441183:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1450, 88 off122256 00000004:00080000:0.0:1763333176.441188:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1280520838888ns, next at 1280856550572ns, rc = 0 00000040:00080000:0.0:1763333176.441199:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1451, 88 off122256 00000004:00080000:0.0:1763333176.441204:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1280520854428ns, next at 1280195897991ns, rc = 0 00000100:00100000:1.0:1763333176.441342:0:28429:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613761664 00000100:00100000:1.0:1763333176.441373:0:28429:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613761664 00000100:00100000:1.0:1763333176.441419:0:28429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1638 00000100:00100000:1.0:1763333176.441427:0:28429:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2420:x1848987613761664:12345-192.168.204.28@tcp:4:lfs.0 00010000:00010000:1.0:1763333176.441461:0:28429:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c5734d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x246:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.441477:0:28429:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96e00/0xb32e3ef184c570fa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x246:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bb9 expref: 23 pid: 28600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333176.441485:0:28429:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333176.441488:0:28429:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333176.441491:0:28429:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c5734d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x246:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.441525:0:28429:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96e00/0xb32e3ef184c570fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x246:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bb9 expref: 23 pid: 28600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333176.441539:0:28429:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96e00/0xb32e3ef184c570fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x246:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bb9 expref: 23 pid: 28600 timeout: 1380 lvb_type: 1 00000100:00100000:1.0:1763333176.441552:0:28429:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe43998000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_013:lustre-OST0000_UUID:28429:1848987627282432:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333176.441624:0:28429:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff800d30c0 going to sleep for 11 seconds 00000001:00080000:2.0:1763333176.447231:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972428 is committed 00000004:00080000:2.0:1763333176.447246:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 952 committed 00000004:00080000:2.0:1763333176.447268:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 949 committed 00000004:00080000:2.0:1763333176.447278:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 948 committed 00000004:00080000:2.0:1763333176.447281:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 951 committed 00000100:00100000:0.0:1763333176.447443:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7403b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627282688:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333176.447444:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7403a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627282944:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333176.447577:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333176.447586:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe434c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627282560:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333176.447623:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333176.447642:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627282944 00000100:00100000:1.0:1763333176.447649:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627282944 00000100:00100000:1.0:1763333176.447709:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627282560 00000100:00100000:1.0:1763333176.447713:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627282560 00010000:00010000:3.0:1763333176.447728:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c572c1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.447741:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c572c1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00000100:00100000:1.0:1763333176.447746:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6648 00010000:00010000:3.0:1763333176.447756:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c572c1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00000100:00100000:1.0:1763333176.447760:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+35:3652:x1848987627282944:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1763333176.447768:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333176.447774:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c572c1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.447782:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c572c1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.447799:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff4ad5eb00) 00010000:00010000:3.0:1763333176.447802:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333176.447807:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c572c1 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.447813:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c572c1 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.447836:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c57323 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1bd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333176.447843:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c57323 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1bd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333176.447848:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c57323 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1bd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333176.447853:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff4148e600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333176.447856:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c57323 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1bd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333176.447861:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c57323 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1bd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333176.447867:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bd:0x0].0x0 (ffff92ff61a46b00) 00010000:00010000:3.0:1763333176.447870:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333176.447873:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c57323 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1bd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333176.447878:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c57323 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1bd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000100:00100000:3.0:1763333176.447900:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6649 00000100:00100000:3.0:1763333176.447911:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+19:3653:x1848987627282560:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333176.447949:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+36:3652:x1848987627282944:12345-0@lo:2:osp-syn-0-1.0 Request processed in 191us (371us total) trans 21474838938 rc 0/0 00000100:00100000:1.0:1763333176.447959:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6648 00000004:00080000:1.0:1763333176.448016:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7403a300/2, rc 0, transno 21474838938 00000100:00100000:1.0:1763333176.448022:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7403a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627282944:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1763333176.448089:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c57346 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1bd:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c84 expref: 244 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.448100:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bd:0x0].0x0 (ffff92ff61a46b00) 00010000:00010000:1.0:1763333176.448103:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763333176.448116:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48192400/0xb32e3ef184c5733f lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1bd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c84 expref: 244 pid: 12741 timeout: 0 lvb_type: 3 00000100:00100000:0.0:1763333176.448186:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333176.448209:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763333176.448215:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe434c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627282816:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333176.448235:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333176.448256:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627282688 00000100:00100000:0.0:1763333176.448260:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627282688 00000100:00100000:0.0:1763333176.448281:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627282816 00000100:00100000:0.0:1763333176.448284:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627282816 00000100:00100000:0.0:1763333176.448300:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6650 00000100:00100000:0.0:1763333176.448306:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74039c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+36:3654:x1848987627282688:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333176.448404:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74039c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+37:3654:x1848987627282688:12345-0@lo:2:osp-syn-0-1.0 Request processed in 97us (217us total) trans 21474838939 rc 0/0 00000100:00100000:0.0:1763333176.448410:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6650 00000100:00100000:0.0:1763333176.448422:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6651 00000100:00100000:0.0:1763333176.448429:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+21:3654:x1848987627282816:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333176.448506:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+22:3654:x1848987627282816:12345-0@lo:2:osp-syn-1-1.0 Request processed in 77us (269us total) trans 17179871635 rc 0/0 00000100:00100000:0.0:1763333176.448513:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6651 00000004:00080000:0.0:1763333176.448544:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe434c5880/2, rc 0, transno 17179871635 00000100:00100000:0.0:1763333176.448548:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe434c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627282816:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1763333176.448555:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7403b480/2, rc 0, transno 21474838939 00000100:00100000:0.0:1763333176.448558:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7403b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627282688:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333176.448624:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+21:3653:x1848987627282560:12345-0@lo:2:osp-syn-1-1.0 Request processed in 715us (1001us total) trans 17179871634 rc 0/0 00000100:00100000:3.0:1763333176.448631:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6649 00000004:00080000:2.0:1763333176.448694:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe434c4380/2, rc 0, transno 17179871634 00000100:00100000:2.0:1763333176.448699:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe434c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627282560:0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1763333176.449588:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c57346 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1bd:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c84 expref: 243 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.449621:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bd:0x0].0x0 (ffff92ff61a46b00) 00010000:00010000:1.0:1763333176.449624:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763333176.449627:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48193c00, rc 0) 00000100:00100000:1.0:1763333176.449693:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:55917:x1848987613761536:12345-192.168.204.28@tcp:101:bash.0 Request processed in 9075us (9283us total) trans 4294972428 rc 0/0 00000100:00100000:1.0:1763333176.449702:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9438 00000100:00100000:1.0:1763333176.451798:0:28429:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe43998000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_013:lustre-OST0000_UUID:28429:1848987627282432:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333176.451816:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:1.0:1763333176.451830:0:28429:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c5734d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x246:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333176.451888:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613761792 00000100:00100000:3.0:1763333176.451895:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613761792 00010000:00010000:3.0:1763333176.451929:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96e00/0xb32e3ef184c570fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x246:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bb9 expref: 24 pid: 28600 timeout: 1380 lvb_type: 1 00000100:00100000:3.0:1763333176.451973:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3109 00000100:00100000:3.0:1763333176.451982:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:2421:x1848987613761792:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333176.451997:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333176.452017:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96e00/0xb32e3ef184c570fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x246:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bb9 expref: 24 pid: 28600 timeout: 1380 lvb_type: 1 00010000:00010000:3.0:1763333176.452028:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96e00/0xb32e3ef184c570fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x246:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bb9 expref: 24 pid: 28600 timeout: 1380 lvb_type: 1 00010000:00010000:3.0:1763333176.452057:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96e00/0xb32e3ef184c570fa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x246:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bb9 expref: 24 pid: 28600 timeout: 1380 lvb_type: 1 00010000:00010000:3.0:1763333176.452071:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333176.452074:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333176.452078:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c5734d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.452087:0:28428:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c5734d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.452118:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333176.452168:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2421:x1848987613761792:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 186us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333176.452175:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3109 00010000:00010000:1.0:1763333176.452210:0:28429:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c5734d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.452221:0:28429:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c5734d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1763333176.455525:0:24714:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838940 is committed 00000001:00080000:2.0:1763333176.455540:0:24714:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838939 is committed 00002000:00010000:1.0:1763333176.456440:0:28429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x246:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:1.0:1763333176.456456:0:28429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x246:0x0] updating lvb mtime from disk: 0 -> 1763333176 00002000:00010000:1.0:1763333176.456460:0:28429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x246:0x0] updating lvb ctime from disk: 0 -> 1763333176 00002000:00010000:1.0:1763333176.456462:0:28429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x246:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1763333176.456477:0:28429:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c5734d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.456489:0:28429:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c5734d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.456499:0:28429:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c5734d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.456506:0:28429:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea800 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333176.456510:0:28429:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c5734d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333176.456518:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:1.0:1763333176.456527:0:28429:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c5734d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.456547:0:28429:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c5734d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.456560:0:28429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c5734d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333176.456675:0:28429:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+10:2420:x1848987613761664:12345-192.168.204.28@tcp:4:lfs.0 Request processed in 15247us (16159us total) trans 21474838940 rc 0/0 00000100:00100000:1.0:1763333176.456687:0:28429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1638 00000100:00100000:0.0:1763333176.456781:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613761920 00000100:00100000:0.0:1763333176.456791:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613761920 00000100:00100000:0.0:1763333176.456846:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6652 00000100:00100000:0.0:1763333176.456856:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+10:55917:x1848987613761920:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333176.456873:0:28600:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333176.456893:0:28600:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe48192200/0xb32e3ef184c57354 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969c8b expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763333176.456909:0:28600:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x247:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333176.456925:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333176.456928:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333176.456937:0:28600:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe48192200/0xb32e3ef184c57354 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c8b expref: 11 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.456952:0:28600:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe48192200/0xb32e3ef184c57354 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c8b expref: 11 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.456962:0:28600:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48192200, rc 0) 00000100:00100000:0.0:1763333176.457002:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+11:55917:x1848987613761920:12345-192.168.204.28@tcp:101:bash.0 Request processed in 145us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333176.457009:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6652 00000100:00100000:3.0:1763333176.464544:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.464617:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613762048 00000100:00100000:0.0:1763333176.464628:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613762048 00000100:00100000:0.0:1763333176.466501:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6653 00000100:00100000:0.0:1763333176.466522:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:55917:x1848987613762048:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333176.466542:0:28600:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333176.466565:0:28600:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe48192400/0xb32e3ef184c5735b lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969c92 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763333176.466589:0:28600:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x247:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333176.466614:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333176.466616:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333176.466625:0:28600:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe48192400/0xb32e3ef184c5735b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c92 expref: 20 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.466640:0:28600:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe48192400/0xb32e3ef184c5735b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c92 expref: 20 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.466659:0:28600:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48192400, rc 0) 00000100:00100000:0.0:1763333176.467512:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:55917:x1848987613762048:12345-192.168.204.28@tcp:101:bash.0 Request processed in 994us (2973us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333176.467521:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6653 00000100:00100000:2.0:1763333176.471849:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333176.473236:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.473431:0:28429:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613762176 00000100:00100000:1.0:1763333176.473441:0:28429:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613762176 00002000:00010000:1.0:1763333176.473490:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/583 (0->18446744073709551615) 00002000:00100000:1.0:1763333176.473494:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4684c700 with x1848987613762176 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333176.473506:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe4684c700. 00000100:00100000:1.0:1763333176.473544:0:28429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1639 00000100:00100000:1.0:1763333176.473554:0:28429:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+11:2419:x1848987613762176:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:1.0:1763333176.473746:0:28429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x247:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333176.473750:0:28429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x247:0x0] updating lvb mtime from disk: 0 -> 1763333176 00002000:00010000:1.0:1763333176.473752:0:28429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x247:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333176.473755:0:28429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x247:0x0] updating lvb ctime from disk: 0 -> 1763333176 00002000:00010000:1.0:1763333176.473757:0:28429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x247:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333176.473814:0:28429:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:2419:x1848987613762176:12345-192.168.204.28@tcp:10:bash.0 Request processed in 262us (1975us total) trans 21474838941 rc 0/0 00000100:00100000:1.0:1763333176.473822:0:28429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1639 00002000:00010000:1.0:1763333176.473826:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/583 (0->18446744073709551615) 00002000:00100000:1.0:1763333176.473828:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4684c700 with x1848987613762176 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333176.473833:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe4684c700. 00000100:00100000:0.0:1763333176.474984:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613762304 00000100:00100000:0.0:1763333176.474993:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613762304 00002000:00010000:0.0:1763333176.475024:0:16635:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/583 (0->18446744073709551615) 00002000:00100000:0.0:1763333176.475028:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4684c380 with x1848987613762304 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333176.475036:0:16635:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe4684c380. 00000100:00100000:0.0:1763333176.475065:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1640 00000100:00100000:0.0:1763333176.475072:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2418:x1848987613762304:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:0.0:1763333176.475192:0:16635:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x247:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333176.475195:0:16635:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x247:0x0] updating lvb mtime from disk: 0 -> 1763333176 00002000:00010000:0.0:1763333176.475197:0:16635:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x247:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333176.475199:0:16635:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x247:0x0] updating lvb ctime from disk: 0 -> 1763333176 00002000:00010000:0.0:1763333176.475201:0:16635:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x247:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333176.475252:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2418:x1848987613762304:12345-192.168.204.28@tcp:10:bash.0 Request processed in 179us (2022us total) trans 17179871636 rc 0/0 00000100:00100000:0.0:1763333176.475259:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1640 00002000:00010000:0.0:1763333176.475262:0:16635:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/583 (0->18446744073709551615) 00002000:00100000:0.0:1763333176.475265:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4684c380 with x1848987613762304 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333176.475268:0:16635:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe4684c380. 00000100:00100000:3.0:1763333176.482283:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.482381:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613762560 00000100:00100000:1.0:1763333176.482394:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613762560 00000100:00100000:1.0:1763333176.482468:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9439 00000100:00100000:1.0:1763333176.482479:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:56886:x1848987613762560:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:1.0:1763333176.482539:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333176.482568:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57282 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1bc:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c37 expref: 243 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.482588:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:1.0:1763333176.482594:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333176.482658:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c57362 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333176.482672:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c57362 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.482683:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c57362 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00010000:1.0:1763333176.482808:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003559b91b reply state 00000000bb482697 transno 4294972429 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c57362 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.482820:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c57362 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.482827:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:1.0:1763333176.482829:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333176.482832:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763333176.482929:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56886:x1848987613762560:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 450us (654us total) trans 4294972429 rc 0/0 00000100:00100000:1.0:1763333176.482937:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9439 00000100:00100000:2.0:1763333176.485589:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.486545:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613762816 00000100:00100000:1.0:1763333176.486558:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613762816 00000100:00100000:1.0:1763333176.486621:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3224 00000100:00100000:1.0:1763333176.486631:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:55917:x1848987613762816:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:3.0:1763333176.487149:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.487284:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613762944 00000100:00100000:0.0:1763333176.487290:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613762944 00000100:00100000:0.0:1763333176.487328:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6654 00000100:00100000:0.0:1763333176.487365:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:56886:x1848987613762944:12345-192.168.204.28@tcp:101:lfs.0 00000100:00100000:1.0:1763333176.487372:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:55917:x1848987613762816:12345-192.168.204.28@tcp:35:bash.0 Request processed in 742us (1792us total) trans 4294972430 rc 0/0 00010000:00010000:0.0:1763333176.487377:0:28600:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1763333176.487379:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3224 00010000:00010000:0.0:1763333176.487398:0:28600:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c57369 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969c99 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763333176.487423:0:28600:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x246:0x0] initial LVB size: 4096, mtime: 0x691a5438, atime: 0x0, ctime: 0x691a5438, blocks: 0x8 00010000:00010000:0.0:1763333176.487442:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333176.487453:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333176.487462:0:28600:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c57369 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c99 expref: 13 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.487478:0:28600:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c57369 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c99 expref: 13 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.487492:0:28600:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4742e000, rc 0) 00000100:00100000:0.0:1763333176.487516:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:56886:x1848987613762944:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 181us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333176.487522:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6654 00000100:00100000:2.0:1763333176.496563:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333176.496933:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613763072 00000100:00100000:3.0:1763333176.496945:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613763072 00000100:00100000:3.0:1763333176.497631:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6655 00000100:00100000:3.0:1763333176.497646:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:56886:x1848987613763072:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333176.497666:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333176.497687:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c57370 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969ca0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.497718:0:8404:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c57101 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x246:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bc0 expref: 22 pid: 28600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333176.497728:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333176.497730:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333176.497736:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c57370 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ca0 expref: 22 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.497772:0:8404:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c57101 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x246:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bc0 expref: 22 pid: 28600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333176.497793:0:8404:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c57101 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x246:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bc0 expref: 22 pid: 28600 timeout: 1380 lvb_type: 1 00000100:00100000:3.0:1763333176.497807:0:8404:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7400fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8404:1848987627283072:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333176.497894:0:8404:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff49c92240 going to sleep for 11 seconds 00000100:00100000:2.0:1763333176.499171:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333176.499345:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613763200 00000100:00100000:3.0:1763333176.499589:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613763200 00000100:00100000:2.0:1763333176.502134:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9440 00000100:00100000:2.0:1763333176.502150:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56889:x1848987613763200:12345-192.168.204.28@tcp:101:rm.0 00010000:00010000:2.0:1763333176.502182:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333176.502207:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57377 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969ca7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.502302:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5737e lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333176.502315:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5737e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.502327:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5737e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.502339:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57385 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333176.502346:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57385 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.502393:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57385 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.502481:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5738c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1bd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333176.502491:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5738c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bd:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.502497:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5738c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bd:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:2.0:1763333176.502539:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1bd:0x0]: returning size 5 00000004:00200000:2.0:1763333176.502543:0:6519:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763333176.502561:0:6519:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5738c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bd:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.502572:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5738c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.502580:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5737e lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.502585:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5737e lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.502591:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5737e lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.502597:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5737e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.502602:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4a00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333176.502605:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5737e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.502612:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5737e lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.502623:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff621ac300) 00010000:00010000:2.0:1763333176.502626:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333176.502630:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5737e lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.502635:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5737e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.502649:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57385 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.502655:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57385 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.502660:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57385 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.502664:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333176.502667:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57385 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.502671:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57385 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.502678:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff621ac200) 00010000:00010000:2.0:1763333176.502681:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333176.502683:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57385 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.502689:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57385 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.502718:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57377 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ca7 expref: 247 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.502732:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5738c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ca7 expref: 246 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.502740:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bd:0x0].0x0 (ffff92ff61a46b00) 00010000:00010000:2.0:1763333176.502743:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333176.502745:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5e00, rc 0) 00000100:00100000:2.0:1763333176.502812:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56889:x1848987613763200:12345-192.168.204.28@tcp:101:rm.0 Request processed in 666us (3646us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333176.502820:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9440 00000100:00100000:2.0:1763333176.507109:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.507195:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613763328 00000100:00100000:1.0:1763333176.507207:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613763328 00010000:00010000:1.0:1763333176.507250:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c57101 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x246:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bc0 expref: 23 pid: 28600 timeout: 1380 lvb_type: 1 00000100:00100000:1.0:1763333176.507293:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3110 00000100:00100000:1.0:1763333176.507303:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2420:x1848987613763328:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333176.507319:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333176.507341:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c57101 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x246:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bc0 expref: 23 pid: 28600 timeout: 1380 lvb_type: 1 00010000:00010000:1.0:1763333176.507376:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c57101 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x246:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bc0 expref: 23 pid: 28600 timeout: 1380 lvb_type: 1 00010000:00010000:1.0:1763333176.507404:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333176.507406:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333176.507412:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c57370 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ca0 expref: 23 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.507421:0:28428:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c57370 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ca0 expref: 23 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.507478:0:28428:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c57370 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ca0 expref: 23 pid: 8404 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333176.507492:0:28428:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe434c6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:28428:1848987627283200:192.168.204.28@tcp:105: 00000100:00100000:1.0:1763333176.507568:0:28428:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff6be073c0 going to sleep for 11 seconds 00010000:00010000:3.0:1763333176.508227:0:8404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c57101 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x246:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bc0 expref: 23 pid: 28600 timeout: 1380 lvb_type: 1 00000100:00100000:3.0:1763333176.508243:0:8404:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7400fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8404:1848987627283072:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333176.508269:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c57370 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ca0 expref: 22 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.508279:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e800, rc 0) 00000100:00100000:3.0:1763333176.508330:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:56886:x1848987613763072:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 10689us (11778us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333176.508338:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6655 00000100:00100000:2.0:1763333176.510100:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.510532:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613763584 00000100:00100000:0.0:1763333176.510545:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613763584 00000100:00100000:0.0:1763333176.510613:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9441 00000100:00100000:0.0:1763333176.510625:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56889:x1848987613763584:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:0.0:1763333176.510688:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1763333176.510720:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c57346 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1bd:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c84 expref: 246 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.510746:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5738c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1bd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ca7 expref: 245 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.510760:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c57315 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1bd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c6f expref: 244 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.510771:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bd:0x0].0x0 (ffff92ff61a46b00) 00010000:00010000:0.0:1763333176.510781:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333176.510813:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0fc00/0xb32e3ef184c57393 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333176.510826:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0fc00/0xb32e3ef184c57393 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.510840:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0fc00/0xb32e3ef184c57393 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.510850:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0ea00/0xb32e3ef184c5739a lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333176.510857:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0ea00/0xb32e3ef184c5739a lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.510862:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0ea00/0xb32e3ef184c5739a lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.510950:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0ee00/0xb32e3ef184c573a1 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1bd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333176.510958:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0ee00/0xb32e3ef184c573a1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.510968:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0ee00/0xb32e3ef184c573a1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000040:00080000:0.0:1763333176.511224:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1452, 64 off122320 00000004:00080000:0.0:1763333176.511232:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1280590882619ns, next at 1281590880154ns, rc = 0 00000040:00080000:0.0:1763333176.511258:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1451, 64 off122320 00000040:00080000:0.0:1763333176.511270:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1452, 64 off122384 00000040:00080000:0.0:1763333176.511279:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1453, 64 off122384 00010000:00010000:0.0:1763333176.511343:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45f75a00/0xb32e3ef184c573a8 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1bd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333176.511398:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45f75a00/0xb32e3ef184c573a8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1bd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.511407:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45f75a00/0xb32e3ef184c573a8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1bd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.511414:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45f75a00/0xb32e3ef184c573a8 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1bd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.511420:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45f75a00/0xb32e3ef184c573a8 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1bd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.511427:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45f75a00/0xb32e3ef184c573a8 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1bd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.511455:0:6519:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763333176.511476:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0ee00/0xb32e3ef184c573a1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.511481:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0ee00/0xb32e3ef184c573a1 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1bd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.511487:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0ee00/0xb32e3ef184c573a1 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1bd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.511493:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77a0ee00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333176.511497:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0ee00/0xb32e3ef184c573a1 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1bd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.511504:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0ee00/0xb32e3ef184c573a1 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1bd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.511511:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bd:0x0].0x0 (ffff92fe44e12f00) 00010000:00010000:0.0:1763333176.511514:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1763333176.511518:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0ee00/0xb32e3ef184c573a1 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1bd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.511523:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0ee00/0xb32e3ef184c573a1 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1bd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.511648:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0fc00/0xb32e3ef184c57393 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.511655:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0fc00/0xb32e3ef184c57393 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.511660:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0fc00/0xb32e3ef184c57393 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.511666:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0fc00/0xb32e3ef184c57393 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.511670:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77a0fc00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333176.511673:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0fc00/0xb32e3ef184c57393 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.511677:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0fc00/0xb32e3ef184c57393 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.511688:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:0.0:1763333176.511691:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333176.511694:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0fc00/0xb32e3ef184c57393 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.511699:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0fc00/0xb32e3ef184c57393 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:0.0:1763333176.511711:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000008d3a0b58 reply state 00000000a6487f40 transno 4294972431 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0ea00/0xb32e3ef184c5739a lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.511721:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0ea00/0xb32e3ef184c5739a lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.511726:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe44e12700) 00010000:00010000:0.0:1763333176.511728:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333176.511731:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763333176.511818:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56889:x1848987613763584:12345-192.168.204.28@tcp:36:rm.0 Request processed in 1193us (1723us total) trans 4294972431 rc 0/0 00000100:00100000:0.0:1763333176.511831:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9441 00010000:00010000:2.0:1763333176.513064:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333176.513075:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45f75a00/0xb32e3ef184c573a8 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1bd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.513085:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45f75a00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333176.513089:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45f75a00/0xb32e3ef184c573a8 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1bd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.513096:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45f75a00/0xb32e3ef184c573a8 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1bd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.513111:0:8422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bd:0x0].0x0 (ffff92fe44e12f00) 00010000:00010000:2.0:1763333176.513114:0:8422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1763333176.513118:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45f75a00/0xb32e3ef184c573a8 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1bd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.513123:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45f75a00/0xb32e3ef184c573a8 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1bd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.513145:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333176.513147:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333176.513149:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763333176.514423:0:28428:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe434c6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:28428:1848987627283200:192.168.204.28@tcp:105: 00010000:00010000:1.0:1763333176.514457:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333176.514516:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2420:x1848987613763328:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 7214us (7417us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333176.514527:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3110 00000100:00100000:3.0:1763333176.519815:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333176.519866:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.520099:0:28429:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613763712 00000100:00100000:1.0:1763333176.520110:0:28429:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613763712 00002000:00010000:1.0:1763333176.520152:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/582 (5->18446744073709551615) 00002000:00100000:1.0:1763333176.520157:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7400fb80 with x1848987613763712 ext(5->18446744073709551615) 00002000:00010000:1.0:1763333176.520168:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7400fb80. 00000100:00100000:1.0:1763333176.520195:0:28429:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613763840 00000100:00100000:1.0:1763333176.520198:0:28429:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613763840 00002000:00010000:1.0:1763333176.520209:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/582 (0->18446744073709551615) 00002000:00100000:1.0:1763333176.520212:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7400f800 with x1848987613763840 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333176.520218:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff7400f800. 00000100:00100000:0.0:1763333176.520236:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1641 00000100:00100000:0.0:1763333176.520250:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2420:x1848987613763712:12345-192.168.204.28@tcp:10:lfs.0 00002000:00010000:0.0:1763333176.520578:0:16635:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x246:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:0.0:1763333176.520582:0:16635:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x246:0x0] updating lvb mtime from disk: 1763333176 -> 1763333176 00002000:00010000:0.0:1763333176.520585:0:16635:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x246:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333176.520587:0:16635:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x246:0x0] updating lvb ctime from disk: 1763333176 -> 1763333176 00002000:00010000:0.0:1763333176.520589:0:16635:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x246:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1763333176.520640:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2420:x1848987613763712:12345-192.168.204.28@tcp:10:lfs.0 Request processed in 394us (836us total) trans 21474838942 rc 0/0 00000100:00100000:1.0:1763333176.520912:0:28429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1642 00000100:00100000:1.0:1763333176.520922:0:28429:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2420:x1848987613763840:12345-192.168.204.28@tcp:10:lfs.0 00002000:00010000:1.0:1763333176.521027:0:28429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x246:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333176.521030:0:28429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x246:0x0] updating lvb mtime from disk: 0 -> 1763333176 00002000:00010000:1.0:1763333176.521033:0:28429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x246:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333176.521035:0:28429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x246:0x0] updating lvb ctime from disk: 0 -> 1763333176 00002000:00010000:1.0:1763333176.521038:0:28429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x246:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333176.521061:0:28429:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2420:x1848987613763840:12345-192.168.204.28@tcp:10:lfs.0 Request processed in 141us (1194us total) trans 17179871637 rc 0/0 00000100:00100000:1.0:1763333176.521067:0:28429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1642 00002000:00010000:1.0:1763333176.521071:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/582 (0->18446744073709551615) 00002000:00100000:1.0:1763333176.521074:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7400f800 with x1848987613763840 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333176.521085:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff7400f800. 00000100:00100000:0.0:1763333176.521798:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1641 00002000:00010000:0.0:1763333176.521804:0:16635:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/582 (5->18446744073709551615) 00002000:00100000:0.0:1763333176.521807:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7400fb80 with x1848987613763712 ext(5->18446744073709551615) 00002000:00010000:0.0:1763333176.521813:0:16635:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7400fb80. 00000100:00100000:2.0:1763333176.527553:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.527641:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613764096 00000100:00100000:1.0:1763333176.527652:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613764096 00000100:00100000:1.0:1763333176.527714:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9442 00000100:00100000:1.0:1763333176.527723:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56886:x1848987613764096:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:1.0:1763333176.527817:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c573af lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333176.527836:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c573af lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.527849:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c573af lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00010000:1.0:1763333176.527972:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a1c285e8 reply state 000000002c34c775 transno 4294972432 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c573af lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.527986:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c573af lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.527993:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:1.0:1763333176.527996:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333176.528000:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763333176.528108:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56886:x1848987613764096:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 385us (566us total) trans 4294972432 rc 0/0 00000100:00100000:1.0:1763333176.528115:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9442 00000100:00100000:3.0:1763333176.530397:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.530482:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613764224 00000100:00100000:0.0:1763333176.530493:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613764224 00000100:00100000:0.0:1763333176.530561:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6656 00000100:00100000:0.0:1763333176.530573:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2421:x1848987613764224:12345-192.168.204.28@tcp:2:lfs.0 00002000:00010000:0.0:1763333176.530772:0:8404:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x245:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1763333176.530776:0:8404:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x245:0x0] updating lvb mtime from disk: 1763333176 -> 1763333176 00002000:00010000:0.0:1763333176.530778:0:8404:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x245:0x0] updating lvb atime from disk: 0 -> 1763333176 00002000:00010000:0.0:1763333176.530781:0:8404:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x245:0x0] updating lvb ctime from disk: 1763333176 -> 1763333176 00002000:00010000:0.0:1763333176.530783:0:8404:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x245:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1763333176.530852:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2421:x1848987613764224:12345-192.168.204.28@tcp:2:lfs.0 Request processed in 280us (511us total) trans 17179871638 rc 0/0 00000100:00100000:0.0:1763333176.530861:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6656 00000100:00100000:3.0:1763333176.533276:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.533391:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613764480 00000100:00100000:1.0:1763333176.533401:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613764480 00000100:00100000:1.0:1763333176.533459:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3225 00000100:00100000:1.0:1763333176.533468:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc02450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56886:x1848987613764480:12345-192.168.204.28@tcp:35:lfs.0 00000004:00010000:1.0:1763333176.533526:0:19668:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x240000404:0x1bc:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c57212 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1bc:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c1b expref: 247 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.533569:0:19668:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c573b6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19668 initiator: MDT0 00010000:00010000:1.0:1763333176.533581:0:19668:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5724a lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c30 expref: 247 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.533592:0:19668:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c573b6 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19668 initiator: MDT1 00010000:00010000:1.0:1763333176.533631:0:19668:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5724a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c30 expref: 247 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.533644:0:19668:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5724a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c30 expref: 247 pid: 8606 timeout: 1380 lvb_type: 0 00000100:00100000:1.0:1763333176.533659:0:19668:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe434c6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:19668:1848987627283328:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333176.533744:0:19668:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff6be07780 going to sleep for 11 seconds 00000100:00100000:2.0:1763333176.539398:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333176.539434:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.539536:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613764736 00000100:00100000:0.0:1763333176.539548:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613764736 00000100:00100000:0.0:1763333176.539616:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9443 00000100:00100000:0.0:1763333176.539626:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:56890:x1848987613764736:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333176.539647:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333176.539670:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45f74c00/0xb32e3ef184c573bd lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969cae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.539735:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45f75a00/0xb32e3ef184c573c4 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333176.539749:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45f75a00/0xb32e3ef184c573c4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.539759:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45f75a00/0xb32e3ef184c573c4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.539769:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0fc00/0xb32e3ef184c573cb lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333176.539775:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0fc00/0xb32e3ef184c573cb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.539781:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0fc00/0xb32e3ef184c573cb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.539823:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45f75a00/0xb32e3ef184c573c4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.539829:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45f75a00/0xb32e3ef184c573c4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.539834:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45f75a00/0xb32e3ef184c573c4 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.539839:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45f75a00/0xb32e3ef184c573c4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.539844:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45f75a00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333176.539847:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45f75a00/0xb32e3ef184c573c4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.539853:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45f75a00/0xb32e3ef184c573c4 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.539867:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:0.0:1763333176.539870:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333176.539874:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45f75a00/0xb32e3ef184c573c4 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.539879:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45f75a00/0xb32e3ef184c573c4 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.539891:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0fc00/0xb32e3ef184c573cb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.539896:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0fc00/0xb32e3ef184c573cb lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.539901:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0fc00/0xb32e3ef184c573cb lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.539905:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77a0fc00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333176.539907:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0fc00/0xb32e3ef184c573cb lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.539912:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0fc00/0xb32e3ef184c573cb lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.539917:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe44e12700) 00010000:00010000:0.0:1763333176.539919:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333176.539922:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0fc00/0xb32e3ef184c573cb lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.539926:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0fc00/0xb32e3ef184c573cb lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.539947:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45f74c00/0xb32e3ef184c573bd lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969cae expref: 249 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.539967:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:0.0:1763333176.539970:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333176.539973:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45f74c00/0xb32e3ef184c573bd lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969cae expref: 249 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.539984:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45f74c00, rc 0) 00000100:00100000:0.0:1763333176.540032:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:56890:x1848987613764736:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 408us (597us total) trans 0 rc 301/301 00000100:00100000:0.0:1763333176.540038:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9443 00000100:00100000:3.0:1763333176.540300:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613764608 00000100:00100000:3.0:1763333176.540305:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613764608 00010000:00010000:3.0:1763333176.540327:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5724a lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c30 expref: 248 pid: 8606 timeout: 1380 lvb_type: 0 00000100:00100000:3.0:1763333176.540387:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3111 00000100:00100000:3.0:1763333176.540394:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff44f0b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:2421:x1848987613764608:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333176.540404:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333176.540410:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5724a lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c30 expref: 248 pid: 8606 timeout: 1380 lvb_type: 0 00010000:00010000:3.0:1763333176.540420:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5724a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c30 expref: 248 pid: 8606 timeout: 1380 lvb_type: 0 00010000:00010000:3.0:1763333176.540433:0:28428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:3.0:1763333176.540437:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c573b6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 19668 initiator: MDT1 00010000:00010000:3.0:1763333176.540453:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c573b6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 19668 initiator: MDT1 00010000:00010000:3.0:1763333176.540460:0:28428:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c573b6 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 19668 initiator: MDT1 00010000:00010000:3.0:1763333176.540476:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333176.540498:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff44f0b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:2421:x1848987613764608:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 105us (1109us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333176.540504:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3111 00010000:00010000:1.0:1763333176.541498:0:19668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5724a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c30 expref: 247 pid: 8606 timeout: 1380 lvb_type: 0 00000100:00100000:1.0:1763333176.541521:0:19668:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe434c6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:19668:1848987627283328:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333176.541543:0:19668:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c573b6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19668 initiator: MDT1 00010000:00010000:1.0:1763333176.541552:0:19668:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c573b6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19668 initiator: MDT1 00010000:00010000:1.0:1763333176.541557:0:19668:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c573b6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19668 initiator: MDT1 00000040:00080000:1.0:1763333176.541760:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1453, 88 off122472 00000004:00080000:1.0:1763333176.541767:0:19668:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1280621417735ns, next at 1280856550572ns, rc = 0 00000100:00100000:3.0:1763333176.542842:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.542972:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613764864 00000100:00100000:0.0:1763333176.542981:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613764864 00000100:00100000:0.0:1763333176.543024:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9444 00000100:00100000:0.0:1763333176.543031:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56890:x1848987613764864:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333176.543049:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333176.543070:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0ee00/0xb32e3ef184c573d2 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969cb5 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.543127:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c573d9 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333176.543139:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c573d9 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.543149:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c573d9 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.543160:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c573e0 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333176.543172:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c573e0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.543177:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c573e0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.543206:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c573d9 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.543212:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c573d9 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.543217:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c573d9 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.543224:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c573d9 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.543229:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48193c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333176.543233:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c573d9 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.543239:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c573d9 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.543249:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12100) 00010000:00010000:0.0:1763333176.543251:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333176.543255:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c573d9 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.543260:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193c00/0xb32e3ef184c573d9 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.543270:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c573e0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.543276:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c573e0 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.543282:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c573e0 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.543286:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c85e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333176.543289:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c573e0 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.543294:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c573e0 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.543299:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe44e12700) 00010000:00010000:0.0:1763333176.543301:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333176.543304:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c573e0 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.543309:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c573e0 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.543329:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0ee00/0xb32e3ef184c573d2 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969cb5 expref: 248 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.543337:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12100) 00010000:00010000:0.0:1763333176.543339:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333176.543342:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0ee00/0xb32e3ef184c573d2 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969cb5 expref: 248 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.543371:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77a0ee00, rc 0) 00000100:00100000:0.0:1763333176.543418:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56890:x1848987613764864:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 386us (580us total) trans 0 rc 301/301 00000100:00100000:0.0:1763333176.543424:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9444 00000040:00080000:1.0:1763333176.543897:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1454, 88 off122472 00000004:00080000:1.0:1763333176.543906:0:19668:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1280623556601ns, next at 1281590880154ns, rc = 0 00000040:00080000:1.0:1763333176.543929:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1455, 88 off122560 00000004:00080000:1.0:1763333176.543932:0:19668:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1280623583375ns, next at 1281590880154ns, rc = 0 00000040:00080000:1.0:1763333176.543944:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1454, 88 off122560 00000004:00080000:1.0:1763333176.543947:0:19668:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1280623597806ns, next at 1280856550572ns, rc = 0 00000001:00080000:1.0:1763333176.545954:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972433 is committed 00000004:00080000:1.0:1763333176.545965:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 951 committed 00000004:00080000:1.0:1763333176.547570:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 955 committed 00010000:00010000:3.0:1763333176.547691:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c57362 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.547703:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c57362 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.547711:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c57362 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.547716:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333176.547720:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c57362 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.547727:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c57362 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.547742:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:3.0:1763333176.547745:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333176.547750:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c57362 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.547756:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c57362 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.547776:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0ea00/0xb32e3ef184c5739a lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333176.547782:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0ea00/0xb32e3ef184c5739a lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333176.547787:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0ea00/0xb32e3ef184c5739a lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333176.547792:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77a0ea00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333176.547794:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0ea00/0xb32e3ef184c5739a lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333176.547799:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0ea00/0xb32e3ef184c5739a lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333176.547806:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe44e12700) 00010000:00010000:3.0:1763333176.547809:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333176.547811:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0ea00/0xb32e3ef184c5739a lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333176.547816:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77a0ea00/0xb32e3ef184c5739a lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333176.547830:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c573af lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.547836:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c573af lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.547841:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c573af lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.547845:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feaa00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333176.547848:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c573af lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.547853:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c573af lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.547859:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:3.0:1763333176.547860:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333176.547863:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c573af lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.547868:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c573af lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000100:00100000:2.0:1763333176.548058:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4684f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627283584:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763333176.548136:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333176.548169:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1763333176.548173:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4684ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627283712:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333176.548190:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333176.548218:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627283584 00000100:00100000:2.0:1763333176.548225:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627283584 00000100:00100000:2.0:1763333176.548260:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627283712 00000100:00100000:2.0:1763333176.548262:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627283712 00000100:00100000:2.0:1763333176.548279:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6657 00000100:00100000:2.0:1763333176.548286:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75666300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+22:3654:x1848987627283584:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1763333176.548308:0:28600:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:584 count 1 00002000:00010000:2.0:1763333176.548338:0:28600:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x248:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763333176.548345:0:28600:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c573e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.548380:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333176.548382:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333176.548388:0:28600:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c573e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.548400:0:28600:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c573e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.548408:0:28600:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c573e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.548414:0:28600:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c573e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.548435:0:28600:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763333176.548624:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75666300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+23:3654:x1848987627283584:12345-0@lo:6:osp-syn-1-1.0 Request processed in 337us (487us total) trans 17179871639 rc 0/0 00000100:00100000:2.0:1763333176.548631:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6657 00000100:00100000:2.0:1763333176.548647:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6658 00000100:00100000:2.0:1763333176.548652:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75664000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+22:3654:x1848987627283712:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1763333176.548713:0:28600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x245:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1763333176.548716:0:28600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x245:0x0] updating lvb mtime from disk: 1763333176 -> 1763333176 00002000:00010000:2.0:1763333176.548719:0:28600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x245:0x0] updating lvb atime from disk: 1763333176 -> 1763333176 00002000:00010000:2.0:1763333176.548722:0:28600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x245:0x0] updating lvb ctime from disk: 1763333176 -> 1763333176 00002000:00010000:2.0:1763333176.548724:0:28600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x245:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1763333176.548746:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75664000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+23:3654:x1848987627283712:12345-0@lo:2:osp-syn-1-1.0 Request processed in 94us (555us total) trans 17179871640 rc 0/0 00000100:00100000:2.0:1763333176.548753:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6658 00010000:00010000:2.0:1763333176.548771:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333176.548776:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c573e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.548783:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5c00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333176.548788:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c573e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.548795:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c573e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.548811:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c573e7 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.548818:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c573e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.548831:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333176.548832:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333176.548834:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763333176.548857:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4684ce00/2, rc 0, transno 17179871640 00000100:00100000:2.0:1763333176.548862:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4684ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627283712:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1763333176.548869:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4684f480/2, rc 0, transno 17179871639 00000100:00100000:2.0:1763333176.548872:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4684f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627283584:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1763333176.548925:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 954 committed 00000100:00100000:3.0:1763333176.549582:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4684fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627283456:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763333176.549616:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333176.549637:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763333176.549642:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4684c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627283840:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333176.549657:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333176.549823:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627283456 00000100:00100000:0.0:1763333176.549828:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627283456 00000100:00100000:0.0:1763333176.549850:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627283840 00000100:00100000:0.0:1763333176.549853:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627283840 00000100:00100000:0.0:1763333176.549867:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6659 00000100:00100000:0.0:1763333176.549872:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+24:3653:x1848987627283456:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1763333176.549886:0:17605:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:583 count 1 00010000:00010000:0.0:1763333176.549901:0:17605:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c573ee lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x247:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.549915:0:17605:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe48192400/0xb32e3ef184c5735b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x247:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c92 expref: 22 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.549922:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333176.549924:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333176.549927:0:17605:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c573ee lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x247:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.549958:0:17605:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe48192400/0xb32e3ef184c5735b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x247:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c92 expref: 22 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.549970:0:17605:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe48192400/0xb32e3ef184c5735b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x247:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c92 expref: 22 pid: 28600 timeout: 1380 lvb_type: 0 00000100:00100000:0.0:1763333176.549982:0:17605:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77b14380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17605:1848987627284480:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333176.550030:0:17605:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe46e0e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763333176.550046:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6660 00000100:00100000:0.0:1763333176.550052:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+24:3653:x1848987627283840:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1763333176.550122:0:8611:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x246:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333176.550125:0:8611:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x246:0x0] updating lvb mtime from disk: 1763333176 -> 1763333176 00002000:00010000:0.0:1763333176.550128:0:8611:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x246:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333176.550129:0:8611:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x246:0x0] updating lvb ctime from disk: 1763333176 -> 1763333176 00002000:00010000:0.0:1763333176.550132:0:8611:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x246:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333176.550155:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+25:3653:x1848987627283840:12345-0@lo:2:osp-syn-1-1.0 Request processed in 104us (497us total) trans 17179871641 rc 0/0 00000100:00100000:0.0:1763333176.550161:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6660 00000100:00100000:0.0:1763333176.550182:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627284224:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333176.550201:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333176.550215:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1763333176.550219:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627284096:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763333176.550235:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333176.550251:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627284224 00000100:00100000:0.0:1763333176.550254:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627284224 00000100:00100000:0.0:1763333176.550272:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627284096 00000100:00100000:0.0:1763333176.550274:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627284096 00000100:00100000:0.0:1763333176.550286:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6661 00000100:00100000:0.0:1763333176.550290:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+6:3655:x1848987627284224:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1763333176.550374:0:29013:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x245:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333176.550377:0:29013:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x245:0x0] updating lvb mtime from disk: 1763333176 -> 1763333176 00002000:00010000:0.0:1763333176.550380:0:29013:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x245:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333176.550381:0:29013:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x245:0x0] updating lvb ctime from disk: 1763333176 -> 1763333176 00002000:00010000:0.0:1763333176.550383:0:29013:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x245:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333176.550408:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+7:3655:x1848987627284224:12345-0@lo:2:osp-syn-0-1.0 Request processed in 117us (206us total) trans 21474838943 rc 0/0 00000100:00100000:0.0:1763333176.550414:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6661 00000100:00100000:0.0:1763333176.550425:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6662 00000100:00100000:0.0:1763333176.550430:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+6:3655:x1848987627284096:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1763333176.550439:0:29013:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:584 count 1 00002000:00010000:0.0:1763333176.550466:0:29013:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x248:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333176.550471:0:29013:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84c00/0xb32e3ef184c573f5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.550479:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333176.550481:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333176.550485:0:29013:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84c00/0xb32e3ef184c573f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.550495:0:29013:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84c00/0xb32e3ef184c573f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.550503:0:29013:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84c00/0xb32e3ef184c573f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.550511:0:29013:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84c00/0xb32e3ef184c573f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.550524:0:29013:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763333176.550635:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+7:3655:x1848987627284096:12345-0@lo:6:osp-syn-0-1.0 Request processed in 204us (398us total) trans 21474838944 rc 0/0 00000100:00100000:0.0:1763333176.550641:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6662 00000100:00100000:0.0:1763333176.550667:0:3655:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474838939 gen 2 00000004:00080000:0.0:1763333176.550672:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4920d180, transno 21474838899 00000004:00080000:0.0:1763333176.550678:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4920f100, transno 21474838900 00000004:00080000:0.0:1763333176.550680:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44de0380, transno 21474838901 00000004:00080000:0.0:1763333176.550683:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4920ce00, transno 21474838902 00000004:00080000:0.0:1763333176.550685:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe45181c00, transno 21474838904 00000004:00080000:0.0:1763333176.550687:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe45180a80, transno 21474838905 00000004:00080000:0.0:1763333176.550690:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44de1c00, transno 21474838906 00000004:00080000:0.0:1763333176.550692:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44de2a00, transno 21474838907 00000004:00080000:0.0:1763333176.550694:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44de1f80, transno 21474838908 00000004:00080000:0.0:1763333176.550697:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46e2ed80, transno 21474838909 00000004:00080000:0.0:1763333176.550699:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46a6e300, transno 21474838910 00000004:00080000:0.0:1763333176.550701:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46e2dc00, transno 21474838911 00000004:00080000:0.0:1763333176.550704:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7dcfed80, transno 21474838914 00000004:00080000:0.0:1763333176.550706:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe42f0d180, transno 21474838915 00000004:00080000:0.0:1763333176.550708:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe49609880, transno 21474838916 00000004:00080000:0.0:1763333176.550710:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4960b100, transno 21474838917 00000004:00080000:0.0:1763333176.550713:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff77b17100, transno 21474838921 00000004:00080000:0.0:1763333176.550715:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff77b14e00, transno 21474838922 00000004:00080000:0.0:1763333176.550717:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff77b15c00, transno 21474838923 00000004:00080000:0.0:1763333176.550719:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff77b16680, transno 21474838924 00000004:00080000:0.0:1763333176.550721:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe49608a80, transno 21474838925 00000004:00080000:0.0:1763333176.550723:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4960bb80, transno 21474838926 00000004:00080000:0.0:1763333176.550726:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe49608700, transno 21474838927 00000004:00080000:0.0:1763333176.550728:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4960b480, transno 21474838928 00000004:00080000:0.0:1763333176.550732:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46e2c380, transno 21474838931 00000004:00080000:0.0:1763333176.550734:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46e2e300, transno 21474838932 00000004:00080000:0.0:1763333176.550736:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46e2d180, transno 21474838933 00000004:00080000:0.0:1763333176.550738:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46e2ea00, transno 21474838934 00000004:00080000:0.0:1763333176.550741:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe469a2a00, transno 21474838936 00000004:00080000:0.0:1763333176.550744:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe469a0380, transno 21474838937 00000004:00080000:0.0:1763333176.550746:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7403a300, transno 21474838938 00000004:00080000:0.0:1763333176.550748:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7403b480, transno 21474838939 00000100:00100000:0.0:1763333176.550754:0:3655:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff92fe44e05180 x1848987627284096/t21474838944(21474838944) o6->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1763333192 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1763333176.550764:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44e05180/2, rc 0, transno 21474838944 00000100:00100000:0.0:1763333176.550768:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627284096:0@lo:6:osp-syn-0-1.0 00000004:00080000:0.0:1763333176.550777:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44e04000/2, rc 0, transno 21474838943 00000100:00100000:0.0:1763333176.550781:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627284224:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1763333176.550930:0:8604:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 4 in progress, 2 in flight, 32 done 00000004:00080000:1.0:1763333176.551068:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 950 committed 00000004:00080000:1.0:1763333176.551080:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 953 committed 00000100:00100000:1.0:1763333176.551100:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627284352:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333176.551128:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333176.551143:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763333176.551147:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627283968:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763333176.551162:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333176.551178:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627284352 00000100:00100000:1.0:1763333176.551182:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627284352 00000100:00100000:1.0:1763333176.551199:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627283968 00000100:00100000:1.0:1763333176.551201:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627283968 00000100:00100000:1.0:1763333176.551213:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6663 00000100:00100000:1.0:1763333176.551218:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+8:3652:x1848987627284352:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1763333176.551272:0:28650:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x246:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1763333176.551275:0:28650:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x246:0x0] updating lvb mtime from disk: 1763333176 -> 1763333176 00002000:00010000:1.0:1763333176.551277:0:28650:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x246:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333176.551279:0:28650:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x246:0x0] updating lvb ctime from disk: 1763333176 -> 1763333176 00002000:00010000:1.0:1763333176.551282:0:28650:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x246:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1763333176.551305:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+9:3652:x1848987627284352:12345-0@lo:2:osp-syn-0-1.0 Request processed in 86us (176us total) trans 21474838945 rc 0/0 00000100:00100000:1.0:1763333176.551310:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6663 00000100:00100000:1.0:1763333176.551321:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6664 00000100:00100000:1.0:1763333176.551326:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+8:3652:x1848987627283968:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1763333176.551335:0:28650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:583 count 1 00010000:00010000:1.0:1763333176.551344:0:28650:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c573fc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x247:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.551376:0:28650:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe48192200/0xb32e3ef184c57354 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x247:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c8b expref: 13 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.551384:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333176.551385:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333176.551388:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c573fc lrc: 4/0,1 mode: --/PW res: [0x280000400:0x247:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.551410:0:28650:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe48192200/0xb32e3ef184c57354 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x247:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c8b expref: 13 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.551420:0:28650:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe48192200/0xb32e3ef184c57354 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x247:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c8b expref: 13 pid: 28600 timeout: 1380 lvb_type: 0 00000100:00100000:1.0:1763333176.551431:0:28650:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe434c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28650:1848987627284608:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333176.551476:0:28650:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff6b0c2540 going to sleep for 11 seconds 00000004:00080000:1.0:1763333176.551494:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff77b16300/2, rc 0, transno 21474838945 00000100:00100000:1.0:1763333176.551498:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627284352:0@lo:2:osp-syn-0-1.0 00000004:00010000:1.0:1763333176.551526:0:19668:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009ff6f6c7 reply state 0000000005171bed transno 4294972433 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c573b6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19668 initiator: MDT1 00010000:00010000:1.0:1763333176.551540:0:19668:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c573b6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19668 initiator: MDT1 00010000:00010000:1.0:1763333176.551549:0:19668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:1.0:1763333176.551552:0:19668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1763333176.551555:0:19668:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763333176.551560:0:19668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:1.0:1763333176.551563:0:19668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763333176.551566:0:19668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48193400/0xb32e3ef184c57212 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1bc:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c1b expref: 239 pid: 12741 timeout: 0 lvb_type: 0 00010000:00080000:1.0:1763333176.551622:0:19668:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1763333176.551632:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc02450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56886:x1848987613764480:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 18166us (18368us total) trans 4294972433 rc 0/0 00000100:00100000:1.0:1763333176.551643:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3225 00010000:00010000:3.0:1763333176.551746:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c573b6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19668 initiator: MDT1 00010000:00010000:3.0:1763333176.551754:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c573b6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19668 initiator: MDT1 00010000:00010000:3.0:1763333176.551760:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c573b6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19668 initiator: MDT1 00010000:00010000:3.0:1763333176.551766:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333176.551770:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c573b6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19668 initiator: MDT1 00010000:00010000:3.0:1763333176.551776:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c573b6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19668 initiator: MDT1 00010000:00010000:3.0:1763333176.551785:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:3.0:1763333176.551787:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763333176.551790:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c573b6 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19668 initiator: MDT1 00010000:00010000:3.0:1763333176.551796:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c573b6 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19668 initiator: MDT1 00000004:00080000:3.0:1763333176.551823:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4684c000/2, rc 0, transno 17179871641 00000100:00100000:3.0:1763333176.551828:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4684c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627283840:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333176.551871:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.552036:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613764992 00000100:00100000:1.0:1763333176.552040:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613764992 00000100:00100000:1.0:1763333176.552076:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9445 00000100:00100000:1.0:1763333176.552082:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+238:56890:x1848987613764992:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333176.552093:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333176.552108:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57403 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969cbc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.552149:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c5740a lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333176.552158:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c5740a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.552166:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c5740a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:1.0:1763333176.552197:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1763333176.552201:0:6519:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1763333176.552223:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57403 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969cbc expref: 240 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.552236:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c5740a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969cbc expref: 239 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.552243:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff62250e00) 00010000:00010000:1.0:1763333176.552245:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1763333176.552247:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff4148e600, rc 0) 00000100:00100000:1.0:1763333176.552270:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56890:x1848987613764992:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 189us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333176.552276:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9445 00010000:00010000:2.0:1763333176.552680:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333176.552688:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84c00/0xb32e3ef184c573f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.552696:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c84c00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333176.552700:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84c00/0xb32e3ef184c573f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.552707:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84c00/0xb32e3ef184c573f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.552719:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84c00/0xb32e3ef184c573f5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.552731:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84c00/0xb32e3ef184c573f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.552747:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333176.552749:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333176.552750:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763333176.556642:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333176.556757:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613765120 00000100:00100000:2.0:1763333176.556766:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613765120 00010000:00010000:2.0:1763333176.556805:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe48192400/0xb32e3ef184c5735b lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x247:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c92 expref: 23 pid: 28600 timeout: 1380 lvb_type: 0 00000100:00100000:2.0:1763333176.556835:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3112 00000100:00100000:2.0:1763333176.556842:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2421:x1848987613765120:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333176.556856:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333176.556861:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe48192400/0xb32e3ef184c5735b lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x247:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c92 expref: 23 pid: 28600 timeout: 1380 lvb_type: 0 00010000:00010000:2.0:1763333176.556873:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe48192400/0xb32e3ef184c5735b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x247:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c92 expref: 23 pid: 28600 timeout: 1380 lvb_type: 0 00010000:00010000:2.0:1763333176.556896:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333176.556897:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333176.556902:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c573ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x247:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.556912:0:6506:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c573ee lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x247:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.556935:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333176.556996:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2421:x1848987613765120:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 154us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333176.557003:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3112 00010000:00010000:0.0:1763333176.557098:0:17605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe48192400/0xb32e3ef184c5735b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x247:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c92 expref: 22 pid: 28600 timeout: 1380 lvb_type: 0 00000100:00100000:0.0:1763333176.557112:0:17605:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77b14380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17605:1848987627284480:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333176.557133:0:17605:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c573ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.557143:0:17605:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c573ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.557150:0:17605:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c573ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.557158:0:17605:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c573ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.557172:0:17605:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c573ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.557195:0:17605:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763333176.557416:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+25:3653:x1848987627283456:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7541us (7797us total) trans 17179871642 rc 0/0 00000100:00100000:0.0:1763333176.557423:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6659 00000004:00080000:0.0:1763333176.557467:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4684fb80/2, rc 0, transno 17179871642 00000100:00100000:0.0:1763333176.557472:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4684fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627283456:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1763333176.557929:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333176.557936:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c573ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.557944:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c85e00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333176.557949:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c573ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.557957:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c573ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.557969:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c573ee lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.557976:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c573ee lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.557993:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333176.557994:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333176.557996:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763333176.558197:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.558252:0:28650:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe434c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28650:1848987627284608:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333176.558267:0:28650:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c573fc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x247:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333176.558307:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613765248 00000100:00100000:3.0:1763333176.558311:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613765248 00010000:00010000:3.0:1763333176.558333:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe48192200/0xb32e3ef184c57354 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x247:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c8b expref: 14 pid: 28600 timeout: 1380 lvb_type: 0 00000100:00100000:3.0:1763333176.558380:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3113 00000100:00100000:3.0:1763333176.558387:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2419:x1848987613765248:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333176.558396:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333176.558551:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe48192200/0xb32e3ef184c57354 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x247:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c8b expref: 14 pid: 28600 timeout: 1380 lvb_type: 0 00010000:00010000:3.0:1763333176.558563:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe48192200/0xb32e3ef184c57354 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x247:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c8b expref: 14 pid: 28600 timeout: 1380 lvb_type: 0 00010000:00010000:3.0:1763333176.558578:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe48192200/0xb32e3ef184c57354 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x247:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c8b expref: 14 pid: 28600 timeout: 1380 lvb_type: 0 00010000:00010000:3.0:1763333176.558587:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333176.558589:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333176.558592:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c573fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x247:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.558600:0:28428:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c573fc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x247:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333176.558792:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.558814:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.558831:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613765376 00000100:00100000:1.0:1763333176.558835:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613765376 00000100:00100000:1.0:1763333176.558856:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613765504 00000100:00100000:1.0:1763333176.558858:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613765504 00000100:00100000:1.0:1763333176.558872:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9446 00000100:00100000:1.0:1763333176.558877:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:56890:x1848987613765376:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333176.558891:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333176.558905:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c57411 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969cc3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.558990:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c57418 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333176.559002:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c57418 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.559010:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c57418 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.559022:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5741f lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333176.559029:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5741f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.559035:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5741f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.559069:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c57418 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.559074:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c57418 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.559084:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c57418 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.559090:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c57418 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.559095:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdea00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333176.559098:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c57418 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.559104:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c57418 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.559111:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff62250e00) 00010000:00010000:1.0:1763333176.559115:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333176.559118:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c57418 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.559124:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c57418 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.559134:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5741f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.559140:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5741f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.559145:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5741f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.559149:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333176.559152:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5741f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.559157:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5741f lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.559162:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff62250f00) 00010000:00010000:1.0:1763333176.559164:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333176.559166:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5741f lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.559171:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5741f lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.559194:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c57411 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969cc3 expref: 241 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.559202:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff62250e00) 00010000:00010000:1.0:1763333176.559204:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333176.559207:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c57411 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969cc3 expref: 241 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.559214:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff4148ee00, rc 0) 00000100:00100000:1.0:1763333176.559249:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:56890:x1848987613765376:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 371us (457us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333176.559256:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9446 00000100:00100000:1.0:1763333176.559270:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9447 00000100:00100000:1.0:1763333176.559276:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+239:56886:x1848987613765504:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333176.559285:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333176.559292:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c57426 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969cca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.559319:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c57426 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969cca expref: 240 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.559328:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdee00/0xb32e3ef184c57426 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969cca expref: 240 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.559342:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:1.0:1763333176.559344:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763333176.559365:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdee00, rc 0) 00000100:00100000:1.0:1763333176.559382:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:56886:x1848987613765504:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 106us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333176.559387:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9447 00010000:00010000:2.0:1763333176.560121:0:28650:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c573fc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x247:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.560137:0:28650:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c573fc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x247:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.560146:0:28650:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c573fc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x247:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.560152:0:28650:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c573fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x247:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.560178:0:28650:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763333176.560393:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+9:3652:x1848987627283968:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9066us (9229us total) trans 21474838946 rc 0/0 00000100:00100000:2.0:1763333176.560402:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6664 00010000:00010000:0.0:1763333176.560529:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333176.560536:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c573fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x247:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.560544:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feba00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333176.560548:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c573fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x247:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.560555:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c573fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x247:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.560569:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c573fc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x247:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.560575:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333176.560577:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333176.560579:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333176.560651:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c573fc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x247:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.560676:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333176.560715:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2419:x1848987613765248:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 2327us (2518us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333176.560724:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3113 00000004:00080000:1.0:1763333176.561254:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44e06a00/2, rc 0, transno 21474838946 00000100:00100000:1.0:1763333176.561261:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627283968:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763333176.572161:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333176.572234:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613765760 00000100:00100000:2.0:1763333176.572247:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613765760 00000100:00100000:2.0:1763333176.572326:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3226 00000100:00100000:2.0:1763333176.572336:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+240:56886:x1848987613765760:12345-192.168.204.28@tcp:35:lfs.0 00000004:00080000:2.0:1763333176.572746:0:19668:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x1bc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1763333176.572807:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1455, 64 off122624 00000040:00080000:2.0:1763333176.572829:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1456, 64 off122624 00000040:00080000:2.0:1763333176.572837:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1457, 64 off122688 00000040:00080000:2.0:1763333176.572844:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1456, 64 off122688 00010000:00010000:2.0:1763333176.572907:0:19668:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5742d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19668 initiator: MDT0 00010000:00010000:2.0:1763333176.572925:0:19668:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5742d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1bc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333176.572941:0:19668:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5742d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1bc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333176.572949:0:19668:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5742d lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1bc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333176.572955:0:19668:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5742d lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1bc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333176.572961:0:19668:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5742d lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1bc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333176.572994:0:19668:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763333176.573194:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56886:x1848987613765760:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 858us (1042us total) trans 4294972434 rc 0/0 00000100:00100000:2.0:1763333176.573203:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3226 00010000:00010000:0.0:1763333176.573391:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333176.573399:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5742d lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1bc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333176.573407:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5c00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333176.573410:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5742d lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1bc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333176.573418:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5742d lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1bc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333176.573430:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bc:0x0].0x0 (ffff92ff8016f000) 00010000:00010000:0.0:1763333176.573433:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763333176.573438:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5742d lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1bc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333176.573452:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5742d lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1bc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333176.573463:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333176.573465:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333176.573466:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763333176.574720:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333176.574892:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613766016 00000100:00100000:3.0:1763333176.574903:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613766016 00000100:00100000:3.0:1763333176.574975:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9448 00000100:00100000:3.0:1763333176.574995:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+241:56890:x1848987613766016:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333176.575026:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333176.575032:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763333176.575064:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c5740a lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969cbc expref: 241 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.575086:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff62250e00) 00010000:00010000:3.0:1763333176.575097:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333176.575116:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c57434 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969cd1 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.575253:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c5743b lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333176.575264:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c5743b lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.575273:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c5743b lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.575284:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c57442 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333176.575290:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c57442 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.575296:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c57442 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.575887:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c57449 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333176.575897:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c57449 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.575905:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c57449 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:3.0:1763333176.575915:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1bf:0x0]: returning size 0 00010000:00010000:3.0:1763333176.575943:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c5743b lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.575949:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c5743b lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.575955:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c5743b lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.575962:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c5743b lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.575968:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333176.575972:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c5743b lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.575978:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c5743b lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.576049:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff8016f200) 00010000:00010000:3.0:1763333176.576052:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333176.576057:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c5743b lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.576063:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c5743b lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000004:00010000:3.0:1763333176.576076:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000cd1d9fd6 reply state 00000000f876871a transno 4294972435 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c57442 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.576087:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c57442 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.576093:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff8016f700) 00010000:00010000:3.0:1763333176.576095:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763333176.576098:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763333176.576135:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c57434 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969cd1 expref: 243 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.576154:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c57449 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969cd1 expref: 242 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.576161:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bf:0x0].0x0 (ffff92ff8016f400) 00010000:00010000:3.0:1763333176.576164:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333176.576166:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e000, rc 0) 00000100:00100000:3.0:1763333176.576241:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:56890:x1848987613766016:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1256us (1528us total) trans 4294972435 rc 0/0 00000100:00100000:3.0:1763333176.576249:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9448 00000100:00100000:1.0:1763333176.580158:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333176.580277:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613766272 00000100:00100000:3.0:1763333176.580288:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613766272 00000100:00100000:3.0:1763333176.580379:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9449 00000100:00100000:3.0:1763333176.580390:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:56890:x1848987613766272:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333176.580428:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333176.580461:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c57457 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1bf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969cd8 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.580647:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5745e lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1bf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333176.580666:0:12741:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c57449 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969cd1 expref: 244 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.580675:0:12741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5745e lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.580718:0:12741:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c57449 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969cd1 expref: 244 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.580732:0:12741:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c57449 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969cd1 expref: 244 pid: 12741 timeout: 1380 lvb_type: 0 00000100:00100000:3.0:1763333176.580749:0:12741:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77c6d180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627284736:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333176.580852:0:12741:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff49c92b40 going to sleep for 11 seconds 00000100:00100000:1.0:1763333176.582264:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.583118:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613766528 00000100:00100000:0.0:1763333176.583134:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613766528 00000100:00100000:0.0:1763333176.583518:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9450 00000100:00100000:0.0:1763333176.583529:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56886:x1848987613766528:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333176.583553:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333176.583576:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57465 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1bf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969cdf expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.583708:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c5746c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333176.583723:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c5746c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.583735:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c5746c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:0.0:1763333176.583746:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1bf:0x0]: returning size 0 00010000:00010000:0.0:1763333176.583841:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c5746c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.583848:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c5746c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.583855:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c5746c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.583860:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c84e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333176.583864:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c5746c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.583871:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c5746c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.583884:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bf:0x0].0x0 (ffff92ff8016f400) 00010000:00010000:0.0:1763333176.583887:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1763333176.583892:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c5746c lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.583898:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c5746c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.583948:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57465 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1bf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969cdf expref: 247 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.583959:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bf:0x0].0x0 (ffff92ff8016f400) 00010000:00010000:0.0:1763333176.583962:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763333176.583966:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57465 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1bf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969cdf expref: 247 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.583976:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45c84200, rc 0) 00000100:00100000:0.0:1763333176.584909:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56886:x1848987613766528:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1375us (2650us total) trans 4294972436 rc 301/301 00000100:00100000:0.0:1763333176.584919:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9450 00000100:00100000:3.0:1763333176.586821:0:12741:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77c6d180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627284736:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333176.586852:0:12741:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5745e lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000100:00100000:0.0:1763333176.586935:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333176.587098:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613766656 00000100:00100000:3.0:1763333176.587108:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613766656 00010000:00010000:3.0:1763333176.587142:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c57449 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969cd1 expref: 246 pid: 12741 timeout: 1380 lvb_type: 0 00000100:00100000:3.0:1763333176.587178:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3114 00000100:00100000:3.0:1763333176.587186:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:2420:x1848987613766656:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333176.587198:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333176.587204:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c57449 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969cd1 expref: 246 pid: 12741 timeout: 1380 lvb_type: 0 00010000:00010000:3.0:1763333176.587215:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c57449 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969cd1 expref: 246 pid: 12741 timeout: 1380 lvb_type: 0 00010000:00010000:3.0:1763333176.587233:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c57449 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969cd1 expref: 246 pid: 12741 timeout: 1380 lvb_type: 0 00010000:00010000:3.0:1763333176.587248:0:28428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bf:0x0].0x0 (ffff92ff8016f400) 00010000:00010000:3.0:1763333176.587252:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5745e lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.587261:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5745e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.587267:0:28428:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5745e lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1bf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.587547:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333176.587642:0:12741:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5745e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.587651:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5745e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:0.0:1763333176.587674:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1bf:0x0]: returning size 0 00000004:00080000:0.0:1763333176.587852:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x249:0x0], index 1: 0 00000004:00080000:0.0:1763333176.587859:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x249:0x0], index 0: 0 00000004:00080000:0.0:1763333176.587864:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x24a:0x0], index 0: 0 00000004:00080000:0.0:1763333176.587868:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x24a:0x0], index 1: 0 00010000:00010000:0.0:1763333176.587995:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5745e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.588003:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5745e lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1bf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.588010:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5745e lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1bf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.588015:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333176.588018:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5745e lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1bf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.588025:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5745e lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1bf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.588033:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bf:0x0].0x0 (ffff92ff8016f400) 00010000:00010000:0.0:1763333176.588035:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333176.588040:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5745e lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1bf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.588046:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5745e lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1bf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.588091:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c57457 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1bf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969cd8 expref: 246 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.588100:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bf:0x0].0x0 (ffff92ff8016f400) 00010000:00010000:0.0:1763333176.588102:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763333176.588105:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c57457 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1bf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969cd8 expref: 246 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.588117:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7ec00, rc 0) 00000100:00100000:0.0:1763333176.588164:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56890:x1848987613766272:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 7776us (8020us total) trans 4294972437 rc 301/301 00000100:00100000:0.0:1763333176.588172:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9449 00000100:00100000:2.0:1763333176.588256:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:2420:x1848987613766656:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 1069us (1319us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333176.588265:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3114 00000100:00100000:0.0:1763333176.591766:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333176.591926:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613766912 00000100:00100000:3.0:1763333176.591937:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613766912 00000100:00100000:3.0:1763333176.592521:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3227 00000100:00100000:3.0:1763333176.592535:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56886:x1848987613766912:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333176.592945:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56886:x1848987613766912:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 414us (1187us total) trans 4294972438 rc 0/0 00000100:00100000:3.0:1763333176.592953:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3227 00000100:00100000:2.0:1763333176.593178:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.593293:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613767168 00000100:00100000:0.0:1763333176.593300:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613767168 00000100:00100000:0.0:1763333176.593413:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3228 00000100:00100000:0.0:1763333176.593422:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56890:x1848987613767168:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333176.593545:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56890:x1848987613767168:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 123us (366us total) trans 4294972439 rc 0/0 00000100:00100000:0.0:1763333176.594427:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3228 00000100:00100000:2.0:1763333176.597261:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.597772:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613767424 00000100:00100000:0.0:1763333176.597783:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613767424 00000100:00100000:0.0:1763333176.597851:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3229 00000100:00100000:0.0:1763333176.597862:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56890:x1848987613767424:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333176.598070:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56890:x1848987613767424:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 210us (817us total) trans 4294972440 rc 0/0 00000100:00100000:0.0:1763333176.598078:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3229 00000100:00100000:1.0:1763333176.602338:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.602813:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613767680 00000100:00100000:0.0:1763333176.602824:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613767680 00000100:00100000:0.0:1763333176.602891:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9451 00000100:00100000:0.0:1763333176.602903:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:55917:x1848987613767680:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333176.602928:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333176.602962:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57481 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969ce6 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.603120:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c57488 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333176.603134:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c57488 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.603146:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c57488 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.603156:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c5748f lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333176.603164:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c5748f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.603170:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c5748f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.603235:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85200/0xb32e3ef184c57496 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333176.603244:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85200/0xb32e3ef184c57496 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.603251:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85200/0xb32e3ef184c57496 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:0.0:1763333176.603262:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1bf:0x0]: returning size 0 00010000:00010000:0.0:1763333176.603332:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c57488 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.603338:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c57488 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.603344:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c57488 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.603374:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c57488 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.603379:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c84e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333176.603383:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c57488 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.603389:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c57488 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.603399:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12100) 00010000:00010000:0.0:1763333176.603402:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333176.603406:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c57488 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.603411:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c57488 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.603422:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c5748f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.603428:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c5748f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.603433:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c5748f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.603438:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c85c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333176.603441:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c5748f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.603459:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c5748f lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.603467:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff8016f700) 00010000:00010000:0.0:1763333176.603469:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333176.603472:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c5748f lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.603481:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c5748f lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.603518:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57481 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ce6 expref: 250 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.603535:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85200/0xb32e3ef184c57496 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ce6 expref: 249 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.603541:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bf:0x0].0x0 (ffff92fe44e12e00) 00010000:00010000:0.0:1763333176.603544:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333176.603546:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45c85200, rc 0) 00000100:00100000:0.0:1763333176.603682:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:55917:x1848987613767680:12345-192.168.204.28@tcp:101:bash.0 Request processed in 779us (1351us total) trans 4294972441 rc 0/0 00000100:00100000:0.0:1763333176.603689:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9451 00000100:00100000:1.0:1763333176.607410:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.607854:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333176.608251:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613767808 00000100:00100000:3.0:1763333176.608262:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613767808 00000100:00100000:3.0:1763333176.608328:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613768064 00000100:00100000:3.0:1763333176.608332:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613768064 00000100:00100000:3.0:1763333176.608390:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9452 00000100:00100000:3.0:1763333176.608402:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:55917:x1848987613767808:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333176.608428:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333176.608460:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c574a4 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969ced expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.608497:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c574ab lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333176.608511:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c574ab lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.608523:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c574ab lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.608646:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c574a4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ced expref: 252 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.608663:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c574ab lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ced expref: 251 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.608672:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bf:0x0].0x0 (ffff92fe44e12e00) 00010000:00010000:3.0:1763333176.608675:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763333176.608679:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f000, rc 0) 00000100:00100000:3.0:1763333176.608736:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:55917:x1848987613767808:12345-192.168.204.28@tcp:101:bash.0 Request processed in 336us (1334us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333176.608744:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9452 00000100:00100000:3.0:1763333176.608763:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9453 00000100:00100000:3.0:1763333176.608771:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:56891:x1848987613768064:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333176.608778:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333176.608786:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c574b2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1bf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969cf4 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.608843:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c574b9 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x1bf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333176.608851:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c574b9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x1bf:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.608859:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c574b9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x1bf:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:3.0:1763333176.608869:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1bf:0x0]: returning size 0 00010000:00010000:3.0:1763333176.608976:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c574b2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1bf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969cf4 expref: 253 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.608987:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c574b9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1bf:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969cf4 expref: 252 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.608994:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bf:0x0].0x0 (ffff92fe44e12e00) 00010000:00010000:3.0:1763333176.608996:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1763333176.608999:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f600, rc 0) 00000100:00100000:3.0:1763333176.609021:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:56891:x1848987613768064:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 251us (1168us total) trans 4294972442 rc 0/0 00000100:00100000:3.0:1763333176.609026:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9453 00000100:00100000:1.0:1763333176.613501:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.613542:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.613603:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613768320 00000100:00100000:0.0:1763333176.613615:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613768320 00000100:00100000:0.0:1763333176.613674:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613768448 00000100:00100000:0.0:1763333176.613678:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613768448 00000100:00100000:0.0:1763333176.613713:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9454 00000100:00100000:0.0:1763333176.613723:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:55917:x1848987613768320:12345-192.168.204.28@tcp:36:bash.0 00000100:00100000:2.0:1763333176.613773:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9455 00010000:00010000:0.0:1763333176.613779:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1763333176.613783:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:56891:x1848987613768448:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333176.613792:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333176.613804:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85200/0xb32e3ef184c57496 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ce6 expref: 253 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.613807:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c574c7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969cfb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.613821:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bf:0x0].0x0 (ffff92fe44e12e00) 00010000:00010000:0.0:1763333176.613825:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333176.613872:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c574ce lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333176.613885:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c574ce lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.613894:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c574ce lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.614008:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c574d5 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333176.614017:0:12741:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c574ce lrc: 2/1,0 mode: PR/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.614025:0:12741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c574d5 lrc: 4/0,1 mode: --/PW res: [0x240000404:0x1bf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.614040:0:12741:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c574ce lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.614050:0:12741:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c574d5 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1bf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:2.0:1763333176.614096:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1bf:0x0]: returning size 0 00000004:00200000:2.0:1763333176.614101:0:6519:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763333176.614118:0:6519:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c574ce lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.614141:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c574c7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1bf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969cfb expref: 255 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.614158:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c574ce lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969cfb expref: 254 pid: 6519 timeout: 1380 lvb_type: 0 00010000:00010000:2.0:1763333176.614167:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c574ce lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969cfb expref: 254 pid: 6519 timeout: 1380 lvb_type: 0 00010000:00010000:2.0:1763333176.614174:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4400, rc 0) 00000100:00100000:2.0:1763333176.614300:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+254:56891:x1848987613768448:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 518us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333176.614307:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9455 00000100:00100000:2.0:1763333176.617527:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.617721:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613768576 00000100:00100000:1.0:1763333176.617732:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613768576 00000100:00100000:3.0:1763333176.618274:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333176.618333:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613768704 00000100:00100000:2.0:1763333176.618337:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613768704 00010000:00010000:2.0:1763333176.618392:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c574ce lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969cfb expref: 254 pid: 6519 timeout: 1380 lvb_type: 0 00000100:00100000:2.0:1763333176.618431:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3115 00000100:00100000:2.0:1763333176.618449:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+254:2421:x1848987613768704:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333176.618465:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333176.618472:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c574ce lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969cfb expref: 254 pid: 6519 timeout: 1380 lvb_type: 0 00010000:00010000:2.0:1763333176.618484:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c574ce lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969cfb expref: 254 pid: 6519 timeout: 1380 lvb_type: 0 00010000:00010000:2.0:1763333176.618506:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c574ce lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969cfb expref: 254 pid: 6519 timeout: 1380 lvb_type: 0 00010000:00010000:2.0:1763333176.618522:0:28428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bf:0x0].0x0 (ffff92fe44e12e00) 00010000:00010000:2.0:1763333176.618528:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c574d5 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1bf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.618537:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c574d5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1bf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12741 initiator: MDT1 00000100:00100000:1.0:1763333176.618666:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6665 00000100:00100000:1.0:1763333176.618676:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75665500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2418:x1848987613768576:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333176.618690:0:28650:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333176.618708:0:28650:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c574dc lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969d02 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333176.618729:0:28650:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x249:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763333176.618735:0:28428:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c574d5 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1bf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.618744:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333176.618746:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333176.618755:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c574dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d02 expref: 23 pid: 28650 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333176.618769:0:28650:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c574dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d02 expref: 23 pid: 28650 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333176.618780:0:28650:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdea00, rc 0) 00010000:00010000:2.0:1763333176.618955:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333176.619162:0:12741:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c574d5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1bf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.619171:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c574d5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1bf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000001:00080000:3.0:1763333176.619259:0:12741:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294972443 00000100:00100000:2.0:1763333176.619286:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+254:2421:x1848987613768704:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 845us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333176.619286:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75665500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2418:x1848987613768576:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 612us (1769us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333176.619294:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3115 00000100:00100000:1.0:1763333176.619294:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6665 00000004:00010000:2.0:1763333176.619719:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000cc488760 reply state 000000004b7ace81 transno 4294972444 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c574d5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1bf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.619737:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c574d5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1bf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.619744:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bf:0x0].0x0 (ffff92fe44e12e00) 00010000:00010000:2.0:1763333176.619747:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333176.619749:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763333176.619827:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+254:55917:x1848987613768320:12345-192.168.204.28@tcp:36:bash.0 Request processed in 6105us (6334us total) trans 4294972444 rc 0/0 00000100:00100000:2.0:1763333176.619833:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9454 00000020:00080000:2.0:1763333176.619837:0:12741:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763333176.621759:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333176.621823:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613768960 00000100:00100000:3.0:1763333176.621824:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333176.621833:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613768960 00000100:00100000:2.0:1763333176.621888:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613769088 00000100:00100000:2.0:1763333176.621892:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613769088 00000100:00100000:3.0:1763333176.621903:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9456 00000100:00100000:2.0:1763333176.621965:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9457 00000100:00100000:3.0:1763333176.621968:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+255:55917:x1848987613768960:12345-192.168.204.28@tcp:101:bash.0 00000100:00100000:2.0:1763333176.621972:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+255:56891:x1848987613769088:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333176.621992:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333176.621992:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333176.621996:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763333176.622013:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c574e3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969d10 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.622019:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c574b9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1bf:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969cf4 expref: 255 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.622036:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bf:0x0].0x0 (ffff92fe44e12e00) 00010000:00010000:3.0:1763333176.622041:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333176.622047:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c574ea lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1bf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969d09 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.622076:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c574f1 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1bf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333176.622080:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c574e3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d10 expref: 256 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.622193:0:8606:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c574e3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d10 expref: 256 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.622203:0:8606:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c574f1 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1bf:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.622241:0:8606:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c574e3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d10 expref: 256 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.622255:0:8606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c574e3 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x1bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d10 expref: 256 pid: 12741 timeout: 1380 lvb_type: 0 00000100:00100000:3.0:1763333176.622269:0:8606:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff6bc10380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627284864:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333176.622270:0:12741:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c574e3 lrc: 6/0,0 mode: CR/CR res: [0x240000404:0x1bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d10 expref: 256 pid: 12741 timeout: 1380 lvb_type: 0 00010000:00010000:2.0:1763333176.622278:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c574e3 lrc: 6/0,0 mode: CR/CR res: [0x240000404:0x1bf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d10 expref: 256 pid: 12741 timeout: 1380 lvb_type: 0 00010000:00010000:2.0:1763333176.622300:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5c00, rc 0) 00000100:00100000:2.0:1763333176.622405:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+256:56891:x1848987613769088:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 432us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333176.622418:0:8606:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff49c92780 going to sleep for 11 seconds 00000100:00100000:2.0:1763333176.622422:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9457 00000100:00100000:0.0:1763333176.627686:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.627764:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333176.627865:0:8606:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff6bc10380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627284864:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333176.627892:0:8606:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c574f1 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1bf:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000100:00100000:1.0:1763333176.628699:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613769216 00000100:00100000:1.0:1763333176.628710:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613769216 00000100:00100000:1.0:1763333176.628840:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9458 00000100:00100000:1.0:1763333176.628852:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+256:56891:x1848987613769216:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333176.628879:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333176.628900:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c574f8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1bf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969d17 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333176.628957:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613769344 00000100:00100000:2.0:1763333176.628964:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613769344 00010000:00010000:2.0:1763333176.628990:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c574e3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d10 expref: 258 pid: 12741 timeout: 1380 lvb_type: 0 00000100:00100000:2.0:1763333176.629018:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3116 00000100:00100000:2.0:1763333176.629028:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+258:2419:x1848987613769344:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333176.629029:0:12741:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c574f1 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1bf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333176.629042:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333176.629044:0:12741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c574f8 lrc: 4/0,0 mode: --/CR res: [0x240000404:0x1bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d17 expref: 258 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.629052:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c574e3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1bf:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d10 expref: 258 pid: 12741 timeout: 1380 lvb_type: 0 00010000:00010000:2.0:1763333176.629067:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c574e3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d10 expref: 258 pid: 12741 timeout: 1380 lvb_type: 0 00010000:00010000:1.0:1763333176.629381:0:12741:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c574f1 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1bf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.629396:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c574f8 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x1bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d17 expref: 258 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.629408:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bf:0x0].0x0 (ffff92fe44e12e00) 00010000:00010000:1.0:1763333176.629411:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763333176.629414:0:12741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c574f1 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1bf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.629421:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdf200, rc 0) 00000100:00100000:1.0:1763333176.629498:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+258:56891:x1848987613769216:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 647us (1820us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333176.629505:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9458 00010000:00010000:2.0:1763333176.629552:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c574e3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1bf:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d10 expref: 257 pid: 12741 timeout: 1380 lvb_type: 0 00010000:00010000:2.0:1763333176.629568:0:28428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bf:0x0].0x0 (ffff92fe44e12e00) 00010000:00010000:2.0:1763333176.629573:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c574f1 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1bf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333176.629581:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c574f1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333176.629593:0:28428:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c574f1 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1bf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333176.629603:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c574f8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1bf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d17 expref: 256 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.629622:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333176.629647:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+256:2419:x1848987613769344:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 622us (1883us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333176.629655:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3116 00010000:00010000:1.0:1763333176.629746:0:8606:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c574f1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bf:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.629755:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c574f1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bf:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 8606 initiator: MDT1 00000040:00080000:1.0:1763333176.630048:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1457, 88 off122776 00000004:00080000:1.0:1763333176.630057:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1280709708024ns, next at 1280856550572ns, rc = 0 00000040:00080000:1.0:1763333176.630094:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1458, 88 off122776 00000004:00080000:1.0:1763333176.630099:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1280709749764ns, next at 1281590880154ns, rc = 0 00000040:00080000:1.0:1763333176.630160:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1460, 88 off122968 00000004:00080000:1.0:1763333176.630166:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1280709817194ns, next at 1281590880154ns, rc = 0 00000040:00080000:1.0:1763333176.630187:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1459, 88 off122968 00000004:00080000:1.0:1763333176.630191:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1280709842222ns, next at 1280856550572ns, rc = 0 00000001:00080000:1.0:1763333176.632297:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972445 is committed 00000004:00080000:1.0:1763333176.632309:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 953 committed 00000100:00100000:2.0:1763333176.633147:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff75667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627284992:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763333176.633208:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333176.633244:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1763333176.633250:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff75664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627285376:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333176.633268:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333176.633294:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff75664700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627285120:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763333176.633313:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333176.633327:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1763333176.633332:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff75666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627285248:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333176.633367:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333176.633395:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627284992 00000100:00100000:2.0:1763333176.633400:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627284992 00000100:00100000:2.0:1763333176.633434:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627285376 00000100:00100000:2.0:1763333176.633436:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627285376 00000100:00100000:2.0:1763333176.633457:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627285120 00000100:00100000:2.0:1763333176.633460:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627285120 00000100:00100000:2.0:1763333176.633471:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627285248 00000100:00100000:2.0:1763333176.633473:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627285248 00000100:00100000:2.0:1763333176.633487:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6666 00000100:00100000:2.0:1763333176.633494:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75665180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+28:3653:x1848987627284992:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1763333176.633518:0:28650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:581 count 1 00010000:00010000:2.0:1763333176.633542:0:28650:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c574ff lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.633560:0:28650:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57297 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c4c expref: 22 pid: 17605 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333176.633567:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333176.633569:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333176.633573:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c574ff lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.633601:0:28650:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57297 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c4c expref: 22 pid: 17605 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333176.633614:0:28650:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57297 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c4c expref: 22 pid: 17605 timeout: 1380 lvb_type: 1 00000100:00100000:2.0:1763333176.633624:0:28650:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff75665c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28650:1848987627285504:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333176.633681:0:28650:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff742b9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1763333176.633697:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6667 00000100:00100000:2.0:1763333176.633703:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75667800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+28:3653:x1848987627285376:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333176.633839:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75667800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+29:3653:x1848987627285376:12345-0@lo:2:osp-syn-1-1.0 Request processed in 136us (569us total) trans 17179871643 rc 0/0 00000100:00100000:2.0:1763333176.633846:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6667 00000100:00100000:2.0:1763333176.633862:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6668 00000100:00100000:2.0:1763333176.633867:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+28:3654:x1848987627285120:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1763333176.633874:0:17605:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:582 count 1 00010000:00010000:2.0:1763333176.633883:0:17605:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57506 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.633893:0:17605:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c57370 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ca0 expref: 22 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.633898:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333176.633900:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333176.633902:0:17605:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57506 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.633916:0:17605:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c57370 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ca0 expref: 22 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.633922:0:17605:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c57370 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ca0 expref: 22 pid: 8404 timeout: 1380 lvb_type: 0 00000100:00100000:2.0:1763333176.633930:0:17605:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff75667480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17605:1848987627285632:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333176.633951:0:17605:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe46e0e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763333176.633966:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6669 00000100:00100000:2.0:1763333176.633974:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+28:3654:x1848987627285248:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1763333176.634041:0:8404:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x249:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333176.634045:0:8404:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x249:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1763333176.634047:0:8404:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x249:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333176.634050:0:8404:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x249:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1763333176.634052:0:8404:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x249:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333176.634081:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+29:3654:x1848987627285248:12345-0@lo:2:osp-syn-1-1.0 Request processed in 108us (713us total) trans 17179871644 rc 0/0 00000100:00100000:2.0:1763333176.634087:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6669 00000004:00080000:2.0:1763333176.634138:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff75666a00/2, rc 0, transno 17179871644 00000100:00100000:2.0:1763333176.634144:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff75666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627285248:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1763333176.634159:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff75664a80/2, rc 0, transno 17179871643 00000100:00100000:2.0:1763333176.634163:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff75664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627285376:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1763333176.634316:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c57442 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.634326:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c57442 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.634333:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c57442 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.634340:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333176.634344:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c57442 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.634367:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c57442 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.634383:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff8016f700) 00010000:00010000:3.0:1763333176.634386:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333176.634390:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c57442 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.634397:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c57442 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.634569:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c574d5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1bf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.634577:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c574d5 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1bf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.634583:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c574d5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1bf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.634588:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c84200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333176.634591:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c574d5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1bf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.634597:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c574d5 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1bf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.634605:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bf:0x0].0x0 (ffff92fe44e12e00) 00010000:00010000:3.0:1763333176.634607:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333176.634611:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c574d5 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1bf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.634616:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c574d5 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1bf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000004:00080000:1.0:1763333176.635208:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 957 committed 00000004:00080000:1.0:1763333176.635229:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 956 committed 00000004:00080000:1.0:1763333176.635232:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 952 committed 00010000:00010000:1.0:1763333176.635327:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c574f1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1bf:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d09 expref: 243 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.635338:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bf:0x0].0x0 (ffff92fe44e12e00) 00010000:00010000:1.0:1763333176.635340:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763333176.635345:0:8606:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c574f8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d17 expref: 243 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.635379:0:8606:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c574f8 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x1bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d17 expref: 243 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.635387:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c574f8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d17 expref: 243 pid: 12741 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333176.635702:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff6bc10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627285760:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763333176.635753:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff6bc10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627286016:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333176.635755:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333176.635790:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763333176.635793:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333176.635800:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff6bc12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627286144:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333176.635829:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333176.635838:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763333176.635847:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff6bc12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627285888:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763333176.635873:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333176.635909:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627285760 00000100:00100000:3.0:1763333176.635914:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627285760 00000100:00100000:3.0:1763333176.635946:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627286016 00000100:00100000:3.0:1763333176.635948:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627286016 00010000:00010000:1.0:1763333176.635974:0:8606:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c574f8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d17 expref: 243 pid: 12741 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333176.635986:0:8606:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42ef8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627286272:192.168.204.28@tcp:105: 00000100:00100000:1.0:1763333176.636252:0:8606:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff6be073c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763333176.636333:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627286144 00000100:00100000:0.0:1763333176.636339:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627286144 00000100:00100000:0.0:1763333176.636385:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627285888 00000100:00100000:0.0:1763333176.636389:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627285888 00000100:00100000:0.0:1763333176.636409:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6670 00000100:00100000:0.0:1763333176.636417:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+12:3653:x1848987627285760:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1763333176.636437:0:8611:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:581 count 1 00010000:00010000:0.0:1763333176.636471:0:8611:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85200/0xb32e3ef184c5750d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.636493:0:8611:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c5718d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bf1 expref: 12 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.636501:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333176.636504:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333176.636508:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85200/0xb32e3ef184c5750d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.636532:0:8611:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c5718d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bf1 expref: 12 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.636544:0:8611:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c5718d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bf1 expref: 12 pid: 17605 timeout: 1380 lvb_type: 0 00000100:00100000:0.0:1763333176.636555:0:8611:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77b16680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8611:1848987627286400:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333176.636587:0:8611:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7412bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1763333176.636600:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6671 00000100:00100000:1.0:1763333176.636609:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+12:3653:x1848987627286144:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333176.636821:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6672 00000100:00100000:3.0:1763333176.636827:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e0f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+12:3655:x1848987627285888:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763333176.636839:0:28651:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:582 count 1 00010000:00010000:3.0:1763333176.636850:0:28651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c57514 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x246:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.636861:0:28651:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c57369 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c99 expref: 12 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.636868:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333176.636870:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333176.636872:0:28651:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c57514 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x246:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.636888:0:28651:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c57369 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c99 expref: 12 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.636896:0:28651:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c57369 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c99 expref: 12 pid: 28600 timeout: 1380 lvb_type: 0 00000100:00100000:3.0:1763333176.636910:0:28651:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff6bc11180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28651:1848987627286528:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333176.636936:0:28651:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff49c92780 going to sleep for 11 seconds 00000100:00100000:3.0:1763333176.636952:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6673 00000100:00100000:3.0:1763333176.636959:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+12:3655:x1848987627286016:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333176.637078:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+13:3655:x1848987627286016:12345-0@lo:2:osp-syn-0-1.0 Request processed in 118us (1285us total) trans 21474838948 rc 0/0 00000100:00100000:3.0:1763333176.637085:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6673 00000004:00080000:3.0:1763333176.637122:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff6bc10a80/2, rc 0, transno 21474838948 00000100:00100000:3.0:1763333176.637128:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff6bc10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627286016:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333176.637337:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+13:3653:x1848987627286144:12345-0@lo:2:osp-syn-0-1.0 Request processed in 729us (1507us total) trans 21474838947 rc 0/0 00000100:00100000:1.0:1763333176.637343:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6671 00000004:00080000:3.0:1763333176.637815:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff6bc12d80/2, rc 0, transno 21474838947 00000100:00100000:3.0:1763333176.637822:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff6bc12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627286144:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333176.641406:0:17605:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff75667480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17605:1848987627285632:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333176.641437:0:17605:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57506 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333176.641561:0:28650:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff75665c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28650:1848987627285504:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333176.641579:0:28650:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c574ff lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333176.642515:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.642537:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.642553:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.642567:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.642589:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333176.642882:0:28651:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff6bc11180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28651:1848987627286528:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333176.642901:0:28651:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c57514 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x246:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333176.642970:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613769728 00000100:00100000:2.0:1763333176.642977:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613769728 00010000:00010000:2.0:1763333176.643016:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c5718d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bf1 expref: 13 pid: 17605 timeout: 1380 lvb_type: 0 00000100:00100000:2.0:1763333176.643038:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613769856 00000100:00100000:2.0:1763333176.643041:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613769856 00000100:00100000:1.0:1763333176.643090:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613769472 00000100:00100000:1.0:1763333176.643095:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613769472 00010000:00010000:1.0:1763333176.643115:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57297 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c4c expref: 23 pid: 17605 timeout: 1380 lvb_type: 1 00000100:00100000:1.0:1763333176.643130:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613769600 00000100:00100000:1.0:1763333176.643133:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613769600 00010000:00010000:1.0:1763333176.643144:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c57370 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ca0 expref: 24 pid: 8404 timeout: 1380 lvb_type: 0 00000100:00100000:1.0:1763333176.643163:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3117 00000100:00100000:1.0:1763333176.643172:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2418:x1848987613769728:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333176.643187:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333176.643193:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c5718d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bf1 expref: 14 pid: 17605 timeout: 1380 lvb_type: 0 00010000:00010000:1.0:1763333176.643204:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c5718d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bf1 expref: 14 pid: 17605 timeout: 1380 lvb_type: 0 00010000:00010000:1.0:1763333176.643229:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333176.643231:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333176.643236:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85200/0xb32e3ef184c5750d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.643246:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85200/0xb32e3ef184c5750d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.643265:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333176.643273:0:8611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c5718d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969bf1 expref: 14 pid: 17605 timeout: 1380 lvb_type: 0 00000100:00100000:0.0:1763333176.643289:0:8611:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77b16680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8611:1848987627286400:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333176.643305:0:8611:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85200/0xb32e3ef184c5750d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.643316:0:8611:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85200/0xb32e3ef184c5750d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.643323:0:8611:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85200/0xb32e3ef184c5750d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333176.643329:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2418:x1848987613769728:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 154us (814us total) trans 0 rc 0/0 00010000:00010000:0.0:1763333176.643337:0:8611:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85200/0xb32e3ef184c5750d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333176.643343:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3117 00010000:00010000:0.0:1763333176.643377:0:8611:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85200/0xb32e3ef184c5750d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333176.643387:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3118 00000100:00100000:1.0:1763333176.643395:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43998000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:2421:x1848987613769472:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333176.643397:0:8611:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763333176.643404:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333176.643410:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57297 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x245:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c4c expref: 24 pid: 17605 timeout: 1380 lvb_type: 1 00010000:00010000:1.0:1763333176.643421:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57297 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x245:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c4c expref: 24 pid: 17605 timeout: 1380 lvb_type: 1 00010000:00010000:1.0:1763333176.643436:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57297 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x245:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c4c expref: 24 pid: 17605 timeout: 1380 lvb_type: 1 00010000:00010000:1.0:1763333176.643454:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333176.643455:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333176.643459:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c574ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.643465:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c574ff lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.643483:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333176.643503:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43998000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2421:x1848987613769472:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 109us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333176.643509:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3118 00000100:00100000:1.0:1763333176.643524:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3119 00000100:00100000:1.0:1763333176.643531:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2421:x1848987613769600:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333176.643539:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333176.643544:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c57370 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ca0 expref: 22 pid: 8404 timeout: 1380 lvb_type: 0 00010000:00010000:1.0:1763333176.643552:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c57370 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ca0 expref: 22 pid: 8404 timeout: 1380 lvb_type: 0 00010000:00010000:1.0:1763333176.643566:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c57370 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ca0 expref: 22 pid: 8404 timeout: 1380 lvb_type: 0 00010000:00010000:1.0:1763333176.643575:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333176.643577:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333176.643580:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57506 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.643587:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57506 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.643604:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333176.643626:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2421:x1848987613769600:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 96us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333176.643632:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3119 00010000:00010000:1.0:1763333176.643652:0:28650:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c574ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333176.643655:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+13:3653:x1848987627285760:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7225us (7887us total) trans 21474838949 rc 0/0 00010000:00010000:1.0:1763333176.643666:0:28650:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c574ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333176.643671:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6670 00010000:00010000:1.0:1763333176.643680:0:28650:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c574ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.643687:0:28650:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c574ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.643721:0:28650:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1763333176.643753:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c57369 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c99 expref: 12 pid: 28600 timeout: 1380 lvb_type: 0 00000100:00100000:2.0:1763333176.643779:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3120 00000100:00100000:2.0:1763333176.643787:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff44f08050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:2418:x1848987613769856:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333176.643796:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333176.643800:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c57369 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c99 expref: 12 pid: 28600 timeout: 1380 lvb_type: 0 00010000:00010000:2.0:1763333176.643809:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c57369 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c99 expref: 12 pid: 28600 timeout: 1380 lvb_type: 0 00010000:00010000:2.0:1763333176.643828:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c57369 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x246:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969c99 expref: 12 pid: 28600 timeout: 1380 lvb_type: 0 00010000:00010000:2.0:1763333176.643837:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333176.643839:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333176.643843:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c57514 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.643850:0:6506:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c57514 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.643867:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333176.643889:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff44f08050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+11:2418:x1848987613769856:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 104us (1351us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333176.643896:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3120 00000100:00100000:2.0:1763333176.643952:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613769984 00000100:00100000:2.0:1763333176.643957:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613769984 00000100:00100000:2.0:1763333176.643986:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3230 00000100:00100000:1.0:1763333176.643987:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75665180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+29:3653:x1848987627284992:12345-0@lo:6:osp-syn-1-1.0 Request processed in 10489us (10775us total) trans 17179871645 rc 0/0 00000100:00100000:2.0:1763333176.643997:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4399a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56891:x1848987613769984:12345-192.168.204.28@tcp:49:lfs.0 00000100:00100000:1.0:1763333176.644000:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6666 00010000:00010000:1.0:1763333176.644029:0:17605:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57506 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.644037:0:17605:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57506 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.644045:0:17605:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57506 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.644052:0:17605:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57506 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.644068:0:17605:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1763333176.644105:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4399a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56891:x1848987613769984:12345-192.168.204.28@tcp:49:lfs.0 Request processed in 109us (1547us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333176.644112:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3230 00010000:00010000:2.0:1763333176.644143:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1763333176.644150:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85200/0xb32e3ef184c5750d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.644162:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c85200 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333176.644167:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85200/0xb32e3ef184c5750d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.644176:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85200/0xb32e3ef184c5750d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333176.644176:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+29:3654:x1848987627285120:12345-0@lo:6:osp-syn-1-1.0 Request processed in 10307us (10860us total) trans 17179871646 rc 0/0 00000100:00100000:1.0:1763333176.644191:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6668 00010000:00010000:2.0:1763333176.644198:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85200/0xb32e3ef184c5750d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.644207:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85200/0xb32e3ef184c5750d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.644214:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1763333176.644221:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c574ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.644226:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333176.644234:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57506 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.644234:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4800 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333176.644240:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c574ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.644248:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5e00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333176.644254:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57506 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.644255:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c574ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.644272:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57506 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.644280:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c574ff lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.644286:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57506 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.644290:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c574ff lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.644314:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57506 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.644319:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333176.644323:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333176.644326:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333176.644333:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333176.644336:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333176.644338:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763333176.644391:0:8606:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42ef8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627286272:192.168.204.28@tcp:105: 00010000:00010000:2.0:1763333176.644415:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c574ea lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d09 expref: 243 pid: 8606 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1763333176.644430:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c574f1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1bf:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d09 expref: 242 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.644460:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e000, rc 0) 00000100:00100000:2.0:1763333176.644485:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:55917:x1848987613768960:12345-192.168.204.28@tcp:101:bash.0 Request processed in 22574us (22734us total) trans 4294972445 rc 0/0 00000100:00100000:2.0:1763333176.644492:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9456 00000004:00080000:3.0:1763333176.644674:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff75664700/2, rc 0, transno 17179871646 00000100:00100000:3.0:1763333176.644681:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff75664700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627285120:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1763333176.644707:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff6bc10380/2, rc 0, transno 21474838949 00000100:00100000:3.0:1763333176.644712:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff6bc10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627285760:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1763333176.644721:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff75667b80/2, rc 0, transno 17179871645 00000100:00100000:3.0:1763333176.644724:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff75667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627284992:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1763333176.644739:0:28651:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c57514 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.644747:0:28651:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c57514 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.644756:0:28651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c57514 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.644762:0:28651:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c57514 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.644788:0:28651:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763333176.644989:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e0f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+13:3655:x1848987627285888:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8161us (9113us total) trans 21474838950 rc 0/0 00000100:00100000:3.0:1763333176.644996:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6672 00000004:00080000:1.0:1763333176.645764:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff6bc12300/2, rc 0, transno 21474838950 00000100:00100000:1.0:1763333176.645771:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff6bc12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627285888:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1763333176.646120:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333176.646128:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c57514 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.646139:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fe00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333176.646143:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c57514 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.646153:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c57514 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.646175:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c57514 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.646183:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c57514 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.646203:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333176.646205:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333176.646207:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333176.649343:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763333176.652410:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.652501:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613770240 00000100:00100000:0.0:1763333176.652513:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613770240 00000100:00100000:0.0:1763333176.652571:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3231 00000100:00100000:0.0:1763333176.652580:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc03c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:56891:x1848987613770240:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333176.652837:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc03c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:56891:x1848987613770240:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 257us (438us total) trans 4294972446 rc 0/0 00000100:00100000:0.0:1763333176.652845:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3231 00000100:00100000:3.0:1763333176.653282:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.653517:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613770368 00000100:00100000:0.0:1763333176.653523:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613770368 00000100:00100000:0.0:1763333176.653562:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6674 00000100:00100000:0.0:1763333176.653570:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:55917:x1848987613770368:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333176.653585:0:28651:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333176.653604:0:28651:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c5751b lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969d1e expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.653633:0:28651:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c574dc lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d02 expref: 22 pid: 28650 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333176.653648:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333176.653650:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333176.653655:0:28651:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c5751b lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d1e expref: 22 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.653689:0:28651:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c574dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d02 expref: 22 pid: 28650 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333176.653703:0:28651:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c574dc lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d02 expref: 22 pid: 28650 timeout: 1380 lvb_type: 1 00000100:00100000:0.0:1763333176.653715:0:28651:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77b16680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28651:1848987627286656:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333176.655412:0:28651:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff58cbf780 going to sleep for 11 seconds 00000100:00100000:3.0:1763333176.658922:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333176.659019:0:28651:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77b16680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28651:1848987627286656:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333176.659064:0:28651:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c5751b lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d1e expref: 22 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.659085:0:28651:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45c85600, rc 0) 00000100:00100000:2.0:1763333176.659150:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:55917:x1848987613770368:12345-192.168.204.28@tcp:101:bash.0 Request processed in 5580us (5869us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333176.659162:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6674 00000100:00100000:3.0:1763333176.660083:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.662701:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613770624 00000100:00100000:0.0:1763333176.662720:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613770624 00000100:00100000:0.0:1763333176.662811:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9459 00000100:00100000:0.0:1763333176.662822:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:56891:x1848987613770624:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333176.662848:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333176.662873:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57522 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969d25 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.662966:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85200/0xb32e3ef184c57529 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333176.662981:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85200/0xb32e3ef184c57529 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.662992:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85200/0xb32e3ef184c57529 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.663003:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57530 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333176.663008:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57530 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.663014:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57530 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.663156:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57537 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333176.663165:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57537 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.663171:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57537 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:0.0:1763333176.663182:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1bf:0x0]: returning size 2 00010000:00010000:0.0:1763333176.663263:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85200/0xb32e3ef184c57529 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.663298:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85200/0xb32e3ef184c57529 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.663303:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85200/0xb32e3ef184c57529 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.663309:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85200/0xb32e3ef184c57529 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.663314:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c85200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333176.663319:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85200/0xb32e3ef184c57529 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.663330:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85200/0xb32e3ef184c57529 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.663342:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355600) 00010000:00010000:0.0:1763333176.663345:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333176.663404:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85200/0xb32e3ef184c57529 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.663411:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85200/0xb32e3ef184c57529 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.663423:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57530 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.663428:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57530 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.663434:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57530 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.663439:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c84200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333176.663451:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57530 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.663457:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57530 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.663464:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355200) 00010000:00010000:0.0:1763333176.663466:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333176.663469:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57530 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.663474:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57530 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.663577:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57522 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d25 expref: 246 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.663596:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57537 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d25 expref: 245 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.663603:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bf:0x0].0x0 (ffff92fe44e12e00) 00010000:00010000:0.0:1763333176.663606:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333176.663608:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45c84400, rc 0) 00000100:00100000:0.0:1763333176.663695:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56891:x1848987613770624:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 874us (4786us total) trans 4294972447 rc 0/0 00000100:00100000:0.0:1763333176.663704:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9459 00000100:00100000:2.0:1763333176.663918:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613770752 00000100:00100000:2.0:1763333176.663926:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613770752 00010000:00010000:2.0:1763333176.663971:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c574dc lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d02 expref: 22 pid: 28650 timeout: 1380 lvb_type: 1 00000100:00100000:2.0:1763333176.664004:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3121 00000100:00100000:2.0:1763333176.664012:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2420:x1848987613770752:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333176.664024:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333176.664029:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c574dc lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x249:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d02 expref: 22 pid: 28650 timeout: 1380 lvb_type: 1 00010000:00010000:2.0:1763333176.664039:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c574dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x249:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d02 expref: 22 pid: 28650 timeout: 1380 lvb_type: 1 00010000:00010000:2.0:1763333176.664057:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c574dc lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x249:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d02 expref: 22 pid: 28650 timeout: 1380 lvb_type: 1 00010000:00010000:2.0:1763333176.664070:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333176.664072:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333176.664080:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c5751b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d1e expref: 21 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.664090:0:28428:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c5751b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d1e expref: 21 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.664128:0:28428:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c5751b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d1e expref: 21 pid: 28651 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333176.664143:0:28428:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff75664380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:28428:1848987627286784:192.168.204.28@tcp:105: 00000100:00100000:2.0:1763333176.664212:0:28428:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff6be07780 going to sleep for 11 seconds 00000100:00100000:1.0:1763333176.676965:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.677057:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333176.677142:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613771008 00000100:00100000:3.0:1763333176.677152:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613771008 00000100:00100000:3.0:1763333176.677263:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613770880 00000100:00100000:3.0:1763333176.677267:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613770880 00000100:00100000:3.0:1763333176.677296:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6675 00000100:00100000:3.0:1763333176.677306:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+11:55917:x1848987613771008:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333176.677325:0:28651:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333176.677365:0:28651:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c57545 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969d33 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333176.677393:0:28651:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x249:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333176.677427:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333176.677430:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333176.677439:0:28651:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c57545 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d33 expref: 12 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.677463:0:28651:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c57545 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d33 expref: 12 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.677475:0:28651:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f200, rc 0) 00000100:00100000:3.0:1763333176.677526:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:55917:x1848987613771008:12345-192.168.204.28@tcp:101:bash.0 Request processed in 221us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333176.677535:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6675 00000100:00100000:3.0:1763333176.677553:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6676 00000100:00100000:3.0:1763333176.677560:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2420:x1848987613770880:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333176.677567:0:28651:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333176.677577:0:28651:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5754c lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x249:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969d2c expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333176.677619:0:28651:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff6bc10e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28651:1848987627286912:192.168.204.28@tcp:106: 00000100:00100000:3.0:1763333176.677670:0:28651:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff49c92780 going to sleep for 11 seconds 00000100:00100000:2.0:1763333176.678135:0:28428:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff75664380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:28428:1848987627286784:192.168.204.28@tcp:105: 00010000:00010000:2.0:1763333176.678153:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333176.678188:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2420:x1848987613770752:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 14177us (18110us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333176.678198:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3121 00000100:00100000:1.0:1763333176.684162:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.684272:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.684564:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613771136 00000100:00100000:0.0:1763333176.684575:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613771136 00002000:00010000:0.0:1763333176.684620:0:16635:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/585 (0->18446744073709551615) 00002000:00100000:0.0:1763333176.684624:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe46a6d500 with x1848987613771136 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333176.684636:0:16635:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe46a6d500. 00000100:00100000:0.0:1763333176.684656:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613771264 00000100:00100000:0.0:1763333176.684658:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613771264 00002000:00010000:0.0:1763333176.684670:0:16635:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/585 (0->18446744073709551615) 00002000:00100000:0.0:1763333176.684674:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe46a6df80 with x1848987613771264 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333176.684680:0:16635:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe46a6df80. 00000100:00100000:0.0:1763333176.684701:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1643 00000100:00100000:0.0:1763333176.684709:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2421:x1848987613771136:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:0.0:1763333176.684891:0:16635:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x249:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333176.684895:0:16635:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x249:0x0] updating lvb mtime from disk: 0 -> 1763333176 00002000:00010000:0.0:1763333176.684898:0:16635:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x249:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333176.684900:0:16635:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x249:0x0] updating lvb ctime from disk: 0 -> 1763333176 00002000:00010000:0.0:1763333176.684902:0:16635:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x249:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333176.685205:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:2421:x1848987613771136:12345-192.168.204.28@tcp:10:bash.0 Request processed in 494us (1053us total) trans 17179871647 rc 0/0 00000100:00100000:0.0:1763333176.685214:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1643 00002000:00010000:0.0:1763333176.685219:0:16635:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/585 (0->18446744073709551615) 00002000:00100000:0.0:1763333176.685221:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe46a6d500 with x1848987613771136 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333176.685226:0:16635:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe46a6d500. 00000100:00100000:0.0:1763333176.685244:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1644 00000100:00100000:0.0:1763333176.685251:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:2421:x1848987613771264:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:0.0:1763333176.685338:0:16635:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x249:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333176.685341:0:16635:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x249:0x0] updating lvb mtime from disk: 0 -> 1763333176 00002000:00010000:0.0:1763333176.685343:0:16635:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x249:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333176.685345:0:16635:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x249:0x0] updating lvb ctime from disk: 0 -> 1763333176 00002000:00010000:0.0:1763333176.685374:0:16635:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x249:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333176.685397:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2421:x1848987613771264:12345-192.168.204.28@tcp:10:bash.0 Request processed in 146us (1125us total) trans 21474838951 rc 0/0 00000100:00100000:0.0:1763333176.685404:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1644 00002000:00010000:0.0:1763333176.685407:0:16635:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/585 (0->18446744073709551615) 00002000:00100000:0.0:1763333176.685409:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe46a6df80 with x1848987613771264 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333176.685414:0:16635:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe46a6df80. 00002000:00010000:3.0:1763333176.685899:0:28651:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000400:0x249:0x0] updating lvb atime: 0 -> 1763333176 00000100:00100000:3.0:1763333176.685910:0:28651:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff6bc10e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28651:1848987627286912:192.168.204.28@tcp:106: 00010000:00010000:3.0:1763333176.685939:0:28651:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5754c lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d2c expref: 23 pid: 28651 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333176.685963:0:28651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5754c lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d2c expref: 23 pid: 28651 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333176.685974:0:28651:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7ec00, rc 0) 00000100:00100000:3.0:1763333176.686011:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2420:x1848987613770880:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 8451us (8953us total) trans 0 rc 301/301 00000100:00100000:3.0:1763333176.686018:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6676 00000100:00100000:1.0:1763333176.688907:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333176.689028:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613771520 00000100:00100000:2.0:1763333176.689040:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613771520 00000100:00100000:2.0:1763333176.689098:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3232 00000100:00100000:2.0:1763333176.689106:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:55917:x1848987613771520:12345-192.168.204.28@tcp:35:bash.0 00000001:00080000:2.0:1763333176.689328:0:6522:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294972448 00000100:00100000:2.0:1763333176.689462:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:55917:x1848987613771520:12345-192.168.204.28@tcp:35:bash.0 Request processed in 356us (563us total) trans 4294972449 rc 0/0 00000100:00100000:2.0:1763333176.689470:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3232 00000020:00080000:2.0:1763333176.689474:0:6522:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763333176.694865:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.697006:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613771776 00000100:00100000:0.0:1763333176.697020:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613771776 00000100:00100000:0.0:1763333176.697106:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3233 00000100:00100000:0.0:1763333176.697116:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56891:x1848987613771776:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333176.697561:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:56891:x1848987613771776:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 445us (2704us total) trans 4294972450 rc 0/0 00000100:00100000:0.0:1763333176.697570:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3233 00000100:00100000:1.0:1763333176.699616:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.699765:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613772032 00000100:00100000:0.0:1763333176.699775:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613772032 00000100:00100000:0.0:1763333176.699828:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9460 00000100:00100000:0.0:1763333176.699836:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:56892:x1848987613772032:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:0.0:1763333176.699891:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1763333176.699920:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c574f1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1bf:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d09 expref: 248 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.699942:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c574f8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1bf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d17 expref: 247 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.699955:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57537 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d25 expref: 246 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.699967:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c574ab lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1bf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ced expref: 245 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.699976:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bf:0x0].0x0 (ffff92fe44e12e00) 00010000:00010000:0.0:1763333176.699988:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333176.700018:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57553 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333176.700031:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57553 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.700041:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57553 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.700054:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c5755a lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333176.700061:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c5755a lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.700067:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c5755a lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.700144:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85200/0xb32e3ef184c57561 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1bf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333176.700151:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85200/0xb32e3ef184c57561 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.700158:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85200/0xb32e3ef184c57561 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000040:00080000:0.0:1763333176.701841:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1460, 64 off123032 00000040:00080000:0.0:1763333176.701877:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1461, 64 off123032 00000040:00080000:0.0:1763333176.701887:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1462, 64 off123096 00000040:00080000:0.0:1763333176.701897:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1461, 64 off123096 00010000:00010000:0.0:1763333176.701996:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c57568 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1bf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333176.702010:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c57568 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1bf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.702021:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c57568 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1bf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.702029:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c57568 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1bf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.702039:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c57568 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1bf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.702045:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c57568 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1bf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.702075:0:8606:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763333176.702099:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85200/0xb32e3ef184c57561 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1bf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.702105:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85200/0xb32e3ef184c57561 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1bf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.702110:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333176.702110:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85200/0xb32e3ef184c57561 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1bf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.702116:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c85200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333176.702121:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c57568 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1bf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.702121:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85200/0xb32e3ef184c57561 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1bf:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.702127:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c84e00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333176.702129:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85200/0xb32e3ef184c57561 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1bf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.702130:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c57568 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1bf:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.702140:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c57568 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1bf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.702141:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bf:0x0].0x0 (ffff92fe48355d00) 00010000:00010000:0.0:1763333176.702144:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1763333176.702148:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85200/0xb32e3ef184c57561 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1bf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.702149:0:8422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1bf:0x0].0x0 (ffff92fe48355d00) 00010000:00010000:1.0:1763333176.702152:0:8422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1763333176.702154:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c57568 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1bf:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.702154:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85200/0xb32e3ef184c57561 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1bf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.702160:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c57568 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1bf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.702175:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333176.702176:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333176.702178:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333176.702278:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57553 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.702289:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57553 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.702294:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57553 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.702299:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57553 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.702304:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c84600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333176.702307:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57553 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.702312:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57553 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.702319:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355600) 00010000:00010000:0.0:1763333176.702322:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333176.702325:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57553 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.702330:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57553 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000004:00010000:0.0:1763333176.702342:0:8606:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000052a79940 reply state 0000000043c56e60 transno 4294972451 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c5755a lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.702387:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c5755a lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333176.702392:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355200) 00010000:00010000:0.0:1763333176.702395:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333176.702397:0:8606:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763333176.702506:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56892:x1848987613772032:12345-192.168.204.28@tcp:36:rm.0 Request processed in 2667us (2895us total) trans 4294972451 rc 0/0 00000100:00100000:0.0:1763333176.702515:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9460 00000100:00100000:1.0:1763333176.708017:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333176.708113:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613772288 00000100:00100000:2.0:1763333176.708123:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613772288 00000100:00100000:2.0:1763333176.708186:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9461 00000100:00100000:2.0:1763333176.708196:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56891:x1848987613772288:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333176.708222:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333176.708244:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5756f lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969d3a expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.708329:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57576 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333176.708345:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57576 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333176.708393:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57576 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333176.708406:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5757d lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333176.708413:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5757d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333176.708419:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5757d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333176.708482:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57576 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333176.708490:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57576 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333176.708495:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57576 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333176.708501:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57576 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333176.708507:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333176.708510:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57576 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333176.708520:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57576 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333176.708531:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff621ac300) 00010000:00010000:2.0:1763333176.708534:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333176.708539:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57576 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333176.708545:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57576 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333176.708559:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5757d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333176.708564:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5757d lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333176.708570:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5757d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333176.708575:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333176.708578:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5757d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333176.708583:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5757d lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333176.708590:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355200) 00010000:00010000:2.0:1763333176.708593:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333176.708595:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5757d lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333176.708600:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5757d lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333176.708632:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5756f lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d3a expref: 247 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.708642:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff621ac300) 00010000:00010000:2.0:1763333176.708644:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763333176.708648:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5756f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d3a expref: 247 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.708660:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4400, rc 0) 00000100:00100000:2.0:1763333176.708727:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56891:x1848987613772288:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 533us (720us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333176.708736:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9461 00000100:00100000:2.0:1763333176.723176:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.725566:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613772416 00000100:00100000:1.0:1763333176.725585:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613772416 00000100:00100000:1.0:1763333176.725680:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9462 00000100:00100000:1.0:1763333176.725691:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56893:x1848987613772416:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333176.725712:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333176.725738:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c57584 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969d41 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.725803:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5758b lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333176.725817:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5758b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.725828:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5758b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.725843:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c57592 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333176.725850:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c57592 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.725856:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c57592 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.725900:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5758b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.725907:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5758b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.725913:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5758b lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.725919:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5758b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.725924:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333176.725929:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5758b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.725936:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5758b lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.726159:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff62250a00) 00010000:00010000:1.0:1763333176.726163:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333176.726170:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5758b lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.726177:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5758b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.726194:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c57592 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.726201:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c57592 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.726206:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c57592 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.726210:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdfe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333176.726213:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c57592 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.726218:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c57592 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.726226:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355200) 00010000:00010000:1.0:1763333176.726228:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333176.726232:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c57592 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.726237:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c57592 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.726264:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c57584 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d41 expref: 247 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.726274:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff62250a00) 00010000:00010000:1.0:1763333176.726276:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333176.726279:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c57584 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d41 expref: 247 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.726297:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdea00, rc 0) 00000100:00100000:1.0:1763333176.728524:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56893:x1848987613772416:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 2822us (5345us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333176.728538:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9462 00000100:00100000:3.0:1763333176.735685:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.735903:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613772544 00000100:00100000:1.0:1763333176.735914:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613772544 00000100:00100000:1.0:1763333176.736320:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9463 00000100:00100000:1.0:1763333176.736332:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56893:x1848987613772544:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333176.736524:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333176.737042:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85200/0xb32e3ef184c57599 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969d48 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.737115:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c575a0 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333176.737130:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c575a0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.737143:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c575a0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.737154:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c575a7 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333176.737161:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c575a7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.737167:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c575a7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.737211:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c575a0 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.737219:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c575a0 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.737225:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c575a0 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.737231:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c575a0 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.737242:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c84400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333176.737245:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c575a0 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.737252:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c575a0 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.737264:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355600) 00010000:00010000:0.0:1763333176.737267:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333176.737272:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c575a0 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.737278:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c575a0 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.737291:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c575a7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.737297:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c575a7 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.737303:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c575a7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.737307:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c85c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333176.737310:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c575a7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.737316:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c575a7 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.737323:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355200) 00010000:00010000:0.0:1763333176.737326:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333176.737329:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c575a7 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.737335:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c575a7 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.737411:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85200/0xb32e3ef184c57599 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d48 expref: 247 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.737422:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355600) 00010000:00010000:0.0:1763333176.737425:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333176.737429:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85200/0xb32e3ef184c57599 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d48 expref: 247 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.737453:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45c85200, rc 0) 00000100:00100000:0.0:1763333176.737522:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56893:x1848987613772544:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1192us (1846us total) trans 0 rc 301/301 00000100:00100000:0.0:1763333176.737531:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9463 00000100:00100000:0.0:1763333176.745134:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333176.745480:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613772800 00000100:00100000:2.0:1763333176.745492:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613772800 00000100:00100000:2.0:1763333176.745559:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9464 00000100:00100000:2.0:1763333176.745568:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56894:x1848987613772800:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333176.745588:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333176.745610:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c575ae lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969d4f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.745681:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c575b5 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333176.745694:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c575b5 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.745704:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c575b5 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.745713:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c575bc lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333176.745719:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c575bc lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.745724:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c575bc lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.745759:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c575b5 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.745764:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c575b5 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.745770:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c575b5 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.745776:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c575b5 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.745781:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333176.745785:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c575b5 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.745791:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c575b5 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.745802:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff621ac300) 00010000:00010000:2.0:1763333176.745805:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333176.745809:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c575b5 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.745814:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c575b5 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.745828:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c575bc lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.745833:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c575bc lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.745837:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c575bc lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.745842:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333176.745845:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c575bc lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.745850:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c575bc lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.745856:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355200) 00010000:00010000:2.0:1763333176.745858:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333176.745861:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c575bc lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.745866:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c575bc lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.745892:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c575ae lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d4f expref: 247 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.745902:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff621ac300) 00010000:00010000:2.0:1763333176.745904:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763333176.745907:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c575ae lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d4f expref: 247 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.745924:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5e00, rc 0) 00000100:00100000:2.0:1763333176.747771:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56894:x1848987613772800:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 2193us (2635us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333176.747783:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9464 00000100:00100000:3.0:1763333176.748249:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.749375:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613772928 00000100:00100000:0.0:1763333176.749387:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613772928 00000100:00100000:0.0:1763333176.749459:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9465 00000100:00100000:0.0:1763333176.749472:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56893:x1848987613772928:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333176.749495:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333176.749521:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c575c3 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969d56 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.749583:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c575ca lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333176.749601:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c575ca lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.749612:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c575ca lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:0.0:1763333176.749660:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1763333176.749666:0:6519:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763333176.749698:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c575c3 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d56 expref: 248 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.749716:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c575ca lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d56 expref: 247 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.749725:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355000) 00010000:00010000:0.0:1763333176.749728:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1763333176.749732:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45c84400, rc 0) 00000100:00100000:0.0:1763333176.749785:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56893:x1848987613772928:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 317us (1535us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333176.749792:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9465 00000100:00100000:0.0:1763333176.757070:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333176.757146:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613773056 00000100:00100000:2.0:1763333176.757158:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613773056 00000100:00100000:2.0:1763333176.757232:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9466 00000100:00100000:2.0:1763333176.757243:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56894:x1848987613773056:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333176.757265:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333176.757287:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c575d1 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969d5d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.757435:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c575d8 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333176.757461:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c575d8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.757473:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c575d8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.757485:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c575df lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333176.757491:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c575df lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.757496:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c575df lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.757537:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c575d8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.757543:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c575d8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.757549:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c575d8 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.757556:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c575d8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.757562:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333176.757566:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c575d8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.757572:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c575d8 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.757584:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355000) 00010000:00010000:2.0:1763333176.757587:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333176.757591:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c575d8 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.757597:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c575d8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.757609:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c575df lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.757615:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c575df lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.757620:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c575df lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.757625:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333176.757628:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c575df lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.757633:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c575df lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.757639:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355200) 00010000:00010000:2.0:1763333176.757641:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333176.757644:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c575df lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.757649:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c575df lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.757672:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c575d1 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d5d expref: 248 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.757681:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355000) 00010000:00010000:2.0:1763333176.757683:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333176.757686:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c575d1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d5d expref: 248 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.757695:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4a00, rc 0) 00000100:00100000:2.0:1763333176.758376:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56894:x1848987613773056:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1109us (1289us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333176.758385:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9466 00000100:00100000:2.0:1763333176.768620:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.769072:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613773312 00000100:00100000:0.0:1763333176.769083:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613773312 00000100:00100000:0.0:1763333176.769151:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9467 00000100:00100000:0.0:1763333176.769161:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56893:x1848987613773312:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333176.769183:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333176.769186:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763333176.769214:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c575ca lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d56 expref: 247 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.769234:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355000) 00010000:00010000:0.0:1763333176.769245:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333176.769259:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c575e6 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969d64 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.769488:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c575ed lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333176.769503:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c575ed lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.769515:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c575ed lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.769526:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c575f4 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333176.769533:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c575f4 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.769540:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c575f4 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.769911:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c575fb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333176.769920:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c575fb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.769929:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c575fb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:1.0:1763333176.769938:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c1:0x0]: returning size 0 00010000:00010000:1.0:1763333176.769963:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c575ed lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.769970:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c575ed lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.769976:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c575ed lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.769982:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c575ed lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.769988:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdea00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333176.769991:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c575ed lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.769999:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c575ed lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.770008:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355600) 00010000:00010000:1.0:1763333176.770010:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333176.770014:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c575ed lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.770020:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c575ed lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:1.0:1763333176.770031:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000020b73589 reply state 000000002eaa679a transno 4294972452 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c575f4 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.770046:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c575f4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333176.770052:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355200) 00010000:00010000:1.0:1763333176.770054:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333176.770057:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763333176.770082:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c575e6 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d64 expref: 249 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.770099:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c575fb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d64 expref: 248 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.770107:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff92ff62250a00) 00010000:00010000:1.0:1763333176.770109:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333176.770111:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdf200, rc 0) 00000100:00100000:1.0:1763333176.776760:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:56893:x1848987613773312:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 7587us (8135us total) trans 4294972452 rc 0/0 00000100:00100000:1.0:1763333176.776774:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9467 00000100:00100000:1.0:1763333176.783287:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.783334:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333176.783395:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613773568 00000100:00100000:2.0:1763333176.783407:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613773568 00000100:00100000:3.0:1763333176.783450:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613773824 00000100:00100000:3.0:1763333176.783456:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613773824 00000100:00100000:2.0:1763333176.784038:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9468 00000100:00100000:2.0:1763333176.784051:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:56895:x1848987613773568:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333176.784076:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1763333176.784113:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9469 00000100:00100000:1.0:1763333176.784190:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:56893:x1848987613773824:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333176.784199:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333176.784675:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57609 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1c1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969d6b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.784807:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c57610 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1c1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969d72 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.784859:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c57617 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333176.784875:0:12741:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c575fb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d64 expref: 252 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.784886:0:12741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c57617 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333176.784922:0:12741:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c575fb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d64 expref: 252 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.784937:0:12741:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c575fb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d64 expref: 252 pid: 6519 timeout: 1380 lvb_type: 0 00000100:00100000:1.0:1763333176.784951:0:12741:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7dcff480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627287040:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333176.785047:0:12741:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff742b9c00 going to sleep for 11 seconds 00010000:00010000:2.0:1763333176.785109:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5761e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333176.785120:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5761e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.785131:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5761e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:2.0:1763333176.785144:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c1:0x0]: returning size 0 00010000:00010000:2.0:1763333176.785229:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5761e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.785237:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5761e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.785244:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5761e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.785251:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333176.785255:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5761e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.785262:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5761e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.785274:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff92ff62250a00) 00010000:00010000:2.0:1763333176.785277:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1763333176.785282:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5761e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.785287:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c5761e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.785326:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57609 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d6b expref: 253 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.785335:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff92ff62250a00) 00010000:00010000:2.0:1763333176.785338:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763333176.785342:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57609 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d6b expref: 253 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.785393:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4a00, rc 0) 00000100:00100000:2.0:1763333176.785428:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:56895:x1848987613773568:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1381us (2151us total) trans 4294972453 rc 301/301 00000100:00100000:2.0:1763333176.785437:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9468 00000100:00100000:2.0:1763333176.787966:0:12741:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7dcff480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627287040:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333176.787993:0:12741:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c57617 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000100:00100000:1.0:1763333176.788058:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.788558:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.788644:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613774208 00000100:00100000:0.0:1763333176.788651:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613774208 00000100:00100000:2.0:1763333176.788770:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613773952 00000100:00100000:2.0:1763333176.788775:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613773952 00010000:00010000:2.0:1763333176.788797:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c575fb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d64 expref: 253 pid: 6519 timeout: 1380 lvb_type: 0 00000100:00100000:2.0:1763333176.788823:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3122 00000100:00100000:2.0:1763333176.788832:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:2421:x1848987613773952:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333176.788847:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333176.788853:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c575fb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d64 expref: 253 pid: 6519 timeout: 1380 lvb_type: 0 00010000:00010000:2.0:1763333176.788865:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c575fb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d64 expref: 253 pid: 6519 timeout: 1380 lvb_type: 0 00010000:00010000:2.0:1763333176.788887:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c575fb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d64 expref: 253 pid: 6519 timeout: 1380 lvb_type: 0 00010000:00010000:2.0:1763333176.788902:0:28428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff92ff62250a00) 00010000:00010000:2.0:1763333176.788907:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c57617 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.788915:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c57617 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.788922:0:28428:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c57617 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.788943:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333176.788997:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:2421:x1848987613773952:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 166us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333176.789005:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3122 00010000:00010000:2.0:1763333176.789027:0:12741:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c57617 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.789034:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c57617 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:2.0:1763333176.789055:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c1:0x0]: returning size 0 00000004:00080000:2.0:1763333176.789213:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x24b:0x0], index 0: 0 00000004:00080000:2.0:1763333176.789220:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x24b:0x0], index 1: 0 00000004:00080000:2.0:1763333176.789225:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x24c:0x0], index 1: 0 00000004:00080000:2.0:1763333176.789230:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x24c:0x0], index 0: 0 00010000:00010000:2.0:1763333176.789327:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c57617 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.789334:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c57617 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.789342:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c57617 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.789365:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe467bf600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333176.789369:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c57617 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.789376:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c57617 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.789384:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff92ff62250a00) 00010000:00010000:2.0:1763333176.789387:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333176.789391:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c57617 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.789396:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c57617 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.789450:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c57610 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d72 expref: 252 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.789460:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff92ff62250a00) 00010000:00010000:2.0:1763333176.789462:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763333176.789466:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c57610 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d72 expref: 252 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.789481:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdea00, rc 0) 00000100:00100000:2.0:1763333176.789513:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:56893:x1848987613773824:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 5392us (6178us total) trans 4294972454 rc 301/301 00000100:00100000:2.0:1763333176.789520:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9469 00000100:00100000:0.0:1763333176.789713:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3234 00000100:00100000:0.0:1763333176.789723:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:56895:x1848987613774208:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333176.789889:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:56895:x1848987613774208:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 168us (1331us total) trans 4294972455 rc 0/0 00000100:00100000:0.0:1763333176.789895:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3234 00000100:00100000:2.0:1763333176.796736:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333176.796838:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613774720 00000100:00100000:3.0:1763333176.796849:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613774720 00000100:00100000:3.0:1763333176.797085:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9470 00000100:00100000:3.0:1763333176.797098:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:56895:x1848987613774720:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333176.797123:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333176.797146:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c57633 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969d79 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.797228:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5763a lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333176.797243:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5763a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.797253:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5763a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.797269:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c57641 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333176.797278:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c57641 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.797284:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c57641 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.797421:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c57648 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333176.797430:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c57648 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.797437:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c57648 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:3.0:1763333176.797479:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c1:0x0]: returning size 0 00010000:00010000:3.0:1763333176.797558:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5763a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.797566:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5763a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.797571:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5763a lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.797576:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5763a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.797581:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7ec00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333176.797585:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5763a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.797592:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5763a lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.797603:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff8016fb00) 00010000:00010000:3.0:1763333176.797607:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333176.797611:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5763a lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.797615:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c5763a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.797626:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c57641 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.797632:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c57641 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.797636:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c57641 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.797640:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333176.797643:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c57641 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.797647:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c57641 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.797654:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355200) 00010000:00010000:3.0:1763333176.797656:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333176.797658:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c57641 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.797663:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c57641 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.797699:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c57633 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d79 expref: 254 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.797714:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c57648 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d79 expref: 253 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.797721:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff92ff8016f800) 00010000:00010000:3.0:1763333176.797723:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333176.797725:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e000, rc 0) 00000100:00100000:3.0:1763333176.800245:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:56895:x1848987613774720:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 3139us (3508us total) trans 4294972456 rc 0/0 00000100:00100000:3.0:1763333176.800259:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9470 00000100:00100000:2.0:1763333176.800390:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.800561:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613774464 00000100:00100000:0.0:1763333176.800571:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613774464 00000100:00100000:0.0:1763333176.800616:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3235 00000100:00100000:0.0:1763333176.800625:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:56893:x1848987613774464:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333176.801319:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+254:56893:x1848987613774464:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 692us (926us total) trans 4294972457 rc 0/0 00000100:00100000:0.0:1763333176.801327:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3235 00000100:00100000:0.0:1763333176.806856:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.806900:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.806935:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333176.806964:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613775232 00000100:00100000:2.0:1763333176.806975:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613775232 00000100:00100000:2.0:1763333176.807032:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3236 00000100:00100000:2.0:1763333176.807041:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+254:56893:x1848987613775232:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1763333176.807209:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613774848 00000100:00100000:1.0:1763333176.807214:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613774848 00000100:00100000:1.0:1763333176.807249:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613774976 00000100:00100000:1.0:1763333176.807253:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613774976 00000100:00100000:2.0:1763333176.807254:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+255:56893:x1848987613775232:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 211us (350us total) trans 4294972458 rc 0/0 00000100:00100000:2.0:1763333176.807264:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3236 00000100:00100000:1.0:1763333176.807281:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6677 00000100:00100000:1.0:1763333176.807291:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2421:x1848987613774848:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333176.807302:0:17605:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333176.807323:0:17605:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c57656 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969d80 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333176.807373:0:17605:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x24c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333176.807392:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333176.807394:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333176.807404:0:17605:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c57656 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d80 expref: 23 pid: 17605 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333176.807422:0:17605:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c57656 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d80 expref: 23 pid: 17605 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333176.807435:0:17605:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe467bf600, rc 0) 00000100:00100000:1.0:1763333176.807467:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2421:x1848987613774848:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 179us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333176.807473:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6677 00000100:00100000:1.0:1763333176.807488:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6678 00000100:00100000:1.0:1763333176.807495:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2420:x1848987613774976:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333176.807503:0:17605:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333176.807514:0:17605:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf200/0xb32e3ef184c5765d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969d87 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333176.807530:0:17605:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333176.807539:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333176.807541:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333176.807546:0:17605:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf200/0xb32e3ef184c5765d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d87 expref: 14 pid: 17605 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333176.807556:0:17605:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf200/0xb32e3ef184c5765d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d87 expref: 14 pid: 17605 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333176.807564:0:17605:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe467bf200, rc 0) 00000100:00100000:1.0:1763333176.807584:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2420:x1848987613774976:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 90us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333176.807590:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6678 00000100:00100000:1.0:1763333176.812046:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333176.812690:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613775488 00000100:00100000:3.0:1763333176.812701:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613775488 00000100:00100000:3.0:1763333176.812755:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9471 00000100:00100000:3.0:1763333176.812766:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+255:55917:x1848987613775488:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333176.812791:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333176.812795:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763333176.812822:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c57648 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d79 expref: 255 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.812840:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff92ff8016f800) 00010000:00010000:3.0:1763333176.812850:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333176.812865:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c57664 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x1c1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969d8e expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.813006:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5766b lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1c1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333176.813020:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5766b lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1c1:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.813030:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5766b lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1c1:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:3.0:1763333176.813045:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c1:0x0]: returning size 0 00010000:00010000:3.0:1763333176.813158:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c57664 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1c1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d8e expref: 257 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.813171:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5766b lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1c1:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d8e expref: 256 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.813179:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff92ff8016fb00) 00010000:00010000:3.0:1763333176.813181:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:3.0:1763333176.813184:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f000, rc 0) 00000100:00100000:3.0:1763333176.813253:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+256:55917:x1848987613775488:12345-192.168.204.28@tcp:101:bash.0 Request processed in 488us (1214us total) trans 4294972459 rc 0/0 00000100:00100000:3.0:1763333176.813261:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9471 00000100:00100000:1.0:1763333176.815903:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333176.816185:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613775616 00000100:00100000:3.0:1763333176.816195:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613775616 00000100:00100000:3.0:1763333176.816250:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9472 00000100:00100000:3.0:1763333176.816260:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+256:56895:x1848987613775616:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333176.816279:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333176.816300:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c57679 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1c1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969d95 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.816366:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c57679 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d95 expref: 257 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.816379:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c57679 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d95 expref: 257 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.816396:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff92ff8016fb00) 00010000:00010000:3.0:1763333176.816399:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763333176.816403:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7ec00, rc 0) 00000100:00100000:3.0:1763333176.816460:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+257:56895:x1848987613775616:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 202us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333176.816466:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9472 00000100:00100000:0.0:1763333176.816533:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333176.818087:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613775744 00000100:00100000:3.0:1763333176.818099:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613775744 00000100:00100000:3.0:1763333176.818162:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9473 00000100:00100000:3.0:1763333176.818171:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49609880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+257:55917:x1848987613775744:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333176.818194:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333176.818215:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c57680 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969d9c expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.818247:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c57687 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333176.818258:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c57687 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.818268:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c57687 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.818405:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c57680 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d9c expref: 259 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.818429:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c57687 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d9c expref: 258 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.818437:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff92ff8016fb00) 00010000:00010000:3.0:1763333176.818450:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763333176.818454:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e800, rc 0) 00000100:00100000:3.0:1763333176.818512:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49609880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+258:55917:x1848987613775744:12345-192.168.204.28@tcp:101:bash.0 Request processed in 341us (1979us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333176.818519:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9473 00000100:00100000:0.0:1763333176.821277:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333176.821389:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613776000 00000100:00100000:2.0:1763333176.821402:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613776000 00000100:00100000:2.0:1763333176.821475:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3237 00000100:00100000:2.0:1763333176.821487:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc00850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+258:56895:x1848987613776000:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333176.822844:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc00850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+259:56895:x1848987613776000:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 1352us (1569us total) trans 4294972460 rc 0/0 00000100:00100000:2.0:1763333176.822855:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3237 00000100:00100000:1.0:1763333176.823808:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.824166:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613776256 00000100:00100000:0.0:1763333176.824178:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613776256 00000100:00100000:0.0:1763333176.824239:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9474 00000100:00100000:0.0:1763333176.824250:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+259:55917:x1848987613776256:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:0.0:1763333176.824299:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333176.824324:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5766b lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1c1:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d8e expref: 259 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.824344:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff92ff8016fb00) 00010000:00010000:0.0:1763333176.824389:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333176.824575:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c5768e lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1c1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333176.824589:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c5768e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.824598:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c5768e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000001:00080000:0.0:1763333176.824642:0:6519:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294972461 00000004:00010000:0.0:1763333176.824665:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f7bce2fb reply state 000000008a7beef2 transno 4294972462 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c5768e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.824676:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c5768e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1c1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.824683:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff92ff8016fb00) 00010000:00010000:0.0:1763333176.824685:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333176.824688:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763333176.824772:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+261:55917:x1848987613776256:12345-192.168.204.28@tcp:36:bash.0 Request processed in 523us (966us total) trans 4294972462 rc 0/0 00000100:00100000:0.0:1763333176.824779:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9474 00000020:00080000:0.0:1763333176.824785:0:6519:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763333176.827511:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333176.827799:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613776512 00000100:00100000:3.0:1763333176.827809:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613776512 00000100:00100000:3.0:1763333176.828195:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9475 00000100:00100000:3.0:1763333176.828205:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+261:56895:x1848987613776512:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333176.828228:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333176.828249:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c57695 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969da3 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.828314:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5769c lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333176.828327:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5769c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.828338:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5769c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.828379:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c576a3 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333176.828391:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c576a3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.828398:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c576a3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.828505:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c576aa lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333176.828513:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c576aa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.828520:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c576aa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:3.0:1763333176.828530:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c1:0x0]: returning size 0 00010000:00010000:3.0:1763333176.828597:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5769c lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.828604:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5769c lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.828610:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5769c lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.828616:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5769c lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.828621:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333176.828625:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5769c lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.828632:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5769c lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.828646:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff8016f800) 00010000:00010000:3.0:1763333176.828649:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333176.828653:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5769c lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.828659:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5769c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.828669:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c576a3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.828675:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c576a3 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.828680:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c576a3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.828685:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333176.828688:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c576a3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.828694:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c576a3 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.828699:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355200) 00010000:00010000:3.0:1763333176.828701:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333176.828704:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c576a3 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.828709:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c576a3 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.828739:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c57695 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969da3 expref: 264 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.828754:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c576aa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969da3 expref: 263 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.828761:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff92ff8016fb00) 00010000:00010000:3.0:1763333176.828764:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333176.828766:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe467be000, rc 0) 00000100:00100000:3.0:1763333176.828818:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+263:56895:x1848987613776512:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 614us (1477us total) trans 4294972463 rc 0/0 00000100:00100000:3.0:1763333176.828825:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9475 00000100:00100000:1.0:1763333176.834210:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333176.834770:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613776768 00000100:00100000:3.0:1763333176.835029:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613776768 00000100:00100000:1.0:1763333176.835206:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333176.835490:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613777024 00000100:00100000:2.0:1763333176.835497:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613777024 00000100:00100000:2.0:1763333176.835556:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3238 00000100:00100000:2.0:1763333176.835568:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+264:56895:x1848987613777024:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333176.835844:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+265:56895:x1848987613777024:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 278us (639us total) trans 4294972464 rc 0/0 00000100:00100000:2.0:1763333176.835852:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3238 00000100:00100000:0.0:1763333176.838234:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9476 00000100:00100000:0.0:1763333176.838250:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+264:55917:x1848987613776768:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333176.838270:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333176.838273:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763333176.838300:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c57679 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d95 expref: 264 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.838317:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff92ff8016fb00) 00010000:00010000:0.0:1763333176.838323:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333176.838337:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85400/0xb32e3ef184c576b8 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969daa expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333176.839383:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333176.839470:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613777152 00000100:00100000:3.0:1763333176.839479:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613777152 00000100:00100000:3.0:1763333176.839524:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3239 00000100:00100000:3.0:1763333176.839531:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+265:56895:x1848987613777152:12345-192.168.204.28@tcp:33:lfs.0 00000100:00100000:3.0:1763333176.839674:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+265:56895:x1848987613777152:12345-192.168.204.28@tcp:33:lfs.0 Request processed in 142us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333176.839682:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3239 00010000:00010000:0.0:1763333176.840209:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c576bf lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333176.840226:0:12741:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c576aa lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969da3 expref: 264 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.840236:0:12741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c576bf lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.840268:0:12741:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c576aa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969da3 expref: 264 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.840282:0:12741:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c576aa lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969da3 expref: 264 pid: 12741 timeout: 1380 lvb_type: 0 00000100:00100000:0.0:1763333176.840296:0:12741:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4960b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627287168:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333176.840375:0:12741:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7dfb5600 going to sleep for 11 seconds 00000100:00100000:0.0:1763333176.845597:0:12741:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4960b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627287168:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333176.845635:0:12741:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c576bf lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000100:00100000:1.0:1763333176.849463:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333176.851224:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613777280 00000100:00100000:2.0:1763333176.851242:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613777280 00010000:00010000:2.0:1763333176.851298:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c576aa lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969da3 expref: 265 pid: 12741 timeout: 1380 lvb_type: 0 00000100:00100000:0.0:1763333176.852857:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3123 00000100:00100000:0.0:1763333176.852884:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+265:2420:x1848987613777280:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333176.852903:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333176.852913:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c576aa lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969da3 expref: 265 pid: 12741 timeout: 1380 lvb_type: 0 00010000:00010000:0.0:1763333176.852931:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c576aa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969da3 expref: 265 pid: 12741 timeout: 1380 lvb_type: 0 00010000:00010000:0.0:1763333176.852954:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467be000/0xb32e3ef184c576aa lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969da3 expref: 265 pid: 12741 timeout: 1380 lvb_type: 0 00010000:00010000:0.0:1763333176.852971:0:28428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff92ff8016fb00) 00010000:00010000:0.0:1763333176.852976:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c576bf lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.852986:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c576bf lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333176.852993:0:28428:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c576bf lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.854340:0:12741:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c576bf lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.854373:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c576bf lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000040:00080000:3.0:1763333176.854612:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1463, 88 off123184 00000004:00080000:3.0:1763333176.854620:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1280934270282ns, next at 1281590880154ns, rc = 0 00000040:00080000:3.0:1763333176.854657:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1462, 88 off123184 00000004:00080000:3.0:1763333176.854663:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1280934314266ns, next at 1280856550572ns, rc = 0 00000040:00080000:3.0:1763333176.854677:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1463, 88 off123272 00000004:00080000:3.0:1763333176.854681:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1280934332066ns, next at 1280856550572ns, rc = 0 00000040:00080000:3.0:1763333176.854691:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1464, 88 off123272 00000004:00080000:3.0:1763333176.854695:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1280934345740ns, next at 1281590880154ns, rc = 0 00010000:00010000:0.0:1763333176.855562:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333176.855649:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+265:2420:x1848987613777280:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 2771us (6204us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333176.855661:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3123 00000100:00100000:1.0:1763333176.857686:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333176.857761:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613777536 00000100:00100000:2.0:1763333176.857772:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613777536 00000100:00100000:2.0:1763333176.857838:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9477 00000100:00100000:2.0:1763333176.857848:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6b3cec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+265:56896:x1848987613777536:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333176.857869:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333176.857895:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c576c6 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969db1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.857977:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c576cd lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333176.857991:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c576cd lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.858003:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c576cd lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.858014:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c576d4 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333176.858021:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c576d4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.858028:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c576d4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.858139:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c576db lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333176.858149:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c576db lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.858155:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c576db lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:2.0:1763333176.858165:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c1:0x0]: returning size 2 00010000:00010000:2.0:1763333176.858250:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c576db lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.858258:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c576db lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.858265:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c576db lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.858270:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333176.858275:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c576db lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.858282:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c576db lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.858295:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff92ff8016fb00) 00010000:00010000:2.0:1763333176.858298:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1763333176.858303:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c576db lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.858312:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c576db lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.858328:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c576cd lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.858334:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c576cd lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.858339:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c576cd lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.858345:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c576cd lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.858390:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333176.858394:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c576cd lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.858400:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c576cd lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.858407:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff621ac300) 00010000:00010000:2.0:1763333176.858410:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333176.858413:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c576cd lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.858418:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c576cd lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.858426:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c576d4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.858432:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c576d4 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.858445:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c576d4 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.858450:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333176.858453:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c576d4 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.858458:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c576d4 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.858464:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355200) 00010000:00010000:2.0:1763333176.858466:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333176.858469:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c576d4 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.858474:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c576d4 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333176.858512:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c576c6 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969db1 expref: 267 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.858522:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff621ac300) 00010000:00010000:2.0:1763333176.858525:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763333176.858527:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c576c6 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969db1 expref: 267 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.858540:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4000, rc 0) 00000100:00100000:2.0:1763333176.858595:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6b3cec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+266:56896:x1848987613777536:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 748us (917us total) trans 4294972466 rc 301/301 00000100:00100000:2.0:1763333176.858602:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9477 00000001:00080000:1.0:1763333176.860120:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972465 is committed 00000004:00080000:1.0:1763333176.860133:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 959 committed 00000004:00080000:1.0:1763333176.860152:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 955 committed 00000004:00080000:1.0:1763333176.860162:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 954 committed 00000004:00080000:1.0:1763333176.860164:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 958 committed 00000100:00100000:1.0:1763333176.860316:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4920f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627287552:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333176.860409:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333176.860455:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1763333176.860462:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4920ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627287424:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763333176.860487:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763333176.860681:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c5755a lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.860694:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c5755a lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.860702:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c5755a lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.860708:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c84200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333176.860713:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c5755a lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.860720:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c5755a lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.860735:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355200) 00010000:00010000:3.0:1763333176.860738:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333176.860742:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c5755a lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.860749:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c5755a lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.860767:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c575f4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333176.860773:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c575f4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333176.860779:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c575f4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333176.860784:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdfe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333176.860787:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c575f4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333176.860793:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c575f4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333176.860800:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355200) 00010000:00010000:3.0:1763333176.860802:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333176.860805:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c575f4 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333176.860811:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c575f4 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333176.860829:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c5768e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1c1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333176.860836:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c5768e lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1c1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333176.860841:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c5768e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1c1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333176.860846:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c84c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333176.860849:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c5768e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1c1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333176.860856:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c5768e lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1c1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333176.860864:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff92ff8016fb00) 00010000:00010000:3.0:1763333176.860866:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333176.860870:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c5768e lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1c1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333176.860876:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c5768e lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1c1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000100:00100000:3.0:1763333176.860895:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4920ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627287296:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763333176.860925:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333176.860961:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4960b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627287808:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763333176.860985:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333176.861004:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1763333176.861010:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4920e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627287680:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333176.861030:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333176.861046:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe49608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627288192:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333176.861065:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333176.861092:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe49608a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627287936:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763333176.861113:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333176.861129:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763333176.861135:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4960bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627288064:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333176.861155:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333176.861183:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627287552 00000100:00100000:3.0:1763333176.861193:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627287552 00000100:00100000:3.0:1763333176.861238:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627287424 00000100:00100000:3.0:1763333176.861241:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627287424 00000100:00100000:3.0:1763333176.861256:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627287296 00000100:00100000:3.0:1763333176.861259:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627287296 00000100:00100000:3.0:1763333176.861270:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627287808 00000100:00100000:3.0:1763333176.861272:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627287808 00000100:00100000:3.0:1763333176.861282:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627287680 00000100:00100000:3.0:1763333176.861285:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627287680 00000100:00100000:3.0:1763333176.861294:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627288192 00000100:00100000:3.0:1763333176.861297:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627288192 00000100:00100000:3.0:1763333176.861305:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627287936 00000100:00100000:3.0:1763333176.861307:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627287936 00000100:00100000:3.0:1763333176.861315:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627288064 00000100:00100000:3.0:1763333176.861317:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627288064 00000100:00100000:3.0:1763333176.861330:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6679 00000100:00100000:3.0:1763333176.861337:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+32:3655:x1848987627287552:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333176.861557:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+33:3655:x1848987627287552:12345-0@lo:2:osp-syn-1-1.0 Request processed in 220us (1148us total) trans 17179871648 rc 0/0 00000100:00100000:3.0:1763333176.861564:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6679 00000100:00100000:3.0:1763333176.861581:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6680 00000100:00100000:3.0:1763333176.861586:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+32:3655:x1848987627287424:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763333176.861601:0:8611:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:586 count 1 00002000:00010000:3.0:1763333176.861627:0:8611:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x24a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333176.861633:0:8611:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c576e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.861646:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333176.861649:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333176.861654:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c576e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.861668:0:8611:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c576e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.861682:0:8611:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c576e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.861690:0:8611:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c576e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.861706:0:8611:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763333176.861862:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+33:3655:x1848987627287424:12345-0@lo:6:osp-syn-1-1.0 Request processed in 275us (1373us total) trans 17179871649 rc 0/0 00000100:00100000:3.0:1763333176.861869:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6680 00000100:00100000:3.0:1763333176.861881:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6681 00000100:00100000:3.0:1763333176.861887:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+32:3653:x1848987627287296:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763333176.861899:0:8611:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:585 count 1 00010000:00010000:3.0:1763333176.861910:0:8611:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c576f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.861924:0:8611:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c5751b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d1e expref: 22 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.861932:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333176.861933:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333176.861936:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c576f0 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.861965:0:8611:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c5751b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d1e expref: 22 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.861985:0:8611:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c5751b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d1e expref: 22 pid: 28651 timeout: 1380 lvb_type: 0 00000100:00100000:3.0:1763333176.861997:0:8611:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff50065180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8611:1848987627288320:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333176.862057:0:8611:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff49c92780 going to sleep for 11 seconds 00000100:00100000:3.0:1763333176.862080:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6682 00000100:00100000:3.0:1763333176.862088:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+16:3653:x1848987627287808:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763333176.862101:0:17605:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:585 count 1 00010000:00010000:3.0:1763333176.862117:0:17605:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff4148e200/0xb32e3ef184c576f7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.862129:0:17605:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c57545 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d33 expref: 13 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.862136:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333176.862138:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333176.862141:0:17605:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff4148e200/0xb32e3ef184c576f7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.862161:0:17605:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c57545 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d33 expref: 13 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.862170:0:17605:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c57545 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d33 expref: 13 pid: 28651 timeout: 1380 lvb_type: 0 00000100:00100000:3.0:1763333176.862181:0:17605:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff50064e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17605:1848987627288448:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333176.862206:0:17605:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff5119d780 going to sleep for 11 seconds 00000100:00100000:3.0:1763333176.862225:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6683 00000100:00100000:3.0:1763333176.862233:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+32:3653:x1848987627287680:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1763333176.862297:0:29013:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333176.862300:0:29013:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x24c:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763333176.862302:0:29013:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x24c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333176.862305:0:29013:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x24c:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763333176.862307:0:29013:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x24c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333176.862343:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+33:3653:x1848987627287680:12345-0@lo:2:osp-syn-1-1.0 Request processed in 111us (1311us total) trans 17179871650 rc 0/0 00000100:00100000:3.0:1763333176.862377:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6683 00000100:00100000:3.0:1763333176.862391:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6684 00000100:00100000:3.0:1763333176.862398:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4399a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+16:3653:x1848987627288192:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1763333176.862478:0:29013:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333176.862481:0:29013:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763333176.862483:0:29013:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333176.862485:0:29013:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763333176.862487:0:29013:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333176.862513:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4399a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+17:3653:x1848987627288192:12345-0@lo:2:osp-syn-0-1.0 Request processed in 116us (1447us total) trans 21474838952 rc 0/0 00000100:00100000:3.0:1763333176.862520:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6684 00000100:00100000:3.0:1763333176.862533:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6685 00000100:00100000:3.0:1763333176.862539:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43999180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+16:3654:x1848987627287936:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763333176.862551:0:29013:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:586 count 1 00002000:00010000:3.0:1763333176.862570:0:29013:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333176.862575:0:29013:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c576fe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.862584:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333176.862586:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333176.862589:0:29013:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c576fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.862599:0:29013:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c576fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.862607:0:29013:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c576fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.862615:0:29013:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c576fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.862629:0:29013:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1763333176.862753:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43999180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+17:3654:x1848987627287936:12345-0@lo:6:osp-syn-0-1.0 Request processed in 214us (1638us total) trans 21474838953 rc 0/0 00000100:00100000:3.0:1763333176.862760:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6685 00000100:00100000:3.0:1763333176.862773:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6686 00000100:00100000:3.0:1763333176.862780:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4399b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+16:3654:x1848987627288064:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333176.862849:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4399b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+17:3654:x1848987627288064:12345-0@lo:2:osp-syn-0-1.0 Request processed in 68us (1692us total) trans 21474838954 rc 0/0 00000100:00100000:3.0:1763333176.862855:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6686 00000004:00080000:3.0:1763333176.862904:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4960bb80/2, rc 0, transno 21474838954 00000100:00100000:3.0:1763333176.862911:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4960bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627288064:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1763333176.862921:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe49608a80/2, rc 0, transno 21474838953 00000100:00100000:3.0:1763333176.862925:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe49608a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627287936:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1763333176.862949:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4920e300/2, rc 0, transno 17179871650 00000100:00100000:3.0:1763333176.862954:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4920e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627287680:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763333176.862963:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe49608700/2, rc 0, transno 21474838952 00000100:00100000:3.0:1763333176.862966:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe49608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627288192:0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1763333176.863019:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c576bf lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c1:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969daa expref: 243 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.863030:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff92ff8016fb00) 00010000:00010000:3.0:1763333176.863033:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763333176.863048:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85400/0xb32e3ef184c576b8 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969daa expref: 243 pid: 12741 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1763333176.863062:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c576bf lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c1:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969daa expref: 242 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.863088:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff92ff8016fb00) 00010000:00010000:3.0:1763333176.863091:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763333176.863093:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45c85e00, rc 0) 00000100:00100000:3.0:1763333176.863120:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:55917:x1848987613776768:12345-192.168.204.28@tcp:101:bash.0 Request processed in 24875us (28919us total) trans 4294972465 rc 0/0 00000100:00100000:3.0:1763333176.863127:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9476 00010000:00010000:0.0:1763333176.864570:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1763333176.864580:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c576e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.864590:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff4148e600 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333176.864594:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c576e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.864604:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c576e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.864623:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c576e9 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.864631:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c576e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.864654:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333176.864659:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c576fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.864666:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feb400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333176.864669:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c576fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.864676:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c576fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.864687:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c576fe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.864692:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c576fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.864704:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333176.864706:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333176.864707:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763333176.864803:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4920ea00/2, rc 0, transno 17179871649 00000100:00100000:1.0:1763333176.864811:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4920ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627287424:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1763333176.864821:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4920f800/2, rc 0, transno 17179871648 00000100:00100000:1.0:1763333176.864824:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4920f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627287552:0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1763333176.864927:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763333176.872935:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333176.873379:0:17605:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff50064e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17605:1848987627288448:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333176.873410:0:17605:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92ff4148e200/0xb32e3ef184c576f7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333176.873714:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333176.873806:0:8611:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff50065180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8611:1848987627288320:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333176.873821:0:8611:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c576f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333176.874014:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.874048:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.874095:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613777792 00000100:00100000:0.0:1763333176.874103:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613777792 00010000:00010000:0.0:1763333176.874139:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c57545 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d33 expref: 14 pid: 28651 timeout: 1380 lvb_type: 0 00000100:00100000:0.0:1763333176.874177:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613777664 00000100:00100000:0.0:1763333176.874181:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613777664 00010000:00010000:0.0:1763333176.874193:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c5751b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d1e expref: 23 pid: 28651 timeout: 1380 lvb_type: 0 00000100:00100000:0.0:1763333176.874215:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3124 00000100:00100000:0.0:1763333176.874224:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45180e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2419:x1848987613777792:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333176.874238:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333176.874244:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c57545 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x249:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d33 expref: 14 pid: 28651 timeout: 1380 lvb_type: 0 00010000:00010000:0.0:1763333176.874255:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c57545 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x249:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d33 expref: 14 pid: 28651 timeout: 1380 lvb_type: 0 00010000:00010000:0.0:1763333176.874278:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c57545 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x249:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d33 expref: 14 pid: 28651 timeout: 1380 lvb_type: 0 00010000:00010000:0.0:1763333176.874293:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333176.874295:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333176.874299:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff4148e200/0xb32e3ef184c576f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.874308:0:28428:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff4148e200/0xb32e3ef184c576f7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.874330:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333176.874402:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45180e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2419:x1848987613777792:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 178us (1477us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333176.874409:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3124 00000100:00100000:0.0:1763333176.874428:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3125 00000100:00100000:0.0:1763333176.874435:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50e69450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2419:x1848987613777664:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333176.874453:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333176.874458:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c5751b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d1e expref: 23 pid: 28651 timeout: 1380 lvb_type: 0 00010000:00010000:0.0:1763333176.874468:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c5751b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d1e expref: 23 pid: 28651 timeout: 1380 lvb_type: 0 00010000:00010000:0.0:1763333176.874482:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c5751b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d1e expref: 23 pid: 28651 timeout: 1380 lvb_type: 0 00010000:00010000:0.0:1763333176.874496:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333176.874498:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333176.874501:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c576f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.874508:0:28428:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c576f0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.874525:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333176.874544:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50e69450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2419:x1848987613777664:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 110us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333176.874551:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3125 00010000:00010000:0.0:1763333176.874599:0:8611:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c576f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.874607:0:8611:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c576f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.874616:0:8611:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c576f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.874624:0:8611:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c576f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.874640:0:8611:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763333176.874829:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+33:3653:x1848987627287296:12345-0@lo:6:osp-syn-1-1.0 Request processed in 12942us (13902us total) trans 17179871651 rc 0/0 00000100:00100000:0.0:1763333176.874839:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6681 00000100:00100000:0.0:1763333176.874851:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613777920 00000100:00100000:0.0:1763333176.874854:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613777920 00000100:00100000:0.0:1763333176.874870:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6687 00000100:00100000:0.0:1763333176.874875:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:55917:x1848987613777920:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333176.874885:0:8611:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333176.874900:0:8611:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c57705 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969db8 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763333176.874918:0:8611:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333176.874928:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333176.874930:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333176.874935:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c57705 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969db8 expref: 14 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.874945:0:8611:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c57705 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969db8 expref: 14 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333176.875171:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613778048 00000100:00100000:3.0:1763333176.875176:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613778048 00000100:00100000:3.0:1763333176.875201:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9478 00000100:00100000:3.0:1763333176.875207:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:56896:x1848987613778048:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333176.875219:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333176.875230:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5770c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1c1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969dbf expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.875306:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57713 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333176.875318:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57713 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.875327:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57713 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:3.0:1763333176.875384:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c1:0x0]: returning size 2 00000004:00200000:3.0:1763333176.875390:0:12741:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763333176.875412:0:12741:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57713 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333176.875434:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5770c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969dbf expref: 244 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.875456:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57713 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969dbf expref: 243 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.875464:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff92ff8016fb00) 00010000:00010000:3.0:1763333176.875467:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333176.875471:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea000, rc 0) 00000100:00100000:3.0:1763333176.875503:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:56896:x1848987613778048:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 296us (1489us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333176.875511:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9478 00010000:00010000:3.0:1763333176.875545:0:17605:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92ff4148e200/0xb32e3ef184c576f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.875553:0:17605:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff4148e200/0xb32e3ef184c576f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.875561:0:17605:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff4148e200/0xb32e3ef184c576f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.875567:0:17605:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92ff4148e200/0xb32e3ef184c576f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.876105:0:17605:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1763333176.876264:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+17:3653:x1848987627287808:12345-0@lo:6:osp-syn-0-1.0 Request processed in 14176us (15277us total) trans 21474838955 rc 0/0 00000100:00100000:3.0:1763333176.876272:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6682 00010000:00010000:3.0:1763333176.876398:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1763333176.876405:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c576f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.876414:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff4148ee00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333176.876417:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c576f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.876430:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c576f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.876452:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c576f0 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.876459:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c576f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.876473:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333176.876477:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92ff4148e200/0xb32e3ef184c576f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.876483:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff4148e200 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333176.876486:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff4148e200/0xb32e3ef184c576f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.876493:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff4148e200/0xb32e3ef184c576f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.876501:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92ff4148e200/0xb32e3ef184c576f7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.876508:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff4148e200/0xb32e3ef184c576f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.876523:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333176.876525:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333176.876526:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333176.876636:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763333176.877809:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4920ed80/2, rc 0, transno 17179871651 00000100:00100000:2.0:1763333176.877818:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4920ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627287296:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1763333176.877830:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4960b100/2, rc 0, transno 21474838955 00000100:00100000:2.0:1763333176.877834:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4960b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627287808:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1763333176.882138:0:8611:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45c84400, rc 0) 00000100:00100000:1.0:1763333176.882139:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.882217:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:55917:x1848987613777920:12345-192.168.204.28@tcp:101:bash.0 Request processed in 7339us (8165us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333176.882228:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6687 00000100:00100000:3.0:1763333176.882243:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613778176 00000100:00100000:3.0:1763333176.882253:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613778176 00000100:00100000:3.0:1763333176.882302:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6688 00000100:00100000:3.0:1763333176.882311:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2418:x1848987613778176:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333176.882325:0:17605:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333176.882344:0:17605:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c5771a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969dc6 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333176.882423:0:17605:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff50065180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17605:1848987627288576:192.168.204.28@tcp:106: 00000100:00100000:3.0:1763333176.882492:0:17605:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff47d72e40 going to sleep for 11 seconds 00000100:00100000:2.0:1763333176.887946:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.888005:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613778304 00000100:00100000:0.0:1763333176.888015:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613778304 00002000:00010000:3.0:1763333176.888078:0:17605:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x24b:0x0] updating lvb mtime: 0 -> 1763333177 00002000:00010000:3.0:1763333176.888084:0:17605:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x24b:0x0] updating lvb atime: 0 -> 1763333177 00000100:00100000:0.0:1763333176.888085:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6689 00002000:00010000:3.0:1763333176.888090:0:17605:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x24b:0x0] updating lvb ctime: 0 -> 1763333177 00000100:00100000:0.0:1763333176.888101:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75664380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:55917:x1848987613778304:12345-192.168.204.28@tcp:101:bash.0 00000100:00100000:3.0:1763333176.888111:0:17605:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff50065180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17605:1848987627288576:192.168.204.28@tcp:106: 00010000:00010000:0.0:1763333176.888125:0:8611:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333176.888146:0:17605:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c5771a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969dc6 expref: 15 pid: 17605 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333176.888148:0:8611:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85200/0xb32e3ef184c57721 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969dcd expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.888176:0:17605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c5771a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969dc6 expref: 15 pid: 17605 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1763333176.888177:0:8611:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x24b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333176.888197:0:17605:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea200, rc 0) 00010000:00010000:0.0:1763333176.888201:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333176.888205:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333176.888215:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85200/0xb32e3ef184c57721 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969dcd expref: 23 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.888229:0:8611:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85200/0xb32e3ef184c57721 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969dcd expref: 23 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.888237:0:8611:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45c85200, rc 0) 00000100:00100000:3.0:1763333176.888256:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2418:x1848987613778176:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 5944us (6120us total) trans 0 rc 301/301 00000100:00100000:3.0:1763333176.888267:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6688 00000100:00100000:0.0:1763333176.888268:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75664380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:55917:x1848987613778304:12345-192.168.204.28@tcp:101:bash.0 Request processed in 168us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333176.888278:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6689 00000100:00100000:1.0:1763333176.891941:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333176.895867:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.895941:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613778816 00000100:00100000:0.0:1763333176.895952:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613778816 00000100:00100000:3.0:1763333176.895964:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.896397:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3240 00000100:00100000:0.0:1763333176.896409:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50065180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:56896:x1848987613778816:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333176.896923:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50065180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56896:x1848987613778816:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 514us (1064us total) trans 4294972467 rc 0/0 00000100:00100000:0.0:1763333176.896932:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3240 00000100:00100000:1.0:1763333176.897100:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613778432 00000100:00100000:1.0:1763333176.897107:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613778432 00002000:00010000:1.0:1763333176.897133:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/587 (0->18446744073709551615) 00002000:00100000:1.0:1763333176.897138:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45180e00 with x1848987613778432 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333176.897150:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe45180e00. 00000100:00100000:1.0:1763333176.897175:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613778560 00000100:00100000:1.0:1763333176.897179:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613778560 00002000:00010000:1.0:1763333176.897197:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/587 (0->18446744073709551615) 00002000:00100000:1.0:1763333176.897200:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff50064700 with x1848987613778560 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333176.897205:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff50064700. 00000100:00100000:1.0:1763333176.897220:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1645 00000100:00100000:1.0:1763333176.897227:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2421:x1848987613778432:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:1.0:1763333176.897394:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333176.897397:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24b:0x0] updating lvb mtime from disk: 1763333177 -> 1763333177 00002000:00010000:1.0:1763333176.897400:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24b:0x0] updating lvb atime from disk: 1763333177 -> 0 00002000:00010000:1.0:1763333176.897402:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24b:0x0] updating lvb ctime from disk: 1763333177 -> 1763333177 00002000:00010000:1.0:1763333176.897405:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333176.897434:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2421:x1848987613778432:12345-192.168.204.28@tcp:10:bash.0 Request processed in 208us (5503us total) trans 21474838956 rc 0/0 00000100:00100000:1.0:1763333176.897472:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1645 00002000:00010000:1.0:1763333176.897475:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/587 (0->18446744073709551615) 00002000:00100000:1.0:1763333176.897478:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45180e00 with x1848987613778432 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333176.897483:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe45180e00. 00000100:00100000:1.0:1763333176.897499:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1646 00000100:00100000:1.0:1763333176.897506:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50064700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2421:x1848987613778560:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:1.0:1763333176.897594:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x24b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333176.897597:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x24b:0x0] updating lvb mtime from disk: 0 -> 1763333177 00002000:00010000:1.0:1763333176.897600:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x24b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333176.897601:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x24b:0x0] updating lvb ctime from disk: 0 -> 1763333177 00002000:00010000:1.0:1763333176.897604:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x24b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333176.897625:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50064700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:2421:x1848987613778560:12345-192.168.204.28@tcp:10:bash.0 Request processed in 120us (1662us total) trans 17179871652 rc 0/0 00000100:00100000:1.0:1763333176.897632:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1646 00002000:00010000:1.0:1763333176.897635:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/587 (0->18446744073709551615) 00002000:00100000:1.0:1763333176.897637:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff50064700 with x1848987613778560 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333176.897641:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff50064700. 00000100:00100000:3.0:1763333176.904017:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.904192:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613778944 00000100:00100000:1.0:1763333176.904203:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613778944 00000100:00100000:2.0:1763333176.904933:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9479 00000100:00100000:2.0:1763333176.904948:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50065c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56896:x1848987613778944:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333176.904973:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333176.904996:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c57728 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969dd4 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.905063:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5772f lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333176.905088:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5772f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.905099:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5772f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.905112:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57736 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333176.905118:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57736 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.905125:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57736 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.905197:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5773d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333176.905207:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5773d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.905214:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5773d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:2.0:1763333176.905251:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c1:0x0]: returning size 2 00000004:00200000:2.0:1763333176.905255:0:12741:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763333176.905271:0:12741:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5773d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.905281:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5773d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.905289:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5772f lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.905296:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5772f lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.905301:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5772f lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.905308:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5772f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.905313:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333176.905317:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5772f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.905325:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5772f lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.905336:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff621ac300) 00010000:00010000:2.0:1763333176.905339:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333176.905344:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5772f lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.905380:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c5772f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.905395:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57736 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.905401:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57736 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.905407:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57736 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.905412:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333176.905415:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57736 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.905421:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57736 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.905443:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff621ac200) 00010000:00010000:2.0:1763333176.905447:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333176.905450:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57736 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.905456:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57736 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333176.905484:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c57728 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969dd4 expref: 246 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.905498:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5773d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969dd4 expref: 245 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.905505:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff92ff8016fb00) 00010000:00010000:2.0:1763333176.905508:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333176.905510:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4000, rc 0) 00000100:00100000:2.0:1763333176.905573:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50065c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56896:x1848987613778944:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 630us (1566us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333176.905581:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9479 00000100:00100000:0.0:1763333176.911906:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.912091:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613779200 00000100:00100000:1.0:1763333176.912101:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613779200 00000100:00100000:1.0:1763333176.912165:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3241 00000100:00100000:1.0:1763333176.912175:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4960b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:55917:x1848987613779200:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:1.0:1763333176.912504:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4960b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:55917:x1848987613779200:12345-192.168.204.28@tcp:35:bash.0 Request processed in 329us (607us total) trans 4294972468 rc 0/0 00000100:00100000:1.0:1763333176.912512:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3241 00000100:00100000:2.0:1763333176.913136:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe45180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1848987627288704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1763333176.913196:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333176.913277:0:8409:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627288704 00000100:00100000:3.0:1763333176.913283:0:8409:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627288704 00000100:00100000:3.0:1763333176.913318:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 781 00000100:00100000:3.0:1763333176.913326:0:8409:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75665500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1848987627288704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1763333176.913344:0:8409:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 484927680 pending 28672 free 3919179776 avail 3687571456 00000100:00100000:3.0:1763333176.914023:0:8409:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75665500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1848987627288704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 695us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333176.914033:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 781 00000100:00100000:3.0:1763333176.914083:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe45181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1848987627288832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1763333176.914173:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe45180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1848987627288704:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1763333176.914246:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763333176.915220:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333176.915414:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627288832 00000100:00100000:3.0:1763333176.915422:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627288832 00000100:00100000:3.0:1763333176.915472:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 782 00000100:00100000:3.0:1763333176.915481:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75667800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1848987627288832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1763333176.915505:0:8408:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 484899008 pending 0 free 3920236544 avail 3688599552 00000100:00100000:3.0:1763333176.915567:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75667800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1848987627288832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333176.915574:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 782 00000100:00100000:1.0:1763333176.915664:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff75667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627288960:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1763333176.915698:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333176.915739:0:8409:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627288960 00000100:00100000:1.0:1763333176.915743:0:8409:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627288960 00000100:00100000:1.0:1763333176.915771:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 783 00000100:00100000:1.0:1763333176.915778:0:8409:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+17:3655:x1848987627288960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1763333176.915791:0:8409:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 484899008 pending 0 free 3920236544 avail 3688599552 00000100:00100000:1.0:1763333176.915820:0:8409:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+17:3655:x1848987627288960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333176.915826:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 783 00000100:00100000:1.0:1763333176.915865:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff75667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627288960:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1763333176.916395:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe45181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1848987627288832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1763333176.926453:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333176.926485:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333176.926528:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.928138:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613779456 00000100:00100000:1.0:1763333176.928150:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613779456 00000100:00100000:1.0:1763333176.928216:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613779840 00000100:00100000:1.0:1763333176.928220:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613779840 00000100:00100000:2.0:1763333176.928344:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613779584 00000100:00100000:2.0:1763333176.928373:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613779584 00000100:00100000:2.0:1763333176.928419:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 411 00000100:00100000:2.0:1763333176.928429:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50067b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:2419:x1848987613779584:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333176.928456:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333176.928484:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5773d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969dd4 expref: 248 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333176.928504:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff92ff8016fb00) 00010000:00010000:2.0:1763333176.928509:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333176.928561:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50067b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:2419:x1848987613779584:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 134us (2074us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333176.928569:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 411 00000100:00100000:1.0:1763333176.928996:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9480 00000100:00100000:1.0:1763333176.929008:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50065500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56896:x1848987613779456:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333176.929025:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333176.929040:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c57744 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1c1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969ddb expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.929143:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c5774b lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1c1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333176.929157:0:8606:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57713 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969dbf expref: 247 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.929167:0:8606:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c5774b lrc: 4/0,1 mode: --/CW res: [0x240000404:0x1c1:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00000100:00100000:3.0:1763333176.929250:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9481 00000100:00100000:3.0:1763333176.929264:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56897:x1848987613779840:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:3.0:1763333176.929294:0:29240:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1763333176.929308:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c576bf lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c1:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969daa expref: 247 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.929325:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c57687 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d9c expref: 246 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.929334:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff92ff8016fb00) 00010000:00010000:3.0:1763333176.929337:0:29240:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c5774b lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1c1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.929345:0:29240:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c5774b lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1c1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.929388:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c5774b lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x1c1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.929404:0:29240:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333176.929423:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57752 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:3.0:1763333176.929430:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57752 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333176.929446:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57752 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333176.929458:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57759 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:3.0:1763333176.929464:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57759 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333176.929474:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57759 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333176.929550:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57760 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:3.0:1763333176.929558:0:29240:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c5774b lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1c1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.929563:0:29240:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57760 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333176.929574:0:29240:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c5774b lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x1c1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333176.929581:0:29240:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57760 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333176.929689:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57713 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969dbf expref: 245 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.929702:0:8606:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c5774b lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1c1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.929709:0:8606:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c5774b lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1c1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.929714:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c5774b lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1c1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8606 initiator: MDT1 00000004:00200000:1.0:1763333176.929727:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c1:0x0]: returning size 5 00010000:00010000:1.0:1763333176.929827:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c57744 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ddb expref: 246 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.929845:0:8606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c5774b lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1c1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ddb expref: 245 pid: 8606 timeout: 1381 lvb_type: 0 00010000:00010000:1.0:1763333176.929854:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c5774b lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1c1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ddb expref: 245 pid: 8606 timeout: 1381 lvb_type: 0 00010000:00010000:1.0:1763333176.929860:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe44c38800, rc 0) 00000100:00100000:1.0:1763333176.930613:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50065500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56896:x1848987613779456:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1606us (4175us total) trans 4294972469 rc 0/0 00000100:00100000:1.0:1763333176.930622:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9480 00000100:00100000:0.0:1763333176.948740:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.948797:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333176.948880:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613780096 00000100:00100000:3.0:1763333176.948892:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613780096 00010000:00010000:3.0:1763333176.948933:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c5774b lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1c1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ddb expref: 245 pid: 8606 timeout: 1381 lvb_type: 0 00000100:00100000:3.0:1763333176.948987:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3126 00000100:00100000:3.0:1763333176.948997:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49609180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:2420:x1848987613780096:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333176.949013:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333176.949019:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c5774b lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1c1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ddb expref: 245 pid: 8606 timeout: 1381 lvb_type: 0 00010000:00010000:3.0:1763333176.949031:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c5774b lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1c1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ddb expref: 245 pid: 8606 timeout: 1381 lvb_type: 0 00010000:00010000:3.0:1763333176.949054:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c5774b lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1c1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ddb expref: 245 pid: 8606 timeout: 1381 lvb_type: 0 00010000:00010000:3.0:1763333176.949084:0:8423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff92ff8016fb00) 00010000:00010000:3.0:1763333176.949089:0:8423:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57760 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333176.949103:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57760 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333176.949111:0:8423:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57760 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333176.949148:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333176.949206:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49609180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:2420:x1848987613780096:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 210us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333176.949214:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3126 00010000:00010000:3.0:1763333176.949244:0:29240:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57760 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333176.949252:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57760 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00000004:00080000:3.0:1763333176.949535:0:29240:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x1c1:0x0] is inserted into orphan list, open count = 1 00010000:00010000:3.0:1763333176.949635:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57760 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333176.949644:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57760 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333176.949650:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57760 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333176.949658:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feba00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333176.949662:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57760 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333176.949670:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57760 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333176.949680:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff92ff8016fb00) 00010000:00010000:3.0:1763333176.949683:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1763333176.949687:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57760 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333176.949693:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57760 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333176.949714:0:29240:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57752 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333176.949720:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57752 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333176.949726:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57752 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333176.949731:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57752 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333176.949736:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feaa00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333176.949739:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57752 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333176.949745:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57752 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333176.949756:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff42c64900) 00010000:00010000:3.0:1763333176.949758:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333176.949761:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57752 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333176.949767:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57752 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00000004:00010000:3.0:1763333176.949778:0:29240:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f4009ce6 reply state 00000000f62c06e0 transno 4294972470 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57759 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333176.949789:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57759 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333176.949794:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff42c64400) 00010000:00010000:3.0:1763333176.949797:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763333176.949800:0:29240:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763333176.949848:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56897:x1848987613779840:12345-192.168.204.28@tcp:36:rm.0 Request processed in 20587us (23317us total) trans 4294972470 rc 0/0 00000100:00100000:3.0:1763333176.949855:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9481 00000100:00100000:3.0:1763333176.949872:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613779968 00000100:00100000:3.0:1763333176.949876:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613779968 00000100:00100000:3.0:1763333176.949899:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9482 00000100:00100000:3.0:1763333176.949905:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56896:x1848987613779968:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333176.949922:0:29240:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333176.949939:0:29240:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5776e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1c1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969de2 expref: -99 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.949994:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57775 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:3.0:1763333176.950003:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57775 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333176.950009:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57775 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00000004:00200000:3.0:1763333176.950027:0:29240:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c1:0x0]: returning size 5 00000004:00200000:3.0:1763333176.950031:0:29240:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763333176.950043:0:29240:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57775 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333176.950061:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5776e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969de2 expref: 247 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.950072:0:29240:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57775 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969de2 expref: 246 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.950080:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff92ff42c64500) 00010000:00010000:3.0:1763333176.950082:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1763333176.950085:0:29240:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea000, rc 0) 00000100:00100000:3.0:1763333176.950115:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56896:x1848987613779968:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 210us (1386us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333176.950121:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9482 00000100:00100000:0.0:1763333176.954135:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.954229:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613780352 00000100:00100000:1.0:1763333176.954239:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613780352 00000100:00100000:1.0:1763333176.954298:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9483 00000100:00100000:1.0:1763333176.954308:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56896:x1848987613780352:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333176.954330:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333176.954388:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c5777c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1c1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969de9 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.954506:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57783 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1c1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333176.954520:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57783 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c1:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333176.954531:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57783 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c1:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:1.0:1763333176.954543:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c1:0x0]: returning size 5 00010000:00010000:1.0:1763333176.954643:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c5777c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969de9 expref: 249 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.954661:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57783 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1c1:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969de9 expref: 248 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.954670:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff92ff42c64500) 00010000:00010000:1.0:1763333176.954672:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763333176.954676:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4874b000, rc 0) 00000100:00100000:1.0:1763333176.954734:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:56896:x1848987613780352:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 427us (619us total) trans 4294972471 rc 0/0 00000100:00100000:1.0:1763333176.954742:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9483 00000100:00100000:1.0:1763333176.959511:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.959597:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613780480 00000100:00100000:0.0:1763333176.959616:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613780480 00000100:00100000:0.0:1763333176.959678:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6690 00000100:00100000:0.0:1763333176.959687:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2421:x1848987613780480:12345-192.168.204.28@tcp:1:lfs.0 00010000:00010000:0.0:1763333176.959731:0:8611:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84600/0xb32e3ef184c57791 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.959748:0:8611:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c57705 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969db8 expref: 15 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.959755:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333176.959758:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333176.959761:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84600/0xb32e3ef184c57791 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.959796:0:8611:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c57705 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969db8 expref: 15 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.959810:0:8611:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c57705 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969db8 expref: 15 pid: 8611 timeout: 1381 lvb_type: 0 00000100:00100000:0.0:1763333176.959825:0:8611:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4960aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8611:1848987627289216:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333176.959911:0:8611:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7dfb5e40 going to sleep for 11 seconds 00000100:00100000:3.0:1763333176.972260:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.972488:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613780608 00000100:00100000:1.0:1763333176.972500:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613780608 00002000:00100000:1.0:1763333176.972551:0:28427:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000400:0x24b:0x0] (0->4) req@ffff92ff50066a00 x1848987613780608/t0(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:487/0 lens 496/0 e 0 to 0 dl 1763333187 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763333176.972562:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff50066a00 with x1848987613780608 ext(0->4) 00010000:00010000:1.0:1763333176.972572:0:28427:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c57705 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969db8 expref: 16 pid: 8611 timeout: 1381 lvb_type: 0 00010000:00010000:1.0:1763333176.972589:0:28427:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c57705 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969db8 expref: 16 pid: 8611 timeout: 1381 lvb_type: 0 00002000:00010000:1.0:1763333176.972597:0:28427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff92ff50066a00 00000100:00100000:0.0:1763333176.972894:0:8611:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4960aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8611:1848987627289216:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333176.972936:0:8611:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84600/0xb32e3ef184c57791 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333176.973447:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 110 00000100:00100000:1.0:1763333176.973461:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50066a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2420:x1848987613780608:12345-192.168.204.28@tcp:4:bash.0 00000100:00100000:3.0:1763333176.977582:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333176.978473:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50066a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2420:x1848987613780608:12345-192.168.204.28@tcp:4:bash.0 Request processed in 5012us (6220us total) trans 21474838957 rc 0/0 00000100:00100000:1.0:1763333176.978487:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 110 00002000:00100000:1.0:1763333176.978500:0:28427:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000400:0x24b:0x0] (0->4) req@ffff92ff50066a00 x1848987613780608/t21474838957(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:487/0 lens 496/448 e 0 to 0 dl 1763333187 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763333176.978511:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff50066a00 with x1848987613780608 ext(0->4) 00010000:00010000:1.0:1763333176.978521:0:28427:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c57705 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969db8 expref: 18 pid: 8611 timeout: 1381 lvb_type: 0 00010000:00010000:1.0:1763333176.978538:0:28427:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c57705 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969db8 expref: 18 pid: 8611 timeout: 1381 lvb_type: 0 00002000:00010000:1.0:1763333176.978545:0:28427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff92ff50066a00 00000100:00100000:0.0:1763333176.979314:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613780736 00000100:00100000:0.0:1763333176.979325:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613780736 00000100:00100000:0.0:1763333176.979405:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9484 00000100:00100000:0.0:1763333176.979416:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50064e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:56898:x1848987613780736:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333176.979449:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333176.979474:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c57798 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969df0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.979547:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c5779f lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333176.979561:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c5779f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.979572:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c5779f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.979582:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c577a6 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333176.979588:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c577a6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.979593:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c577a6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.979634:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c5779f lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.979643:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c5779f lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.979648:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c5779f lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.979654:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c5779f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.979659:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c85600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333176.979663:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c5779f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.979669:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c5779f lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.979681:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355c00) 00010000:00010000:0.0:1763333176.979685:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333176.979689:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c5779f lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.979694:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c5779f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.979707:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c577a6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.979713:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c577a6 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.979718:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c577a6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.979722:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c85e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333176.979726:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c577a6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.979731:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c577a6 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.979737:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff42c64400) 00010000:00010000:0.0:1763333176.979740:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333176.979743:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c577a6 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.979748:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c577a6 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.979775:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c57798 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969df0 expref: 249 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.979785:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355c00) 00010000:00010000:0.0:1763333176.979787:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333176.979790:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c57798 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969df0 expref: 249 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.979802:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45c84e00, rc 0) 00000100:00100000:0.0:1763333176.979853:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50064e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:56898:x1848987613780736:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 439us (2280us total) trans 0 rc 301/301 00000100:00100000:0.0:1763333176.979864:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9484 00000100:00100000:2.0:1763333176.994746:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333176.994787:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333176.994871:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613780864 00000100:00100000:0.0:1763333176.994883:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613780864 00000100:00100000:0.0:1763333176.994950:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9485 00000100:00100000:0.0:1763333176.994961:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:56898:x1848987613780864:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333176.994986:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1763333176.995004:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613780992 00000100:00100000:1.0:1763333176.995009:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613780992 00010000:00010000:0.0:1763333176.995011:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c577ad lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969df7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.995030:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c57705 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969db8 expref: 18 pid: 8611 timeout: 1381 lvb_type: 0 00000100:00100000:1.0:1763333176.995066:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3127 00000100:00100000:1.0:1763333176.995074:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75666d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2418:x1848987613780992:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333176.995084:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1763333176.995101:0:6505:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24b:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:1.0:1763333176.995104:0:6505:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24b:0x0] updating lvb atime from disk: 0 -> 1763333177 00002000:00010000:1.0:1763333176.995107:0:6505:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24b:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1763333176.995113:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c57705 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969db8 expref: 18 pid: 8611 timeout: 1381 lvb_type: 0 00010000:00010000:1.0:1763333176.995126:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c57705 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969db8 expref: 18 pid: 8611 timeout: 1381 lvb_type: 0 00010000:00010000:1.0:1763333176.995149:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c57705 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969db8 expref: 18 pid: 8611 timeout: 1381 lvb_type: 0 00010000:00010000:1.0:1763333176.995536:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333176.995539:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333176.995545:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84600/0xb32e3ef184c57791 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.995556:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84600/0xb32e3ef184c57791 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333176.995592:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333176.995654:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75666d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2418:x1848987613780992:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 580us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333176.995662:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3127 00010000:00010000:3.0:1763333176.996017:0:8611:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84600/0xb32e3ef184c57791 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.996027:0:8611:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84600/0xb32e3ef184c57791 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.996049:0:8611:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84600/0xb32e3ef184c57791 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.996058:0:8611:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84600/0xb32e3ef184c57791 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.996066:0:8611:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84600/0xb32e3ef184c57791 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.996072:0:8611:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c84600 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333176.996076:0:8611:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84600/0xb32e3ef184c57791 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.996084:0:8611:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84600/0xb32e3ef184c57791 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.996096:0:8611:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84600/0xb32e3ef184c57791 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333176.996103:0:8611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84600/0xb32e3ef184c57791 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.996214:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c577b4 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333176.996227:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c577b4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.996236:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c577b4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.996246:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c577bb lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333176.996252:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c577bb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.996257:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c577bb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.996297:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c577b4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.996303:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c577b4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.996309:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c577b4 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.996314:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c577b4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.996319:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c85e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333176.996323:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c577b4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.996328:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c577b4 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.996336:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355c00) 00010000:00010000:0.0:1763333176.996339:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333176.996342:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c577b4 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.996363:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c577b4 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.996374:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c577bb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.996379:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c577bb lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.996385:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c577bb lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.996389:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c85600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333176.996392:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c577bb lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.996398:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c577bb lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.996404:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff42c64400) 00010000:00010000:0.0:1763333176.996407:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333176.996410:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c577bb lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.996421:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c577bb lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333176.996464:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c577ad lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969df7 expref: 249 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.996473:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355c00) 00010000:00010000:0.0:1763333176.996475:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333176.996478:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c577ad lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969df7 expref: 249 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333176.996490:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45c84e00, rc 0) 00000100:00100000:3.0:1763333176.996889:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2421:x1848987613780480:12345-192.168.204.28@tcp:1:lfs.0 Request processed in 37201us (37386us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333176.996898:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6690 00000100:00100000:0.0:1763333176.997898:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:56898:x1848987613780864:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 2934us (3157us total) trans 0 rc 301/301 00000100:00100000:0.0:1763333176.997907:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9485 00000100:00100000:2.0:1763333177.003505:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333177.003694:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613781120 00000100:00100000:1.0:1763333177.003705:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613781120 00000100:00100000:2.0:1763333177.003714:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333177.004493:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613781376 00000100:00100000:0.0:1763333177.004501:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613781376 00000100:00100000:3.0:1763333177.004511:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9486 00000100:00100000:0.0:1763333177.004539:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9487 00000100:00100000:0.0:1763333177.004546:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:56896:x1848987613781376:12345-192.168.204.28@tcp:36:lfs.0 00000100:00100000:2.0:1763333177.004580:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:56898:x1848987613781120:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333177.004591:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333177.004598:0:29240:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333177.004613:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c577c2 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969dfe expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.004620:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57775 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969de2 expref: 249 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.004635:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff92ff42c64500) 00010000:00010000:0.0:1763333177.004640:0:29240:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333177.004659:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c577d0 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:2.0:1763333177.004660:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c577c9 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333177.004673:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c577c9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.004673:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c577d0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333177.004683:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c577c9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.004683:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c577d0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00000004:00200000:2.0:1763333177.004726:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1763333177.004731:0:8606:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1763333177.004761:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c577c2 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969dfe expref: 250 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.004775:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c577c9 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969dfe expref: 249 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.004786:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff621ac300) 00010000:00010000:2.0:1763333177.004789:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1763333177.004792:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5e00, rc 0) 00000100:00100000:2.0:1763333177.004854:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:56898:x1848987613781120:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 332us (1360us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333177.004861:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9486 00000040:00080000:0.0:1763333177.004882:0:29240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1465, 88 off123360 00000004:00080000:0.0:1763333177.004892:0:29240:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1281084542592ns, next at 1281590880154ns, rc = 0 00000040:00080000:1.0:1763333177.005415:0:29240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1464, 88 off123360 00000004:00080000:1.0:1763333177.005426:0:29240:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1281085076683ns, next at 1280856550572ns, rc = 0 00000040:00080000:1.0:1763333177.005461:0:29240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1465, 88 off123448 00000004:00080000:1.0:1763333177.005466:0:29240:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1281085117140ns, next at 1280856550572ns, rc = 0 00000040:00080000:1.0:1763333177.005480:0:29240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1466, 88 off123448 00000004:00080000:1.0:1763333177.005485:0:29240:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1281085135821ns, next at 1281590880154ns, rc = 0 00000001:00080000:1.0:1763333177.011141:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972472 is committed 00000004:00080000:1.0:1763333177.011155:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 961 committed 00000004:00080000:1.0:1763333177.011172:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 957 committed 00000004:00080000:1.0:1763333177.011188:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 956 committed 00000004:00080000:1.0:1763333177.011191:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 960 committed 00000004:00010000:1.0:1763333177.011265:0:29240:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f5da0b85 reply state 000000001383ebc4 transno 4294972472 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c577d0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.011291:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c577d0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.011301:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff92ff42c64500) 00010000:00010000:1.0:1763333177.011305:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1763333177.011310:0:29240:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763333177.011404:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff75665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627289472:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333177.011475:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333177.011511:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1763333177.011518:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff75667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627289344:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333177.011541:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333177.011563:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4960aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627289600:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333177.011597:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333177.011634:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763333177.011640:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe49609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627289728:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333177.011661:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333177.011696:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627289472 00000100:00100000:0.0:1763333177.011705:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627289472 00000100:00100000:0.0:1763333177.011753:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627289344 00000100:00100000:0.0:1763333177.011756:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627289344 00000100:00100000:0.0:1763333177.011769:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627289600 00000100:00100000:0.0:1763333177.011772:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627289600 00000100:00100000:0.0:1763333177.011786:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627289728 00000100:00100000:0.0:1763333177.011789:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627289728 00000100:00100000:0.0:1763333177.011808:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6691 00000100:00100000:0.0:1763333177.011816:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75666300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+18:3653:x1848987627289472:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1763333177.011954:0:29010:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333177.011958:0:29010:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763333177.011960:0:29010:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333177.011962:0:29010:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763333177.011964:0:29010:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333177.012004:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75666300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+19:3653:x1848987627289472:12345-0@lo:2:osp-syn-0-1.0 Request processed in 188us (529us total) trans 21474838958 rc 0/0 00000100:00100000:0.0:1763333177.012012:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6691 00000100:00100000:0.0:1763333177.012027:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6692 00000100:00100000:0.0:1763333177.012035:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75664000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+18:3653:x1848987627289344:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333177.012100:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75664000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+19:3653:x1848987627289344:12345-0@lo:2:osp-syn-0-1.0 Request processed in 66us (558us total) trans 21474838959 rc 0/0 00000100:00100000:0.0:1763333177.012107:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6692 00000100:00100000:0.0:1763333177.012119:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6693 00000100:00100000:0.0:1763333177.012124:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+34:3654:x1848987627289600:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1763333177.012188:0:29010:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x24b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333177.012191:0:29010:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x24b:0x0] updating lvb mtime from disk: 1763333177 -> 1763333177 00002000:00010000:0.0:1763333177.012193:0:29010:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x24b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333177.012195:0:29010:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x24b:0x0] updating lvb ctime from disk: 1763333177 -> 1763333177 00002000:00010000:0.0:1763333177.012197:0:29010:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x24b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333177.012226:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+35:3654:x1848987627289600:12345-0@lo:2:osp-syn-1-1.0 Request processed in 102us (628us total) trans 17179871653 rc 0/0 00000100:00100000:0.0:1763333177.012233:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6693 00000100:00100000:0.0:1763333177.012246:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6694 00000100:00100000:0.0:1763333177.012253:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49608380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+34:3654:x1848987627289728:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1763333177.012299:0:29010:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333177.012302:0:29010:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x24c:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763333177.012304:0:29010:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x24c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333177.012306:0:29010:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x24c:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763333177.012308:0:29010:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x24c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333177.012331:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49608380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+35:3654:x1848987627289728:12345-0@lo:2:osp-syn-1-1.0 Request processed in 79us (669us total) trans 17179871654 rc 0/0 00000100:00100000:0.0:1763333177.012341:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6694 00000004:00080000:0.0:1763333177.012422:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe49609f80/2, rc 0, transno 17179871654 00000100:00100000:0.0:1763333177.012428:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe49609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627289728:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1763333177.012449:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4960aa00/2, rc 0, transno 17179871653 00000100:00100000:0.0:1763333177.012453:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4960aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627289600:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1763333177.012472:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff75667100/2, rc 0, transno 21474838959 00000100:00100000:0.0:1763333177.012476:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff75667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627289344:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1763333177.012482:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff75665f80/2, rc 0, transno 21474838958 00000100:00100000:0.0:1763333177.012485:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff75665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627289472:0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1763333177.012660:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57759 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333177.012669:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57759 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333177.012676:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57759 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333177.012681:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333177.012685:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57759 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333177.012692:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57759 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333177.012703:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff42c64400) 00010000:00010000:3.0:1763333177.012706:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333177.012709:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57759 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333177.012715:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57759 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00080000:1.0:1763333177.013066:0:29240:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1763333177.013086:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:56896:x1848987613781376:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 8538us (9368us total) trans 4294972472 rc 0/0 00000100:00100000:1.0:1763333177.013094:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9487 00010000:00010000:3.0:1763333177.013223:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c577d0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333177.013232:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c577d0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333177.013238:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c577d0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333177.013242:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c85c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333177.013247:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c577d0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333177.013252:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c577d0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333177.013260:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff92ff42c64500) 00010000:00010000:3.0:1763333177.013263:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763333177.013266:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c577d0 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333177.013271:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c577d0 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00000100:00100000:2.0:1763333177.014216:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333177.015128:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613781504 00000100:00100000:1.0:1763333177.015137:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613781504 00000100:00100000:3.0:1763333177.015513:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333177.015767:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613781632 00000100:00100000:0.0:1763333177.015773:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613781632 00000100:00100000:0.0:1763333177.015820:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9488 00000100:00100000:0.0:1763333177.015831:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:56898:x1848987613781504:12345-192.168.204.28@tcp:101:lfs.0 00000100:00100000:2.0:1763333177.015839:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9489 00000100:00100000:2.0:1763333177.015852:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5004b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:56896:x1848987613781632:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333177.015854:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333177.015867:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333177.015877:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c577d7 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969e05 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.015880:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c577de lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1c1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969e0c expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.015933:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c577de lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e0c expref: 244 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.015944:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c577e5 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333177.015950:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c577de lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e0c expref: 244 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.015968:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff92ff42c64500) 00010000:00010000:2.0:1763333177.015972:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333177.015976:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4a00, rc 0) 00000100:00100000:2.0:1763333177.016023:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5004b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56896:x1848987613781632:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 175us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333177.016030:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9489 00010000:00010000:0.0:1763333177.016626:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c577e5 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333177.016637:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c577e5 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333177.016655:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c577ec lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333177.016662:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c577ec lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333177.016668:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c577ec lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333177.016705:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c577e5 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333177.016712:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c577e5 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333177.016717:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c577e5 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333177.016723:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c577e5 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333177.016728:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c85600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333177.016732:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c577e5 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333177.016738:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c577e5 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333177.016748:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff621ac300) 00010000:00010000:0.0:1763333177.016750:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333177.016754:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c577e5 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333177.016760:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c577e5 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333177.016772:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c577ec lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333177.016778:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c577ec lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333177.016783:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c577ec lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333177.016788:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c85e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333177.016791:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c577ec lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333177.016796:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c577ec lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333177.016802:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355c00) 00010000:00010000:0.0:1763333177.016806:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333177.016808:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c577ec lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333177.016813:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c577ec lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333177.016846:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c577d7 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e05 expref: 243 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.016857:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff621ac300) 00010000:00010000:0.0:1763333177.016859:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333177.016863:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c577d7 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e05 expref: 243 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.016872:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45c84e00, rc 0) 00000100:00100000:0.0:1763333177.018046:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:56898:x1848987613781504:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 2211us (3829us total) trans 0 rc 301/301 00000100:00100000:0.0:1763333177.018056:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9488 00000100:00100000:3.0:1763333177.019255:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333177.019307:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613781760 00000100:00100000:0.0:1763333177.019317:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613781760 00000100:00100000:1.0:1763333177.022892:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9490 00000100:00100000:1.0:1763333177.022916:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:56896:x1848987613781760:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333177.022938:0:29240:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333177.022974:0:29240:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c577f3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1c1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969e13 expref: -99 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.023067:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c577fa lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:1.0:1763333177.023086:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c577fa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.023099:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c577fa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00000004:00200000:1.0:1763333177.023150:0:29240:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c1:0x0]: returning size 5 00000004:00200000:1.0:1763333177.023155:0:29240:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763333177.023180:0:29240:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c577fa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.023209:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c577f3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e13 expref: 244 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.023228:0:29240:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c577fa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e13 expref: 243 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.023237:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff92ff42c64500) 00010000:00010000:1.0:1763333177.023241:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1763333177.023245:0:29240:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4874a600, rc 0) 00000100:00100000:1.0:1763333177.023336:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:56896:x1848987613781760:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 432us (4087us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333177.023345:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9490 00000100:00100000:2.0:1763333177.024460:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333177.025127:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613782016 00000100:00100000:1.0:1763333177.025140:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613782016 00000100:00100000:1.0:1763333177.025195:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9491 00000100:00100000:1.0:1763333177.025203:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:56898:x1848987613782016:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333177.025222:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333177.025225:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763333177.025250:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c577c9 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969dfe expref: 243 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.025268:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff621ac300) 00010000:00010000:1.0:1763333177.025278:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333177.025293:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b200/0xb32e3ef184c57801 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969e1a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.025666:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57808 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333177.025682:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57808 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333177.025692:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57808 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333177.025701:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c5780f lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333177.025707:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c5780f lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333177.025712:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c5780f lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333177.026236:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c57816 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333177.026245:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c57816 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333177.026252:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c57816 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:1.0:1763333177.026264:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c2:0x0]: returning size 0 00010000:00010000:1.0:1763333177.026291:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57808 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333177.026297:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57808 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333177.026304:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57808 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333177.026310:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57808 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333177.026316:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4874ae00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333177.026320:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57808 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333177.026327:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57808 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333177.026336:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44cd0100) 00010000:00010000:1.0:1763333177.026339:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333177.026343:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57808 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000100:00100000:3.0:1763333177.027427:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.027545:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613782144 00000100:00100000:2.0:1763333177.027557:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613782144 00000100:00100000:2.0:1763333177.027620:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6695 00000100:00100000:2.0:1763333177.027631:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5004ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2421:x1848987613782144:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333177.027649:0:28600:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333177.027671:0:28600:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57824 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969e21 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763333177.027693:0:28600:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24b:0x0] initial LVB size: 5, mtime: 0x691a5439, atime: 0x691a5439, ctime: 0x691a5439, blocks: 0x8 00010000:00010000:2.0:1763333177.027716:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333177.027719:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333177.027735:0:28600:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57824 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e21 expref: 17 pid: 28600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333177.027753:0:28600:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57824 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e21 expref: 17 pid: 28600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333177.027765:0:28600:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4400, rc 0) 00000100:00100000:2.0:1763333177.027839:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5004ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2421:x1848987613782144:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 211us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333177.027846:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6695 00010000:00010000:1.0:1763333177.029869:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57808 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:1.0:1763333177.029898:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e4a03aca reply state 0000000002c9017f transno 4294972473 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c5780f lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333177.029915:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c5780f lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333177.029924:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe44cd0200) 00010000:00010000:1.0:1763333177.029927:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333177.029931:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763333177.030104:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b200/0xb32e3ef184c57801 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e1a expref: 245 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.030126:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c57816 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e1a expref: 244 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.030134:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c2:0x0].0x0 (ffff92fe44cd0800) 00010000:00010000:1.0:1763333177.030137:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333177.030139:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe44c38800, rc 0) 00000100:00100000:1.0:1763333177.030205:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56898:x1848987613782016:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 5001us (5753us total) trans 4294972473 rc 0/0 00000100:00100000:1.0:1763333177.030213:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9491 00000100:00100000:3.0:1763333177.034112:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333177.034222:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613782400 00000100:00100000:1.0:1763333177.034236:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613782400 00000100:00100000:1.0:1763333177.034305:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9492 00000100:00100000:1.0:1763333177.034316:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5004a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56898:x1848987613782400:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333177.034346:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333177.034396:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c5782b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1c2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969e28 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.034848:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57832 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333177.034869:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c57816 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e1a expref: 246 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.034879:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57832 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333177.034921:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c57816 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e1a expref: 246 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.035006:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c57816 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e1a expref: 246 pid: 6519 timeout: 1381 lvb_type: 0 00000100:00100000:2.0:1763333177.035025:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46a6f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627289856:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333177.037882:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff6be07780 going to sleep for 11 seconds 00000100:00100000:0.0:1763333177.044597:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.045184:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46a6f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627289856:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333177.045216:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57832 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000100:00100000:1.0:1763333177.047173:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613782528 00000100:00100000:1.0:1763333177.047194:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613782528 00010000:00010000:2.0:1763333177.047325:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c57816 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e1a expref: 247 pid: 6519 timeout: 1381 lvb_type: 0 00000100:00100000:2.0:1763333177.047484:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3128 00000100:00100000:2.0:1763333177.047499:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49609880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:2420:x1848987613782528:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333177.047519:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333177.047528:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c57816 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e1a expref: 247 pid: 6519 timeout: 1381 lvb_type: 0 00010000:00010000:2.0:1763333177.047547:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c57816 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e1a expref: 247 pid: 6519 timeout: 1381 lvb_type: 0 00010000:00010000:2.0:1763333177.047575:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c57816 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e1a expref: 247 pid: 6519 timeout: 1381 lvb_type: 0 00010000:00010000:2.0:1763333177.047596:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c2:0x0].0x0 (ffff92fe44cd0800) 00010000:00010000:2.0:1763333177.047603:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57832 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333177.047612:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57832 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333177.047620:0:6505:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57832 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333177.048002:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333177.048108:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57832 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333177.048117:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57832 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:0.0:1763333177.048144:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c2:0x0]: returning size 0 00000100:00100000:2.0:1763333177.048377:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49609880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:2420:x1848987613782528:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 878us (3796us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333177.048386:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3128 00000004:00080000:3.0:1763333177.048664:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x24d:0x0], index 1: 0 00000004:00080000:3.0:1763333177.048675:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x24d:0x0], index 0: 0 00000004:00080000:3.0:1763333177.048680:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x24e:0x0], index 0: 0 00000004:00080000:3.0:1763333177.048685:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x24e:0x0], index 1: 0 00010000:00010000:3.0:1763333177.050506:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57832 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333177.050525:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57832 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333177.050534:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57832 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333177.050540:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333177.050546:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57832 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333177.050554:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57832 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333177.050573:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c2:0x0].0x0 (ffff92fe44cd0800) 00010000:00010000:3.0:1763333177.050576:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763333177.050580:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57832 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333177.050586:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57832 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333177.050659:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c5782b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1c2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e28 expref: 246 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.050670:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c2:0x0].0x0 (ffff92fe44cd0800) 00010000:00010000:3.0:1763333177.050673:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763333177.050676:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c5782b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e28 expref: 246 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.050693:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe44c39000, rc 0) 00000100:00100000:3.0:1763333177.052686:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5004a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56898:x1848987613782400:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 18359us (18574us total) trans 4294972474 rc 301/301 00000100:00100000:3.0:1763333177.052700:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9492 00000100:00100000:0.0:1763333177.062421:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333177.062545:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613782784 00000100:00100000:3.0:1763333177.062563:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613782784 00000100:00100000:3.0:1763333177.062629:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3242 00000100:00100000:3.0:1763333177.062640:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7403b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56898:x1848987613782784:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333177.062948:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7403b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56898:x1848987613782784:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 309us (538us total) trans 4294972475 rc 0/0 00000100:00100000:3.0:1763333177.062956:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3242 00000100:00100000:1.0:1763333177.065077:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333177.065178:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613783040 00000100:00100000:0.0:1763333177.065187:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613783040 00000100:00100000:0.0:1763333177.065244:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3243 00000100:00100000:0.0:1763333177.065255:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc01850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56898:x1848987613783040:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333177.065519:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc01850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56898:x1848987613783040:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 265us (450us total) trans 4294972476 rc 0/0 00000100:00100000:0.0:1763333177.065527:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3243 00000100:00100000:0.0:1763333177.077141:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333177.077233:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613783296 00000100:00100000:3.0:1763333177.077244:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613783296 00000100:00100000:3.0:1763333177.077311:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9493 00000100:00100000:3.0:1763333177.077321:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7403b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:55917:x1848987613783296:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333177.077345:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333177.077406:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c57840 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969e2f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.077648:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c57847 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333177.077663:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c57847 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333177.077673:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c57847 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333177.077683:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c5784e lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333177.077691:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c5784e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333177.077698:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c5784e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333177.077753:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c57855 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333177.077765:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c57855 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333177.077772:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c57855 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:3.0:1763333177.077782:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c2:0x0]: returning size 0 00010000:00010000:3.0:1763333177.077861:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c57847 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333177.077869:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c57847 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333177.077874:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c57847 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333177.077881:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c57847 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333177.077886:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4742fc00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333177.077890:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c57847 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333177.077897:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c57847 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333177.077909:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff42c64400) 00010000:00010000:3.0:1763333177.077912:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333177.077917:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c57847 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333177.077923:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c57847 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333177.077941:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c5784e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333177.077946:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c5784e lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333177.077951:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c5784e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333177.077956:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4742f400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333177.077959:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c5784e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333177.077964:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c5784e lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333177.077970:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe44cd0200) 00010000:00010000:3.0:1763333177.077972:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333177.077975:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c5784e lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333177.077980:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c5784e lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333177.078018:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c57840 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e2f expref: 250 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.078036:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c57855 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e2f expref: 249 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.078043:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c2:0x0].0x0 (ffff92ff42c64900) 00010000:00010000:3.0:1763333177.078046:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333177.078048:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4742fa00, rc 0) 00000100:00100000:3.0:1763333177.078107:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7403b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:55917:x1848987613783296:12345-192.168.204.28@tcp:101:bash.0 Request processed in 786us (976us total) trans 4294972477 rc 0/0 00000100:00100000:3.0:1763333177.078115:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9493 00000100:00100000:1.0:1763333177.078231:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333177.083724:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613783424 00000100:00100000:3.0:1763333177.083743:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613783424 00000100:00100000:3.0:1763333177.083817:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6696 00000100:00100000:3.0:1763333177.083828:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2420:x1848987613783424:12345-192.168.204.28@tcp:23:lfs.0 00000100:00100000:3.0:1763333177.083962:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2420:x1848987613783424:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 136us (5731us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333177.083970:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6696 00000100:00100000:1.0:1763333177.084820:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.084895:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613783552 00000100:00100000:2.0:1763333177.084901:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613783552 00000100:00100000:2.0:1763333177.084948:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9494 00000100:00100000:2.0:1763333177.084957:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:55917:x1848987613783552:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333177.084977:0:29240:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333177.084999:0:29240:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c57863 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1c2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969e36 expref: -99 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.085034:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5786a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:2.0:1763333177.085049:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5786a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333177.085060:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5786a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333177.085197:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c57863 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e36 expref: 251 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.085216:0:29240:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5786a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e36 expref: 250 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.085224:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c2:0x0].0x0 (ffff92ff42c64900) 00010000:00010000:2.0:1763333177.085227:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763333177.085231:0:29240:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4000, rc 0) 00000100:00100000:2.0:1763333177.085280:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:55917:x1848987613783552:12345-192.168.204.28@tcp:101:bash.0 Request processed in 325us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333177.085288:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9494 00000100:00100000:1.0:1763333177.091258:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.091417:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613783680 00000100:00100000:2.0:1763333177.091429:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613783680 00000100:00100000:2.0:1763333177.091504:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6697 00000100:00100000:2.0:1763333177.091516:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2421:x1848987613783680:12345-192.168.204.28@tcp:23:lfs.0 00000100:00100000:2.0:1763333177.091659:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2421:x1848987613783680:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 144us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333177.091667:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6697 00000100:00100000:1.0:1763333177.092256:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333177.092504:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613783936 00000100:00100000:3.0:1763333177.092511:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613783936 00000100:00100000:3.0:1763333177.092563:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9495 00000100:00100000:3.0:1763333177.092574:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:55917:x1848987613783936:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:3.0:1763333177.092623:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333177.092653:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c57855 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e2f expref: 250 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.092675:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c2:0x0].0x0 (ffff92ff42c64900) 00010000:00010000:3.0:1763333177.092681:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333177.092883:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57871 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1c2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333177.092899:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57871 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333177.092909:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57871 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000001:00080000:3.0:1763333177.092965:0:6519:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294972478 00000004:00010000:3.0:1763333177.092991:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001e1cc704 reply state 00000000b8bb825e transno 4294972479 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57871 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333177.093002:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57871 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1c2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333177.093009:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c2:0x0].0x0 (ffff92ff42c64900) 00010000:00010000:3.0:1763333177.093011:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763333177.093014:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763333177.093089:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:55917:x1848987613783936:12345-192.168.204.28@tcp:36:bash.0 Request processed in 515us (833us total) trans 4294972479 rc 0/0 00000100:00100000:3.0:1763333177.093097:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9495 00000020:00080000:3.0:1763333177.093101:0:6519:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763333177.097768:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.097849:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333177.097912:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613784192 00000100:00100000:1.0:1763333177.097924:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613784192 00000100:00100000:1.0:1763333177.097999:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1647 00000100:00100000:1.0:1763333177.098010:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2420:x1848987613784192:12345-192.168.204.28@tcp:3:lfs.0 00010000:00010000:1.0:1763333177.098054:0:28427:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57878 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.098070:0:28427:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333177.098072:0:28427:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333177.098077:0:28427:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57878 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.098090:0:28427:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57878 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.098195:0:28427:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57878 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.098203:0:28427:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57878 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.098215:0:28427:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57878 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.098222:0:28427:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4874ae00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333177.098226:0:28427:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57878 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.098235:0:28427:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57878 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.098251:0:28427:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57878 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.098259:0:28427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57878 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333177.098339:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2420:x1848987613784192:12345-192.168.204.28@tcp:3:lfs.0 Request processed in 331us (583us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1763333177.098382:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1647 00000100:00100000:3.0:1763333177.098484:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613784064 00000100:00100000:3.0:1763333177.098489:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613784064 00000100:00100000:3.0:1763333177.098526:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9496 00000100:00100000:3.0:1763333177.098533:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:55917:x1848987613784064:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333177.098548:0:29240:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333177.098562:0:29240:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c5787f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1c2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969e3d expref: -99 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.098606:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c5787f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e3d expref: 253 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.098619:0:29240:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c5787f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e3d expref: 253 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.098635:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c2:0x0].0x0 (ffff92ff42c64900) 00010000:00010000:3.0:1763333177.098638:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763333177.098641:0:29240:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea000, rc 0) 00000100:00100000:3.0:1763333177.098666:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:55917:x1848987613784064:12345-192.168.204.28@tcp:101:bash.0 Request processed in 134us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333177.098671:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9496 00000100:00100000:2.0:1763333177.103125:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.103186:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333177.103282:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613784448 00000100:00100000:3.0:1763333177.103295:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613784448 00000100:00100000:1.0:1763333177.103315:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613784576 00000100:00100000:1.0:1763333177.103320:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613784576 00000100:00100000:3.0:1763333177.103389:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9497 00000100:00100000:3.0:1763333177.103400:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+254:55917:x1848987613784448:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333177.103421:0:29240:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333177.103424:0:29240:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763333177.103461:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c5787f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e3d expref: 254 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.103480:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c2:0x0].0x0 (ffff92ff42c64900) 00010000:00010000:3.0:1763333177.103485:0:29240:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333177.103499:0:29240:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57886 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1c2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969e44 expref: -99 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.103552:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5788d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:3.0:1763333177.103566:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5788d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c2:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333177.103577:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5788d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c2:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00000040:00080000:3.0:1763333177.103860:0:29240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1466, 88 off123536 00000004:00080000:3.0:1763333177.103868:0:29240:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1281183518324ns, next at 1280856550572ns, rc = 0 00000040:00080000:3.0:1763333177.103897:0:29240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1467, 88 off123536 00000004:00080000:3.0:1763333177.103903:0:29240:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1281183553619ns, next at 1281590880154ns, rc = 0 00000040:00080000:3.0:1763333177.103921:0:29240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1468, 88 off123624 00000004:00080000:3.0:1763333177.103925:0:29240:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1281183576079ns, next at 1281590880154ns, rc = 0 00000040:00080000:3.0:1763333177.103935:0:29240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1467, 88 off123624 00000004:00080000:3.0:1763333177.103939:0:29240:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1281183590229ns, next at 1280856550572ns, rc = 0 00000100:00100000:1.0:1763333177.104549:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9498 00000100:00100000:1.0:1763333177.104571:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+255:56896:x1848987613784576:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333177.104585:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333177.104601:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57894 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969e4b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.104632:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b200/0xb32e3ef184c5789b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333177.104644:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b200/0xb32e3ef184c5789b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333177.104653:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b200/0xb32e3ef184c5789b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333177.104764:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57894 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e4b expref: 257 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.104781:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b200/0xb32e3ef184c5789b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e4b expref: 256 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.104789:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff92ff42c64500) 00010000:00010000:1.0:1763333177.104792:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763333177.104795:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4874b200, rc 0) 00000100:00100000:1.0:1763333177.104853:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+256:56896:x1848987613784576:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 286us (1666us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333177.104860:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9498 00000001:00080000:1.0:1763333177.110492:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972480 is committed 00000004:00080000:1.0:1763333177.110510:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 959 committed 00010000:00010000:3.0:1763333177.110520:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c5780f lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00000004:00080000:1.0:1763333177.110520:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 963 committed 00010000:00010000:3.0:1763333177.110537:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c5780f lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00000004:00080000:1.0:1763333177.110539:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 962 committed 00000004:00080000:1.0:1763333177.110544:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 958 committed 00010000:00010000:3.0:1763333177.110550:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c5780f lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333177.110558:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4874ba00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333177.110564:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c5780f lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333177.110571:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c5780f lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333177.110592:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe44cd0200) 00010000:00010000:3.0:1763333177.110596:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333177.110602:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c5780f lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333177.110609:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c5780f lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333177.110657:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5788d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c2:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e44 expref: 247 pid: 29240 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333177.110795:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff74039180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627290368:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333177.110796:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46a6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627289984:0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1763333177.110840:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57871 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333177.110852:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57871 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333177.110858:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57871 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333177.110863:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333177.110866:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57871 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333177.110872:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57871 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333177.110882:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c2:0x0].0x0 (ffff92ff42c64900) 00010000:00010000:3.0:1763333177.110884:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333177.110887:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57871 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333177.110892:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57871 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000100:00100000:3.0:1763333177.110925:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff74039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627290112:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333177.110991:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333177.111038:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46a6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627290240:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333177.111061:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333177.111093:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627289984 00000100:00100000:2.0:1763333177.111100:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627289984 00000100:00100000:2.0:1763333177.111144:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627290240 00000100:00100000:2.0:1763333177.111147:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627290240 00000100:00100000:2.0:1763333177.111169:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6698 00000100:00100000:2.0:1763333177.111177:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+20:3652:x1848987627289984:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333177.111375:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+21:3652:x1848987627289984:12345-0@lo:2:osp-syn-0-1.0 Request processed in 198us (383us total) trans 21474838960 rc 0/0 00000100:00100000:2.0:1763333177.111382:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6698 00000100:00100000:2.0:1763333177.111401:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6699 00000100:00100000:2.0:1763333177.111408:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+20:3654:x1848987627290240:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333177.111498:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+21:3654:x1848987627290240:12345-0@lo:2:osp-syn-0-1.0 Request processed in 90us (435us total) trans 21474838961 rc 0/0 00000100:00100000:2.0:1763333177.111504:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6699 00000004:00080000:2.0:1763333177.111553:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe46a6c700/2, rc 0, transno 21474838961 00000100:00100000:2.0:1763333177.111559:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46a6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627290240:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1763333177.111578:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe46a6d180/2, rc 0, transno 21474838960 00000100:00100000:2.0:1763333177.111582:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46a6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627289984:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1763333177.111912:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c2:0x0].0x0 (ffff92ff42c64900) 00010000:00010000:1.0:1763333177.111916:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763333177.111935:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57886 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e44 expref: 246 pid: 29240 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763333177.111952:0:29240:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5788d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c2:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e44 expref: 245 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.111976:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c2:0x0].0x0 (ffff92ff42c64900) 00010000:00010000:1.0:1763333177.111978:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763333177.111981:0:29240:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea800, rc 0) 00000100:00100000:1.0:1763333177.112027:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:55917:x1848987613784448:12345-192.168.204.28@tcp:101:bash.0 Request processed in 8630us (8914us total) trans 4294972480 rc 0/0 00000100:00100000:1.0:1763333177.112035:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9497 00000100:00100000:0.0:1763333177.112714:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333177.112806:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627290368 00000100:00100000:3.0:1763333177.112812:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333177.112813:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627290368 00000100:00100000:1.0:1763333177.112848:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6700 00000100:00100000:1.0:1763333177.112854:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74038a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+35:3655:x1848987627290368:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333177.113001:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74038a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+36:3655:x1848987627290368:12345-0@lo:2:osp-syn-1-1.0 Request processed in 146us (289us total) trans 17179871655 rc 0/0 00000100:00100000:1.0:1763333177.113007:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6700 00000100:00100000:0.0:1763333177.113060:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613784704 00000100:00100000:0.0:1763333177.113064:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613784704 00000100:00100000:0.0:1763333177.113103:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1648 00000100:00100000:0.0:1763333177.113109:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5004b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:2418:x1848987613784704:12345-192.168.204.28@tcp:4:lfs.0 00010000:00010000:0.0:1763333177.113131:0:16635:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c578a2 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.113147:0:16635:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c57656 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d80 expref: 24 pid: 17605 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333177.113155:0:16635:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333177.113157:0:16635:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333177.113161:0:16635:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c578a2 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.113187:0:16635:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c57656 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d80 expref: 24 pid: 17605 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333177.113198:0:16635:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c57656 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d80 expref: 24 pid: 17605 timeout: 1381 lvb_type: 1 00000100:00100000:0.0:1763333177.113210:0:16635:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff74038700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:16635:1848987627290496:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333177.113265:0:16635:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff742b9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1763333177.114134:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333177.114189:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627290112 00000100:00100000:2.0:1763333177.114195:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627290112 00000100:00100000:2.0:1763333177.114233:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6701 00000100:00100000:2.0:1763333177.114241:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+36:3653:x1848987627290112:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333177.114394:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+37:3653:x1848987627290112:12345-0@lo:2:osp-syn-1-1.0 Request processed in 152us (261us total) trans 17179871656 rc 0/0 00000100:00100000:2.0:1763333177.114401:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6701 00000004:00080000:0.0:1763333177.114446:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff74039500/2, rc 0, transno 17179871656 00000100:00100000:0.0:1763333177.114454:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff74039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627290112:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763333177.114641:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff74039180/2, rc 0, transno 17179871655 00000100:00100000:3.0:1763333177.114647:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff74039180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627290368:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333177.118415:0:16635:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff74038700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:16635:1848987627290496:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333177.118456:0:16635:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c578a2 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333177.121770:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.121913:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613784832 00000100:00100000:2.0:1763333177.121922:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613784832 00010000:00010000:2.0:1763333177.121962:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c57656 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d80 expref: 25 pid: 17605 timeout: 1381 lvb_type: 1 00000100:00100000:2.0:1763333177.122060:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3129 00000100:00100000:2.0:1763333177.122069:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74038700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:2421:x1848987613784832:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333177.122083:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333177.122101:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c57656 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d80 expref: 25 pid: 17605 timeout: 1381 lvb_type: 1 00010000:00010000:2.0:1763333177.122114:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c57656 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d80 expref: 25 pid: 17605 timeout: 1381 lvb_type: 1 00010000:00010000:2.0:1763333177.122136:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe467bf600/0xb32e3ef184c57656 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d80 expref: 25 pid: 17605 timeout: 1381 lvb_type: 1 00010000:00010000:2.0:1763333177.122149:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333177.122152:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333177.122156:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c578a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.122170:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c578a2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.122200:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333177.122681:0:16635:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c578a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.122696:0:16635:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c578a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333177.125845:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74038700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:2421:x1848987613784832:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 3754us (4060us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333177.125861:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3129 00000001:00080000:2.0:1763333177.127914:0:26035:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871657 is committed 00000001:00080000:2.0:1763333177.127930:0:26035:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871656 is committed 00002000:00010000:0.0:1763333177.128098:0:16635:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x24c:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:0.0:1763333177.128103:0:16635:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x24c:0x0] updating lvb mtime from disk: 0 -> 1763333177 00002000:00010000:0.0:1763333177.128106:0:16635:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x24c:0x0] updating lvb ctime from disk: 0 -> 1763333177 00002000:00010000:0.0:1763333177.128108:0:16635:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x24c:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1763333177.128120:0:16635:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c578a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.128130:0:16635:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c578a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.128138:0:16635:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c578a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.128145:0:16635:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c85c00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333177.128149:0:16635:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c578a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.128158:0:16635:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c578a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.128177:0:16635:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c578a2 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.128184:0:16635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c578a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333177.129045:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333177.130628:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613784960 00000100:00100000:3.0:1763333177.130640:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613784960 00000100:00100000:3.0:1763333177.130700:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6702 00000100:00100000:3.0:1763333177.130709:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:55917:x1848987613784960:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333177.130727:0:8611:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333177.130748:0:8611:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c578a9 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969e52 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333177.130768:0:8611:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x24d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333177.130789:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333177.130791:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333177.130800:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c578a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e52 expref: 14 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.130815:0:8611:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c578a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e52 expref: 14 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.130827:0:8611:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea200, rc 0) 00000100:00100000:0.0:1763333177.130907:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5004b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2418:x1848987613784704:12345-192.168.204.28@tcp:4:lfs.0 Request processed in 17796us (18097us total) trans 17179871657 rc 0/0 00000100:00100000:0.0:1763333177.130917:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1648 00000100:00100000:3.0:1763333177.131541:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:55917:x1848987613784960:12345-192.168.204.28@tcp:101:bash.0 Request processed in 831us (2501us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333177.131547:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6702 00000100:00100000:3.0:1763333177.136189:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333177.136565:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613785088 00000100:00100000:0.0:1763333177.136577:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613785088 00000100:00100000:0.0:1763333177.136636:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6703 00000100:00100000:0.0:1763333177.136646:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50049c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:55917:x1848987613785088:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333177.136665:0:8611:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333177.136688:0:8611:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c578b0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969e59 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763333177.136712:0:8611:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333177.136735:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333177.136737:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333177.136746:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c578b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e59 expref: 18 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.136762:0:8611:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c578b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e59 expref: 18 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.136775:0:8611:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45c84400, rc 0) 00000100:00100000:0.0:1763333177.136838:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50049c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:55917:x1848987613785088:12345-192.168.204.28@tcp:101:bash.0 Request processed in 193us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333177.136845:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6703 00000100:00100000:1.0:1763333177.146136:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333177.146176:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333177.146266:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613785216 00000100:00100000:0.0:1763333177.146276:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613785216 00002000:00010000:0.0:1763333177.146323:0:16635:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/589 (0->18446744073709551615) 00002000:00100000:0.0:1763333177.146329:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe472f4000 with x1848987613785216 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333177.146344:0:16635:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe472f4000. 00000100:00100000:0.0:1763333177.146398:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613785344 00000100:00100000:0.0:1763333177.146401:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613785344 00002000:00010000:0.0:1763333177.146413:0:16635:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/589 (0->18446744073709551615) 00002000:00100000:0.0:1763333177.146417:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe472f7b80 with x1848987613785344 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333177.146424:0:16635:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe472f7b80. 00000100:00100000:0.0:1763333177.146453:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1649 00000100:00100000:0.0:1763333177.146463:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2420:x1848987613785216:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:0.0:1763333177.146652:0:16635:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x24d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333177.146655:0:16635:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x24d:0x0] updating lvb mtime from disk: 0 -> 1763333177 00002000:00010000:0.0:1763333177.146658:0:16635:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x24d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333177.146660:0:16635:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x24d:0x0] updating lvb ctime from disk: 0 -> 1763333177 00002000:00010000:0.0:1763333177.146663:0:16635:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x24d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333177.146715:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2420:x1848987613785216:12345-192.168.204.28@tcp:10:bash.0 Request processed in 253us (590us total) trans 17179871658 rc 0/0 00000100:00100000:0.0:1763333177.146722:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1649 00002000:00010000:0.0:1763333177.146726:0:16635:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/589 (0->18446744073709551615) 00002000:00100000:0.0:1763333177.146728:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe472f4000 with x1848987613785216 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333177.146732:0:16635:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe472f4000. 00000100:00100000:0.0:1763333177.146748:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1650 00000100:00100000:0.0:1763333177.146755:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2420:x1848987613785344:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:0.0:1763333177.146830:0:16635:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333177.146833:0:16635:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb mtime from disk: 0 -> 1763333177 00002000:00010000:0.0:1763333177.146835:0:16635:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333177.146837:0:16635:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb ctime from disk: 0 -> 1763333177 00002000:00010000:0.0:1763333177.146839:0:16635:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333177.146860:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2420:x1848987613785344:12345-192.168.204.28@tcp:10:bash.0 Request processed in 105us (683us total) trans 21474838962 rc 0/0 00000100:00100000:0.0:1763333177.146866:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1650 00002000:00010000:0.0:1763333177.146869:0:16635:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/589 (0->18446744073709551615) 00002000:00100000:0.0:1763333177.146872:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe472f7b80 with x1848987613785344 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333177.146876:0:16635:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe472f7b80. 00000100:00100000:3.0:1763333177.151885:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333177.152175:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613785600 00000100:00100000:1.0:1763333177.152186:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613785600 00000100:00100000:1.0:1763333177.152249:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3244 00000100:00100000:1.0:1763333177.152260:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50048380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:55917:x1848987613785600:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:1.0:1763333177.152615:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50048380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:55917:x1848987613785600:12345-192.168.204.28@tcp:35:bash.0 Request processed in 356us (737us total) trans 4294972481 rc 0/0 00000100:00100000:1.0:1763333177.152623:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3244 00000100:00100000:0.0:1763333177.169415:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333177.169457:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333177.169667:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613785856 00000100:00100000:3.0:1763333177.169677:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613785856 00000100:00100000:3.0:1763333177.169735:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613785984 00000100:00100000:3.0:1763333177.169739:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613785984 00000100:00100000:3.0:1763333177.169775:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9499 00000100:00100000:3.0:1763333177.169786:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74039c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56896:x1848987613785856:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:3.0:1763333177.169849:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333177.169877:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c577fa lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c1:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e13 expref: 247 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.169896:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff92ff42c64500) 00010000:00010000:3.0:1763333177.169901:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333177.169967:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c578b7 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1c1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00000100:00100000:0.0:1763333177.170105:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9500 00000100:00100000:0.0:1763333177.170116:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7403a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56899:x1848987613785984:12345-192.168.204.28@tcp:101:rm.0 00010000:00010000:0.0:1763333177.170127:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333177.170141:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c578be lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969e60 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.170185:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c578c5 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333177.170197:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c578c5 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333177.170207:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c578c5 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333177.170218:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85400/0xb32e3ef184c578cc lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333177.170224:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85400/0xb32e3ef184c578cc lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333177.170234:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85400/0xb32e3ef184c578cc lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333177.170303:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c578d3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333177.170313:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c578d3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333177.170320:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c578d3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:0.0:1763333177.170345:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c2:0x0]: returning size 5 00000004:00200000:0.0:1763333177.170375:0:6519:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763333177.170394:0:6519:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c578d3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333177.170405:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c578d3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333177.170414:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c578c5 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333177.170421:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c578c5 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333177.170428:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c578c5 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333177.170446:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c578c5 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333177.170452:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c84600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333177.170456:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c578c5 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333177.170465:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c578c5 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333177.170474:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe48355b00) 00010000:00010000:0.0:1763333177.170477:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333177.170481:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c578c5 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333177.170488:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c578c5 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333177.170500:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85400/0xb32e3ef184c578cc lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333177.170506:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85400/0xb32e3ef184c578cc lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333177.170513:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85400/0xb32e3ef184c578cc lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333177.170518:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c85400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333177.170521:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85400/0xb32e3ef184c578cc lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333177.170528:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85400/0xb32e3ef184c578cc lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333177.170535:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe48355200) 00010000:00010000:0.0:1763333177.170537:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333177.170540:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85400/0xb32e3ef184c578cc lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333177.170546:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85400/0xb32e3ef184c578cc lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333177.170577:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c578be lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e60 expref: 248 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.170593:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c578d3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e60 expref: 247 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.170600:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c2:0x0].0x0 (ffff92ff42c64900) 00010000:00010000:0.0:1763333177.170603:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333177.170605:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45c84c00, rc 0) 00000100:00100000:0.0:1763333177.170668:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7403a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56899:x1848987613785984:12345-192.168.204.28@tcp:101:rm.0 Request processed in 555us (1210us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333177.170676:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9500 00010000:00010000:3.0:1763333177.171255:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c578b7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333177.171265:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c578b7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00010000:3.0:1763333177.171416:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005675f843 reply state 0000000018b8199a transno 4294972482 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c578b7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333177.171428:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c578b7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1c1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333177.171443:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff92ff42c64500) 00010000:00010000:3.0:1763333177.171445:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763333177.171448:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763333177.171516:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74039c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:56896:x1848987613785856:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 1731us (2108us total) trans 4294972482 rc 0/0 00000100:00100000:3.0:1763333177.171524:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9499 00000100:00100000:0.0:1763333177.176338:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.176651:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613786112 00000100:00100000:2.0:1763333177.176661:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613786112 00000100:00100000:2.0:1763333177.176716:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6704 00000100:00100000:2.0:1763333177.176723:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7403b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:56896:x1848987613786112:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333177.176747:0:28651:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333177.176768:0:28651:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c578da lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969e67 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763333177.176794:0:28651:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x24c:0x0] initial LVB size: 4096, mtime: 0x691a5439, atime: 0x0, ctime: 0x691a5439, blocks: 0x8 00010000:00010000:2.0:1763333177.176815:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333177.176818:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333177.176825:0:28651:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c578da lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e67 expref: 15 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.176839:0:28651:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c578da lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e67 expref: 15 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.176855:0:28651:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4800, rc 0) 00000100:00100000:2.0:1763333177.176917:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7403b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:56896:x1848987613786112:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 193us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333177.176924:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6704 00000100:00100000:2.0:1763333177.178424:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333177.178511:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613786368 00000100:00100000:3.0:1763333177.178519:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613786368 00000100:00100000:3.0:1763333177.178566:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9501 00000100:00100000:3.0:1763333177.178575:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:56899:x1848987613786368:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:3.0:1763333177.178627:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1763333177.178657:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5788d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c2:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e44 expref: 248 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.178678:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c578d3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e60 expref: 247 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.178693:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5786a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e36 expref: 246 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.178704:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c2:0x0].0x0 (ffff92ff42c64900) 00010000:00010000:3.0:1763333177.178714:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333177.178739:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c578e1 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333177.178751:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c578e1 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.178761:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c578e1 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.178775:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c578e8 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333177.178782:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c578e8 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.178789:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c578e8 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.178866:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c578ef lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333177.178874:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c578ef lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.178884:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c578ef lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000040:00080000:3.0:1763333177.179146:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1468, 64 off123688 00000004:00080000:3.0:1763333177.179154:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1281258804753ns, next at 1282258802447ns, rc = 0 00000040:00080000:3.0:1763333177.179177:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1469, 64 off123688 00000040:00080000:3.0:1763333177.179188:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1470, 64 off123752 00000040:00080000:3.0:1763333177.179199:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1469, 64 off123752 00010000:00010000:3.0:1763333177.179250:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c578f6 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1c2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333177.179260:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c578f6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.179267:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c578f6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.179274:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c578f6 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1c2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.179280:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c578f6 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1c2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.179286:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c578f6 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1c2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.179312:0:8606:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763333177.179331:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c578ef lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.179338:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c578ef lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1c2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.179345:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c578ef lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1c2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.179388:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4742fa00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333177.179392:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c578ef lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1c2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.179404:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c578ef lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1c2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.179414:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c2:0x0].0x0 (ffff92ff6055ad00) 00010000:00010000:3.0:1763333177.179417:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1763333177.179421:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c578ef lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1c2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.179427:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c578ef lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1c2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.179550:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c578e1 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.179557:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c578e1 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.179562:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c578e1 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.179568:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c578e1 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.179573:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feba00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333177.179576:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c578e1 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.179582:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c578e1 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.179595:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055a300) 00010000:00010000:3.0:1763333177.179598:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333177.179601:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c578e1 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.179606:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c578e1 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000004:00010000:3.0:1763333177.179619:0:8606:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a8db6506 reply state 00000000e2eeb5e6 transno 4294972483 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c578e8 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.179630:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c578e8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.179637:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6055a000) 00010000:00010000:3.0:1763333177.179640:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763333177.179642:0:8606:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763333177.179709:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56899:x1848987613786368:12345-192.168.204.28@tcp:36:rm.0 Request processed in 1134us (1289us total) trans 4294972483 rc 0/0 00000100:00100000:3.0:1763333177.179717:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9501 00010000:00010000:2.0:1763333177.180600:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333177.180609:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c578f6 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1c2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333177.180617:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4742e000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333177.180621:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c578f6 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1c2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333177.180628:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c578f6 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1c2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333177.180638:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c2:0x0].0x0 (ffff92ff6055ad00) 00010000:00010000:2.0:1763333177.180641:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1763333177.180645:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c578f6 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1c2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333177.180651:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c578f6 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1c2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333177.180668:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333177.180671:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333177.180672:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763333177.183765:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333177.183869:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613786496 00000100:00100000:0.0:1763333177.183881:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613786496 00000100:00100000:0.0:1763333177.183951:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6705 00000100:00100000:0.0:1763333177.183962:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50049500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:56896:x1848987613786496:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333177.183983:0:8611:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333177.184004:0:8611:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85400/0xb32e3ef184c578fd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969e6e expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.184036:0:8611:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf200/0xb32e3ef184c5765d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d87 expref: 20 pid: 17605 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333177.184044:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333177.184047:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333177.184051:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85400/0xb32e3ef184c578fd lrc: 4/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e6e expref: 20 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.184088:0:8611:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf200/0xb32e3ef184c5765d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d87 expref: 20 pid: 17605 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333177.184102:0:8611:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf200/0xb32e3ef184c5765d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d87 expref: 20 pid: 17605 timeout: 1381 lvb_type: 1 00000100:00100000:0.0:1763333177.184116:0:8611:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff50065180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8611:1848987627290624:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333177.184210:0:8611:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff742b9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1763333177.188179:0:8611:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff50065180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8611:1848987627290624:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333177.188221:0:8611:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85400/0xb32e3ef184c578fd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e6e expref: 20 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.188242:0:8611:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45c85400, rc 0) 00000100:00100000:3.0:1763333177.188307:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50049500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:56896:x1848987613786496:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 4346us (4552us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333177.188316:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6705 00000100:00100000:3.0:1763333177.189666:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.189759:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613786624 00000100:00100000:2.0:1763333177.189768:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613786624 00010000:00010000:2.0:1763333177.189803:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf200/0xb32e3ef184c5765d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d87 expref: 20 pid: 17605 timeout: 1381 lvb_type: 1 00000100:00100000:2.0:1763333177.189842:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3130 00000100:00100000:2.0:1763333177.189851:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50048700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2421:x1848987613786624:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333177.189864:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333177.189884:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf200/0xb32e3ef184c5765d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d87 expref: 20 pid: 17605 timeout: 1381 lvb_type: 1 00010000:00010000:2.0:1763333177.189896:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf200/0xb32e3ef184c5765d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d87 expref: 20 pid: 17605 timeout: 1381 lvb_type: 1 00010000:00010000:2.0:1763333177.189917:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf200/0xb32e3ef184c5765d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969d87 expref: 20 pid: 17605 timeout: 1381 lvb_type: 1 00010000:00010000:2.0:1763333177.189929:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333177.189931:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333177.189937:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85400/0xb32e3ef184c578fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e6e expref: 19 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.189946:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85400/0xb32e3ef184c578fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e6e expref: 19 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.189980:0:6505:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85400/0xb32e3ef184c578fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e6e expref: 19 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333177.189991:0:6505:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7dcfd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6505:1848987627290752:192.168.204.28@tcp:105: 00000100:00100000:2.0:1763333177.190061:0:6505:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff6be07780 going to sleep for 11 seconds 00000100:00100000:0.0:1763333177.197567:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333177.197599:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.198492:0:6505:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7dcfd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6505:1848987627290752:192.168.204.28@tcp:105: 00010000:00010000:2.0:1763333177.198522:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333177.198587:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50048700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2421:x1848987613786624:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 8736us (8925us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333177.198600:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3130 00000100:00100000:1.0:1763333177.199832:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613786752 00000100:00100000:1.0:1763333177.199843:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613786752 00002000:00010000:1.0:1763333177.199883:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/588 (5->18446744073709551615) 00002000:00100000:1.0:1763333177.199887:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff50065180 with x1848987613786752 ext(5->18446744073709551615) 00002000:00010000:1.0:1763333177.199898:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff50065180. 00000100:00100000:1.0:1763333177.199923:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613786880 00000100:00100000:1.0:1763333177.199927:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613786880 00002000:00010000:1.0:1763333177.199938:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:1.0:1763333177.199941:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4960b480 with x1848987613786880 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333177.199947:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe4960b480. 00000100:00100000:1.0:1763333177.199974:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1651 00000100:00100000:1.0:1763333177.199983:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50065180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2421:x1848987613786752:12345-192.168.204.28@tcp:10:lfs.0 00002000:00010000:1.0:1763333177.200279:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x24c:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:1.0:1763333177.200283:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x24c:0x0] updating lvb mtime from disk: 1763333177 -> 1763333177 00002000:00010000:1.0:1763333177.200285:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x24c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333177.200288:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x24c:0x0] updating lvb ctime from disk: 1763333177 -> 1763333177 00002000:00010000:1.0:1763333177.200290:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x24c:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1763333177.200338:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50065180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2421:x1848987613786752:12345-192.168.204.28@tcp:10:lfs.0 Request processed in 356us (2783us total) trans 17179871659 rc 0/0 00000100:00100000:1.0:1763333177.200367:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1651 00002000:00010000:1.0:1763333177.200371:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/588 (5->18446744073709551615) 00002000:00100000:1.0:1763333177.200373:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff50065180 with x1848987613786752 ext(5->18446744073709551615) 00002000:00010000:1.0:1763333177.200379:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff50065180. 00000100:00100000:1.0:1763333177.200397:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1652 00000100:00100000:1.0:1763333177.200404:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4960b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2420:x1848987613786880:12345-192.168.204.28@tcp:10:lfs.0 00002000:00010000:1.0:1763333177.200513:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333177.200517:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 0 -> 1763333177 00002000:00010000:1.0:1763333177.200519:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333177.200521:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 0 -> 1763333177 00002000:00010000:1.0:1763333177.200524:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333177.200544:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4960b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2420:x1848987613786880:12345-192.168.204.28@tcp:10:lfs.0 Request processed in 141us (2945us total) trans 21474838963 rc 0/0 00000100:00100000:1.0:1763333177.200551:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1652 00002000:00010000:1.0:1763333177.200554:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:1.0:1763333177.200556:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4960b480 with x1848987613786880 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333177.200560:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe4960b480. 00000100:00100000:2.0:1763333177.204615:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.204664:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333177.204746:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613787008 00000100:00100000:1.0:1763333177.204756:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613787008 00000100:00100000:1.0:1763333177.204814:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613787264 00000100:00100000:1.0:1763333177.204817:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613787264 00000100:00100000:1.0:1763333177.205501:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9502 00000100:00100000:1.0:1763333177.205515:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:56900:x1848987613787008:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333177.205540:0:29240:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333177.205564:0:29240:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57904 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969e75 expref: -99 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.205636:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c5790b lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:1.0:1763333177.205654:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c5790b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.205664:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c5790b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.205673:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57912 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:1.0:1763333177.205681:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57912 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.205687:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57912 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.205726:0:29240:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c5790b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.205732:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c5790b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.205738:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c5790b lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.205744:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c5790b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.205750:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4874a600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333177.205754:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c5790b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.205761:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c5790b lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.205775:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44cd0100) 00010000:00010000:1.0:1763333177.205778:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333177.205782:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c5790b lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.205788:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c5790b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.205799:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57912 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.205804:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57912 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.205809:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57912 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.205825:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4874ae00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333177.205828:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57912 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.205834:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57912 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.205840:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6055a000) 00010000:00010000:1.0:1763333177.205842:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333177.205844:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57912 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.205850:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57912 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.205873:0:29240:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57904 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e75 expref: 249 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.205883:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44cd0100) 00010000:00010000:1.0:1763333177.205885:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333177.205889:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57904 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e75 expref: 249 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.205901:0:29240:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4874aa00, rc 0) 00000100:00100000:1.0:1763333177.205970:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:56900:x1848987613787008:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 459us (1369us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333177.205977:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9502 00000100:00100000:1.0:1763333177.205993:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9503 00000100:00100000:1.0:1763333177.205999:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56896:x1848987613787264:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:1.0:1763333177.206044:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57919 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1c1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:1.0:1763333177.206053:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57919 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.206061:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57919 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00000004:00010000:1.0:1763333177.206173:0:29240:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000041a7e733 reply state 000000002c34c775 transno 4294972484 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57919 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.206185:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57919 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1c1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.206191:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff92ff42c64500) 00010000:00010000:1.0:1763333177.206193:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333177.206196:0:29240:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763333177.206250:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:56896:x1848987613787264:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 251us (1585us total) trans 4294972484 rc 0/0 00000100:00100000:1.0:1763333177.206256:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9503 00000100:00100000:1.0:1763333177.211106:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333177.212916:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.213185:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613787392 00000100:00100000:2.0:1763333177.213199:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613787392 00000100:00100000:2.0:1763333177.213267:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6706 00000100:00100000:2.0:1763333177.213278:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2419:x1848987613787392:12345-192.168.204.28@tcp:2:lfs.0 00002000:00010000:2.0:1763333177.213495:0:8611:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24b:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1763333177.213499:0:8611:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24b:0x0] updating lvb mtime from disk: 1763333177 -> 1763333177 00002000:00010000:2.0:1763333177.213502:0:8611:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24b:0x0] updating lvb atime from disk: 1763333177 -> 1763333177 00002000:00010000:2.0:1763333177.213504:0:8611:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24b:0x0] updating lvb ctime from disk: 1763333177 -> 1763333177 00002000:00010000:2.0:1763333177.213507:0:8611:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24b:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1763333177.213569:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2419:x1848987613787392:12345-192.168.204.28@tcp:2:lfs.0 Request processed in 293us (2474us total) trans 21474838964 rc 0/0 00000100:00100000:2.0:1763333177.213578:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6706 00000100:00100000:1.0:1763333177.214082:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613787520 00000100:00100000:1.0:1763333177.214089:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613787520 00000100:00100000:1.0:1763333177.214132:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9504 00000100:00100000:1.0:1763333177.214142:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:56900:x1848987613787520:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333177.214164:0:29240:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333177.214191:0:29240:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c57920 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969e7c expref: -99 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.214259:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c57927 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:1.0:1763333177.214273:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c57927 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.214284:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c57927 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.214297:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c5792e lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:1.0:1763333177.214304:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c5792e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.214311:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c5792e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.214380:0:29240:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c57927 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.214388:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c57927 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.214394:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c57927 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.214401:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c57927 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.214406:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700ce00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333177.214410:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c57927 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.214417:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c57927 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.214430:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44cd0000) 00010000:00010000:1.0:1763333177.214442:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333177.214448:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c57927 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.214454:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c57927 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.214471:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c5792e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.214476:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c5792e lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.214482:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c5792e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.214487:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700c200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333177.214491:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c5792e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.214496:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c5792e lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.214503:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6055a000) 00010000:00010000:1.0:1763333177.214506:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333177.214509:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c5792e lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.214514:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c5792e lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.214542:0:29240:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c57920 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e7c expref: 250 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.214553:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44cd0000) 00010000:00010000:1.0:1763333177.214555:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333177.214559:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c57920 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e7c expref: 250 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.214574:0:29240:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4700de00, rc 0) 00000100:00100000:1.0:1763333177.214622:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:56900:x1848987613787520:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 481us (1718us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333177.214630:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9504 00000100:00100000:2.0:1763333177.218829:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.219283:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333177.219472:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613787776 00000100:00100000:0.0:1763333177.219491:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613787776 00000100:00100000:3.0:1763333177.219672:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613787904 00000100:00100000:3.0:1763333177.219678:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613787904 00000100:00100000:3.0:1763333177.219722:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9505 00000100:00100000:3.0:1763333177.219733:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:56900:x1848987613787904:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333177.219756:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333177.219785:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c57935 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969e83 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.219857:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c5793c lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333177.219872:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c5793c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333177.219884:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c5793c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:3.0:1763333177.219936:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1763333177.219941:0:12741:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1763333177.219989:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c57935 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e83 expref: 252 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.220009:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c5793c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e83 expref: 251 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.220018:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055a300) 00010000:00010000:3.0:1763333177.220022:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1763333177.220025:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4742f400, rc 0) 00000100:00100000:3.0:1763333177.220088:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:56900:x1848987613787904:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 356us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333177.220099:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9505 00000100:00100000:0.0:1763333177.220301:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3245 00000100:00100000:0.0:1763333177.220312:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:56896:x1848987613787776:12345-192.168.204.28@tcp:35:lfs.0 00000004:00010000:0.0:1763333177.220375:0:19668:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x240000404:0x1c1:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57783 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1c1:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969de9 expref: 250 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.220411:0:19668:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c57943 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19668 initiator: MDT0 00010000:00010000:0.0:1763333177.220421:0:19668:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c577de lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e0c expref: 250 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.220430:0:19668:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c57943 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333177.220482:0:19668:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c577de lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e0c expref: 250 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.220496:0:19668:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c577de lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e0c expref: 250 pid: 12741 timeout: 1381 lvb_type: 0 00000100:00100000:0.0:1763333177.220510:0:19668:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46e2ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:19668:1848987627290880:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333177.220574:0:19668:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff742b93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763333177.223536:0:19668:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46e2ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:19668:1848987627290880:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333177.223570:0:19668:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c57943 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19668 initiator: MDT1 00000100:00100000:2.0:1763333177.226531:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.226909:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333177.227031:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613788032 00000100:00100000:0.0:1763333177.227041:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613788032 00010000:00010000:0.0:1763333177.227089:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c577de lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e0c expref: 251 pid: 12741 timeout: 1381 lvb_type: 0 00000100:00100000:0.0:1763333177.227130:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3131 00000100:00100000:0.0:1763333177.227141:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50e6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:2421:x1848987613788032:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333177.227161:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333177.227168:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c577de lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e0c expref: 251 pid: 12741 timeout: 1381 lvb_type: 0 00010000:00010000:0.0:1763333177.227181:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c577de lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e0c expref: 251 pid: 12741 timeout: 1381 lvb_type: 0 00010000:00010000:0.0:1763333177.227203:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c577de lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e0c expref: 251 pid: 12741 timeout: 1381 lvb_type: 0 00010000:00010000:0.0:1763333177.227221:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff92ff42c64500) 00010000:00010000:0.0:1763333177.227227:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c57943 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333177.227236:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c57943 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333177.227243:0:6505:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c57943 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333177.227273:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333177.227320:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50e6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:2421:x1848987613788032:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 181us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333177.227327:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3131 00010000:00010000:0.0:1763333177.227421:0:19668:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c57943 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333177.227429:0:19668:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c57943 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19668 initiator: MDT1 00000040:00080000:0.0:1763333177.227674:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1471, 88 off123840 00000004:00080000:0.0:1763333177.227682:0:19668:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1281307332201ns, next at 1281590880154ns, rc = 0 00000040:00080000:0.0:1763333177.227707:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1470, 88 off123840 00000004:00080000:0.0:1763333177.227711:0:19668:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1281307361980ns, next at 1282258802447ns, rc = 0 00000040:00080000:0.0:1763333177.227725:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1471, 88 off123928 00000004:00080000:0.0:1763333177.227728:0:19668:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1281307379563ns, next at 1282258802447ns, rc = 0 00000040:00080000:0.0:1763333177.227737:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1472, 88 off123928 00000004:00080000:0.0:1763333177.227741:0:19668:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1281307391993ns, next at 1281590880154ns, rc = 0 00000100:00100000:1.0:1763333177.228373:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613788160 00000100:00100000:1.0:1763333177.228380:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613788160 00000100:00100000:1.0:1763333177.228423:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9506 00000100:00100000:1.0:1763333177.228439:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:56900:x1848987613788160:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333177.228458:0:29240:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333177.228475:0:29240:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c5794a lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969e8a expref: -99 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.228535:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c57951 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:1.0:1763333177.228548:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c57951 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.228558:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c57951 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.228568:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c57958 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:1.0:1763333177.228575:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c57958 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.228581:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c57958 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.228618:0:29240:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c57951 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.228625:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c57951 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.228632:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c57951 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.228638:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c57951 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.228644:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700c200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333177.228650:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c57951 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.228657:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c57951 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.228668:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055a300) 00010000:00010000:1.0:1763333177.228670:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333177.228675:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c57951 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.228681:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c57951 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.228692:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c57958 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.228698:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c57958 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.228703:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c57958 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.228708:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700ce00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333177.228711:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c57958 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.228717:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c57958 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.228723:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6055a000) 00010000:00010000:1.0:1763333177.228726:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333177.228728:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c57958 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.228738:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c57958 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.228763:0:29240:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c5794a lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e8a expref: 252 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.228772:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055a300) 00010000:00010000:1.0:1763333177.228775:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333177.228778:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c5794a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e8a expref: 252 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.228788:0:29240:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4700de00, rc 0) 00000100:00100000:1.0:1763333177.228844:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:56900:x1848987613788160:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 412us (1934us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333177.228851:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9506 00000001:00080000:1.0:1763333177.233755:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972485 is committed 00000004:00080000:1.0:1763333177.233769:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 965 committed 00010000:00010000:3.0:1763333177.233896:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c578b7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1c1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333177.233908:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c578b7 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1c1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333177.233917:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c578b7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1c1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333177.233922:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feaa00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333177.233928:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c578b7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1c1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333177.233935:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c578b7 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1c1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333177.233953:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff92ff42c64500) 00010000:00010000:3.0:1763333177.233956:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333177.233961:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c578b7 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1c1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333177.233967:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c578b7 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1c1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333177.233986:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c578e8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00000004:00080000:1.0:1763333177.234068:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 962 committed 00000100:00100000:0.0:1763333177.234221:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46e2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627291136:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763333177.234283:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333177.234323:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1763333177.234328:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46e2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627291008:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763333177.234345:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333177.234388:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46e2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627291392:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333177.234408:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333177.234425:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1763333177.234441:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627291264:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333177.234464:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333177.234493:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627291136 00000100:00100000:0.0:1763333177.234500:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627291136 00000100:00100000:0.0:1763333177.234544:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627291008 00000100:00100000:0.0:1763333177.234547:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627291008 00000100:00100000:0.0:1763333177.234560:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627291392 00000100:00100000:0.0:1763333177.234563:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627291392 00000100:00100000:0.0:1763333177.234577:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627291264 00000100:00100000:0.0:1763333177.234580:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627291264 00000100:00100000:0.0:1763333177.234599:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6707 00000100:00100000:0.0:1763333177.234606:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+24:3653:x1848987627291136:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1763333177.234631:0:28651:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:590 count 1 00002000:00010000:0.0:1763333177.234669:0:28651:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333177.234675:0:28651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84600/0xb32e3ef184c5795f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.234688:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333177.234690:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333177.234696:0:28651:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84600/0xb32e3ef184c5795f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.234714:0:28651:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84600/0xb32e3ef184c5795f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.234722:0:28651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84600/0xb32e3ef184c5795f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.234727:0:28651:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84600/0xb32e3ef184c5795f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.234747:0:28651:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763333177.234980:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+25:3653:x1848987627291136:12345-0@lo:6:osp-syn-0-1.0 Request processed in 373us (695us total) trans 21474838965 rc 0/0 00000100:00100000:0.0:1763333177.234988:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6707 00000100:00100000:0.0:1763333177.235007:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6708 00000100:00100000:0.0:1763333177.235013:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+24:3653:x1848987627291008:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1763333177.235025:0:28651:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:589 count 1 00010000:00010000:0.0:1763333177.235037:0:28651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57966 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.235053:0:28651:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c578b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e59 expref: 20 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.235061:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333177.235063:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333177.235066:0:28651:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57966 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.235100:0:28651:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c578b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e59 expref: 20 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.235115:0:28651:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c578b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e59 expref: 20 pid: 8611 timeout: 1381 lvb_type: 0 00000100:00100000:0.0:1763333177.235128:0:28651:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46e2ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28651:1848987627291520:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333177.235191:0:28651:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff49c92e40 going to sleep for 11 seconds 00000100:00100000:0.0:1763333177.235211:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6709 00000100:00100000:0.0:1763333177.235217:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+24:3655:x1848987627291392:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1763333177.235294:0:28650:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333177.235297:0:28650:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763333177 -> 1763333177 00002000:00010000:0.0:1763333177.235299:0:28650:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333177.235301:0:28650:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763333177 -> 1763333177 00002000:00010000:0.0:1763333177.235304:0:28650:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333177.235330:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+25:3655:x1848987627291392:12345-0@lo:2:osp-syn-0-1.0 Request processed in 113us (921us total) trans 21474838966 rc 0/0 00000100:00100000:0.0:1763333177.235335:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6709 00000100:00100000:0.0:1763333177.235369:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6710 00000100:00100000:0.0:1763333177.235376:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e0f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+24:3655:x1848987627291264:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1763333177.235419:0:28650:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24b:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1763333177.235421:0:28650:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24b:0x0] updating lvb mtime from disk: 1763333177 -> 1763333177 00002000:00010000:0.0:1763333177.235424:0:28650:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24b:0x0] updating lvb atime from disk: 1763333177 -> 1763333177 00002000:00010000:0.0:1763333177.235426:0:28650:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24b:0x0] updating lvb ctime from disk: 1763333177 -> 1763333177 00002000:00010000:0.0:1763333177.235429:0:28650:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24b:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1763333177.235463:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e0f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+25:3655:x1848987627291264:12345-0@lo:2:osp-syn-0-1.0 Request processed in 88us (1000us total) trans 21474838967 rc 0/0 00000100:00100000:0.0:1763333177.235470:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6710 00010000:00010000:0.0:1763333177.235497:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333177.235503:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84600/0xb32e3ef184c5795f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.235510:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c84600 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333177.235514:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84600/0xb32e3ef184c5795f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.235522:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84600/0xb32e3ef184c5795f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.235536:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84600/0xb32e3ef184c5795f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.235543:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84600/0xb32e3ef184c5795f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.235558:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333177.235560:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333177.235561:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763333177.235590:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe46e2ed80/2, rc 0, transno 21474838967 00000100:00100000:0.0:1763333177.235596:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627291264:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1763333177.235605:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe46e2dc00/2, rc 0, transno 21474838966 00000100:00100000:0.0:1763333177.235608:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46e2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627291392:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1763333177.235627:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe46e2fb80/2, rc 0, transno 21474838965 00000100:00100000:0.0:1763333177.235631:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46e2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627291136:0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1763333177.235797:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 961 committed 00010000:00010000:3.0:1763333177.235858:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c578e8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.235864:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c578e8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.235872:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feb400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333177.235875:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c578e8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.235881:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c578e8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.235892:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6055a000) 00010000:00010000:3.0:1763333177.235894:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333177.235897:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c578e8 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.235902:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c578e8 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.235922:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57919 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1c1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333177.235927:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57919 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1c1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333177.235932:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57919 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1c1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333177.235937:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4874ba00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333177.235940:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57919 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1c1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333177.235946:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57919 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1c1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333177.235952:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff92ff42c64500) 00010000:00010000:3.0:1763333177.235954:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333177.235956:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57919 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1c1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333177.235961:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57919 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1c1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00000100:00100000:2.0:1763333177.236872:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7dcff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627291904:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333177.236917:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333177.236946:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1763333177.236952:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7dcfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627292032:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333177.236972:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333177.236997:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627291904 00000100:00100000:2.0:1763333177.237003:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627291904 00000100:00100000:2.0:1763333177.237036:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627292032 00000100:00100000:2.0:1763333177.237039:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627292032 00000100:00100000:2.0:1763333177.237057:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6711 00000100:00100000:2.0:1763333177.237064:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+6:3654:x1848987627291904:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1763333177.237167:0:28600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x24b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333177.237170:0:28600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x24b:0x0] updating lvb mtime from disk: 1763333177 -> 1763333177 00002000:00010000:2.0:1763333177.237173:0:28600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x24b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333177.237174:0:28600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x24b:0x0] updating lvb ctime from disk: 1763333177 -> 1763333177 00002000:00010000:2.0:1763333177.237177:0:28600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x24b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333177.237209:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+7:3654:x1848987627291904:12345-0@lo:2:osp-syn-1-1.0 Request processed in 146us (292us total) trans 17179871660 rc 0/0 00000100:00100000:2.0:1763333177.237216:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6711 00000100:00100000:2.0:1763333177.237232:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6712 00000100:00100000:2.0:1763333177.237237:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+6:3654:x1848987627292032:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1763333177.237281:0:28600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x24c:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1763333177.237284:0:28600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x24c:0x0] updating lvb mtime from disk: 1763333177 -> 1763333177 00002000:00010000:2.0:1763333177.237286:0:28600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x24c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333177.237287:0:28600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x24c:0x0] updating lvb ctime from disk: 1763333177 -> 1763333177 00002000:00010000:2.0:1763333177.237289:0:28600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x24c:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1763333177.237311:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+7:3654:x1848987627292032:12345-0@lo:2:osp-syn-1-1.0 Request processed in 73us (338us total) trans 17179871661 rc 0/0 00000100:00100000:2.0:1763333177.237319:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6712 00000100:00100000:2.0:1763333177.237374:0:3654:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179871656 gen 2 00000004:00080000:2.0:1763333177.237379:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7400f480, transno 17179871617 00000004:00080000:2.0:1763333177.237386:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7400c700, transno 17179871618 00000004:00080000:2.0:1763333177.237388:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7400ca80, transno 17179871619 00000004:00080000:2.0:1763333177.237391:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7400f100, transno 17179871620 00000004:00080000:2.0:1763333177.237393:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44e04e00, transno 17179871621 00000004:00080000:2.0:1763333177.237396:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44e06680, transno 17179871622 00000004:00080000:2.0:1763333177.237398:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44e04700, transno 17179871623 00000004:00080000:2.0:1763333177.237400:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44e06300, transno 17179871624 00000004:00080000:2.0:1763333177.237402:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe43999f80, transno 17179871626 00000004:00080000:2.0:1763333177.237405:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4399b480, transno 17179871627 00000004:00080000:2.0:1763333177.237407:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe43999880, transno 17179871628 00000004:00080000:2.0:1763333177.237409:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4399bb80, transno 17179871629 00000004:00080000:2.0:1763333177.237410:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4399b800, transno 17179871632 00000004:00080000:2.0:1763333177.237412:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4399a300, transno 17179871633 00000004:00080000:2.0:1763333177.237415:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe434c4380, transno 17179871634 00000004:00080000:2.0:1763333177.237417:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe434c5880, transno 17179871635 00000004:00080000:2.0:1763333177.237419:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4684f480, transno 17179871639 00000004:00080000:2.0:1763333177.237421:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4684ce00, transno 17179871640 00000004:00080000:2.0:1763333177.237423:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4684c000, transno 17179871641 00000004:00080000:2.0:1763333177.237425:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4684fb80, transno 17179871642 00000004:00080000:2.0:1763333177.237427:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff75664a80, transno 17179871643 00000004:00080000:2.0:1763333177.237429:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff75666a00, transno 17179871644 00000004:00080000:2.0:1763333177.237439:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff75667b80, transno 17179871645 00000004:00080000:2.0:1763333177.237441:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff75664700, transno 17179871646 00000004:00080000:2.0:1763333177.237443:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4920f800, transno 17179871648 00000004:00080000:2.0:1763333177.237446:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4920ea00, transno 17179871649 00000004:00080000:2.0:1763333177.237448:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4920e300, transno 17179871650 00000004:00080000:2.0:1763333177.237451:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4920ed80, transno 17179871651 00000004:00080000:2.0:1763333177.237453:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4960aa00, transno 17179871653 00000004:00080000:2.0:1763333177.237456:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe49609f80, transno 17179871654 00000004:00080000:2.0:1763333177.237458:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff74039180, transno 17179871655 00000004:00080000:2.0:1763333177.237460:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff74039500, transno 17179871656 00000100:00100000:2.0:1763333177.237465:0:3654:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff92ff7dcfc000 x1848987627292032/t17179871661(17179871661) o2->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763333193 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1763333177.237475:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7dcfc000/2, rc 0, transno 17179871661 00000100:00100000:2.0:1763333177.237479:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7dcfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627292032:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1763333177.237488:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7dcff800/2, rc 0, transno 17179871660 00000100:00100000:2.0:1763333177.237492:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7dcff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627291904:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333177.237507:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7dcfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627291776:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763333177.237527:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333177.237540:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1763333177.237544:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7dcfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627291648:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763333177.237559:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333177.237574:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627291776 00000100:00100000:2.0:1763333177.237577:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627291776 00000100:00100000:2.0:1763333177.237593:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627291648 00000100:00100000:2.0:1763333177.237596:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627291648 00000100:00100000:2.0:1763333177.237610:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6713 00000100:00100000:2.0:1763333177.237616:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+8:3653:x1848987627291776:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1763333177.237630:0:17605:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:590 count 1 00002000:00010000:2.0:1763333177.237652:0:17605:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x24e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763333177.237659:0:17605:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5796d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.237676:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333177.237679:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333177.237683:0:17605:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5796d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.237696:0:17605:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5796d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.237705:0:17605:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5796d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.237712:0:17605:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5796d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.237730:0:17605:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763333177.237878:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+9:3653:x1848987627291776:12345-0@lo:6:osp-syn-1-1.0 Request processed in 262us (349us total) trans 17179871662 rc 0/0 00000100:00100000:2.0:1763333177.237884:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6713 00000100:00100000:2.0:1763333177.237895:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6714 00000100:00100000:2.0:1763333177.237900:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+8:3653:x1848987627291648:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1763333177.237909:0:17605:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:589 count 1 00010000:00010000:2.0:1763333177.237917:0:17605:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57974 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.237929:0:17605:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c578a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e52 expref: 15 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.237941:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333177.237942:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333177.237945:0:17605:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57974 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.237981:0:17605:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c578a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e52 expref: 15 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.237991:0:17605:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c578a9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e52 expref: 15 pid: 8611 timeout: 1381 lvb_type: 0 00000100:00100000:2.0:1763333177.238002:0:17605:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77b14700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17605:1848987627292160:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333177.238048:0:17605:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff6be073c0 going to sleep for 11 seconds 00000004:00080000:2.0:1763333177.238067:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7dcfed80/2, rc 0, transno 17179871662 00000100:00100000:2.0:1763333177.238071:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7dcfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627291776:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1763333177.238211:0:9836:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 4 in progress, 1 in flight, 32 done 00000100:00100000:3.0:1763333177.238826:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000004:00080000:1.0:1763333177.239339:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 964 committed 00000004:00080000:1.0:1763333177.239376:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 960 committed 00010000:00010000:1.0:1763333177.239399:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333177.239407:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5796d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.239416:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333177.239421:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5796d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.239445:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5796d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.239466:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5796d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.239473:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5796d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.239495:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333177.239497:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333177.239498:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763333177.240917:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333177.241069:0:28651:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46e2ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28651:1848987627291520:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333177.241094:0:28651:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57966 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333177.241130:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613788672 00000100:00100000:3.0:1763333177.241135:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613788672 00010000:00010000:3.0:1763333177.241164:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c578a9 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e52 expref: 16 pid: 8611 timeout: 1381 lvb_type: 0 00000100:00100000:2.0:1763333177.241895:0:17605:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77b14700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17605:1848987627292160:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333177.241913:0:17605:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57974 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333177.241933:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613788416 00000100:00100000:2.0:1763333177.241936:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613788416 00000004:00010000:0.0:1763333177.242314:0:19668:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000dc35cc31 reply state 000000007651c440 transno 4294972485 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c57943 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333177.242333:0:19668:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c57943 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333177.242342:0:19668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff92ff42c64500) 00010000:00010000:0.0:1763333177.242345:0:19668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1763333177.242366:0:19668:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763333177.242372:0:19668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff92ff42c64500) 00010000:00010000:0.0:1763333177.242375:0:19668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763333177.242380:0:19668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57783 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1c1:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969de9 expref: 243 pid: 8606 timeout: 0 lvb_type: 0 00010000:00080000:0.0:1763333177.242494:0:19668:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1763333177.242509:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:56896:x1848987613787776:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 22200us (23691us total) trans 4294972485 rc 0/0 00000100:00100000:0.0:1763333177.242518:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3245 00010000:00010000:0.0:1763333177.242547:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c57943 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333177.242555:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c57943 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333177.242562:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c57943 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333177.242568:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c84e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333177.242572:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c57943 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333177.242580:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c57943 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333177.242590:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff92ff42c64500) 00010000:00010000:0.0:1763333177.242593:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333177.242597:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c57943 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333177.242602:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c57943 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19668 initiator: MDT1 00000100:00100000:0.0:1763333177.242669:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333177.242694:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613788544 00000100:00100000:0.0:1763333177.242698:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613788544 00010000:00010000:0.0:1763333177.242716:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c578b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e59 expref: 21 pid: 8611 timeout: 1381 lvb_type: 0 00000100:00100000:0.0:1763333177.242740:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3132 00000100:00100000:0.0:1763333177.242749:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5004bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2418:x1848987613788672:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333177.242762:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333177.242767:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c578a9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x24d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e52 expref: 16 pid: 8611 timeout: 1381 lvb_type: 0 00010000:00010000:0.0:1763333177.242776:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c578a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e52 expref: 16 pid: 8611 timeout: 1381 lvb_type: 0 00010000:00010000:0.0:1763333177.242795:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c578a9 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x24d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e52 expref: 16 pid: 8611 timeout: 1381 lvb_type: 0 00010000:00010000:0.0:1763333177.242811:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333177.242813:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333177.242817:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57974 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.242826:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57974 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.242856:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333177.242877:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5004bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2418:x1848987613788672:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 130us (1967us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333177.242884:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3132 00000100:00100000:0.0:1763333177.242900:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3133 00000100:00100000:0.0:1763333177.242907:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2420:x1848987613788544:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333177.242916:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333177.242921:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c578b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e59 expref: 21 pid: 8611 timeout: 1381 lvb_type: 0 00010000:00010000:0.0:1763333177.242931:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c578b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e59 expref: 21 pid: 8611 timeout: 1381 lvb_type: 0 00010000:00010000:0.0:1763333177.242946:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c578b0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e59 expref: 21 pid: 8611 timeout: 1381 lvb_type: 0 00010000:00010000:2.0:1763333177.243088:0:17605:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57974 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.243102:0:17605:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57974 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.243111:0:17605:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57974 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.243118:0:17605:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57974 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.243134:0:17605:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763333177.243340:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+9:3653:x1848987627291648:12345-0@lo:6:osp-syn-1-1.0 Request processed in 5439us (5779us total) trans 17179871663 rc 0/0 00000100:00100000:2.0:1763333177.243367:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6714 00010000:00010000:2.0:1763333177.243388:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333177.243394:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57974 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.243401:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5e00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333177.243404:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57974 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.243411:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57974 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.243422:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57974 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.243447:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57974 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.243465:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333177.243466:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333177.243468:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763333177.243497:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7dcfe300/2, rc 0, transno 17179871663 00000100:00100000:2.0:1763333177.243503:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7dcfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627291648:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763333177.243522:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9507 00000100:00100000:2.0:1763333177.243529:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5004b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+242:56900:x1848987613788416:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333177.243544:0:29240:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333177.243546:0:29240:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763333177.243559:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c5793c lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e83 expref: 242 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.243569:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055a300) 00010000:00010000:2.0:1763333177.243575:0:29240:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333177.243589:0:29240:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5797b lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969e91 expref: -99 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.243674:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57982 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:2.0:1763333177.243684:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57982 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333177.243692:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57982 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333177.243704:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c57989 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:2.0:1763333177.243710:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c57989 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333177.243715:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c57989 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333177.244011:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c57990 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:2.0:1763333177.244019:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c57990 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333177.244025:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c57990 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00000004:00200000:2.0:1763333177.244032:0:29240:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c4:0x0]: returning size 0 00010000:00010000:2.0:1763333177.244050:0:29240:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57982 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333177.244056:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57982 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333177.244061:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57982 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333177.244066:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57982 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333177.244070:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333177.244073:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57982 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333177.244078:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57982 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333177.244085:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31400) 00010000:00010000:2.0:1763333177.244086:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333177.244089:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57982 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333177.244094:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57982 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00000004:00010000:2.0:1763333177.244102:0:29240:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003ea39781 reply state 00000000ac4b339a transno 4294972486 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c57989 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333177.244110:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c57989 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333177.244115:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43a31700) 00010000:00010000:2.0:1763333177.244117:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333177.244118:0:29240:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763333177.244137:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c5797b lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e91 expref: 244 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.244149:0:29240:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c57990 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e91 expref: 243 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.244156:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff92fe43a31600) 00010000:00010000:2.0:1763333177.244157:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333177.244159:0:29240:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe44c38800, rc 0) 00000100:00100000:2.0:1763333177.244185:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5004b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56900:x1848987613788416:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 657us (5361us total) trans 4294972486 rc 0/0 00000100:00100000:2.0:1763333177.244193:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9507 00010000:00010000:0.0:1763333177.246233:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333177.246235:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333177.246243:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57966 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.246253:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57966 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.246289:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333177.246361:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2420:x1848987613788544:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 3438us (3675us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333177.246371:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3133 00010000:00010000:1.0:1763333177.246473:0:28651:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57966 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.246482:0:28651:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57966 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.246492:0:28651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57966 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.246498:0:28651:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57966 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.246526:0:28651:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763333177.246762:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+25:3653:x1848987627291008:12345-0@lo:6:osp-syn-0-1.0 Request processed in 11748us (12413us total) trans 21474838968 rc 0/0 00000100:00100000:1.0:1763333177.246771:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6708 00010000:00010000:0.0:1763333177.248371:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333177.248385:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57966 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.248397:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c84c00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333177.248401:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57966 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.248413:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57966 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.248443:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57966 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.248450:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57966 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.248473:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333177.248475:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333177.248478:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763333177.248781:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000004:00080000:2.0:1763333177.249018:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe46e2ca80/2, rc 0, transno 21474838968 00000100:00100000:2.0:1763333177.249026:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46e2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627291008:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763333177.249218:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613788800 00000100:00100000:0.0:1763333177.249225:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613788800 00000100:00100000:0.0:1763333177.249272:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9508 00000100:00100000:0.0:1763333177.249280:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5004aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:56896:x1848987613788800:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333177.249302:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333177.249321:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c5799e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1c1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969e98 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.249389:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c5799e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e98 expref: 244 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.249402:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84e00/0xb32e3ef184c5799e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e98 expref: 244 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.249418:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff92ff42c64500) 00010000:00010000:0.0:1763333177.249422:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333177.249425:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45c84e00, rc 0) 00000100:00100000:0.0:1763333177.250810:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5004aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56896:x1848987613788800:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1522us (2024us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333177.250821:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9508 00000100:00100000:3.0:1763333177.250933:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333177.251569:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613789056 00000100:00100000:0.0:1763333177.251579:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613789056 00000100:00100000:0.0:1763333177.251630:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9509 00000100:00100000:0.0:1763333177.251640:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56900:x1848987613789056:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333177.251660:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333177.251681:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c579a5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969e9f expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.251798:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c579ac lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333177.251812:0:12741:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c57990 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e91 expref: 245 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.251821:0:12741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c579ac lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333177.251853:0:12741:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c57990 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e91 expref: 245 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.251867:0:12741:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c57990 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e91 expref: 245 pid: 29240 timeout: 1381 lvb_type: 0 00000100:00100000:0.0:1763333177.251880:0:12741:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46e2f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627292288:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333177.252743:0:12741:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff49c92600 going to sleep for 11 seconds 00000100:00100000:2.0:1763333177.255749:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333177.255969:0:12741:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46e2f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627292288:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333177.255999:0:12741:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c579ac lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000100:00100000:1.0:1763333177.256132:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613789184 00000100:00100000:1.0:1763333177.256139:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613789184 00010000:00010000:1.0:1763333177.256173:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c57990 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e91 expref: 246 pid: 29240 timeout: 1381 lvb_type: 0 00000100:00100000:1.0:1763333177.256210:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3134 00000100:00100000:1.0:1763333177.256219:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:2421:x1848987613789184:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333177.256233:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333177.256239:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c57990 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e91 expref: 246 pid: 29240 timeout: 1381 lvb_type: 0 00010000:00010000:1.0:1763333177.256249:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c57990 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e91 expref: 246 pid: 29240 timeout: 1381 lvb_type: 0 00010000:00010000:1.0:1763333177.256269:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c57990 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e91 expref: 246 pid: 29240 timeout: 1381 lvb_type: 0 00010000:00010000:1.0:1763333177.256284:0:8423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff92fe43a31600) 00010000:00010000:1.0:1763333177.256289:0:8423:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c579ac lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.256297:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c579ac lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.256307:0:8423:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c579ac lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.256337:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333177.256414:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:2421:x1848987613789184:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 195us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333177.256421:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3134 00010000:00010000:2.0:1763333177.260831:0:12741:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c579ac lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.260847:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c579ac lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:2.0:1763333177.260876:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c4:0x0]: returning size 0 00000004:00080000:2.0:1763333177.261051:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x24f:0x0], index 0: 0 00000004:00080000:2.0:1763333177.261058:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x24f:0x0], index 1: 0 00000004:00080000:2.0:1763333177.261062:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x250:0x0], index 1: 0 00000004:00080000:2.0:1763333177.261066:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x250:0x0], index 0: 0 00010000:00010000:2.0:1763333177.261171:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c579ac lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.261179:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c579ac lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.261186:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c579ac lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.261192:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c84200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333177.261196:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c579ac lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.261202:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c579ac lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.261220:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff92fe43a31600) 00010000:00010000:2.0:1763333177.261223:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333177.261227:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c579ac lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.261232:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c579ac lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.261282:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c579a5 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e9f expref: 245 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.261293:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff92fe43a31600) 00010000:00010000:2.0:1763333177.261295:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763333177.261298:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c579a5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e9f expref: 245 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.261313:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45c84600, rc 0) 00000100:00100000:2.0:1763333177.261404:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56900:x1848987613789056:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 9764us (10470us total) trans 4294972487 rc 301/301 00000100:00100000:2.0:1763333177.261413:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9509 00000100:00100000:3.0:1763333177.261634:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333177.262069:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613789440 00000100:00100000:1.0:1763333177.262079:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613789440 00000100:00100000:1.0:1763333177.262120:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3246 00000100:00100000:1.0:1763333177.262128:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5004ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56896:x1848987613789440:12345-192.168.204.28@tcp:35:lfs.0 00000004:00080000:1.0:1763333177.262320:0:19668:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x1c1:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1763333177.262408:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1473, 64 off123992 00000040:00080000:1.0:1763333177.262446:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1472, 64 off123992 00000040:00080000:1.0:1763333177.262459:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1473, 64 off124056 00000040:00080000:1.0:1763333177.262468:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1474, 64 off124056 00010000:00010000:1.0:1763333177.262526:0:19668:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c579ba lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1c1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19668 initiator: MDT0 00010000:00010000:1.0:1763333177.262545:0:19668:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c579ba lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 19668 initiator: MDT1 00010000:00010000:1.0:1763333177.262555:0:19668:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c579ba lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 19668 initiator: MDT1 00010000:00010000:1.0:1763333177.262563:0:19668:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c579ba lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1c1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 19668 initiator: MDT1 00010000:00010000:1.0:1763333177.262569:0:19668:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c579ba lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1c1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 19668 initiator: MDT1 00010000:00010000:1.0:1763333177.262580:0:19668:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c579ba lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1c1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 19668 initiator: MDT1 00010000:00010000:1.0:1763333177.262605:0:19668:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763333177.262776:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5004ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56896:x1848987613789440:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 647us (1140us total) trans 4294972488 rc 0/0 00000100:00100000:1.0:1763333177.262785:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3246 00010000:00010000:2.0:1763333177.263493:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333177.263504:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c579ba lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1c1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333177.263512:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700ce00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333177.263515:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c579ba lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1c1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333177.263523:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c579ba lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1c1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333177.263539:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c1:0x0].0x0 (ffff92ff42c64500) 00010000:00010000:2.0:1763333177.263542:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1763333177.263548:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c579ba lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1c1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333177.263553:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c579ba lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1c1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333177.263566:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333177.263567:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333177.263569:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763333177.267914:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333177.268383:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613789696 00000100:00100000:1.0:1763333177.268394:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613789696 00000100:00100000:1.0:1763333177.268463:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3247 00000100:00100000:1.0:1763333177.268474:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50049c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56900:x1848987613789696:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1763333177.268774:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50049c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56900:x1848987613789696:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 302us (870us total) trans 4294972489 rc 0/0 00000100:00100000:1.0:1763333177.268782:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3247 00000100:00100000:3.0:1763333177.298272:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333177.298322:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333177.298405:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613789952 00000100:00100000:1.0:1763333177.298421:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613789952 00000100:00100000:3.0:1763333177.298428:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00080000:3.0:1763333177.298484:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1763333177.298539:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1497 00000100:00100000:1.0:1763333177.298551:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50049500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2421:x1848987613789952:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1763333177.298633:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50049500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2421:x1848987613789952:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 83us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333177.298642:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1497 00000100:00100000:2.0:1763333177.298861:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333177.299475:0:32351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613789824 00000100:00100000:0.0:1763333177.299482:0:32351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613789824 00000100:00100000:0.0:1763333177.299529:0:32351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 155 00000100:00100000:0.0:1763333177.299538:0:32351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae3ba77-d588-4a44-b5f9-fbec4e33064f+9:2420:x1848987613789824:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1763333177.299589:0:32351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae3ba77-d588-4a44-b5f9-fbec4e33064f+9:2420:x1848987613789824:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 53us (1331us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333177.299603:0:32351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 155 00000100:00100000:0.0:1763333177.299646:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613790464 00000100:00100000:0.0:1763333177.299651:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613790464 00000100:00100000:0.0:1763333177.299691:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3248 00000100:00100000:0.0:1763333177.299699:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc02c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56900:x1848987613790464:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333177.299891:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc02c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56900:x1848987613790464:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 193us (1466us total) trans 4294972490 rc 0/0 00000100:00100000:0.0:1763333177.299898:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3248 00000100:00100000:1.0:1763333177.302024:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613790208 00000100:00100000:1.0:1763333177.302033:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613790208 00000100:00100000:1.0:1763333177.302088:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9510 00000100:00100000:1.0:1763333177.302095:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56896:x1848987613790208:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333177.302113:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333177.302134:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c579c1 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969ea6 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.302197:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c600/0xb32e3ef184c579c8 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333177.302211:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c600/0xb32e3ef184c579c8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.302222:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c600/0xb32e3ef184c579c8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.302231:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c579cf lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333177.302238:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c579cf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.302244:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c579cf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.302333:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c579d6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333177.302340:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c579d6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.303631:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c579d6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:1.0:1763333177.303656:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c4:0x0]: returning size 0 00010000:00010000:1.0:1763333177.303766:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c600/0xb32e3ef184c579c8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.303778:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c600/0xb32e3ef184c579c8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.303785:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c600/0xb32e3ef184c579c8 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.303791:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c600/0xb32e3ef184c579c8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.305385:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700c600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333177.305393:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c600/0xb32e3ef184c579c8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.305402:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c600/0xb32e3ef184c579c8 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.305418:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44cd0000) 00010000:00010000:1.0:1763333177.305420:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333177.305425:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c600/0xb32e3ef184c579c8 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.305441:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c600/0xb32e3ef184c579c8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.305460:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c579cf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.305466:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c579cf lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.305473:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c579cf lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.305478:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700ce00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333177.305481:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c579cf lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.305487:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c579cf lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.305494:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43a31700) 00010000:00010000:1.0:1763333177.305496:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333177.305499:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c579cf lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.305504:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c579cf lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.305553:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c579c1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ea6 expref: 250 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.305574:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c579d6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ea6 expref: 249 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.305581:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff92fe44cd0100) 00010000:00010000:1.0:1763333177.305584:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333177.305586:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4700de00, rc 0) 00000100:00100000:1.0:1763333177.305661:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:56896:x1848987613790208:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 3565us (6799us total) trans 4294972491 rc 0/0 00000100:00100000:1.0:1763333177.305670:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9510 00000100:00100000:3.0:1763333177.313780:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333177.313908:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613790592 00000100:00100000:1.0:1763333177.313919:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613790592 00000100:00100000:1.0:1763333177.313993:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6715 00000100:00100000:1.0:1763333177.314003:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50048700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2421:x1848987613790592:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333177.314031:0:28651:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333177.314056:0:28651:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4700c200/0xb32e3ef184c579e4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969ead expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333177.314079:0:28651:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333177.314104:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333177.314107:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333177.314117:0:28651:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4700c200/0xb32e3ef184c579e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ead expref: 21 pid: 28651 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333177.314133:0:28651:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe4700c200/0xb32e3ef184c579e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ead expref: 21 pid: 28651 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333177.314147:0:28651:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4700c200, rc 0) 00000100:00100000:1.0:1763333177.314210:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50048700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2421:x1848987613790592:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 207us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333177.314216:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6715 00000100:00100000:3.0:1763333177.315482:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333177.315547:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613790848 00000100:00100000:1.0:1763333177.315553:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613790848 00000100:00100000:1.0:1763333177.315593:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9511 00000100:00100000:1.0:1763333177.315601:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50048380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:55917:x1848987613790848:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333177.315620:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333177.315622:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763333177.315646:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c579d6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ea6 expref: 249 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.315669:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff92fe44cd0100) 00010000:00010000:1.0:1763333177.315682:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333177.315693:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c579eb lrc: 2/0,0 mode: --/CW res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969eb4 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.315792:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c600/0xb32e3ef184c579f2 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333177.315803:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c600/0xb32e3ef184c579f2 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1c4:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.315812:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c600/0xb32e3ef184c579f2 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1c4:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:1.0:1763333177.315826:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c4:0x0]: returning size 0 00010000:00010000:1.0:1763333177.315942:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c579eb lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1c4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969eb4 expref: 251 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.315955:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c600/0xb32e3ef184c579f2 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1c4:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969eb4 expref: 250 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.315962:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff92fe44cd0500) 00010000:00010000:1.0:1763333177.315965:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:1.0:1763333177.315967:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4700c600, rc 0) 00000100:00100000:1.0:1763333177.316011:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50048380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:55917:x1848987613790848:12345-192.168.204.28@tcp:101:bash.0 Request processed in 410us (533us total) trans 4294972492 rc 0/0 00000100:00100000:1.0:1763333177.316017:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9511 00000100:00100000:0.0:1763333177.319176:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333177.319284:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613791104 00000100:00100000:1.0:1763333177.319294:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613791104 00000100:00100000:1.0:1763333177.319403:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3249 00000100:00100000:1.0:1763333177.319417:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:56896:x1848987613791104:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1763333177.319692:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:56896:x1848987613791104:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 276us (527us total) trans 4294972493 rc 0/0 00000100:00100000:1.0:1763333177.319703:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3249 00000100:00100000:3.0:1763333177.320922:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.321012:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613791232 00000100:00100000:2.0:1763333177.321019:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613791232 00000100:00100000:2.0:1763333177.321084:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9512 00000100:00100000:2.0:1763333177.321096:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5004ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:55917:x1848987613791232:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333177.321111:0:29240:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333177.321136:0:29240:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c57a00 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969ebb expref: -99 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.321170:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c57a07 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:2.0:1763333177.321185:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c57a07 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333177.321195:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c57a07 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333177.321306:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c57a00 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ebb expref: 253 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.321328:0:29240:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c57a07 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ebb expref: 252 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.321337:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff92fe44cd0500) 00010000:00010000:2.0:1763333177.321340:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763333177.321343:0:29240:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdea00, rc 0) 00000100:00100000:2.0:1763333177.321425:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5004ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:55917:x1848987613791232:12345-192.168.204.28@tcp:101:bash.0 Request processed in 333us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333177.321439:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9512 00000100:00100000:3.0:1763333177.324786:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333177.324895:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613791488 00000100:00100000:1.0:1763333177.324906:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613791488 00000100:00100000:1.0:1763333177.324963:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9513 00000100:00100000:1.0:1763333177.324972:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50049c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:56896:x1848987613791488:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333177.324999:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333177.325024:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c57a0e lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969ec2 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.325105:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c57a15 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333177.325118:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c57a15 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.325128:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c57a15 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.325139:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c57a1c lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333177.325147:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c57a1c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.325152:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c57a1c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.325252:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57a23 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333177.325268:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57a23 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.325273:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57a23 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.325279:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57a23 lrc: 3/0,0 mode: --/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.325285:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4874ba00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333177.325289:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57a23 lrc: 3/0,0 mode: --/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.325296:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57a23 lrc: 4/0,0 mode: --/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.325305:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff92fe44cd0500) 00010000:00010000:1.0:1763333177.325310:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57a23 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.325316:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57a23 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000004:00200000:1.0:1763333177.325331:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c4:0x0]: returning size 0 00010000:00010000:1.0:1763333177.325456:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c57a15 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.325463:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c57a15 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.325469:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c57a15 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.325474:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c57a15 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.325479:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700de00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333177.325482:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c57a15 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.325488:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c57a15 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.325495:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44cd0100) 00010000:00010000:1.0:1763333177.325497:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333177.325500:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c57a15 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.325505:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c57a15 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.325515:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c57a1c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.325521:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c57a1c lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.325526:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c57a1c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.325531:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe44c38800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333177.325534:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c57a1c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.325540:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c57a1c lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.325546:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43a31700) 00010000:00010000:1.0:1763333177.325548:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333177.325552:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c57a1c lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.325557:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c57a1c lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.325590:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c57a0e lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ec2 expref: 254 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.325599:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44cd0100) 00010000:00010000:1.0:1763333177.325602:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763333177.325605:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c57a0e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ec2 expref: 254 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.325619:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4700ce00, rc 0) 00000100:00100000:1.0:1763333177.325670:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50049c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:56896:x1848987613791488:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 698us (896us total) trans 4294972494 rc 301/301 00000100:00100000:1.0:1763333177.325678:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9513 00000100:00100000:3.0:1763333177.327263:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.327394:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613791744 00000100:00100000:2.0:1763333177.327403:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613791744 00000100:00100000:2.0:1763333177.327467:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9514 00000100:00100000:2.0:1763333177.327483:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4399a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:55917:x1848987613791744:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:2.0:1763333177.327530:0:29240:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333177.327554:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c600/0xb32e3ef184c579f2 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1c4:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969eb4 expref: 253 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.327572:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff92fe44cd0500) 00010000:00010000:2.0:1763333177.327576:0:29240:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333177.327743:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c57a31 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:2.0:1763333177.327757:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c57a31 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333177.327766:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c57a31 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00000001:00080000:2.0:1763333177.327832:0:29240:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294972495 00000004:00010000:2.0:1763333177.327854:0:29240:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a959f910 reply state 000000001191b77b transno 4294972496 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c57a31 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333177.327866:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c57a31 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1c4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333177.327872:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff92fe44cd0500) 00010000:00010000:2.0:1763333177.327875:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333177.327877:0:29240:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763333177.327947:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4399a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+255:55917:x1848987613791744:12345-192.168.204.28@tcp:36:bash.0 Request processed in 466us (693us total) trans 4294972496 rc 0/0 00000100:00100000:2.0:1763333177.327954:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9514 00000020:00080000:2.0:1763333177.327960:0:29240:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763333177.331272:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333177.331393:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613791872 00000100:00100000:1.0:1763333177.331411:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613791872 00000100:00100000:1.0:1763333177.331494:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9515 00000100:00100000:1.0:1763333177.331506:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+255:55917:x1848987613791872:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333177.331535:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333177.331557:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57a38 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969ec9 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.331615:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57a38 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ec9 expref: 256 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.331631:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57a38 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ec9 expref: 256 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.331651:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff92fe44cd0500) 00010000:00010000:1.0:1763333177.331654:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763333177.331658:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4874ba00, rc 0) 00000100:00100000:1.0:1763333177.331730:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+256:55917:x1848987613791872:12345-192.168.204.28@tcp:101:bash.0 Request processed in 227us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333177.331737:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9515 00000100:00100000:3.0:1763333177.332755:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333177.332836:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613792128 00000100:00100000:0.0:1763333177.332846:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613792128 00000100:00100000:0.0:1763333177.332904:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3250 00000100:00100000:0.0:1763333177.332914:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4399b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+256:56896:x1848987613792128:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333177.333137:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4399b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+257:56896:x1848987613792128:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 224us (387us total) trans 4294972497 rc 0/0 00000100:00100000:0.0:1763333177.333145:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3250 00000100:00100000:3.0:1763333177.336932:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333177.337057:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613792256 00000100:00100000:1.0:1763333177.337072:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613792256 00000100:00100000:1.0:1763333177.337144:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3251 00000100:00100000:1.0:1763333177.337155:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+257:56896:x1848987613792256:12345-192.168.204.28@tcp:33:lfs.0 00000100:00100000:1.0:1763333177.337321:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+257:56896:x1848987613792256:12345-192.168.204.28@tcp:33:lfs.0 Request processed in 167us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333177.337328:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3251 00000100:00100000:3.0:1763333177.346463:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.346568:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613792512 00000100:00100000:2.0:1763333177.346597:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613792512 00000100:00100000:2.0:1763333177.346683:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9516 00000100:00100000:2.0:1763333177.346694:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4399b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+257:55917:x1848987613792512:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333177.346719:0:29240:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333177.346722:0:29240:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763333177.346751:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57a38 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ec9 expref: 257 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.346771:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff92fe44cd0500) 00010000:00010000:2.0:1763333177.346776:0:29240:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333177.346791:0:29240:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c57a3f lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969ed0 expref: -99 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.346856:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c57a46 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:2.0:1763333177.346870:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c57a46 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333177.346880:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c57a46 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00000040:00080000:2.0:1763333177.347142:0:29240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1475, 88 off124144 00000004:00080000:2.0:1763333177.347152:0:29240:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1281426802542ns, next at 1281590880154ns, rc = 0 00000040:00080000:2.0:1763333177.347193:0:29240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1474, 88 off124144 00000004:00080000:2.0:1763333177.347198:0:29240:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1281426848737ns, next at 1282258802447ns, rc = 0 00000040:00080000:2.0:1763333177.347222:0:29240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1475, 88 off124232 00000004:00080000:2.0:1763333177.347227:0:29240:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1281426877890ns, next at 1282258802447ns, rc = 0 00000040:00080000:2.0:1763333177.347237:0:29240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1476, 88 off124232 00000004:00080000:2.0:1763333177.347242:0:29240:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1281426892796ns, next at 1281590880154ns, rc = 0 00000001:00080000:1.0:1763333177.355099:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972498 is committed 00000004:00080000:1.0:1763333177.355113:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 967 committed 00000004:00080000:1.0:1763333177.355135:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 964 committed 00000004:00080000:1.0:1763333177.355150:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 963 committed 00000004:00080000:1.0:1763333177.355153:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 966 committed 00010000:00010000:0.0:1763333177.355245:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c57989 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.355258:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c57989 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.355266:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c57989 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.355272:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe44c39000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333177.355276:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c57989 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.355285:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c57989 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.355301:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43a31700) 00010000:00010000:0.0:1763333177.355304:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333177.355310:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c57989 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.355316:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c57989 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.355342:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c57a31 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1c4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.355391:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c57a31 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1c4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.355397:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c57a31 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1c4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.355402:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333177.355405:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c57a31 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1c4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.355410:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c57a31 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1c4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.355418:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff92fe44cd0500) 00010000:00010000:0.0:1763333177.355420:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333177.355423:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c57a31 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1c4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.355436:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c57a31 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1c4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00000100:00100000:2.0:1763333177.355651:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627292672:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333177.355713:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333177.355750:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1763333177.355755:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627292800:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333177.355773:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333177.355805:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627292672 00000100:00100000:2.0:1763333177.355812:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627292672 00000100:00100000:2.0:1763333177.355848:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627292800 00000100:00100000:2.0:1763333177.355850:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627292800 00000100:00100000:2.0:1763333177.355865:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6716 00000100:00100000:2.0:1763333177.355873:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+26:3654:x1848987627292672:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:2.0:1763333177.356009:0:28651:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333177.356013:0:28651:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1763333177.356016:0:28651:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333177.356018:0:28651:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1763333177.356020:0:28651:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333177.356053:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+27:3654:x1848987627292672:12345-0@lo:2:osp-syn-0-1.0 Request processed in 181us (339us total) trans 21474838969 rc 0/0 00000100:00100000:2.0:1763333177.356061:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6716 00000100:00100000:2.0:1763333177.356077:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6717 00000100:00100000:2.0:1763333177.356083:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+26:3654:x1848987627292800:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333177.356151:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+27:3654:x1848987627292800:12345-0@lo:2:osp-syn-0-1.0 Request processed in 68us (376us total) trans 21474838970 rc 0/0 00000100:00100000:2.0:1763333177.356157:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6717 00000004:00080000:2.0:1763333177.356195:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff77b16680/2, rc 0, transno 21474838970 00000100:00100000:2.0:1763333177.356200:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627292800:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1763333177.356207:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff77b14380/2, rc 0, transno 21474838969 00000100:00100000:2.0:1763333177.356210:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627292672:0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1763333177.356256:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c57a46 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ed0 expref: 244 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.356265:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff92fe44cd0500) 00010000:00010000:2.0:1763333177.356268:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763333177.356280:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c57a3f lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ed0 expref: 244 pid: 29240 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1763333177.356294:0:29240:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c57a46 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c4:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ed0 expref: 243 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.356319:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff92fe44cd0500) 00010000:00010000:2.0:1763333177.356321:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763333177.356324:0:29240:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4700ce00, rc 0) 00000100:00100000:2.0:1763333177.356398:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4399b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:55917:x1848987613792512:12345-192.168.204.28@tcp:101:bash.0 Request processed in 9706us (9953us total) trans 4294972498 rc 0/0 00000100:00100000:2.0:1763333177.356404:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9516 00000100:00100000:1.0:1763333177.356595:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77b14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627292544:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763333177.356625:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333177.356654:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1763333177.356660:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77b15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627292416:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763333177.356680:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333177.356865:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4399bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627293056:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763333177.356888:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333177.356917:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1763333177.356922:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe43999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627292928:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763333177.356939:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333177.357373:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627292544 00000100:00100000:3.0:1763333177.357381:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627292544 00000100:00100000:3.0:1763333177.357423:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627292416 00000100:00100000:3.0:1763333177.357426:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627292416 00000100:00100000:3.0:1763333177.357451:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627293056 00000100:00100000:3.0:1763333177.357453:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627293056 00000100:00100000:3.0:1763333177.357469:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627292928 00000100:00100000:3.0:1763333177.357472:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627292928 00000100:00100000:3.0:1763333177.357488:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6718 00000100:00100000:3.0:1763333177.357495:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+28:3653:x1848987627292544:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763333177.357518:0:29010:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:588 count 1 00010000:00010000:3.0:1763333177.357541:0:29010:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe4742fa00/0xb32e3ef184c57a4d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.357560:0:29010:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85400/0xb32e3ef184c578fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e6e expref: 20 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.357568:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333177.357570:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333177.357573:0:29010:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4742fa00/0xb32e3ef184c57a4d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.357598:0:29010:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85400/0xb32e3ef184c578fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e6e expref: 20 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.357611:0:29010:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85400/0xb32e3ef184c578fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e6e expref: 20 pid: 8611 timeout: 1381 lvb_type: 0 00000100:00100000:3.0:1763333177.357623:0:29010:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe43998000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:29010:1848987627293440:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333177.357675:0:29010:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff44fdfc00 going to sleep for 11 seconds 00000100:00100000:3.0:1763333177.357693:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6719 00000100:00100000:3.0:1763333177.357700:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+28:3653:x1848987627292416:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763333177.357714:0:8407:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:587 count 1 00010000:00010000:3.0:1763333177.357725:0:8407:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c57a54 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.357736:0:8407:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57824 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e21 expref: 20 pid: 28600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333177.357743:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333177.357745:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333177.357748:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c57a54 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.357765:0:8407:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57824 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e21 expref: 20 pid: 28600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333177.357774:0:8407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57824 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e21 expref: 20 pid: 28600 timeout: 1381 lvb_type: 1 00000100:00100000:3.0:1763333177.357783:0:8407:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe43998380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8407:1848987627293568:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333177.357805:0:8407:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff44fdf900 going to sleep for 11 seconds 00000100:00100000:3.0:1763333177.357821:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6720 00000100:00100000:3.0:1763333177.357827:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+10:3653:x1848987627293056:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763333177.357839:0:29013:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:588 count 1 00010000:00010000:3.0:1763333177.357852:0:29013:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c57a5b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.357863:0:29013:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c578da lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e67 expref: 14 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.357870:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333177.357872:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333177.357875:0:29013:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c57a5b lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.357893:0:29013:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c578da lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e67 expref: 14 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.357902:0:29013:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c578da lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e67 expref: 14 pid: 28651 timeout: 1381 lvb_type: 0 00000100:00100000:3.0:1763333177.357911:0:29013:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe43999c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:29013:1848987627293696:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333177.357932:0:29013:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff43ef5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1763333177.358102:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6721 00000100:00100000:1.0:1763333177.358110:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+10:3653:x1848987627292928:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763333177.358122:0:28600:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:587 count 1 00010000:00010000:1.0:1763333177.358134:0:28600:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57a62 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.358145:0:28600:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85200/0xb32e3ef184c57721 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969dcd expref: 14 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.358151:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333177.358153:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333177.358156:0:28600:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57a62 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.358174:0:28600:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85200/0xb32e3ef184c57721 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969dcd expref: 14 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.358182:0:28600:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85200/0xb32e3ef184c57721 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969dcd expref: 14 pid: 8611 timeout: 1381 lvb_type: 0 00000100:00100000:1.0:1763333177.358192:0:28600:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28600:1848987627293824:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333177.358227:0:28600:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff801ac180 going to sleep for 11 seconds 00000100:00100000:3.0:1763333177.363828:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4399b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627293184:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333177.363894:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333177.363933:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763333177.363940:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4399a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627293312:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333177.363961:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333177.363989:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627293184 00000100:00100000:3.0:1763333177.363996:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627293184 00000100:00100000:3.0:1763333177.364045:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627293312 00000100:00100000:3.0:1763333177.364049:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627293312 00000100:00100000:3.0:1763333177.364066:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6722 00000100:00100000:3.0:1763333177.364074:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+12:3654:x1848987627293184:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333177.364254:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+13:3654:x1848987627293184:12345-0@lo:2:osp-syn-1-1.0 Request processed in 179us (358us total) trans 17179871664 rc 0/0 00000100:00100000:3.0:1763333177.364262:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6722 00000100:00100000:3.0:1763333177.364280:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6723 00000100:00100000:3.0:1763333177.364287:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+12:3654:x1848987627293312:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333177.364375:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+13:3654:x1848987627293312:12345-0@lo:2:osp-syn-1-1.0 Request processed in 64us (387us total) trans 17179871665 rc 0/0 00000100:00100000:3.0:1763333177.364381:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6723 00000004:00080000:3.0:1763333177.364421:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4399a300/2, rc 0, transno 17179871665 00000100:00100000:3.0:1763333177.364438:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4399a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627293312:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763333177.364450:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4399b800/2, rc 0, transno 17179871664 00000100:00100000:3.0:1763333177.364453:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4399b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627293184:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333177.371479:0:29010:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe43998000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:29010:1848987627293440:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333177.371528:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:3.0:1763333177.371529:0:29010:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe4742fa00/0xb32e3ef184c57a4d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333177.371569:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.371599:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333177.371627:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613792640 00000100:00100000:3.0:1763333177.371639:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613792640 00000100:00100000:2.0:1763333177.371639:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:3.0:1763333177.371693:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85400/0xb32e3ef184c578fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e6e expref: 21 pid: 8611 timeout: 1381 lvb_type: 0 00000100:00100000:1.0:1763333177.371749:0:29013:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe43999c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:29013:1848987627293696:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333177.371781:0:29013:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c57a5b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333177.371825:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613792896 00000100:00100000:1.0:1763333177.371832:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613792896 00010000:00010000:1.0:1763333177.371866:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c578da lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e67 expref: 15 pid: 28651 timeout: 1381 lvb_type: 0 00000100:00100000:1.0:1763333177.371887:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613792768 00000100:00100000:1.0:1763333177.371890:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613792768 00010000:00010000:1.0:1763333177.371901:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57824 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e21 expref: 22 pid: 28600 timeout: 1381 lvb_type: 1 00000100:00100000:1.0:1763333177.371911:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613793024 00000100:00100000:1.0:1763333177.371913:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613793024 00010000:00010000:1.0:1763333177.371923:0:6505:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85200/0xb32e3ef184c57721 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969dcd expref: 16 pid: 8611 timeout: 1381 lvb_type: 0 00000100:00100000:1.0:1763333177.371935:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3135 00000100:00100000:1.0:1763333177.371942:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2418:x1848987613792640:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333177.371956:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333177.371961:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85400/0xb32e3ef184c578fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e6e expref: 22 pid: 8611 timeout: 1381 lvb_type: 0 00010000:00010000:1.0:1763333177.371973:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85400/0xb32e3ef184c578fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e6e expref: 22 pid: 8611 timeout: 1381 lvb_type: 0 00010000:00010000:1.0:1763333177.371998:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85400/0xb32e3ef184c578fd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e6e expref: 22 pid: 8611 timeout: 1381 lvb_type: 0 00010000:00010000:1.0:1763333177.372020:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333177.372022:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333177.372027:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe4742fa00/0xb32e3ef184c57a4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.372035:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4742fa00/0xb32e3ef184c57a4d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.372068:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333177.372120:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2418:x1848987613792640:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 178us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333177.372128:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3135 00000100:00100000:1.0:1763333177.372146:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3136 00000100:00100000:1.0:1763333177.372152:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2418:x1848987613792896:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333177.372160:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333177.372165:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c578da lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e67 expref: 16 pid: 28651 timeout: 1381 lvb_type: 0 00010000:00010000:1.0:1763333177.372174:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c578da lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e67 expref: 16 pid: 28651 timeout: 1381 lvb_type: 0 00010000:00010000:1.0:1763333177.372188:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c578da lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e67 expref: 16 pid: 28651 timeout: 1381 lvb_type: 0 00010000:00010000:1.0:1763333177.372198:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333177.372200:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333177.372203:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c57a5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.372211:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c57a5b lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.372227:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333177.372244:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2418:x1848987613792896:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 92us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333177.372251:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3136 00000100:00100000:1.0:1763333177.372264:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3137 00000100:00100000:1.0:1763333177.372270:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2418:x1848987613792768:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333177.372277:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333177.372281:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57824 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x24b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e21 expref: 20 pid: 28600 timeout: 1381 lvb_type: 1 00010000:00010000:1.0:1763333177.372291:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57824 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e21 expref: 20 pid: 28600 timeout: 1381 lvb_type: 1 00010000:00010000:1.0:1763333177.372303:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333177.372305:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333177.372307:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c57a54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.372314:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c57a54 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.372324:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333177.372342:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2418:x1848987613792768:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 72us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333177.372380:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3137 00000100:00100000:1.0:1763333177.372393:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3138 00000100:00100000:1.0:1763333177.372400:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50e6b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2418:x1848987613793024:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333177.372407:0:6505:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333177.372412:0:6505:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85200/0xb32e3ef184c57721 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x24b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969dcd expref: 14 pid: 8611 timeout: 1381 lvb_type: 0 00010000:00010000:1.0:1763333177.372421:0:6505:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85200/0xb32e3ef184c57721 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x24b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969dcd expref: 14 pid: 8611 timeout: 1381 lvb_type: 0 00010000:00010000:1.0:1763333177.372444:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333177.372446:0:6505:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333177.372449:0:6505:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57a62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.372456:0:6505:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57a62 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x24b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.372467:0:6505:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333177.372483:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50e6b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2418:x1848987613793024:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 84us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333177.372489:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3138 00010000:00010000:1.0:1763333177.372540:0:28600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85200/0xb32e3ef184c57721 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969dcd expref: 13 pid: 8611 timeout: 1381 lvb_type: 0 00000100:00100000:1.0:1763333177.372551:0:28600:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28600:1848987627293824:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333177.372562:0:28600:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57a62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.372570:0:28600:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57a62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.372577:0:28600:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57a62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.372586:0:28600:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57a62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.372594:0:28600:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57a62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.372611:0:28600:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763333177.372819:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+13:3653:x1848987627292928:12345-0@lo:6:osp-syn-1-1.0 Request processed in 14710us (15877us total) trans 17179871666 rc 0/0 00000100:00100000:1.0:1763333177.372827:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6721 00010000:00010000:1.0:1763333177.372846:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333177.372851:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57a62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.372858:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4874b000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333177.372862:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57a62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.372875:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57a62 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.372889:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57a62 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.372897:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57a62 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.372916:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333177.372918:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333177.372921:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333177.372946:0:29010:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe4742fa00/0xb32e3ef184c57a4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1763333177.372954:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe43999880/2, rc 0, transno 17179871666 00000100:00100000:1.0:1763333177.372965:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe43999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627292928:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1763333177.372989:0:29010:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4742fa00/0xb32e3ef184c57a4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.373000:0:29013:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c57a5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.373002:0:29010:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe4742fa00/0xb32e3ef184c57a4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.373041:0:29010:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4742fa00/0xb32e3ef184c57a4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.373042:0:29013:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c57a5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.373075:0:29013:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c57a5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.373083:0:29013:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c57a5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.373089:0:29010:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763333177.373117:0:29013:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1763333177.373713:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1763333177.373720:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe4742fa00/0xb32e3ef184c57a4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.373728:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4742fa00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333177.373731:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4742fa00/0xb32e3ef184c57a4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.373738:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4742fa00/0xb32e3ef184c57a4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.373750:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe4742fa00/0xb32e3ef184c57a4d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.373756:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4742fa00/0xb32e3ef184c57a4d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.373773:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333177.373777:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c57a5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.373783:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4742e000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333177.373786:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c57a5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.373793:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c57a5b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.373816:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c57a5b lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.373823:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c57a5b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.373837:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333177.373838:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333177.373840:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333177.374248:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333177.374290:0:8407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57824 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969e21 expref: 19 pid: 28600 timeout: 1381 lvb_type: 1 00000100:00100000:0.0:1763333177.374301:0:8407:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe43998380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8407:1848987627293568:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333177.374317:0:8407:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c57a54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.374325:0:8407:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c57a54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.374332:0:8407:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c57a54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.374340:0:8407:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c57a54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.374368:0:8407:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c57a54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.374383:0:8407:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763333177.374816:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+30:3653:x1848987627292544:12345-0@lo:6:osp-syn-0-1.0 Request processed in 17314us (18183us total) trans 21474838971 rc 0/0 00000100:00100000:3.0:1763333177.374830:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6718 00000100:00100000:0.0:1763333177.375096:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+29:3653:x1848987627292416:12345-0@lo:6:osp-syn-0-1.0 Request processed in 17394us (18411us total) trans 21474838972 rc 0/0 00000100:00100000:0.0:1763333177.375108:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6719 00010000:00010000:0.0:1763333177.375136:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333177.375141:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c57a54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.375150:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4742f400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333177.375153:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c57a54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.375160:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c57a54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.375174:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c57a54 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.375180:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c57a54 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.375197:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333177.375199:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333177.375201:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763333177.375263:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+13:3653:x1848987627293056:12345-0@lo:6:osp-syn-1-1.0 Request processed in 17434us (18372us total) trans 17179871667 rc 0/0 00000100:00100000:1.0:1763333177.375270:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6720 00000004:00080000:1.0:1763333177.375309:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4399bb80/2, rc 0, transno 17179871667 00000100:00100000:1.0:1763333177.375315:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4399bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627293056:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1763333177.375326:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff77b15500/2, rc 0, transno 21474838972 00000100:00100000:1.0:1763333177.375331:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77b15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627292416:0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1763333177.375340:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff77b14a80/2, rc 0, transno 21474838971 00000100:00100000:1.0:1763333177.375343:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77b14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627292544:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763333177.376285:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333177.376334:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333177.376393:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613793152 00000100:00100000:1.0:1763333177.376403:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613793152 00000100:00100000:1.0:1763333177.376480:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6724 00000100:00100000:1.0:1763333177.376491:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:55917:x1848987613793152:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333177.376509:0:29013:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333177.376527:0:29013:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57a69 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969ed7 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.376554:0:29013:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe4700c200/0xb32e3ef184c579e4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ead expref: 20 pid: 28651 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333177.376563:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333177.376565:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333177.376569:0:29013:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57a69 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ed7 expref: 20 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.376609:0:29013:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe4700c200/0xb32e3ef184c579e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ead expref: 20 pid: 28651 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333177.376622:0:29013:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe4700c200/0xb32e3ef184c579e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ead expref: 20 pid: 28651 timeout: 1381 lvb_type: 1 00000100:00100000:1.0:1763333177.376634:0:29013:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29013:1848987627293952:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333177.376711:0:29013:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff801ac180 going to sleep for 11 seconds 00000100:00100000:0.0:1763333177.376791:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613793408 00000100:00100000:0.0:1763333177.376926:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613793408 00000100:00100000:0.0:1763333177.376972:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9517 00000100:00100000:0.0:1763333177.376980:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+243:56902:x1848987613793408:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333177.376993:0:29240:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333177.377009:0:29240:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57a70 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969ede expref: -99 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.377078:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57a77 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:0.0:1763333177.377096:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57a77 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.377106:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57a77 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.377117:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57a7e lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:0.0:1763333177.377123:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57a7e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.377129:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57a7e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.377239:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57a85 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:0.0:1763333177.377248:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57a85 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.377255:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57a85 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00000004:00200000:0.0:1763333177.377265:0:29240:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c4:0x0]: returning size 2 00010000:00010000:0.0:1763333177.377342:0:29240:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57a77 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.377380:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57a77 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.377386:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57a77 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.377393:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57a77 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.377399:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c84c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333177.377403:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57a77 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.377410:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57a77 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.377421:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12200) 00010000:00010000:0.0:1763333177.377424:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333177.377444:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57a77 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.377451:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57a77 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.377463:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57a7e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.377468:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57a7e lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.377474:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57a7e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.377479:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c84600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333177.377482:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57a7e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.377487:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57a7e lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.377494:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe44e12e00) 00010000:00010000:0.0:1763333177.377497:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333177.377501:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57a7e lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.377507:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57a7e lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.377550:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57a70 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ede expref: 246 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.377562:0:29240:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57a85 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ede expref: 245 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.377569:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff92fe44cd0500) 00010000:00010000:0.0:1763333177.377571:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333177.377574:0:29240:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45c84200, rc 0) 00000100:00100000:0.0:1763333177.377627:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56902:x1848987613793408:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 647us (1293us total) trans 4294972499 rc 0/0 00000100:00100000:0.0:1763333177.377635:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9517 00000100:00100000:2.0:1763333177.381528:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333177.381671:0:29013:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29013:1848987627293952:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333177.381715:0:29013:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57a69 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ed7 expref: 20 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.381740:0:29013:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4874aa00, rc 0) 00000100:00100000:1.0:1763333177.381816:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:55917:x1848987613793152:12345-192.168.204.28@tcp:101:bash.0 Request processed in 5326us (5537us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333177.381829:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6724 00000100:00100000:3.0:1763333177.383223:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333177.384448:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613793536 00000100:00100000:0.0:1763333177.384468:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613793536 00010000:00010000:0.0:1763333177.384535:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4700c200/0xb32e3ef184c579e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ead expref: 20 pid: 28651 timeout: 1381 lvb_type: 1 00000100:00100000:0.0:1763333177.384596:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3139 00000100:00100000:0.0:1763333177.384608:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2421:x1848987613793536:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333177.384629:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333177.384637:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe4700c200/0xb32e3ef184c579e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ead expref: 20 pid: 28651 timeout: 1381 lvb_type: 1 00010000:00010000:0.0:1763333177.384660:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe4700c200/0xb32e3ef184c579e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ead expref: 20 pid: 28651 timeout: 1381 lvb_type: 1 00010000:00010000:0.0:1763333177.384690:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4700c200/0xb32e3ef184c579e4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ead expref: 20 pid: 28651 timeout: 1381 lvb_type: 1 00010000:00010000:0.0:1763333177.384710:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333177.384712:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333177.384721:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57a69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ed7 expref: 19 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.384733:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57a69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ed7 expref: 19 pid: 29013 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333177.384781:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613793664 00010000:00010000:0.0:1763333177.384785:0:6504:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57a69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ed7 expref: 19 pid: 29013 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333177.384794:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613793664 00000100:00100000:0.0:1763333177.384819:0:6504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46e2ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6504:1848987627294080:192.168.204.28@tcp:105: 00000100:00100000:1.0:1763333177.384865:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6725 00000100:00100000:1.0:1763333177.384880:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2420:x1848987613793664:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333177.384917:0:29013:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1763333177.384922:0:6504:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff49c92e40 going to sleep for 11 seconds 00010000:00010000:1.0:1763333177.384941:0:29013:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4874b000/0xb32e3ef184c57a93 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969ee5 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333177.385012:0:29013:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29013:1848987627294208:192.168.204.28@tcp:106: 00000100:00100000:1.0:1763333177.385067:0:29013:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff801ac180 going to sleep for 11 seconds 00000100:00100000:0.0:1763333177.395717:0:6504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46e2ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6504:1848987627294080:192.168.204.28@tcp:105: 00000100:00100000:2.0:1763333177.395719:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:0.0:1763333177.395751:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333177.395957:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2421:x1848987613793536:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 11348us (14443us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333177.395968:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3139 00000100:00100000:3.0:1763333177.396918:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613793792 00000100:00100000:3.0:1763333177.396932:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613793792 00000100:00100000:2.0:1763333177.397140:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6726 00000100:00100000:2.0:1763333177.397153:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:55917:x1848987613793792:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333177.397178:0:8407:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333177.397207:0:8407:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c57a9a lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969eec expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763333177.397239:0:8407:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x24f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763333177.397265:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333177.397268:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333177.397279:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c57a9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969eec expref: 14 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.397297:0:8407:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c57a9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969eec expref: 14 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.397314:0:8407:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48191800, rc 0) 00000100:00100000:2.0:1763333177.397414:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:55917:x1848987613793792:12345-192.168.204.28@tcp:101:bash.0 Request processed in 262us (1714us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333177.397424:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6726 00002000:00010000:1.0:1763333177.397594:0:29013:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb mtime: 0 -> 1763333177 00002000:00010000:1.0:1763333177.397599:0:29013:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb atime: 0 -> 1763333177 00002000:00010000:1.0:1763333177.397601:0:29013:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb ctime: 0 -> 1763333177 00000100:00100000:1.0:1763333177.397616:0:29013:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29013:1848987627294208:192.168.204.28@tcp:106: 00010000:00010000:1.0:1763333177.397748:0:29013:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe4874b000/0xb32e3ef184c57a93 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ee5 expref: 20 pid: 29013 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333177.397769:0:29013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4874b000/0xb32e3ef184c57a93 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ee5 expref: 20 pid: 29013 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333177.397784:0:29013:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4874b000, rc 0) 00000100:00100000:1.0:1763333177.397827:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2420:x1848987613793664:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 12951us (14610us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333177.397834:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6725 00000100:00100000:0.0:1763333177.406293:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333177.406343:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.406552:0:28429:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613793920 00000100:00100000:2.0:1763333177.406570:0:28429:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613793920 00002000:00010000:2.0:1763333177.406630:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/591 (0->18446744073709551615) 00002000:00100000:2.0:1763333177.406636:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe46e2ce00 with x1848987613793920 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333177.406653:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe46e2ce00. 00000100:00100000:2.0:1763333177.406687:0:28429:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613794048 00000100:00100000:2.0:1763333177.406691:0:28429:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613794048 00002000:00010000:2.0:1763333177.406709:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/591 (0->18446744073709551615) 00002000:00100000:2.0:1763333177.406712:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe46e2df80 with x1848987613794048 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333177.406720:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe46e2df80. 00000100:00100000:2.0:1763333177.406753:0:28429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1653 00000100:00100000:2.0:1763333177.406764:0:28429:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2418:x1848987613793920:12345-192.168.204.28@tcp:10:bash.0 00000100:00100000:0.0:1763333177.406819:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1654 00000100:00100000:0.0:1763333177.406847:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2419:x1848987613794048:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:2.0:1763333177.407049:0:28429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333177.407055:0:28429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb mtime from disk: 1763333177 -> 1763333177 00002000:00010000:2.0:1763333177.407059:0:28429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb atime from disk: 1763333177 -> 0 00002000:00010000:2.0:1763333177.407062:0:28429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb ctime from disk: 1763333177 -> 1763333177 00002000:00010000:2.0:1763333177.407066:0:28429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1763333177.407078:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x24f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333177.407083:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x24f:0x0] updating lvb mtime from disk: 0 -> 1763333177 00002000:00010000:0.0:1763333177.407086:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x24f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333177.407088:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x24f:0x0] updating lvb ctime from disk: 0 -> 1763333177 00002000:00010000:0.0:1763333177.407091:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x24f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333177.407168:0:28429:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2418:x1848987613793920:12345-192.168.204.28@tcp:10:bash.0 Request processed in 394us (873us total) trans 21474838973 rc 0/0 00000100:00100000:2.0:1763333177.407179:0:28429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1653 00002000:00010000:2.0:1763333177.407184:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/591 (0->18446744073709551615) 00002000:00100000:2.0:1763333177.407187:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe46e2ce00 with x1848987613793920 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333177.407192:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe46e2ce00. 00000100:00100000:0.0:1763333177.407326:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2419:x1848987613794048:12345-192.168.204.28@tcp:10:bash.0 Request processed in 489us (979us total) trans 17179871668 rc 0/0 00000100:00100000:0.0:1763333177.407336:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1654 00002000:00010000:0.0:1763333177.407341:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/591 (0->18446744073709551615) 00002000:00100000:0.0:1763333177.407345:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe46e2df80 with x1848987613794048 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333177.407392:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe46e2df80. 00000100:00100000:2.0:1763333177.408596:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333177.409037:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613794304 00000100:00100000:0.0:1763333177.409053:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613794304 00000100:00100000:0.0:1763333177.409128:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3252 00000100:00100000:0.0:1763333177.409137:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56902:x1848987613794304:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333177.410752:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333177.410827:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613794560 00000100:00100000:1.0:1763333177.410841:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613794560 00000100:00100000:1.0:1763333177.410903:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3253 00000100:00100000:1.0:1763333177.410913:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:55917:x1848987613794560:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:1.0:1763333177.412001:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:55917:x1848987613794560:12345-192.168.204.28@tcp:35:bash.0 Request processed in 1081us (1253us total) trans 4294972501 rc 0/0 00000100:00100000:1.0:1763333177.412015:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3253 00000100:00100000:0.0:1763333177.412371:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56902:x1848987613794304:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 3197us (3747us total) trans 4294972500 rc 0/0 00000100:00100000:0.0:1763333177.412387:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3252 00000100:00100000:2.0:1763333177.422218:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333177.422549:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613794816 00000100:00100000:1.0:1763333177.422565:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613794816 00000100:00100000:1.0:1763333177.422642:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9518 00000100:00100000:1.0:1763333177.422654:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56902:x1848987613794816:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333177.422690:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333177.422722:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57aa1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969ef3 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.422869:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c57aa8 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333177.422889:0:12741:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57a85 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ede expref: 248 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.422901:0:12741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c57aa8 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x1c4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.422947:0:12741:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57a85 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ede expref: 248 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.422963:0:12741:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57a85 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ede expref: 248 pid: 29240 timeout: 1381 lvb_type: 0 00000100:00100000:1.0:1763333177.422978:0:12741:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627294336:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333177.425434:0:12741:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff42ca5780 going to sleep for 11 seconds 00000100:00100000:2.0:1763333177.431756:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333177.433535:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613795072 00000100:00100000:0.0:1763333177.433694:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613795072 00000100:00100000:0.0:1763333177.433776:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9519 00000100:00100000:0.0:1763333177.433785:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:56903:x1848987613795072:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:0.0:1763333177.433844:0:29240:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1763333177.433873:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c57a46 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c4:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ed0 expref: 249 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.433901:0:29240:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57a85 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ede expref: 248 pid: 29240 timeout: 1381 lvb_type: 0 00010000:00010000:0.0:1763333177.433914:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c57a07 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ebb expref: 248 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.433926:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff92fe44cd0500) 00010000:00010000:0.0:1763333177.433933:0:29240:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c57aa8 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1c4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333177.433943:0:29240:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c57aa8 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1c4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333177.433950:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c57aa8 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x1c4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333177.433970:0:29240:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333177.434007:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57aaf lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:0.0:1763333177.434017:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57aaf lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.434026:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57aaf lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.434038:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57ab6 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:0.0:1763333177.434048:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57ab6 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.434056:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57ab6 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.434145:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c57abd lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:0.0:1763333177.434154:0:29240:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c57aa8 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1c4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333177.434161:0:29240:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c57abd lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.434175:0:29240:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c57aa8 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x1c4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333177.434186:0:29240:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c57abd lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.434299:0:12741:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.204.28@tcp) returned -22 from blocking AST (req@000000004ad03a27 x1848987627294336) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57a85 lrc: 1/0,0 mode: --/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ede expref: 247 pid: 29240 timeout: 1381 lvb_type: 0 00010000:00010000:1.0:1763333177.434326:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57a85 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ede expref: 247 pid: 29240 timeout: 1381 lvb_type: 0 00000100:00100000:1.0:1763333177.434344:0:12741:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12741:1848987627294336:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333177.434401:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff92fe44cd0500) 00010000:00010000:1.0:1763333177.434407:0:12741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c57abd lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.434418:0:12741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c57abd lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.434434:0:12741:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c57aa8 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1c4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.434444:0:12741:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c57aa8 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1c4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.434454:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c57aa8 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1c4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 12741 initiator: MDT1 00000004:00200000:1.0:1763333177.434490:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c4:0x0]: returning size 5 00010000:00010000:1.0:1763333177.434693:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57aa1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ef3 expref: 248 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.434721:0:12741:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c57aa8 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1c4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ef3 expref: 247 pid: 12741 timeout: 1381 lvb_type: 0 00010000:00010000:1.0:1763333177.434732:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c57aa8 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1c4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ef3 expref: 247 pid: 12741 timeout: 1381 lvb_type: 0 00010000:00010000:1.0:1763333177.434740:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4874a600, rc 0) 00000100:00100000:1.0:1763333177.434831:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56902:x1848987613794816:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 12178us (12629us total) trans 4294972502 rc 0/0 00000100:00100000:1.0:1763333177.434842:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9518 00000100:00100000:2.0:1763333177.437502:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.437613:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333177.437831:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613795328 00000100:00100000:1.0:1763333177.437845:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613795328 00000100:00100000:1.0:1763333177.437921:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9520 00000100:00100000:1.0:1763333177.437934:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56902:x1848987613795328:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333177.437970:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333177.438001:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57acb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969efa expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.438138:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57ad2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333177.438156:0:12741:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c57abd lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.438164:0:12741:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57ad2 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.438187:0:12741:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c57abd lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.438198:0:12741:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57ad2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000100:00100000:2.0:1763333177.440489:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613795200 00000100:00100000:2.0:1763333177.440512:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613795200 00010000:00010000:2.0:1763333177.440586:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c57aa8 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1c4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ef3 expref: 249 pid: 12741 timeout: 1381 lvb_type: 0 00000100:00100000:2.0:1763333177.440650:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3140 00000100:00100000:2.0:1763333177.440664:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:2419:x1848987613795200:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333177.440687:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333177.440695:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c57aa8 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1c4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ef3 expref: 249 pid: 12741 timeout: 1381 lvb_type: 0 00010000:00010000:2.0:1763333177.440711:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c57aa8 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1c4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ef3 expref: 249 pid: 12741 timeout: 1381 lvb_type: 0 00010000:00010000:2.0:1763333177.440741:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c57aa8 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1c4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ef3 expref: 249 pid: 12741 timeout: 1381 lvb_type: 0 00010000:00010000:2.0:1763333177.440763:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff92fe44cd0500) 00010000:00010000:2.0:1763333177.440770:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c57abd lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333177.440781:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c57abd lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333177.440791:0:6504:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c57abd lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333177.440800:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57ad2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.440807:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57ad2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.440813:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57ad2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.440844:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333177.440860:0:29240:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c57abd lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.440884:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c57abd lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 29240 initiator: MDT1 00000004:00080000:0.0:1763333177.441200:0:29240:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x1c4:0x0] is inserted into orphan list, open count = 1 00010000:00010000:0.0:1763333177.441289:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c57abd lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.441298:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c57abd lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.441309:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c57abd lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.441316:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c85c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333177.441320:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c57abd lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.441328:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c57abd lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.441343:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff92fe44cd0500) 00010000:00010000:0.0:1763333177.441382:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1763333177.441386:0:29240:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57ad2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333177.441397:0:29240:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57ad2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333177.441404:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57ad2 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333177.441453:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c57abd lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.441460:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c57abd lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.441479:0:29240:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57aaf lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.441485:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57aaf lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.441491:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57aaf lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.441497:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57aaf lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.441502:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c84600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333177.441505:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57aaf lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.441511:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57aaf lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.441519:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12200) 00010000:00010000:0.0:1763333177.441521:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333177.441525:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57aaf lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.441531:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57aaf lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00000004:00010000:0.0:1763333177.441548:0:29240:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000cca4e44b reply state 00000000c6cb4d8f transno 4294972503 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57ab6 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.441572:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57ab6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.441578:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe44e12e00) 00010000:00010000:0.0:1763333177.441580:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333177.441583:0:29240:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763333177.441747:0:12741:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57ad2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.441759:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57ad2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:1.0:1763333177.441812:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c4:0x0]: returning size 5 00000004:00200000:1.0:1763333177.441817:0:12741:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763333177.441841:0:12741:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57ad2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.441887:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57acb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969efa expref: 251 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.441905:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57ad2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969efa expref: 250 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.441914:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff92fe44cd0500) 00010000:00010000:1.0:1763333177.441917:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333177.441921:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4874ba00, rc 0) 00000100:00100000:0.0:1763333177.442478:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:56903:x1848987613795072:12345-192.168.204.28@tcp:36:rm.0 Request processed in 8684us (10730us total) trans 4294972503 rc 0/0 00000100:00100000:2.0:1763333177.442491:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:2419:x1848987613795200:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 1825us (4999us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333177.442495:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9519 00000100:00100000:2.0:1763333177.442516:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3140 00000100:00100000:1.0:1763333177.442654:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:56902:x1848987613795328:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 4722us (5040us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333177.442662:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9520 00000100:00100000:2.0:1763333177.448530:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333177.448768:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613795584 00000100:00100000:1.0:1763333177.448782:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613795584 00000100:00100000:1.0:1763333177.448857:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9521 00000100:00100000:1.0:1763333177.448869:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:56902:x1848987613795584:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333177.448898:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333177.448929:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c57ad9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969f01 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.449071:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c57ae0 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333177.449090:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c57ae0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:1.0:1763333177.449103:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c57ae0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:1.0:1763333177.449125:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c4:0x0]: returning size 5 00010000:00010000:1.0:1763333177.449268:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c57ad9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f01 expref: 251 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.449288:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c57ae0 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1c4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f01 expref: 250 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.449298:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff92fe44cd0500) 00010000:00010000:1.0:1763333177.449301:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763333177.449306:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe44c38800, rc 0) 00000100:00100000:1.0:1763333177.449439:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:56902:x1848987613795584:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 562us (1085us total) trans 4294972504 rc 0/0 00000100:00100000:1.0:1763333177.449448:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9521 00000100:00100000:2.0:1763333177.469937:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333177.470546:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613795712 00000100:00100000:1.0:1763333177.470567:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613795712 00000100:00100000:1.0:1763333177.470861:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6727 00000100:00100000:1.0:1763333177.470877:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2419:x1848987613795712:12345-192.168.204.28@tcp:1:lfs.0 00010000:00010000:1.0:1763333177.470946:0:29013:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe44c39000/0xb32e3ef184c57aee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.470972:0:29013:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57a69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ed7 expref: 20 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.470982:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333177.470984:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333177.470989:0:29013:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe44c39000/0xb32e3ef184c57aee lrc: 4/0,1 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.473658:0:29013:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57a69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ed7 expref: 20 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.473711:0:29013:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57a69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ed7 expref: 20 pid: 29013 timeout: 1381 lvb_type: 0 00000100:00100000:1.0:1763333177.473738:0:29013:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29013:1848987627294464:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333177.473895:0:29013:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff801bc3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763333177.480999:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333177.483048:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333177.483325:0:29013:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:29013:1848987627294464:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333177.483384:0:29013:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe44c39000/0xb32e3ef184c57aee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333177.483467:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613795840 00000100:00100000:0.0:1763333177.483478:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613795840 00000100:00100000:0.0:1763333177.483555:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9522 00000100:00100000:0.0:1763333177.483566:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:56904:x1848987613795840:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333177.483598:0:29240:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333177.483629:0:29240:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57af5 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969f08 expref: -99 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.483720:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c57afc lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:0.0:1763333177.483735:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c57afc lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.483746:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c57afc lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.483758:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57b03 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:0.0:1763333177.483765:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57b03 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.483771:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57b03 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.483825:0:29240:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c57afc lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.483832:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c57afc lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.483839:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c57afc lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.483851:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c57afc lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.483856:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c85c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333177.483861:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c57afc lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.483869:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c57afc lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.483884:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12200) 00010000:00010000:0.0:1763333177.483887:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333177.483892:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c57afc lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.483897:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c57afc lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.483910:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57b03 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.483916:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57b03 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.483921:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57b03 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.483926:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c85600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333177.483928:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57b03 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.483934:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57b03 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.483944:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe44e12e00) 00010000:00010000:0.0:1763333177.483946:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333177.483949:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57b03 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.483954:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57b03 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.483990:0:29240:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57af5 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f08 expref: 251 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.484001:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12200) 00010000:00010000:0.0:1763333177.484003:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333177.484006:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57af5 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f08 expref: 251 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.484020:0:29240:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45c84600, rc 0) 00000100:00100000:0.0:1763333177.484118:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:56904:x1848987613795840:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 554us (3136us total) trans 0 rc 301/301 00000100:00100000:0.0:1763333177.484128:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9522 00000100:00100000:2.0:1763333177.484243:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613795968 00000100:00100000:2.0:1763333177.484249:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613795968 00002000:00100000:2.0:1763333177.484294:0:28427:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000400:0x24f:0x0] (0->4) req@ffff92ff6bc10e00 x1848987613795968/t0(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:488/0 lens 496/0 e 0 to 0 dl 1763333188 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763333177.484306:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff6bc10e00 with x1848987613795968 ext(0->4) 00010000:00010000:2.0:1763333177.484315:0:28427:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57a69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ed7 expref: 21 pid: 29013 timeout: 1381 lvb_type: 0 00010000:00010000:2.0:1763333177.484330:0:28427:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57a69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ed7 expref: 21 pid: 29013 timeout: 1381 lvb_type: 0 00002000:00010000:2.0:1763333177.484338:0:28427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff92ff6bc10e00 00000100:00100000:2.0:1763333177.484393:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 111 00000100:00100000:2.0:1763333177.484401:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2420:x1848987613795968:12345-192.168.204.28@tcp:4:bash.0 00000100:00100000:2.0:1763333177.489339:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2420:x1848987613795968:12345-192.168.204.28@tcp:4:bash.0 Request processed in 4925us (6291us total) trans 21474838974 rc 0/0 00000100:00100000:2.0:1763333177.489392:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 111 00002000:00100000:2.0:1763333177.489408:0:28427:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000400:0x24f:0x0] (0->4) req@ffff92ff6bc10e00 x1848987613795968/t21474838974(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:488/0 lens 496/448 e 0 to 0 dl 1763333188 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763333177.489419:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff6bc10e00 with x1848987613795968 ext(0->4) 00010000:00010000:2.0:1763333177.489440:0:28427:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57a69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ed7 expref: 23 pid: 29013 timeout: 1381 lvb_type: 0 00010000:00010000:2.0:1763333177.489459:0:28427:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57a69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ed7 expref: 23 pid: 29013 timeout: 1381 lvb_type: 0 00002000:00010000:2.0:1763333177.489468:0:28427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff92ff6bc10e00 00000100:00100000:3.0:1763333177.489636:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.491631:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613796096 00000100:00100000:2.0:1763333177.491648:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613796096 00000100:00100000:2.0:1763333177.491716:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9523 00000100:00100000:2.0:1763333177.491726:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:56904:x1848987613796096:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333177.491796:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333177.491821:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c57b0a lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969f0f expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.491894:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57b11 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333177.491907:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57b11 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.491918:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57b11 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.491929:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c57b18 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333177.491936:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c57b18 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.491942:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c57b18 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.491985:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57b11 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.491992:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57b11 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.491999:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57b11 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.492006:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57b11 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.492011:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48190e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333177.492014:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57b11 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.492021:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57b11 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.492034:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31600) 00010000:00010000:2.0:1763333177.492037:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333177.492041:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57b11 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.492047:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57b11 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.492060:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c57b18 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.492066:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c57b18 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.492072:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c57b18 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.492077:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48190200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333177.492080:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c57b18 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.492086:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c57b18 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.492092:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe44e12e00) 00010000:00010000:2.0:1763333177.492095:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333177.492098:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c57b18 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.492107:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c57b18 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.492132:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c57b0a lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f0f expref: 251 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.492142:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31600) 00010000:00010000:2.0:1763333177.492144:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333177.492148:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c57b0a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f0f expref: 251 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.492160:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48191600, rc 0) 00000100:00100000:2.0:1763333177.492233:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:56904:x1848987613796096:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 509us (2606us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333177.492242:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9523 00000100:00100000:3.0:1763333177.495853:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.495965:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613796224 00000100:00100000:2.0:1763333177.495975:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613796224 00010000:00010000:2.0:1763333177.496016:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57a69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ed7 expref: 23 pid: 29013 timeout: 1381 lvb_type: 0 00000100:00100000:2.0:1763333177.496047:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3141 00000100:00100000:2.0:1763333177.496056:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43998380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2419:x1848987613796224:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333177.496070:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1763333177.496087:0:6504:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:2.0:1763333177.496089:0:6504:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb atime from disk: 0 -> 1763333177 00002000:00010000:2.0:1763333177.496092:0:6504:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1763333177.496096:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57a69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ed7 expref: 23 pid: 29013 timeout: 1381 lvb_type: 0 00010000:00010000:2.0:1763333177.496108:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57a69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ed7 expref: 23 pid: 29013 timeout: 1381 lvb_type: 0 00010000:00010000:2.0:1763333177.496130:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57a69 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ed7 expref: 23 pid: 29013 timeout: 1381 lvb_type: 0 00010000:00010000:2.0:1763333177.496144:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333177.496146:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333177.496151:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe44c39000/0xb32e3ef184c57aee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.496161:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe44c39000/0xb32e3ef184c57aee lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.496663:0:29013:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe44c39000/0xb32e3ef184c57aee lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.496674:0:29013:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe44c39000/0xb32e3ef184c57aee lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.496697:0:29013:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe44c39000/0xb32e3ef184c57aee lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.496705:0:29013:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe44c39000/0xb32e3ef184c57aee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.496712:0:29013:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe44c39000/0xb32e3ef184c57aee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.496720:0:29013:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe44c39000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333177.496724:0:29013:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe44c39000/0xb32e3ef184c57aee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.496733:0:29013:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe44c39000/0xb32e3ef184c57aee lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.496746:0:29013:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe44c39000/0xb32e3ef184c57aee lrc: 3/0,0 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333177.496827:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2419:x1848987613795712:12345-192.168.204.28@tcp:1:lfs.0 Request processed in 25953us (26908us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333177.496836:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6727 00010000:00010000:2.0:1763333177.496894:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe44c39000/0xb32e3ef184c57aee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.496916:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333177.496940:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43998380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2419:x1848987613796224:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 885us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333177.496947:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3141 00000100:00100000:0.0:1763333177.500552:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333177.500889:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.500952:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613796352 00000100:00100000:2.0:1763333177.500964:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613796352 00000100:00100000:2.0:1763333177.501019:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613796608 00000100:00100000:2.0:1763333177.501023:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613796608 00000100:00100000:2.0:1763333177.501057:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9524 00000100:00100000:2.0:1763333177.501066:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:56904:x1848987613796352:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333177.501086:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333177.501108:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c57b1f lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969f16 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.501167:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c57b26 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333177.501181:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c57b26 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.501193:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c57b26 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:2.0:1763333177.501240:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1763333177.501245:0:12741:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1763333177.501278:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c57b1f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f16 expref: 253 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.501296:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c57b26 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f16 expref: 252 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.501304:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31600) 00010000:00010000:2.0:1763333177.501307:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1763333177.501311:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48190200, rc 0) 00000100:00100000:2.0:1763333177.501394:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:56904:x1848987613796352:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 328us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333177.501407:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9524 00000100:00100000:3.0:1763333177.501492:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9525 00000100:00100000:3.0:1763333177.501509:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:56902:x1848987613796608:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:3.0:1763333177.501559:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333177.501586:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57ad2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969efa expref: 251 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.501603:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff92fe44cd0500) 00010000:00010000:3.0:1763333177.501608:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333177.501640:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57b2d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333177.501652:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57b2d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.501661:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57b2d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000040:00080000:3.0:1763333177.501924:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1477, 88 off124320 00000004:00080000:3.0:1763333177.501933:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1281581583344ns, next at 1281590880154ns, rc = 0 00000040:00080000:3.0:1763333177.502074:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1476, 88 off124320 00000004:00080000:3.0:1763333177.502080:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1281581730647ns, next at 1282258802447ns, rc = 0 00000040:00080000:3.0:1763333177.502136:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1477, 88 off124408 00000004:00080000:3.0:1763333177.502140:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1281581791287ns, next at 1282258802447ns, rc = 0 00000040:00080000:3.0:1763333177.502157:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1478, 88 off124408 00000004:00080000:3.0:1763333177.502161:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1281581811688ns, next at 1281590880154ns, rc = 0 00000001:00080000:1.0:1763333177.507964:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972505 is committed 00000004:00080000:1.0:1763333177.507978:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 969 committed 00000004:00080000:1.0:1763333177.507990:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 966 committed 00000004:00080000:1.0:1763333177.508003:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 965 committed 00000004:00080000:1.0:1763333177.508005:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 968 committed 00000100:00100000:1.0:1763333177.508136:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff5004bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627294720:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333177.508197:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333177.508233:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1763333177.508239:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627294592:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333177.508259:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333177.508289:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627294720 00000100:00100000:1.0:1763333177.508296:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627294720 00000100:00100000:1.0:1763333177.508334:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627294592 00000100:00100000:1.0:1763333177.508338:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627294592 00000100:00100000:1.0:1763333177.508379:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6728 00000100:00100000:1.0:1763333177.508388:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+14:3653:x1848987627294720:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333177.508590:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+15:3653:x1848987627294720:12345-0@lo:2:osp-syn-1-1.0 Request processed in 200us (390us total) trans 17179871669 rc 0/0 00000100:00100000:1.0:1763333177.508597:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6728 00000100:00100000:3.0:1763333177.508605:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe43998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627294848:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333177.508619:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6729 00000100:00100000:1.0:1763333177.508631:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+14:3653:x1848987627294592:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333177.508674:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1763333177.508695:0:29010:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x24f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333177.508701:0:29010:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x24f:0x0] updating lvb mtime from disk: 1763333177 -> 1763333177 00002000:00010000:1.0:1763333177.508705:0:29010:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x24f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333177.508707:0:29010:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x24f:0x0] updating lvb ctime from disk: 1763333177 -> 1763333177 00002000:00010000:1.0:1763333177.508710:0:29010:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x24f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333177.508723:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763333177.508733:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627294976:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333177.508753:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+15:3653:x1848987627294592:12345-0@lo:2:osp-syn-1-1.0 Request processed in 123us (490us total) trans 17179871670 rc 0/0 00000100:00100000:1.0:1763333177.508762:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6729 00000100:00100000:3.0:1763333177.508770:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1763333177.509081:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57ab6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333177.509093:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57ab6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333177.509102:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57ab6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333177.509108:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c84c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333177.509113:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57ab6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333177.509123:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57ab6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333177.509139:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe44e12e00) 00010000:00010000:2.0:1763333177.509143:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333177.509148:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57ab6 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333177.509155:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57ab6 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00000100:00100000:0.0:1763333177.509166:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.511089:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627294976 00000100:00100000:2.0:1763333177.511102:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627294976 00000100:00100000:2.0:1763333177.511173:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6730 00000100:00100000:2.0:1763333177.511183:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+29:3654:x1848987627294976:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333177.511409:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+30:3654:x1848987627294976:12345-0@lo:2:osp-syn-0-1.0 Request processed in 227us (2639us total) trans 21474838975 rc 0/0 00000100:00100000:2.0:1763333177.511417:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6730 00000004:00080000:2.0:1763333177.511490:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44e19880/2, rc 0, transno 21474838975 00000100:00100000:2.0:1763333177.511496:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627294976:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333177.511515:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613796736 00000100:00100000:2.0:1763333177.511521:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613796736 00000100:00100000:2.0:1763333177.511556:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9526 00000100:00100000:2.0:1763333177.511563:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56904:x1848987613796736:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333177.511576:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333177.511612:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57b34 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969f1d expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.511677:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57b3b lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00000100:00100000:1.0:1763333177.511689:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627294848 00010000:00010000:2.0:1763333177.511690:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57b3b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00000100:00100000:1.0:1763333177.511696:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627294848 00010000:00010000:2.0:1763333177.511704:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57b3b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.511720:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57b42 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333177.511729:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57b42 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.511737:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57b42 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000100:00100000:1.0:1763333177.511742:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6731 00000100:00100000:1.0:1763333177.511752:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+30:3654:x1848987627294848:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1763333177.511780:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57b3b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.511789:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57b3b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.511795:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57b3b lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.511802:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57b3b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.511809:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4874aa00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333177.511813:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57b3b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.511819:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57b3b lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.511830:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31600) 00010000:00010000:2.0:1763333177.511833:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333177.511838:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57b3b lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.511844:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57b3b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.511856:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57b42 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.511862:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57b42 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.511868:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57b42 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.511873:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4874ae00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333177.511876:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57b42 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.511881:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57b42 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.511890:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43a31400) 00010000:00010000:2.0:1763333177.511892:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333177.511896:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57b42 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.511902:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57b42 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000100:00100000:1.0:1763333177.511925:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+31:3654:x1848987627294848:12345-0@lo:2:osp-syn-0-1.0 Request processed in 174us (3251us total) trans 21474838976 rc 0/0 00010000:00010000:2.0:1763333177.511934:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57b34 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f1d expref: 245 pid: 12741 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333177.511935:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6731 00010000:00010000:2.0:1763333177.511948:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31600) 00010000:00010000:2.0:1763333177.511952:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333177.511956:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57b34 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f1d expref: 245 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.511967:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48190e00, rc 0) 00000004:00080000:1.0:1763333177.511981:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe472f6a00/2, rc 0, transno 17179871670 00000100:00100000:1.0:1763333177.511989:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627294592:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1763333177.511997:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe43998000/2, rc 0, transno 21474838976 00000100:00100000:2.0:1763333177.512004:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe43998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627294848:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1763333177.512005:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff5004bb80/2, rc 0, transno 17179871669 00000100:00100000:1.0:1763333177.512012:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff5004bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627294720:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333177.512062:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56904:x1848987613796736:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 498us (2900us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333177.512070:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9526 00000004:00010000:1.0:1763333177.512104:0:8606:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d16b8fa1 reply state 00000000d2997a07 transno 4294972505 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57b2d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.512118:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57b2d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.512125:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff92fe44cd0500) 00010000:00010000:1.0:1763333177.512128:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1763333177.512131:0:8606:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1763333177.512181:0:8606:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1763333177.512197:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56902:x1848987613796608:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 10693us (11313us total) trans 4294972505 rc 0/0 00000100:00100000:1.0:1763333177.512204:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9525 00010000:00010000:1.0:1763333177.512238:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57b2d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.512246:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57b2d lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.512252:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57b2d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.512257:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feb400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333177.512260:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57b2d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.512266:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57b2d lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.512276:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff92fe44cd0500) 00010000:00010000:1.0:1763333177.512278:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763333177.512282:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57b2d lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.512286:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57b2d lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000100:00100000:3.0:1763333177.516730:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333177.516783:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333177.517031:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613796864 00000100:00100000:1.0:1763333177.517048:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613796864 00000100:00100000:1.0:1763333177.517113:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613797120 00000100:00100000:1.0:1763333177.517118:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613797120 00000100:00100000:1.0:1763333177.517155:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9527 00000100:00100000:1.0:1763333177.517168:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56902:x1848987613796864:12345-192.168.204.28@tcp:101:lfs.0 00000100:00100000:2.0:1763333177.517174:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9528 00000100:00100000:2.0:1763333177.517197:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:56904:x1848987613797120:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333177.517203:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333177.517218:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333177.517223:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763333177.517234:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c57b49 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969f24 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.517262:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c57b26 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f16 expref: 245 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.517288:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31600) 00010000:00010000:2.0:1763333177.517304:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333177.517307:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c57b49 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f24 expref: 244 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.517324:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c57b50 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969f2b expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.517330:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c57b49 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f24 expref: 244 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.517410:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff92fe44cd0500) 00010000:00010000:1.0:1763333177.517435:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763333177.517440:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe44c39000, rc 0) 00000100:00100000:1.0:1763333177.517518:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56902:x1848987613796864:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 351us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333177.517526:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9527 00010000:00010000:2.0:1763333177.517565:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57b57 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333177.517580:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57b57 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.517590:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57b57 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.517649:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57b5e lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333177.517656:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57b5e lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.517662:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57b5e lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.519642:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57b65 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333177.519665:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57b65 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.519677:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57b65 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:2.0:1763333177.519692:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c5:0x0]: returning size 0 00010000:00010000:2.0:1763333177.519731:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57b57 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.519743:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57b57 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.519750:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57b57 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.519758:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57b57 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.519763:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4874ae00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333177.519768:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57b57 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.519775:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57b57 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.519787:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31a00) 00010000:00010000:2.0:1763333177.519790:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333177.519795:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57b57 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.519801:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57b57 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000004:00010000:2.0:1763333177.519817:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000f3aa05b reply state 000000009eebf840 transno 4294972506 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57b5e lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.519828:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57b5e lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.519834:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43a31400) 00010000:00010000:2.0:1763333177.519836:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333177.519840:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763333177.519880:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c57b50 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f2b expref: 246 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.519900:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57b65 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f2b expref: 245 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.519907:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c5:0x0].0x0 (ffff92fe43a31800) 00010000:00010000:2.0:1763333177.519910:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333177.519913:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4874b000, rc 0) 00000100:00100000:2.0:1763333177.522816:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56904:x1848987613797120:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 5607us (6009us total) trans 4294972506 rc 0/0 00000100:00100000:2.0:1763333177.522833:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9528 00000100:00100000:3.0:1763333177.525827:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.526148:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613797248 00000100:00100000:2.0:1763333177.526158:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613797248 00000100:00100000:2.0:1763333177.526233:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9529 00000100:00100000:2.0:1763333177.526245:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56902:x1848987613797248:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333177.526266:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333177.526294:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57b73 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969f32 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.526412:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c57b7a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333177.526440:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c57b7a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.526455:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c57b7a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:2.0:1763333177.526508:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c4:0x0]: returning size 5 00000004:00200000:2.0:1763333177.526514:0:12741:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763333177.526532:0:12741:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c57b7a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.526560:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57b73 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f32 expref: 248 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.526580:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c57b7a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f32 expref: 247 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.526588:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff92fe44cd0500) 00010000:00010000:2.0:1763333177.526592:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1763333177.526595:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48190200, rc 0) 00000100:00100000:2.0:1763333177.526662:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56902:x1848987613797248:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 418us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333177.526669:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9529 00000100:00100000:0.0:1763333177.527414:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333177.527656:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613797504 00000100:00100000:3.0:1763333177.527667:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613797504 00000100:00100000:3.0:1763333177.527743:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9530 00000100:00100000:3.0:1763333177.527755:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56904:x1848987613797504:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333177.527783:0:29240:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333177.527805:0:29240:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57b81 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1c5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969f39 expref: -99 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.527928:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57b88 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:3.0:1763333177.527944:0:29240:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57b65 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f2b expref: 248 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.527953:0:29240:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57b88 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1c5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333177.527994:0:29240:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57b65 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f2b expref: 248 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.528010:0:29240:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57b65 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f2b expref: 248 pid: 12741 timeout: 1381 lvb_type: 0 00000100:00100000:3.0:1763333177.528026:0:29240:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e1aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:29240:1848987627295104:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333177.528130:0:29240:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff43ef56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763333177.534200:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333177.534486:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613797632 00000100:00100000:1.0:1763333177.534498:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613797632 00000100:00100000:2.0:1763333177.534504:0:29240:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e1aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:29240:1848987627295104:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333177.534540:0:29240:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57b88 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.534555:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57b65 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f2b expref: 249 pid: 12741 timeout: 1381 lvb_type: 0 00000100:00100000:1.0:1763333177.534598:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3142 00000100:00100000:1.0:1763333177.534609:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:2420:x1848987613797632:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333177.534629:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333177.534636:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57b65 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f2b expref: 249 pid: 12741 timeout: 1381 lvb_type: 0 00010000:00010000:1.0:1763333177.534650:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57b65 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f2b expref: 249 pid: 12741 timeout: 1381 lvb_type: 0 00010000:00010000:1.0:1763333177.534676:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57b65 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f2b expref: 249 pid: 12741 timeout: 1381 lvb_type: 0 00010000:00010000:1.0:1763333177.534697:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c5:0x0].0x0 (ffff92fe43a31800) 00010000:00010000:1.0:1763333177.534703:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57b88 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.534713:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57b88 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.534722:0:6504:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57b88 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1c5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.534756:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333177.534828:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:2420:x1848987613797632:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 219us (642us total) trans 0 rc 0/0 00010000:00010000:2.0:1763333177.534838:0:29240:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57b88 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00000100:00100000:1.0:1763333177.534838:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3142 00010000:00010000:2.0:1763333177.534850:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57b88 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00000004:00200000:2.0:1763333177.534880:0:29240:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c5:0x0]: returning size 0 00000100:00100000:0.0:1763333177.535134:0:8605:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46e2ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8605:1848987627295232:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1763333177.535188:0:8605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1763333177.535210:0:29240:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x251:0x0], index 1: 0 00000004:00080000:2.0:1763333177.535223:0:29240:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x251:0x0], index 0: 0 00000100:00100000:0.0:1763333177.535226:0:8605:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff49c92e40 going to sleep for 11 seconds 00000004:00080000:2.0:1763333177.535231:0:29240:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x252:0x0], index 0: 0 00000004:00080000:2.0:1763333177.535239:0:29240:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x252:0x0], index 1: 0 00010000:00010000:2.0:1763333177.535397:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57b88 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333177.535407:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57b88 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1c5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333177.535414:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57b88 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1c5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333177.535420:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feba00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333177.535424:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57b88 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1c5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333177.535442:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57b88 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1c5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333177.535456:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c5:0x0].0x0 (ffff92fe43a31800) 00010000:00010000:2.0:1763333177.535459:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333177.535464:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57b88 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1c5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333177.535470:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57b88 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1c5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333177.535524:0:29240:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57b81 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1c5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f39 expref: 248 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.535535:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c5:0x0].0x0 (ffff92fe43a31800) 00010000:00010000:2.0:1763333177.535537:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763333177.535540:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57b81 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f39 expref: 248 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.535559:0:29240:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feaa00, rc 0) 00000100:00100000:2.0:1763333177.535667:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56904:x1848987613797504:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 7914us (8262us total) trans 4294972507 rc 301/301 00000100:00100000:2.0:1763333177.535677:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9530 00000100:00100000:2.0:1763333177.535737:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627295232 00000100:00100000:2.0:1763333177.535806:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627295232 00000100:00100000:2.0:1763333177.535847:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6732 00000100:00100000:2.0:1763333177.535855:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50067b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+31:8605:x1848987627295232:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1763333177.535897:0:28650:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 610 00000100:00100000:1.0:1763333177.536640:0:9837:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77b17100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9837:1848987627295360:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1763333177.536696:0:9837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333177.537948:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50067b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+32:8605:x1848987627295232:12345-0@lo:5:osp-pre-0-1.0 Request processed in 2074us (2739us total) trans 21474838977 rc 0/0 00000100:00100000:2.0:1763333177.537960:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6732 00000100:00100000:0.0:1763333177.538069:0:8605:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46e2ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8605:1848987627295232:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1763333177.538085:0:8605:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x252:0x0]-[0x280000400:0x281:0x0] 00000100:00100000:1.0:1763333177.538193:0:9837:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff801bc3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763333177.538455:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333177.539321:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627295360 00000100:00100000:1.0:1763333177.539333:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627295360 00000100:00100000:1.0:1763333177.539447:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6733 00000100:00100000:1.0:1763333177.539459:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+15:9837:x1848987627295360:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1763333177.539522:0:29013:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 610 00000100:00100000:3.0:1763333177.541378:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613797760 00000100:00100000:3.0:1763333177.541394:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613797760 00000100:00100000:0.0:1763333177.541717:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6734 00000100:00100000:0.0:1763333177.541735:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75664380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2418:x1848987613797760:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333177.541759:0:28650:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333177.541792:0:28650:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85c00/0xb32e3ef184c57b96 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969f40 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763333177.541822:0:28650:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24f:0x0] initial LVB size: 5, mtime: 0x691a5439, atime: 0x691a5439, ctime: 0x691a5439, blocks: 0x8 00010000:00010000:0.0:1763333177.541852:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333177.541854:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333177.541869:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85c00/0xb32e3ef184c57b96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f40 expref: 22 pid: 28650 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333177.541902:0:28650:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85c00/0xb32e3ef184c57b96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f40 expref: 22 pid: 28650 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333177.541920:0:28650:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45c85c00, rc 0) 00000100:00100000:0.0:1763333177.542017:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75664380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2418:x1848987613797760:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 288us (3563us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333177.542026:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6734 00000100:00100000:3.0:1763333177.542593:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333177.542633:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613798016 00000100:00100000:3.0:1763333177.542640:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613798016 00000100:00100000:3.0:1763333177.542682:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3254 00000100:00100000:3.0:1763333177.542690:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc02850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56904:x1848987613798016:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1763333177.543867:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+16:9837:x1848987627295360:12345-0@lo:5:osp-pre-1-1.0 Request processed in 4402us (7162us total) trans 17179871671 rc 0/0 00000100:00100000:1.0:1763333177.543882:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6733 00000100:00100000:1.0:1763333177.543954:0:9837:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77b17100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9837:1848987627295360:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1763333177.544061:0:9837:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x252:0x0]-[0x2c0000400:0x281:0x0] 00000100:00100000:3.0:1763333177.545593:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc02850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:56904:x1848987613798016:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 2891us (2989us total) trans 4294972508 rc 0/0 00000100:00100000:3.0:1763333177.545609:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3254 00000100:00100000:1.0:1763333177.551734:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333177.551921:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613798272 00000100:00100000:3.0:1763333177.551935:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613798272 00000100:00100000:3.0:1763333177.552023:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3255 00000100:00100000:3.0:1763333177.552035:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:56904:x1848987613798272:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333177.553411:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:56904:x1848987613798272:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 1368us (1684us total) trans 4294972509 rc 0/0 00000100:00100000:3.0:1763333177.553435:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3255 00000100:00100000:0.0:1763333177.564874:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333177.565140:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613798528 00000100:00100000:1.0:1763333177.565159:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613798528 00000100:00100000:1.0:1763333177.565260:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9531 00000100:00100000:1.0:1763333177.565275:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:55917:x1848987613798528:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333177.565320:0:29240:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333177.565404:0:29240:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74202a00/0xb32e3ef184c57b9d lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969f47 expref: -99 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.565608:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57ba4 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:1.0:1763333177.565627:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57ba4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.565642:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57ba4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.565658:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203600/0xb32e3ef184c57bab lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:1.0:1763333177.565667:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203600/0xb32e3ef184c57bab lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.565675:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203600/0xb32e3ef184c57bab lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.565771:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203c00/0xb32e3ef184c57bb2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:1.0:1763333177.565780:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203c00/0xb32e3ef184c57bb2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.565790:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203c00/0xb32e3ef184c57bb2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00000004:00200000:1.0:1763333177.565803:0:29240:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c5:0x0]: returning size 0 00010000:00010000:1.0:1763333177.565933:0:29240:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57ba4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.565942:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57ba4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.565950:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57ba4 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.565956:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57ba4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.565963:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff74203400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333177.565967:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57ba4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.565977:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57ba4 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.565996:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff4ad5eb00) 00010000:00010000:1.0:1763333177.565999:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333177.566006:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57ba4 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.566012:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57ba4 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.566031:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203600/0xb32e3ef184c57bab lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.566038:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203600/0xb32e3ef184c57bab lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.566043:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203600/0xb32e3ef184c57bab lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.566048:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff74203600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333177.566051:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203600/0xb32e3ef184c57bab lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.566058:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203600/0xb32e3ef184c57bab lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.566064:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43a31400) 00010000:00010000:1.0:1763333177.566067:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333177.566070:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203600/0xb32e3ef184c57bab lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.566075:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203600/0xb32e3ef184c57bab lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.566153:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74202a00/0xb32e3ef184c57b9d lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f47 expref: 252 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.566175:0:29240:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203c00/0xb32e3ef184c57bb2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f47 expref: 251 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.566182:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c5:0x0].0x0 (ffff92ff4ad5ea00) 00010000:00010000:1.0:1763333177.566184:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333177.566187:0:29240:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff74203c00, rc 0) 00000100:00100000:1.0:1763333177.566269:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:55917:x1848987613798528:12345-192.168.204.28@tcp:101:bash.0 Request processed in 998us (1411us total) trans 4294972510 rc 0/0 00000100:00100000:1.0:1763333177.566279:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9531 00000100:00100000:0.0:1763333177.580224:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.580420:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613798656 00000100:00100000:2.0:1763333177.580439:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613798656 00000100:00100000:2.0:1763333177.580884:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9532 00000100:00100000:2.0:1763333177.580896:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:55917:x1848987613798656:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333177.580921:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333177.580943:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57bc0 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1c5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969f4e expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.580979:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c57bc7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333177.580993:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c57bc7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.581005:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c57bc7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.581125:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57bc0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f4e expref: 253 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.581143:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c57bc7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f4e expref: 252 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.581152:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c5:0x0].0x0 (ffff92ff4ad5ea00) 00010000:00010000:2.0:1763333177.581155:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763333177.581159:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48191600, rc 0) 00000100:00100000:2.0:1763333177.585275:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:55917:x1848987613798656:12345-192.168.204.28@tcp:101:bash.0 Request processed in 4367us (5047us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333177.585291:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9532 00000100:00100000:0.0:1763333177.589944:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333177.591448:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613798912 00000100:00100000:3.0:1763333177.591473:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613798912 00000100:00100000:3.0:1763333177.591578:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9533 00000100:00100000:3.0:1763333177.591591:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:55917:x1848987613798912:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:3.0:1763333177.591672:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333177.591710:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203c00/0xb32e3ef184c57bb2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f47 expref: 252 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.591734:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c5:0x0].0x0 (ffff92ff4ad5ea00) 00010000:00010000:3.0:1763333177.591741:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333177.595270:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57bce lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1c5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333177.595310:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57bce lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333177.595324:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57bce lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000001:00080000:0.0:1763333177.595503:0:12741:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294972511 00000004:00010000:0.0:1763333177.595586:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f493442b reply state 000000007079de5f transno 4294972512 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57bce lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333177.595605:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57bce lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1c5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333177.595615:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c5:0x0].0x0 (ffff92ff4ad5ea00) 00010000:00010000:0.0:1763333177.595619:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333177.595625:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763333177.599431:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+254:55917:x1848987613798912:12345-192.168.204.28@tcp:36:bash.0 Request processed in 7812us (9474us total) trans 4294972512 rc 0/0 00000100:00100000:0.0:1763333177.599452:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9533 00000020:00080000:0.0:1763333177.599468:0:12741:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763333177.603301:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.604711:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613799040 00000100:00100000:2.0:1763333177.604736:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613799040 00000100:00100000:2.0:1763333177.604858:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9534 00000100:00100000:2.0:1763333177.604873:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+254:55917:x1848987613799040:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333177.604912:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333177.605587:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57bd5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1c5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969f55 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.607240:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57bd5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f55 expref: 255 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.607268:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57bd5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f55 expref: 255 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.607293:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c5:0x0].0x0 (ffff92ff4ad5ea00) 00010000:00010000:2.0:1763333177.607299:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333177.607305:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48190e00, rc 0) 00000100:00100000:2.0:1763333177.607482:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+255:55917:x1848987613799040:12345-192.168.204.28@tcp:101:bash.0 Request processed in 2609us (4190us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333177.607496:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9534 00000100:00100000:1.0:1763333177.611837:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.613250:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613799296 00000100:00100000:2.0:1763333177.613269:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613799296 00000100:00100000:2.0:1763333177.614309:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9535 00000100:00100000:2.0:1763333177.614331:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+255:55917:x1848987613799296:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333177.614377:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333177.614382:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763333177.614418:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57bd5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f55 expref: 255 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.614454:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c5:0x0].0x0 (ffff92ff4ad5ea00) 00010000:00010000:2.0:1763333177.614461:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333177.614480:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57bdc lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1c5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969f5c expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.614555:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57be3 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333177.614571:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57be3 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c5:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.614583:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57be3 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c5:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000040:00080000:2.0:1763333177.616780:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1478, 88 off124496 00000004:00080000:2.0:1763333177.616800:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1281696450082ns, next at 1282258802447ns, rc = 0 00000040:00080000:2.0:1763333177.616840:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1479, 88 off124496 00000004:00080000:2.0:1763333177.616844:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1281696495186ns, next at 1281590880154ns, rc = 0 00000040:00080000:2.0:1763333177.616861:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1480, 88 off124584 00000004:00080000:2.0:1763333177.616864:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1281696515393ns, next at 1281590880154ns, rc = 0 00000040:00080000:2.0:1763333177.616873:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1479, 88 off124584 00000004:00080000:2.0:1763333177.616876:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1281696527057ns, next at 1282258802447ns, rc = 0 00010000:00010000:2.0:1763333177.626870:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57b5e lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.626897:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57b5e lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.626907:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57b5e lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.626915:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4874aa00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333177.626921:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57b5e lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.626930:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57b5e lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.626952:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43a31400) 00010000:00010000:2.0:1763333177.626956:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333177.626961:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57b5e lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.626968:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57b5e lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.627006:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57bce lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1c5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.627019:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57bce lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1c5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.627025:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57bce lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1c5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.627030:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c84200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333177.627032:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57bce lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1c5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.627038:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57bce lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1c5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.627047:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c5:0x0].0x0 (ffff92ff4ad5ea00) 00010000:00010000:2.0:1763333177.627050:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333177.627053:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57bce lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1c5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.627058:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57bce lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1c5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000001:00080000:1.0:1763333177.627145:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972513 is committed 00000004:00080000:1.0:1763333177.627155:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 968 committed 00000004:00080000:1.0:1763333177.627175:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 971 committed 00000004:00080000:1.0:1763333177.627194:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 970 committed 00000004:00080000:1.0:1763333177.627197:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 967 committed 00000100:00100000:0.0:1763333177.627386:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627295616:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1763333177.627473:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57be3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c5:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f5c expref: 247 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.627486:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c5:0x0].0x0 (ffff92ff4ad5ea00) 00010000:00010000:3.0:1763333177.627489:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763333177.627506:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57bdc lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1c5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f5c expref: 247 pid: 12741 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1763333177.627525:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57be3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c5:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f5c expref: 246 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.627571:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c5:0x0].0x0 (ffff92ff4ad5ea00) 00010000:00010000:3.0:1763333177.627574:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763333177.627577:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4874ba00, rc 0) 00000100:00100000:1.0:1763333177.627599:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627295744:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333177.627907:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42efb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627295872:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333177.628481:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333177.628485:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:55917:x1848987613799296:12345-192.168.204.28@tcp:101:bash.0 Request processed in 14161us (16662us total) trans 4294972513 rc 0/0 00000100:00100000:3.0:1763333177.628497:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9535 00000100:00100000:0.0:1763333177.629223:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333177.629262:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42efb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627295488:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333177.629296:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333177.629340:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627295744 00000100:00100000:0.0:1763333177.629365:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627295744 00000100:00100000:0.0:1763333177.629419:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627295616 00000100:00100000:0.0:1763333177.629422:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627295616 00000100:00100000:0.0:1763333177.629451:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627295488 00000100:00100000:0.0:1763333177.629454:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627295488 00000100:00100000:0.0:1763333177.629478:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6735 00000100:00100000:0.0:1763333177.629487:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+17:3653:x1848987627295744:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333177.629868:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333177.629913:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627295872 00000100:00100000:2.0:1763333177.629917:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627295872 00000100:00100000:2.0:1763333177.629948:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6736 00000100:00100000:2.0:1763333177.629956:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75667b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+17:3652:x1848987627295616:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333177.630061:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6737 00000100:00100000:3.0:1763333177.630074:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+33:3652:x1848987627295488:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333177.630129:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75667b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+18:3652:x1848987627295616:12345-0@lo:2:osp-syn-1-1.0 Request processed in 173us (906us total) trans 17179871672 rc 0/0 00000100:00100000:2.0:1763333177.630138:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6736 00000100:00100000:2.0:1763333177.630159:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6738 00000100:00100000:2.0:1763333177.630167:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+34:3654:x1848987627295872:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333177.630229:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+35:3652:x1848987627295488:12345-0@lo:2:osp-syn-0-1.0 Request processed in 159us (930us total) trans 21474838978 rc 0/0 00000100:00100000:3.0:1763333177.630237:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6737 00000100:00100000:2.0:1763333177.630260:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+34:3654:x1848987627295872:12345-0@lo:2:osp-syn-0-1.0 Request processed in 94us (392us total) trans 21474838979 rc 0/0 00000100:00100000:2.0:1763333177.630267:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6738 00000004:00080000:2.0:1763333177.630315:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe42efb100/2, rc 0, transno 21474838979 00000100:00100000:2.0:1763333177.630322:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42efb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627295872:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1763333177.630866:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44e18380/2, rc 0, transno 17179871672 00000100:00100000:1.0:1763333177.630874:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627295616:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1763333177.630886:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe42efb480/2, rc 0, transno 21474838978 00000100:00100000:1.0:1763333177.630890:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42efb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627295488:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333177.631479:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+18:3653:x1848987627295744:12345-0@lo:2:osp-syn-1-1.0 Request processed in 1988us (2994us total) trans 17179871673 rc 0/0 00000100:00100000:0.0:1763333177.631491:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6735 00000004:00080000:1.0:1763333177.631677:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44e19f80/2, rc 0, transno 17179871673 00000100:00100000:1.0:1763333177.631686:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627295744:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333177.636253:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.636624:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613799424 00000100:00100000:2.0:1763333177.636640:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613799424 00000100:00100000:2.0:1763333177.636730:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6739 00000100:00100000:2.0:1763333177.636744:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:55917:x1848987613799424:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333177.636773:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333177.636812:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57bea lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969f63 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763333177.636846:0:8404:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x251:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763333177.636879:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333177.636882:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333177.636895:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57bea lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f63 expref: 16 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.636916:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57bea lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f63 expref: 16 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.636933:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4874aa00, rc 0) 00000100:00100000:2.0:1763333177.637017:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:55917:x1848987613799424:12345-192.168.204.28@tcp:101:bash.0 Request processed in 276us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333177.637028:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6739 00000100:00100000:1.0:1763333177.641606:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.642549:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613799552 00000100:00100000:2.0:1763333177.642565:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613799552 00000100:00100000:2.0:1763333177.642650:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6740 00000100:00100000:2.0:1763333177.642662:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:55917:x1848987613799552:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333177.642687:0:8611:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333177.642717:0:8611:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4874a600/0xb32e3ef184c57bf1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969f6a expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763333177.642748:0:8611:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x251:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763333177.642782:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333177.642785:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333177.642797:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4874a600/0xb32e3ef184c57bf1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f6a expref: 23 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.642817:0:8611:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe4874a600/0xb32e3ef184c57bf1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f6a expref: 23 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.642833:0:8611:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4874a600, rc 0) 00000100:00100000:2.0:1763333177.642930:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:55917:x1848987613799552:12345-192.168.204.28@tcp:101:bash.0 Request processed in 269us (1342us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333177.642939:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6740 00000100:00100000:0.0:1763333177.650742:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333177.650789:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333177.650811:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.651008:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613799680 00000100:00100000:2.0:1763333177.651021:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613799680 00000100:00100000:2.0:1763333177.651089:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6741 00000100:00100000:2.0:1763333177.651099:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2418:x1848987613799680:12345-192.168.204.28@tcp:23:lfs.0 00000100:00100000:2.0:1763333177.651232:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2418:x1848987613799680:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 135us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333177.651241:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6741 00000100:00100000:1.0:1763333177.651476:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613799808 00000100:00100000:1.0:1763333177.651482:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613799808 00002000:00010000:1.0:1763333177.651506:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/593 (0->18446744073709551615) 00002000:00100000:1.0:1763333177.651511:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe49608380 with x1848987613799808 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333177.651525:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe49608380. 00000100:00100000:1.0:1763333177.651548:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613799936 00000100:00100000:1.0:1763333177.651551:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613799936 00002000:00010000:1.0:1763333177.651561:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/593 (0->18446744073709551615) 00002000:00100000:1.0:1763333177.651564:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4960aa00 with x1848987613799936 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333177.651569:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe4960aa00. 00000100:00100000:1.0:1763333177.651583:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1655 00000100:00100000:1.0:1763333177.651589:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49608380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2421:x1848987613799808:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:1.0:1763333177.651783:0:28427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x251:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333177.651787:0:28427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x251:0x0] updating lvb mtime from disk: 0 -> 1763333177 00002000:00010000:1.0:1763333177.651790:0:28427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x251:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333177.651792:0:28427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x251:0x0] updating lvb ctime from disk: 0 -> 1763333177 00002000:00010000:1.0:1763333177.651795:0:28427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x251:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333177.651819:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49608380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2421:x1848987613799808:12345-192.168.204.28@tcp:10:bash.0 Request processed in 230us (1029us total) trans 17179871674 rc 0/0 00000100:00100000:1.0:1763333177.651825:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1655 00002000:00010000:1.0:1763333177.651828:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/593 (0->18446744073709551615) 00002000:00100000:1.0:1763333177.651831:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe49608380 with x1848987613799808 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333177.651834:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe49608380. 00000100:00100000:1.0:1763333177.651848:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1656 00000100:00100000:1.0:1763333177.651854:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4960aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2421:x1848987613799936:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:1.0:1763333177.651934:0:28427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x251:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333177.651937:0:28427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x251:0x0] updating lvb mtime from disk: 0 -> 1763333177 00002000:00010000:1.0:1763333177.651939:0:28427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x251:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333177.651941:0:28427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x251:0x0] updating lvb ctime from disk: 0 -> 1763333177 00002000:00010000:1.0:1763333177.651943:0:28427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x251:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333177.651961:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4960aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:2421:x1848987613799936:12345-192.168.204.28@tcp:10:bash.0 Request processed in 107us (1149us total) trans 21474838980 rc 0/0 00000100:00100000:1.0:1763333177.651967:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1656 00002000:00010000:1.0:1763333177.651969:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/593 (0->18446744073709551615) 00002000:00100000:1.0:1763333177.651972:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4960aa00 with x1848987613799936 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333177.651975:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe4960aa00. 00000100:00100000:1.0:1763333177.656785:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333177.657214:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613800192 00000100:00100000:3.0:1763333177.657229:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613800192 00000100:00100000:2.0:1763333177.659982:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3256 00000100:00100000:2.0:1763333177.660011:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:55917:x1848987613800192:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:1.0:1763333177.662541:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.662756:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:55917:x1848987613800192:12345-192.168.204.28@tcp:35:bash.0 Request processed in 2755us (5985us total) trans 4294972514 rc 0/0 00000100:00100000:2.0:1763333177.662770:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3256 00000100:00100000:3.0:1763333177.663497:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613800320 00000100:00100000:3.0:1763333177.663511:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613800320 00000100:00100000:3.0:1763333177.663584:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6742 00000100:00100000:3.0:1763333177.663595:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:2419:x1848987613800320:12345-192.168.204.28@tcp:23:lfs.0 00000100:00100000:3.0:1763333177.663741:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:2419:x1848987613800320:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 148us (1212us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333177.663749:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6742 00000100:00100000:0.0:1763333177.675715:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.675815:0:28429:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613800448 00000100:00100000:2.0:1763333177.675828:0:28429:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613800448 00000100:00100000:2.0:1763333177.679577:0:28429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1657 00000100:00100000:2.0:1763333177.679619:0:28429:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:2421:x1848987613800448:12345-192.168.204.28@tcp:3:lfs.0 00010000:00010000:2.0:1763333177.679704:0:28429:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57bf8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.679723:0:28429:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333177.679726:0:28429:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333177.679734:0:28429:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57bf8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.679753:0:28429:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57bf8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.682674:0:28429:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57bf8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.682700:0:28429:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57bf8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.682710:0:28429:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57bf8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.682718:0:28429:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4874ae00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333177.682723:0:28429:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57bf8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.682733:0:28429:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57bf8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.682758:0:28429:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57bf8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.682772:0:28429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57bf8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333177.682907:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333177.682955:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613800576 00000100:00100000:3.0:1763333177.682970:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613800576 00000100:00100000:3.0:1763333177.683046:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9536 00000100:00100000:3.0:1763333177.683056:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56905:x1848987613800576:12345-192.168.204.28@tcp:101:rm.0 00010000:00010000:3.0:1763333177.683084:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333177.683113:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57bff lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969f71 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.683195:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c57c06 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333177.683210:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c57c06 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333177.683224:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c57c06 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333177.683237:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57c0d lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333177.683244:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57c0d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333177.683250:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57c0d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333177.683367:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57c14 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:3.0:1763333177.683376:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57c14 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333177.683383:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57c14 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:3.0:1763333177.683729:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c5:0x0]: returning size 5 00000004:00200000:3.0:1763333177.683736:0:12741:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763333177.683806:0:12741:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57c14 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.683821:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57c14 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.683834:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c57c06 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.683839:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c57c06 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.683845:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c57c06 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.683852:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c57c06 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.683857:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333177.683861:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c57c06 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.683867:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c57c06 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.683878:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055a000) 00010000:00010000:2.0:1763333177.683881:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333177.683886:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c57c06 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.683892:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c57c06 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.683905:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57c0d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.683911:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57c0d lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.683917:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57c0d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.683922:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333177.683925:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57c0d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.683930:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57c0d lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.683937:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6055a500) 00010000:00010000:2.0:1763333177.683939:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333177.683942:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57c0d lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.683946:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57c0d lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.683985:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57bff lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f71 expref: 249 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.684003:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57c14 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f71 expref: 248 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.684011:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c5:0x0].0x0 (ffff92ff4ad5ea00) 00010000:00010000:2.0:1763333177.684013:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333177.684016:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feaa00, rc 0) 00000100:00100000:2.0:1763333177.684103:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:56905:x1848987613800576:12345-192.168.204.28@tcp:101:rm.0 Request processed in 1048us (1202us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333177.684112:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9536 00000100:00100000:0.0:1763333177.684530:0:28429:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:2421:x1848987613800448:12345-192.168.204.28@tcp:3:lfs.0 Request processed in 4934us (8827us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1763333177.684542:0:28429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1657 00000100:00100000:1.0:1763333177.690460:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333177.690602:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.690701:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613800832 00000100:00100000:2.0:1763333177.690715:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613800832 00000100:00100000:2.0:1763333177.690775:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613800960 00000100:00100000:2.0:1763333177.690779:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613800960 00000100:00100000:2.0:1763333177.690813:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9537 00000100:00100000:2.0:1763333177.690826:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:56905:x1848987613800832:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:2.0:1763333177.690901:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1763333177.690937:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57be3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c5:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f5c expref: 249 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.690980:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57c14 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f71 expref: 248 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.690996:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c57bc7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f4e expref: 247 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.691008:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c5:0x0].0x0 (ffff92ff4ad5ea00) 00010000:00010000:2.0:1763333177.691021:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333177.691059:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57c1b lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333177.691074:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57c1b lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.691084:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57c1b lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.691098:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57c22 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333177.691106:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57c22 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.691113:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57c22 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000100:00100000:0.0:1763333177.691122:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9538 00000100:00100000:0.0:1763333177.691138:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56902:x1848987613800960:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333177.691150:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333177.691166:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85400/0xb32e3ef184c57c29 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969f78 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.691198:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85200/0xb32e3ef184c57c30 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333177.691209:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85200/0xb32e3ef184c57c30 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333177.691219:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85200/0xb32e3ef184c57c30 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333177.691222:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57c37 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333177.691234:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57c37 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.691241:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57c37 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333177.691330:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85400/0xb32e3ef184c57c29 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f78 expref: 248 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.691378:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85200/0xb32e3ef184c57c30 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f78 expref: 247 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.691387:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff92fe44cd0500) 00010000:00010000:0.0:1763333177.691391:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763333177.691394:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45c85200, rc 0) 00000100:00100000:0.0:1763333177.691552:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56902:x1848987613800960:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 419us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333177.691561:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9538 00000040:00080000:2.0:1763333177.691566:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1480, 64 off124648 00000040:00080000:2.0:1763333177.691596:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1481, 64 off124648 00000004:00080000:2.0:1763333177.691602:0:12741:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1281771252359ns, next at 1282771249577ns, rc = 0 00000040:00080000:2.0:1763333177.691611:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1482, 64 off124712 00000040:00080000:2.0:1763333177.691619:0:12741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1481, 64 off124712 00010000:00010000:2.0:1763333177.691681:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c57c3e lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1c5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333177.691690:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c57c3e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.691699:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c57c3e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.691706:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c57c3e lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1c5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.691713:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c57c3e lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1c5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.691719:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c57c3e lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1c5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.691749:0:12741:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763333177.691766:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57c37 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.691772:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57c37 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1c5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.691779:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57c37 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1c5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.691785:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48190e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333177.691789:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57c37 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1c5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.691797:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57c37 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1c5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.691805:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c5:0x0].0x0 (ffff92ff61a46c00) 00010000:00010000:2.0:1763333177.691808:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763333177.691811:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57c37 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1c5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.691818:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57c37 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1c5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.691947:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57c1b lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.691964:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57c1b lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.691970:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57c1b lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.691976:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57c1b lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.691986:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4874ae00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333177.691989:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57c1b lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.691995:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57c1b lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.692002:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff61a46a00) 00010000:00010000:2.0:1763333177.692004:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333177.692007:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57c1b lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.692013:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57c1b lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000004:00010000:2.0:1763333177.692024:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007167e9c3 reply state 00000000bf3bd2f9 transno 4294972515 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57c22 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.692034:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57c22 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.692040:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff61a46700) 00010000:00010000:2.0:1763333177.692042:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333177.692045:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763333177.692099:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:56905:x1848987613800832:12345-192.168.204.28@tcp:36:rm.0 Request processed in 1275us (1653us total) trans 4294972515 rc 0/0 00000100:00100000:2.0:1763333177.692107:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9537 00010000:00010000:0.0:1763333177.692719:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333177.692727:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c57c3e lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1c5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333177.692735:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe44d75a00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333177.692739:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c57c3e lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1c5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333177.692746:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c57c3e lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1c5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333177.692757:0:8422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c5:0x0].0x0 (ffff92ff61a46c00) 00010000:00010000:0.0:1763333177.692760:0:8422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763333177.692763:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c57c3e lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1c5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333177.692769:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c57c3e lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1c5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333177.692789:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333177.692791:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333177.692792:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763333177.703758:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333177.704934:0:28429:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613801088 00000100:00100000:0.0:1763333177.704955:0:28429:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613801088 00000100:00100000:0.0:1763333177.705068:0:28429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1658 00000100:00100000:0.0:1763333177.705081:0:28429:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2420:x1848987613801088:12345-192.168.204.28@tcp:4:lfs.0 00002000:00010000:0.0:1763333177.705160:0:28429:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x250:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333177.705172:0:28429:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85400/0xb32e3ef184c57c45 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.705192:0:28429:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333177.705195:0:28429:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333177.705203:0:28429:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85400/0xb32e3ef184c57c45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.705219:0:28429:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85400/0xb32e3ef184c57c45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1763333177.712691:0:26035:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871675 is committed 00000001:00080000:2.0:1763333177.712711:0:26035:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871673 is committed 00002000:00010000:0.0:1763333177.712912:0:28429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x250:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:0.0:1763333177.712921:0:28429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x250:0x0] updating lvb mtime from disk: 0 -> 1763333178 00002000:00010000:0.0:1763333177.712924:0:28429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x250:0x0] updating lvb ctime from disk: 0 -> 1763333178 00002000:00010000:0.0:1763333177.712927:0:28429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x250:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1763333177.712944:0:28429:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85400/0xb32e3ef184c57c45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.712958:0:28429:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85400/0xb32e3ef184c57c45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.712968:0:28429:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85400/0xb32e3ef184c57c45 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.712975:0:28429:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c85400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333177.712980:0:28429:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85400/0xb32e3ef184c57c45 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.712995:0:28429:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85400/0xb32e3ef184c57c45 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.713020:0:28429:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85400/0xb32e3ef184c57c45 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.713028:0:28429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85400/0xb32e3ef184c57c45 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333177.713166:0:28429:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2420:x1848987613801088:12345-192.168.204.28@tcp:4:lfs.0 Request processed in 8082us (9415us total) trans 17179871675 rc 0/0 00000100:00100000:0.0:1763333177.713180:0:28429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1658 00000100:00100000:3.0:1763333177.722677:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.722800:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613801216 00000100:00100000:2.0:1763333177.722818:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613801216 00000100:00100000:2.0:1763333177.724116:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9539 00000100:00100000:2.0:1763333177.724137:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:56906:x1848987613801216:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333177.724163:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333177.724187:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c57c4c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969f7f expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.724254:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c57c53 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333177.724267:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c57c53 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.724279:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c57c53 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.724291:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57c5a lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333177.724298:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57c5a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.724304:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57c5a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.724367:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c57c53 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.724374:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c57c53 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.724380:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c57c53 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.724386:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c57c53 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.724392:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe44d75a00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333177.724396:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c57c53 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.724403:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c57c53 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.724415:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff7dcb6700) 00010000:00010000:2.0:1763333177.724418:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333177.724434:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c57c53 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.724441:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c57c53 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.724456:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57c5a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.724462:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57c5a lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.724467:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57c5a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.724472:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48190e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333177.724475:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57c5a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.724481:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57c5a lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.724488:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff61a46700) 00010000:00010000:2.0:1763333177.724490:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333177.724493:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57c5a lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.724499:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57c5a lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.724523:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c57c4c lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f7f expref: 249 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.724533:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff7dcb6700) 00010000:00010000:2.0:1763333177.724535:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333177.724538:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c57c4c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f7f expref: 249 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.724550:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe44d75400, rc 0) 00000100:00100000:2.0:1763333177.724634:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:56906:x1848987613801216:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 505us (1971us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333177.724641:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9539 00000100:00100000:3.0:1763333177.730105:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.731113:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613801344 00000100:00100000:2.0:1763333177.731130:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613801344 00000100:00100000:1.0:1763333177.732454:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9540 00000100:00100000:1.0:1763333177.732483:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:56906:x1848987613801344:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333177.732514:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333177.732547:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203600/0xb32e3ef184c57c61 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969f86 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.732651:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74202a00/0xb32e3ef184c57c68 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333177.732670:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74202a00/0xb32e3ef184c57c68 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.732685:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74202a00/0xb32e3ef184c57c68 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.732698:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203c00/0xb32e3ef184c57c6f lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333177.732706:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203c00/0xb32e3ef184c57c6f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.732713:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203c00/0xb32e3ef184c57c6f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.732768:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74202a00/0xb32e3ef184c57c68 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.732776:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74202a00/0xb32e3ef184c57c68 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.732782:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74202a00/0xb32e3ef184c57c68 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.732789:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74202a00/0xb32e3ef184c57c68 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.732796:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff74202a00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333177.732801:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74202a00/0xb32e3ef184c57c68 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.732810:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74202a00/0xb32e3ef184c57c68 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.732824:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff4ad5eb00) 00010000:00010000:1.0:1763333177.732828:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333177.732834:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74202a00/0xb32e3ef184c57c68 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.732840:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74202a00/0xb32e3ef184c57c68 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.732856:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203c00/0xb32e3ef184c57c6f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.732862:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203c00/0xb32e3ef184c57c6f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.732868:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203c00/0xb32e3ef184c57c6f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.732873:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff74203c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333177.732877:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203c00/0xb32e3ef184c57c6f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.732882:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203c00/0xb32e3ef184c57c6f lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.732889:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff61a46700) 00010000:00010000:1.0:1763333177.732892:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333177.732894:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203c00/0xb32e3ef184c57c6f lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.732901:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203c00/0xb32e3ef184c57c6f lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.732936:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203600/0xb32e3ef184c57c61 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f86 expref: 249 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.732948:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff4ad5eb00) 00010000:00010000:1.0:1763333177.732951:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333177.732955:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203600/0xb32e3ef184c57c61 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f86 expref: 249 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.732970:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff74203600, rc 0) 00000100:00100000:1.0:1763333177.733079:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:56906:x1848987613801344:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 610us (2988us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333177.733087:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9540 00000100:00100000:3.0:1763333177.734611:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.735164:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613801600 00000100:00100000:2.0:1763333177.735180:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613801600 00000100:00100000:2.0:1763333177.735261:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9541 00000100:00100000:2.0:1763333177.735273:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:56902:x1848987613801600:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:2.0:1763333177.735400:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333177.735451:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c57b7a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f32 expref: 248 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.735473:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff92fe44cd0500) 00010000:00010000:2.0:1763333177.735480:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333177.735586:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57c76 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333177.735602:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57c76 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.735613:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57c76 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00010000:2.0:1763333177.735773:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e41ffdc7 reply state 000000005e71c5b4 transno 4294972516 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57c76 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.735787:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57c76 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1c4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:2.0:1763333177.735793:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff92fe44cd0500) 00010000:00010000:2.0:1763333177.735795:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333177.735799:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763333177.735914:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:56902:x1848987613801600:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 643us (1312us total) trans 4294972516 rc 0/0 00000100:00100000:2.0:1763333177.735921:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9541 00000100:00100000:3.0:1763333177.736881:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333177.737731:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613801728 00000100:00100000:0.0:1763333177.737744:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613801728 00000100:00100000:0.0:1763333177.737807:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9542 00000100:00100000:0.0:1763333177.737819:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:56906:x1848987613801728:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333177.737842:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333177.737872:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85400/0xb32e3ef184c57c7d lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969f8d expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.737945:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57c84 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333177.737960:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57c84 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333177.737972:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57c84 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00200000:0.0:1763333177.738029:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1763333177.738035:0:12741:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763333177.738075:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85400/0xb32e3ef184c57c7d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f8d expref: 251 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.738096:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57c84 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f8d expref: 250 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.738105:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12f00) 00010000:00010000:0.0:1763333177.738108:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1763333177.738113:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45c84600, rc 0) 00000100:00100000:0.0:1763333177.738188:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:56906:x1848987613801728:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 371us (1309us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333177.738195:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9542 00000100:00100000:3.0:1763333177.741207:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333177.742653:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613801856 00000100:00100000:1.0:1763333177.742671:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613801856 00000100:00100000:1.0:1763333177.742761:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6743 00000100:00100000:1.0:1763333177.742772:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:56902:x1848987613801856:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333177.742800:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333177.742828:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff74203600/0xb32e3ef184c57c8b lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969f94 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333177.742857:0:8404:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x250:0x0] initial LVB size: 4096, mtime: 0x691a543a, atime: 0x0, ctime: 0x691a543a, blocks: 0x8 00010000:00010000:1.0:1763333177.742885:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333177.742888:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333177.742897:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff74203600/0xb32e3ef184c57c8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f94 expref: 14 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.742915:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92ff74203600/0xb32e3ef184c57c8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f94 expref: 14 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.742929:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff74203600, rc 0) 00000100:00100000:1.0:1763333177.743010:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:56902:x1848987613801856:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 240us (1814us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333177.743021:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6743 00000100:00100000:3.0:1763333177.743945:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333177.744148:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613801984 00000100:00100000:1.0:1763333177.744158:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613801984 00000100:00100000:1.0:1763333177.744215:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9543 00000100:00100000:1.0:1763333177.744225:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:56906:x1848987613801984:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333177.744248:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333177.744270:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203c00/0xb32e3ef184c57c92 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969f9b expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.744825:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74202a00/0xb32e3ef184c57c99 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333177.744843:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74202a00/0xb32e3ef184c57c99 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.744855:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74202a00/0xb32e3ef184c57c99 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.744868:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57ca0 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333177.744875:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57ca0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.744881:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57ca0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.744933:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74202a00/0xb32e3ef184c57c99 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.744940:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74202a00/0xb32e3ef184c57c99 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.744947:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74202a00/0xb32e3ef184c57c99 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.744954:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74202a00/0xb32e3ef184c57c99 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.744960:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff74202a00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333177.744965:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74202a00/0xb32e3ef184c57c99 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.744973:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74202a00/0xb32e3ef184c57c99 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.744988:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12f00) 00010000:00010000:1.0:1763333177.744992:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333177.744999:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74202a00/0xb32e3ef184c57c99 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.745006:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74202a00/0xb32e3ef184c57c99 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.745022:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57ca0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.745028:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57ca0 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.745033:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57ca0 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.745037:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff74203400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333177.745040:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57ca0 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.745049:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57ca0 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.745055:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff61a46700) 00010000:00010000:1.0:1763333177.745057:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333177.745059:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57ca0 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.745065:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57ca0 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.745095:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203c00/0xb32e3ef184c57c92 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f9b expref: 251 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.745105:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12f00) 00010000:00010000:1.0:1763333177.745108:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333177.745111:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203c00/0xb32e3ef184c57c92 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f9b expref: 251 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.745119:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff74203c00, rc 0) 00000100:00100000:1.0:1763333177.745183:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:56906:x1848987613801984:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 960us (1244us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333177.745191:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9543 00000100:00100000:2.0:1763333177.748199:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333177.748249:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613802112 00000100:00100000:1.0:1763333177.748264:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613802112 00000100:00100000:0.0:1763333177.750660:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6744 00000100:00100000:0.0:1763333177.750688:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:56902:x1848987613802112:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333177.750730:0:8611:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333177.750764:0:8611:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85400/0xb32e3ef184c57ca7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969fa2 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763333177.750796:0:8611:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x250:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1763333177.750798:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:0.0:1763333177.750827:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333177.750831:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333177.750841:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85400/0xb32e3ef184c57ca7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fa2 expref: 25 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.750867:0:8611:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85400/0xb32e3ef184c57ca7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fa2 expref: 25 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.750883:0:8611:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45c85400, rc 0) 00000100:00100000:0.0:1763333177.750963:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:56902:x1848987613802112:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 287us (2777us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333177.750970:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6744 00000100:00100000:2.0:1763333177.751128:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613802368 00000100:00100000:2.0:1763333177.751138:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613802368 00000100:00100000:2.0:1763333177.751200:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9544 00000100:00100000:2.0:1763333177.751209:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:56906:x1848987613802368:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333177.751223:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333177.751226:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763333177.751259:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57c84 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f8d expref: 250 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.751279:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12f00) 00010000:00010000:2.0:1763333177.751292:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333177.751306:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c57cae lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969fa9 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.751468:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c57cb5 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333177.751480:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c57cb5 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333177.751490:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c57cb5 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333177.751501:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c57cbc lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333177.751508:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c57cbc lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333177.751514:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c57cbc lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333177.751982:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c57cc3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333177.751993:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c57cc3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333177.752000:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c57cc3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:2.0:1763333177.752012:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c7:0x0]: returning size 0 00010000:00010000:2.0:1763333177.752043:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c57cb5 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333177.752050:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c57cb5 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333177.752058:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c57cb5 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333177.752065:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c57cb5 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333177.752072:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48191600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333177.752078:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c57cb5 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333177.752086:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c57cb5 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333177.752095:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff7dcb6700) 00010000:00010000:2.0:1763333177.752098:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333177.752102:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c57cb5 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333177.752108:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c57cb5 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000004:00010000:2.0:1763333177.752122:0:8606:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e3e237d1 reply state 00000000c8951c0e transno 4294972517 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c57cbc lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333177.752132:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c57cbc lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333177.752137:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff61a46700) 00010000:00010000:2.0:1763333177.752139:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333177.752142:0:8606:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763333177.752170:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c57cae lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fa9 expref: 252 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.752192:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c57cc3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fa9 expref: 251 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.752198:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c7:0x0].0x0 (ffff92ff7dcb6000) 00010000:00010000:2.0:1763333177.752201:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333177.752204:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe44d75a00, rc 0) 00000100:00100000:2.0:1763333177.752269:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:56906:x1848987613802368:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1061us (1472us total) trans 4294972517 rc 0/0 00000100:00100000:2.0:1763333177.752276:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9544 00000100:00100000:3.0:1763333177.759307:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333177.759407:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333177.759450:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333177.759481:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613802880 00000100:00100000:1.0:1763333177.759481:0:28429:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613802752 00000100:00100000:3.0:1763333177.759493:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613802880 00000100:00100000:1.0:1763333177.759493:0:28429:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613802752 00000100:00100000:2.0:1763333177.759531:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613802624 00000100:00100000:2.0:1763333177.759538:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613802624 00002000:00010000:1.0:1763333177.759549:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/592 (5->18446744073709551615) 00002000:00100000:1.0:1763333177.759556:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4399b100 with x1848987613802752 ext(5->18446744073709551615) 00002000:00010000:1.0:1763333177.759573:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe4399b100. 00000100:00100000:2.0:1763333177.759600:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9545 00000100:00100000:2.0:1763333177.759613:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:56906:x1848987613802624:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333177.759642:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1763333177.759668:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1659 00010000:00010000:2.0:1763333177.759670:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57cd1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1c7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969fb0 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333177.759680:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4399b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2420:x1848987613802752:12345-192.168.204.28@tcp:10:lfs.0 00010000:00010000:2.0:1763333177.759819:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57cd8 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333177.759838:0:8606:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c57cc3 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fa9 expref: 253 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.759850:0:8606:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57cd8 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333177.759897:0:8606:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c57cc3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fa9 expref: 253 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.759915:0:8606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c57cc3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fa9 expref: 253 pid: 8606 timeout: 1381 lvb_type: 0 00000100:00100000:2.0:1763333177.759933:0:8606:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42efa680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627296000:192.168.204.28@tcp:104: 00002000:00010000:3.0:1763333177.760028:0:16635:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/592 (0->18446744073709551615) 00000100:00100000:2.0:1763333177.760063:0:8606:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff5119d780 going to sleep for 11 seconds 00002000:00010000:1.0:1763333177.760107:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x250:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:1.0:1763333177.760112:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x250:0x0] updating lvb mtime from disk: 1763333178 -> 1763333178 00002000:00010000:1.0:1763333177.760115:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x250:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333177.760117:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x250:0x0] updating lvb ctime from disk: 1763333178 -> 1763333178 00002000:00010000:1.0:1763333177.760120:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x250:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1763333177.760155:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4399b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2420:x1848987613802752:12345-192.168.204.28@tcp:10:lfs.0 Request processed in 478us (746us total) trans 17179871676 rc 0/0 00000100:00100000:1.0:1763333177.760163:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1659 00002000:00010000:1.0:1763333177.760168:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/592 (5->18446744073709551615) 00002000:00100000:1.0:1763333177.760170:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4399b100 with x1848987613802752 ext(5->18446744073709551615) 00002000:00010000:1.0:1763333177.760175:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe4399b100. 00002000:00100000:3.0:1763333177.761035:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe43999f80 with x1848987613802880 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333177.761044:0:16635:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe43999f80. 00000100:00100000:3.0:1763333177.761079:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1660 00000100:00100000:3.0:1763333177.761230:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:2420:x1848987613802880:12345-192.168.204.28@tcp:10:lfs.0 00002000:00010000:3.0:1763333177.761405:0:16635:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x250:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333177.761408:0:16635:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x250:0x0] updating lvb mtime from disk: 0 -> 1763333178 00002000:00010000:3.0:1763333177.761411:0:16635:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x250:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333177.761413:0:16635:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x250:0x0] updating lvb ctime from disk: 0 -> 1763333178 00002000:00010000:3.0:1763333177.761415:0:16635:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x250:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333177.761477:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+26:2420:x1848987613802880:12345-192.168.204.28@tcp:10:lfs.0 Request processed in 254us (2025us total) trans 21474838981 rc 0/0 00000100:00100000:3.0:1763333177.761485:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1660 00002000:00010000:3.0:1763333177.761489:0:16635:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/592 (0->18446744073709551615) 00002000:00100000:3.0:1763333177.761492:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe43999f80 with x1848987613802880 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333177.761497:0:16635:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe43999f80. 00000100:00100000:2.0:1763333177.767272:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333177.767596:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333177.767926:0:8606:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42efa680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627296000:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333177.767981:0:8606:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57cd8 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000100:00100000:2.0:1763333177.769432:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613803264 00000100:00100000:2.0:1763333177.769449:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613803264 00010000:00010000:2.0:1763333177.769505:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c57cc3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fa9 expref: 254 pid: 8606 timeout: 1381 lvb_type: 0 00000100:00100000:2.0:1763333177.769556:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3143 00000100:00100000:2.0:1763333177.769566:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+254:2421:x1848987613803264:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333177.769587:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333177.769594:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c57cc3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fa9 expref: 254 pid: 8606 timeout: 1381 lvb_type: 0 00010000:00010000:2.0:1763333177.769609:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c57cc3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fa9 expref: 254 pid: 8606 timeout: 1381 lvb_type: 0 00010000:00010000:2.0:1763333177.769635:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75a00/0xb32e3ef184c57cc3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fa9 expref: 254 pid: 8606 timeout: 1381 lvb_type: 0 00010000:00010000:2.0:1763333177.769654:0:28428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c7:0x0].0x0 (ffff92ff7dcb6000) 00010000:00010000:2.0:1763333177.769661:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57cd8 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333177.769677:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57cd8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333177.769686:0:28428:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57cd8 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333177.769732:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333177.769804:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:2421:x1848987613803264:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 237us (2209us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333177.769813:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3143 00010000:00010000:3.0:1763333177.771448:0:8606:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57cd8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.771468:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57cd8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:3.0:1763333177.771506:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c7:0x0]: returning size 0 00000100:00100000:0.0:1763333177.771656:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613803136 00000100:00100000:0.0:1763333177.771667:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613803136 00000100:00100000:0.0:1763333177.771746:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9546 00000004:00080000:3.0:1763333177.771757:0:8606:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x253:0x0], index 0: 0 00000100:00100000:0.0:1763333177.771757:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:56902:x1848987613803136:12345-192.168.204.28@tcp:36:lfs.0 00000004:00080000:3.0:1763333177.771765:0:8606:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x253:0x0], index 1: 0 00000004:00080000:3.0:1763333177.771769:0:8606:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x254:0x0], index 1: 0 00000004:00080000:3.0:1763333177.771774:0:8606:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x254:0x0], index 0: 0 00010000:00010000:0.0:1763333177.771855:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c57cdf lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333177.771871:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c57cdf lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333177.771882:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c57cdf lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333177.771908:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57cd8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.771915:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57cd8 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.771921:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57cd8 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.771928:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4874ba00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333177.771933:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57cd8 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.771946:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57cd8 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00000004:00010000:0.0:1763333177.771946:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009028ef5a reply state 00000000ec8297db transno 4294972519 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c57cdf lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333177.771959:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c7:0x0].0x0 (ffff92ff7dcb6000) 00010000:00010000:0.0:1763333177.771959:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c57cdf lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1c4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:3.0:1763333177.771962:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333177.771965:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff92fe44cd0500) 00010000:00010000:3.0:1763333177.771967:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57cd8 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.771967:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333177.771970:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763333177.771972:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57cd8 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.772017:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57cd1 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1c7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fb0 expref: 256 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.772027:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c7:0x0].0x0 (ffff92ff7dcb6000) 00010000:00010000:3.0:1763333177.772030:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763333177.772033:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57cd1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fb0 expref: 256 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.772047:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4874ae00, rc 0) 00000100:00100000:0.0:1763333177.772068:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+255:56902:x1848987613803136:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 313us (4812us total) trans 4294972519 rc 0/0 00000100:00100000:3.0:1763333177.772076:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+255:56906:x1848987613802624:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 12467us (12786us total) trans 4294972518 rc 301/301 00000100:00100000:0.0:1763333177.772076:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9546 00000100:00100000:3.0:1763333177.772082:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9545 00000100:00100000:0.0:1763333177.776043:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.776148:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613803520 00000100:00100000:2.0:1763333177.776161:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613803520 00000100:00100000:2.0:1763333177.776241:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6745 00000100:00100000:2.0:1763333177.776254:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49609180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+26:56902:x1848987613803520:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333177.776277:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333177.776304:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe48190200/0xb32e3ef184c57ced lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969fb7 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.776344:0:8404:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85c00/0xb32e3ef184c57b96 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f40 expref: 27 pid: 28650 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333177.776647:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333177.776650:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333177.776656:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe48190200/0xb32e3ef184c57ced lrc: 4/0,0 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fb7 expref: 27 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.776705:0:8404:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85c00/0xb32e3ef184c57b96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f40 expref: 27 pid: 28650 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333177.776727:0:8404:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85c00/0xb32e3ef184c57b96 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f40 expref: 27 pid: 28650 timeout: 1381 lvb_type: 1 00000100:00100000:2.0:1763333177.776744:0:8404:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe469a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8404:1848987627296128:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333177.777185:0:8404:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff5119d780 going to sleep for 11 seconds 00000100:00100000:0.0:1763333177.777493:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333177.778434:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613803648 00000100:00100000:1.0:1763333177.778449:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613803648 00000100:00100000:1.0:1763333177.778518:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3257 00000100:00100000:1.0:1763333177.778529:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49609880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+254:56906:x1848987613803648:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1763333177.778901:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49609880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+255:56906:x1848987613803648:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 372us (1408us total) trans 4294972520 rc 0/0 00000100:00100000:1.0:1763333177.778910:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3257 00000100:00100000:0.0:1763333177.783319:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333177.783435:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.783659:0:8404:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe469a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8404:1848987627296128:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333177.783706:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe48190200/0xb32e3ef184c57ced lrc: 3/0,0 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fb7 expref: 27 pid: 8404 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333177.783879:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613803904 00000100:00100000:3.0:1763333177.783889:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613803904 00000100:00100000:3.0:1763333177.783963:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3258 00000100:00100000:3.0:1763333177.783975:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74038a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+255:56906:x1848987613803904:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333177.784267:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74038a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+256:56906:x1848987613803904:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 293us (964us total) trans 4294972521 rc 0/0 00000100:00100000:3.0:1763333177.784277:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3258 00010000:00010000:2.0:1763333177.784527:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48190200, rc 0) 00000100:00100000:2.0:1763333177.784561:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49609180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+27:56902:x1848987613803520:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 8311us (8535us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333177.784570:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6745 00000100:00100000:1.0:1763333177.784672:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613804032 00000100:00100000:1.0:1763333177.784678:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613804032 00010000:00010000:1.0:1763333177.784709:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85c00/0xb32e3ef184c57b96 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f40 expref: 27 pid: 28650 timeout: 1381 lvb_type: 1 00000100:00100000:1.0:1763333177.784760:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3144 00000100:00100000:1.0:1763333177.784769:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7403b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+27:2421:x1848987613804032:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333177.784786:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333177.784810:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85c00/0xb32e3ef184c57b96 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f40 expref: 27 pid: 28650 timeout: 1381 lvb_type: 1 00010000:00010000:1.0:1763333177.784824:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85c00/0xb32e3ef184c57b96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f40 expref: 27 pid: 28650 timeout: 1381 lvb_type: 1 00010000:00010000:1.0:1763333177.784854:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85c00/0xb32e3ef184c57b96 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f40 expref: 27 pid: 28650 timeout: 1381 lvb_type: 1 00010000:00010000:1.0:1763333177.784869:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333177.784871:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333177.784879:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe48190200/0xb32e3ef184c57ced lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fb7 expref: 26 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.784890:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe48190200/0xb32e3ef184c57ced lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fb7 expref: 26 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.784933:0:6504:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff92fe48190200/0xb32e3ef184c57ced lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fb7 expref: 26 pid: 8404 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333177.784955:0:6504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42efa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6504:1848987627296256:192.168.204.28@tcp:105: 00000100:00100000:1.0:1763333177.785025:0:6504:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff801bc240 going to sleep for 11 seconds 00000100:00100000:0.0:1763333177.791723:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333177.791817:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.791946:0:6504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42efa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6504:1848987627296256:192.168.204.28@tcp:105: 00010000:00010000:2.0:1763333177.791989:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333177.792070:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7403b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+26:2421:x1848987613804032:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 7301us (8633us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333177.792086:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3144 00000100:00100000:2.0:1763333177.792145:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613804288 00000100:00100000:2.0:1763333177.792154:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613804288 00000100:00100000:2.0:1763333177.792204:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6746 00000100:00100000:2.0:1763333177.792214:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74039500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+26:2420:x1848987613804288:12345-192.168.204.28@tcp:2:lfs.0 00002000:00010000:2.0:1763333177.792475:0:8404:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1763333177.792481:0:8404:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb mtime from disk: 1763333177 -> 1763333177 00002000:00010000:2.0:1763333177.792484:0:8404:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb atime from disk: 1763333177 -> 1763333177 00002000:00010000:2.0:1763333177.792486:0:8404:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb ctime from disk: 1763333177 -> 1763333178 00002000:00010000:2.0:1763333177.792489:0:8404:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1763333177.792517:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74039500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+27:2420:x1848987613804288:12345-192.168.204.28@tcp:2:lfs.0 Request processed in 305us (699us total) trans 21474838982 rc 0/0 00000100:00100000:2.0:1763333177.792524:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6746 00000100:00100000:1.0:1763333177.792787:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613804416 00000100:00100000:1.0:1763333177.792794:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613804416 00000100:00100000:1.0:1763333177.792845:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9547 00000100:00100000:1.0:1763333177.792853:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+256:55917:x1848987613804416:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333177.792871:0:29240:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333177.792896:0:29240:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203c00/0xb32e3ef184c57cf4 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969fbe expref: -99 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.793049:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57cfb lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:1.0:1763333177.793067:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57cfb lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.793080:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57cfb lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.793092:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74202a00/0xb32e3ef184c57d02 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:1.0:1763333177.793100:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74202a00/0xb32e3ef184c57d02 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.793107:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74202a00/0xb32e3ef184c57d02 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.793171:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff82055c00/0xb32e3ef184c57d09 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:1.0:1763333177.793180:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff82055c00/0xb32e3ef184c57d09 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.793189:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff82055c00/0xb32e3ef184c57d09 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00000004:00200000:1.0:1763333177.793200:0:29240:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c7:0x0]: returning size 0 00010000:00010000:1.0:1763333177.793278:0:29240:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57cfb lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.793286:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57cfb lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.793293:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57cfb lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.793300:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57cfb lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.793307:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff74203400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333177.793312:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57cfb lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.793320:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57cfb lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.793334:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff4ad5e100) 00010000:00010000:1.0:1763333177.793338:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333177.793343:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57cfb lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.793397:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57cfb lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.793417:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74202a00/0xb32e3ef184c57d02 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.793434:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74202a00/0xb32e3ef184c57d02 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.793439:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74202a00/0xb32e3ef184c57d02 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.793445:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff74202a00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333177.793448:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74202a00/0xb32e3ef184c57d02 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.793454:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74202a00/0xb32e3ef184c57d02 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.793462:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff61a46700) 00010000:00010000:1.0:1763333177.793465:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333177.793469:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74202a00/0xb32e3ef184c57d02 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.793474:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74202a00/0xb32e3ef184c57d02 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.793522:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203c00/0xb32e3ef184c57cf4 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fbe expref: 259 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.793542:0:29240:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff82055c00/0xb32e3ef184c57d09 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fbe expref: 258 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.793550:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c7:0x0].0x0 (ffff92ff4ad5ec00) 00010000:00010000:1.0:1763333177.793553:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333177.793556:0:29240:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff82055c00, rc 0) 00000100:00100000:1.0:1763333177.793614:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+258:55917:x1848987613804416:12345-192.168.204.28@tcp:101:bash.0 Request processed in 762us (1908us total) trans 4294972522 rc 0/0 00000100:00100000:1.0:1763333177.793623:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9547 00000100:00100000:0.0:1763333177.801869:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333177.801940:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333177.801953:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613804544 00000100:00100000:3.0:1763333177.801968:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613804544 00000100:00100000:3.0:1763333177.802050:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9548 00000100:00100000:3.0:1763333177.802063:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74038700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+258:55917:x1848987613804544:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333177.802095:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333177.802126:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57d17 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969fc5 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.802170:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57d1e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333177.802190:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57d1e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.802203:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57d1e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.802445:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57d17 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fc5 expref: 260 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.802470:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57d1e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fc5 expref: 259 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.802480:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c7:0x0].0x0 (ffff92ff4ad5ec00) 00010000:00010000:3.0:1763333177.802484:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763333177.802489:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feba00, rc 0) 00000100:00100000:3.0:1763333177.802569:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74038700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+259:55917:x1848987613804544:12345-192.168.204.28@tcp:101:bash.0 Request processed in 508us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333177.802582:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9548 00000100:00100000:1.0:1763333177.803107:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613804800 00000100:00100000:1.0:1763333177.803115:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613804800 00000100:00100000:1.0:1763333177.803175:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3259 00000100:00100000:1.0:1763333177.803185:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc00450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+259:56902:x1848987613804800:12345-192.168.204.28@tcp:35:lfs.0 00000004:00010000:1.0:1763333177.803246:0:6522:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x240000404:0x1c4:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c57ae0 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1c4:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f01 expref: 259 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.803298:0:6522:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff82055600/0xb32e3ef184c57d25 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 00010000:00010000:1.0:1763333177.803311:0:6522:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c57b49 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f24 expref: 259 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.803322:0:6522:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff82055600/0xb32e3ef184c57d25 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 00010000:00010000:1.0:1763333177.803414:0:6522:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c57b49 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f24 expref: 259 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.803439:0:6522:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c57b49 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f24 expref: 259 pid: 8606 timeout: 1381 lvb_type: 0 00000100:00100000:1.0:1763333177.803458:0:6522:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42efa680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6522:1848987627296384:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333177.803552:0:6522:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff801bc240 going to sleep for 11 seconds 00000100:00100000:2.0:1763333177.807866:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333177.808183:0:6522:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42efa680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6522:1848987627296384:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333177.808223:0:6522:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92ff82055600/0xb32e3ef184c57d25 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 00000100:00100000:3.0:1763333177.808314:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613804928 00000100:00100000:0.0:1763333177.808323:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333177.808325:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613804928 00010000:00010000:3.0:1763333177.808408:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c57b49 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f24 expref: 260 pid: 8606 timeout: 1381 lvb_type: 0 00000100:00100000:1.0:1763333177.808480:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613805184 00000100:00100000:1.0:1763333177.808485:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613805184 00000100:00100000:1.0:1763333177.808534:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9549 00000100:00100000:1.0:1763333177.808544:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+261:55917:x1848987613805184:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:1.0:1763333177.808620:0:29240:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333177.808652:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff82055c00/0xb32e3ef184c57d09 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fbe expref: 261 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.808674:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c7:0x0].0x0 (ffff92ff4ad5ec00) 00010000:00010000:1.0:1763333177.808680:0:29240:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333177.808879:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3145 00000100:00100000:2.0:1763333177.808890:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50e6a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+261:2420:x1848987613804928:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333177.808905:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333177.808911:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c57b49 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f24 expref: 261 pid: 8606 timeout: 1381 lvb_type: 0 00010000:00010000:1.0:1763333177.808923:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203c00/0xb32e3ef184c57d2c lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1c7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:2.0:1763333177.808924:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c57b49 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f24 expref: 261 pid: 8606 timeout: 1381 lvb_type: 0 00010000:00010000:2.0:1763333177.808938:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c57b49 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f24 expref: 261 pid: 8606 timeout: 1381 lvb_type: 0 00010000:00010000:1.0:1763333177.808938:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203c00/0xb32e3ef184c57d2c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.808948:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203c00/0xb32e3ef184c57d2c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333177.808949:0:28428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff92fe44cd0500) 00010000:00010000:2.0:1763333177.808954:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff82055600/0xb32e3ef184c57d25 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 00010000:00010000:2.0:1763333177.808963:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff82055600/0xb32e3ef184c57d25 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT1 00010000:00010000:2.0:1763333177.808969:0:28428:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff82055600/0xb32e3ef184c57d25 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT1 00000001:00080000:1.0:1763333177.809001:0:29240:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294972523 00010000:00010000:2.0:1763333177.809002:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00010000:1.0:1763333177.809026:0:29240:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005f822dea reply state 00000000e9afcc5a transno 4294972524 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203c00/0xb32e3ef184c57d2c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.809037:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203c00/0xb32e3ef184c57d2c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1c7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333177.809043:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c7:0x0].0x0 (ffff92ff4ad5ec00) 00010000:00010000:1.0:1763333177.809046:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333177.809049:0:29240:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763333177.809062:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50e6a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+261:2420:x1848987613804928:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 175us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333177.809070:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3145 00000100:00100000:1.0:1763333177.809106:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+261:55917:x1848987613805184:12345-192.168.204.28@tcp:36:bash.0 Request processed in 564us (783us total) trans 4294972524 rc 0/0 00000100:00100000:1.0:1763333177.809113:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9549 00000020:00080000:1.0:1763333177.809116:0:29240:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1763333177.809240:0:6522:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff82055600/0xb32e3ef184c57d25 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 00010000:00010000:0.0:1763333177.809248:0:6522:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff82055600/0xb32e3ef184c57d25 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 00000040:00080000:0.0:1763333177.809520:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1483, 88 off124800 00000004:00080000:0.0:1763333177.809531:0:6522:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1281889180808ns, next at 1282771249577ns, rc = 0 00000040:00080000:0.0:1763333177.809571:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1482, 88 off124800 00000004:00080000:0.0:1763333177.809576:0:6522:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1281889227453ns, next at 1282258802447ns, rc = 0 00000040:00080000:0.0:1763333177.809613:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1483, 88 off124888 00000004:00080000:0.0:1763333177.809619:0:6522:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1281889270185ns, next at 1282258802447ns, rc = 0 00000040:00080000:0.0:1763333177.809628:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1484, 88 off124888 00000004:00080000:0.0:1763333177.809632:0:6522:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1281889283106ns, next at 1282771249577ns, rc = 0 00000001:00080000:1.0:1763333177.811802:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972525 is committed 00000004:00080000:1.0:1763333177.811823:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 974 committed 00000004:00080000:1.0:1763333177.811876:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 970 committed 00010000:00010000:0.0:1763333177.811952:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57c22 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333177.811966:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57c22 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333177.811975:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57c22 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333177.811983:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4874b000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333177.811988:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57c22 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333177.811996:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57c22 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333177.812014:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff61a46700) 00010000:00010000:0.0:1763333177.812016:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333177.812021:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57c22 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333177.812027:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57c22 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333177.812049:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57c76 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1c4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333177.812055:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57c76 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1c4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333177.812060:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57c76 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1c4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333177.812066:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48190e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333177.812069:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57c76 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1c4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333177.812074:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57c76 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1c4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333177.812082:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff92fe44cd0500) 00010000:00010000:0.0:1763333177.812085:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333177.812089:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57c76 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1c4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333177.812095:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c57c76 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1c4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333177.812104:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c57cbc lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.812110:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c57cbc lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.812115:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c57cbc lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.812120:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe44d75400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333177.812122:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c57cbc lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.812127:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c57cbc lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.812132:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff61a46700) 00010000:00010000:0.0:1763333177.812134:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333177.812137:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c57cbc lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.812142:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c57cbc lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.812162:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c57cdf lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1c4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333177.812169:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c57cdf lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1c4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333177.812175:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c57cdf lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1c4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00000100:00100000:2.0:1763333177.812520:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe469a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627296896:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333177.812616:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333177.812664:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1763333177.812672:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe469a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627296512:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763333177.812695:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333177.812734:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627296896 00000100:00100000:2.0:1763333177.812743:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627296896 00000100:00100000:2.0:1763333177.812799:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627296512 00000100:00100000:2.0:1763333177.812803:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627296512 00000100:00100000:2.0:1763333177.812827:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6747 00000100:00100000:2.0:1763333177.812836:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e0f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+35:3654:x1848987627296896:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:2.0:1763333177.813034:0:8404:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x250:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333177.813038:0:8404:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x250:0x0] updating lvb mtime from disk: 1763333178 -> 1763333178 00002000:00010000:2.0:1763333177.813041:0:8404:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x250:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333177.813043:0:8404:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x250:0x0] updating lvb ctime from disk: 1763333178 -> 1763333178 00002000:00010000:2.0:1763333177.813045:0:8404:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x250:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333177.813089:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e0f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+36:3654:x1848987627296896:12345-0@lo:2:osp-syn-0-1.0 Request processed in 253us (473us total) trans 21474838983 rc 0/0 00000100:00100000:2.0:1763333177.813097:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6747 00000100:00100000:2.0:1763333177.813245:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6748 00000100:00100000:2.0:1763333177.813252:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+35:3654:x1848987627296512:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1763333177.813268:0:8404:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:593 count 1 00010000:00010000:2.0:1763333177.813291:0:8404:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe45034800/0xb32e3ef184c57d33 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.813313:0:8404:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe4874a600/0xb32e3ef184c57bf1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f6a expref: 26 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.813322:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333177.813324:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333177.813329:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45034800/0xb32e3ef184c57d33 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.813393:0:8404:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe4874a600/0xb32e3ef184c57bf1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f6a expref: 26 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.813410:0:8404:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe4874a600/0xb32e3ef184c57bf1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f6a expref: 26 pid: 8611 timeout: 1381 lvb_type: 0 00000100:00100000:2.0:1763333177.813433:0:8404:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe469a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8404:1848987627297024:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333177.813515:0:8404:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff58cbf780 going to sleep for 11 seconds 00000004:00080000:2.0:1763333177.813561:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe469a1180/2, rc 0, transno 21474838983 00000100:00100000:2.0:1763333177.813567:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe469a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627296896:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1763333177.813798:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 969 committed 00010000:00010000:0.0:1763333177.813951:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c85e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333177.813957:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c57cdf lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1c4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333177.813966:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c57cdf lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1c4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333177.813983:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff92fe44cd0500) 00010000:00010000:0.0:1763333177.813985:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333177.813990:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c57cdf lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1c4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333177.813995:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c57cdf lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1c4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333177.814017:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203c00/0xb32e3ef184c57d2c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1c7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.814023:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203c00/0xb32e3ef184c57d2c lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1c7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.814029:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203c00/0xb32e3ef184c57d2c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1c7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.814035:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff74203c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333177.814038:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203c00/0xb32e3ef184c57d2c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1c7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.814043:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203c00/0xb32e3ef184c57d2c lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1c7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.814053:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c7:0x0].0x0 (ffff92ff4ad5ec00) 00010000:00010000:0.0:1763333177.814055:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333177.814058:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203c00/0xb32e3ef184c57d2c lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1c7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.814064:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74203c00/0xb32e3ef184c57d2c lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1c7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00000100:00100000:0.0:1763333177.814554:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333177.814632:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613805312 00000100:00100000:3.0:1763333177.814641:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613805312 00000100:00100000:3.0:1763333177.814698:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9550 00000100:00100000:3.0:1763333177.814708:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+256:55917:x1848987613805312:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333177.814727:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333177.814747:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57d3a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1c7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969fcc expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.814808:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57d3a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fcc expref: 257 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.814823:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57d3a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fcc expref: 257 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.814843:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c7:0x0].0x0 (ffff92ff4ad5ec00) 00010000:00010000:3.0:1763333177.814846:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763333177.814850:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feb400, rc 0) 00000100:00100000:3.0:1763333177.814900:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+257:55917:x1848987613805312:12345-192.168.204.28@tcp:101:bash.0 Request processed in 193us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333177.814907:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9550 00000100:00100000:0.0:1763333177.815655:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe469a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627296768:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333177.815713:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333177.815759:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1763333177.815767:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe469a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627296640:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763333177.815786:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333177.815894:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627296768 00000100:00100000:3.0:1763333177.815900:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627296768 00000100:00100000:3.0:1763333177.815937:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627296640 00000100:00100000:3.0:1763333177.815940:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627296640 00000100:00100000:3.0:1763333177.815959:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6749 00000100:00100000:3.0:1763333177.815966:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+37:3653:x1848987627296768:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1763333177.816126:0:8611:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1763333177.816130:0:8611:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb mtime from disk: 1763333177 -> 1763333177 00002000:00010000:3.0:1763333177.816133:0:8611:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb atime from disk: 1763333177 -> 1763333177 00002000:00010000:3.0:1763333177.816136:0:8611:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb ctime from disk: 1763333178 -> 1763333178 00002000:00010000:3.0:1763333177.816139:0:8611:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763333177.816174:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+38:3653:x1848987627296768:12345-0@lo:2:osp-syn-0-1.0 Request processed in 208us (460us total) trans 21474838984 rc 0/0 00000100:00100000:3.0:1763333177.816181:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6749 00000100:00100000:3.0:1763333177.816197:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6750 00000100:00100000:3.0:1763333177.816204:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+37:3653:x1848987627296640:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763333177.816219:0:8611:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:594 count 1 00002000:00010000:3.0:1763333177.816247:0:8611:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x252:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333177.816256:0:8611:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c57d41 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.816270:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333177.816273:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333177.816280:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c57d41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.816294:0:8611:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c57d41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.816310:0:8611:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c57d41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.816318:0:8611:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c57d41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.816339:0:8611:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763333177.816577:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+38:3653:x1848987627296640:12345-0@lo:6:osp-syn-0-1.0 Request processed in 373us (788us total) trans 21474838985 rc 0/0 00000100:00100000:3.0:1763333177.816585:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6750 00010000:00010000:3.0:1763333177.816613:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333177.816622:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c57d41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.816631:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea200 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333177.816637:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c57d41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.816647:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c57d41 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.816667:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c57d41 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.816676:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c57d41 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.816698:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333177.816700:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333177.816702:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763333177.817292:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe469a0000/2, rc 0, transno 21474838985 00000100:00100000:0.0:1763333177.817301:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe469a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627296640:0@lo:6:osp-syn-0-1.0 00000004:00080000:0.0:1763333177.817312:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe469a1500/2, rc 0, transno 21474838984 00000100:00100000:0.0:1763333177.817316:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe469a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627296768:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1763333177.817595:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 973 committed 00000004:00080000:1.0:1763333177.817636:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 972 committed 00000004:00010000:1.0:1763333177.817768:0:6522:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009b8ca035 reply state 00000000bb7dd465 transno 4294972525 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff82055600/0xb32e3ef184c57d25 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 00010000:00010000:1.0:1763333177.817794:0:6522:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff82055600/0xb32e3ef184c57d25 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 00010000:00010000:1.0:1763333177.817806:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff92fe44cd0500) 00010000:00010000:1.0:1763333177.817809:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1763333177.817814:0:6522:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763333177.817821:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff92fe44cd0500) 00010000:00010000:1.0:1763333177.817824:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763333177.817832:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c57ae0 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1c4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f01 expref: 245 pid: 12741 timeout: 0 lvb_type: 0 00010000:00080000:1.0:1763333177.817985:0:6522:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1763333177.818000:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc00450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56902:x1848987613804800:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 14816us (16058us total) trans 4294972525 rc 0/0 00000100:00100000:1.0:1763333177.818010:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3259 00010000:00010000:0.0:1763333177.818371:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff82055600/0xb32e3ef184c57d25 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 00010000:00010000:0.0:1763333177.818380:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff82055600/0xb32e3ef184c57d25 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 00010000:00010000:0.0:1763333177.818387:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff82055600/0xb32e3ef184c57d25 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 00010000:00010000:0.0:1763333177.818393:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff82055600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333177.818397:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff82055600/0xb32e3ef184c57d25 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 00010000:00010000:0.0:1763333177.818405:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff82055600/0xb32e3ef184c57d25 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 00010000:00010000:0.0:1763333177.818415:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff92fe44cd0500) 00010000:00010000:0.0:1763333177.818417:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333177.818428:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff82055600/0xb32e3ef184c57d25 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 00010000:00010000:0.0:1763333177.818434:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff82055600/0xb32e3ef184c57d25 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 00000100:00100000:1.0:1763333177.819226:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe469a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627297536:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333177.819291:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333177.819343:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1763333177.819377:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe469a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627297152:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763333177.819402:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333177.819444:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627297536 00000100:00100000:1.0:1763333177.819452:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627297536 00000100:00100000:1.0:1763333177.819496:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627297152 00000100:00100000:1.0:1763333177.819500:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627297152 00000100:00100000:1.0:1763333177.819519:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6751 00000100:00100000:1.0:1763333177.819529:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+6:3654:x1848987627297536:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1763333177.819709:0:29010:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x250:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1763333177.819713:0:29010:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x250:0x0] updating lvb mtime from disk: 1763333178 -> 1763333178 00002000:00010000:1.0:1763333177.819715:0:29010:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x250:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333177.819717:0:29010:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x250:0x0] updating lvb ctime from disk: 1763333178 -> 1763333178 00002000:00010000:1.0:1763333177.819720:0:29010:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x250:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1763333177.819758:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+7:3654:x1848987627297536:12345-0@lo:2:osp-syn-1-1.0 Request processed in 230us (467us total) trans 17179871677 rc 0/0 00000100:00100000:1.0:1763333177.819765:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6751 00000100:00100000:1.0:1763333177.819783:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6752 00000100:00100000:1.0:1763333177.819789:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+6:3654:x1848987627297152:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763333177.819804:0:29010:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:593 count 1 00010000:00010000:1.0:1763333177.819823:0:29010:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57d48 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.819845:0:29010:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57bea lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f63 expref: 14 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.819858:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333177.819861:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333177.819866:0:29010:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57d48 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.819899:0:29010:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57bea lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f63 expref: 14 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.819913:0:29010:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57bea lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f63 expref: 14 pid: 8404 timeout: 1381 lvb_type: 0 00000100:00100000:1.0:1763333177.819925:0:29010:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42ef9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:29010:1848987627297664:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333177.819996:0:29010:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7dfd8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1763333177.820043:0:3654:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179871673 gen 2 00000004:00080000:1.0:1763333177.820050:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7dcff800, transno 17179871660 00000004:00080000:1.0:1763333177.820058:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7dcfc000, transno 17179871661 00000004:00080000:1.0:1763333177.820061:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7dcfed80, transno 17179871662 00000004:00080000:1.0:1763333177.820065:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7dcfe300, transno 17179871663 00000004:00080000:1.0:1763333177.820068:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4399b800, transno 17179871664 00000004:00080000:1.0:1763333177.820071:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4399a300, transno 17179871665 00000004:00080000:1.0:1763333177.820075:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe43999880, transno 17179871666 00000004:00080000:1.0:1763333177.820078:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4399bb80, transno 17179871667 00000004:00080000:1.0:1763333177.820082:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff5004bb80, transno 17179871669 00000004:00080000:1.0:1763333177.820085:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe472f6a00, transno 17179871670 00000004:00080000:1.0:1763333177.820099:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44e18380, transno 17179871672 00000004:00080000:1.0:1763333177.820102:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44e19f80, transno 17179871673 00000100:00100000:1.0:1763333177.820110:0:3654:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff92fe469a0380 x1848987627297536/t17179871677(17179871677) o2->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763333193 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1763333177.820122:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe469a0380/2, rc 0, transno 17179871677 00000100:00100000:1.0:1763333177.820128:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe469a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627297536:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333177.820366:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe469a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627297280:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763333177.820407:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1763333177.820435:0:9836:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 4 in progress, 3 in flight, 12 done 00000100:00100000:0.0:1763333177.820449:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1763333177.820455:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe469a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627297408:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333177.820476:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333177.820679:0:8404:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe469a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8404:1848987627297024:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333177.820694:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333177.820795:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.820864:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613805696 00000100:00100000:2.0:1763333177.820870:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613805696 00010000:00010000:0.0:1763333177.820877:0:8404:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe45034800/0xb32e3ef184c57d33 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.820902:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4874a600/0xb32e3ef184c57bf1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f6a expref: 27 pid: 8611 timeout: 1381 lvb_type: 0 00000100:00100000:0.0:1763333177.820908:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613805568 00000100:00100000:0.0:1763333177.820912:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613805568 00000100:00100000:2.0:1763333177.820945:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3146 00000100:00100000:2.0:1763333177.820955:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+27:2420:x1848987613805696:12345-192.168.204.28@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1763333177.820959:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9551 00000100:00100000:0.0:1763333177.820966:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+244:55917:x1848987613805568:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333177.820969:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333177.820974:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe4874a600/0xb32e3ef184c57bf1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f6a expref: 27 pid: 8611 timeout: 1381 lvb_type: 0 00010000:00010000:0.0:1763333177.820982:0:29240:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333177.820984:0:29240:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763333177.820986:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe4874a600/0xb32e3ef184c57bf1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f6a expref: 27 pid: 8611 timeout: 1381 lvb_type: 0 00010000:00010000:2.0:1763333177.821004:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4874a600/0xb32e3ef184c57bf1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x251:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f6a expref: 27 pid: 8611 timeout: 1381 lvb_type: 0 00010000:00010000:0.0:1763333177.821006:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57d3a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fcc expref: 244 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.821020:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333177.821022:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c7:0x0].0x0 (ffff92ff4ad5ec00) 00010000:00010000:2.0:1763333177.821023:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333177.821025:0:29240:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333177.821028:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe45034800/0xb32e3ef184c57d33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.821037:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45034800/0xb32e3ef184c57d33 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.821039:0:29240:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57d4f lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969fd3 expref: -99 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.821066:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333177.821074:0:8404:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe45034800/0xb32e3ef184c57d33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.821082:0:8404:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe45034800/0xb32e3ef184c57d33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.821092:0:8404:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe45034800/0xb32e3ef184c57d33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333177.821097:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+26:2420:x1848987613805696:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 143us (301us total) trans 0 rc 0/0 00010000:00010000:0.0:1763333177.821101:0:8404:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45034800/0xb32e3ef184c57d33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333177.821105:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3146 00010000:00010000:0.0:1763333177.821121:0:8404:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763333177.821130:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627297280 00000100:00100000:2.0:1763333177.821134:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627297280 00000100:00100000:2.0:1763333177.821155:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627297408 00000100:00100000:2.0:1763333177.821158:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627297408 00000100:00100000:2.0:1763333177.821175:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6753 00000100:00100000:2.0:1763333177.821182:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+8:3652:x1848987627297280:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1763333177.821197:0:28650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:594 count 1 00002000:00010000:2.0:1763333177.821227:0:28650:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x252:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763333177.821234:0:28650:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c57d56 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.821243:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333177.821245:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333177.821247:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c57d56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.821257:0:28650:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c57d56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.821265:0:28650:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c57d56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.821272:0:28650:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c57d56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.821285:0:28650:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1763333177.821471:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+38:3654:x1848987627296512:12345-0@lo:6:osp-syn-0-1.0 Request processed in 8218us (8773us total) trans 21474838986 rc 0/0 00000100:00100000:0.0:1763333177.821478:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6748 00000100:00100000:0.0:1763333177.821494:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6754 00000100:00100000:0.0:1763333177.821502:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+9:3652:x1848987627297408:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1763333177.821587:0:8404:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x24f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333177.821590:0:8404:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x24f:0x0] updating lvb mtime from disk: 1763333177 -> 1763333177 00002000:00010000:0.0:1763333177.821593:0:8404:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x24f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333177.821596:0:8404:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x24f:0x0] updating lvb ctime from disk: 1763333177 -> 1763333177 00002000:00010000:0.0:1763333177.821598:0:8404:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x24f:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00080000:1.0:1763333177.822299:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe469a1c00/2, rc 0, transno 21474838986 00000100:00100000:1.0:1763333177.822307:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe469a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627296512:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763333177.822445:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+10:3652:x1848987627297280:12345-0@lo:6:osp-syn-1-1.0 Request processed in 1262us (2036us total) trans 17179871678 rc 0/0 00000100:00100000:0.0:1763333177.822445:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+10:3652:x1848987627297408:12345-0@lo:2:osp-syn-1-1.0 Request processed in 944us (1966us total) trans 17179871679 rc 0/0 00000100:00100000:2.0:1763333177.822454:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6753 00000100:00100000:0.0:1763333177.822457:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6754 00010000:00010000:2.0:1763333177.822480:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333177.822480:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333177.822489:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c57d56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.822489:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe45034800/0xb32e3ef184c57d33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.822499:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45034c00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333177.822499:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45034800 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333177.822504:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c57d56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.822504:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe45034800/0xb32e3ef184c57d33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.822516:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c57d56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.822516:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe45034800/0xb32e3ef184c57d33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.822532:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c57d56 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.822532:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe45034800/0xb32e3ef184c57d33 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.822540:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c57d56 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.822541:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe45034800/0xb32e3ef184c57d33 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.822562:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333177.822563:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333177.822564:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333177.822564:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333177.822566:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333177.822566:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333177.822739:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57d5d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:0.0:1763333177.822756:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57d5d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.822767:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57d5d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00000004:00080000:1.0:1763333177.822993:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe469a0700/2, rc 0, transno 17179871679 00000100:00100000:1.0:1763333177.823000:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe469a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627297408:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1763333177.823011:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe469a2a00/2, rc 0, transno 17179871678 00000100:00100000:1.0:1763333177.823015:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe469a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627297280:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763333177.823079:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333177.823309:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613805824 00000100:00100000:3.0:1763333177.823317:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613805824 00000100:00100000:2.0:1763333177.823566:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9552 00000100:00100000:2.0:1763333177.823576:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+245:56902:x1848987613805824:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333177.823600:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333177.823620:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45035200/0xb32e3ef184c57d64 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969fda expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.823673:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45035200/0xb32e3ef184c57d64 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fda expref: 246 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.823686:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45035200/0xb32e3ef184c57d64 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fda expref: 246 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.823709:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff92fe44cd0500) 00010000:00010000:2.0:1763333177.823713:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333177.823716:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45035200, rc 0) 00000100:00100000:2.0:1763333177.823783:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56902:x1848987613805824:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 208us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333177.823790:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9552 00000040:00080000:0.0:1763333177.824246:0:29240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1485, 88 off124976 00000004:00080000:0.0:1763333177.824832:0:29240:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1281904480304ns, next at 1282771249577ns, rc = 0 00000040:00080000:0.0:1763333177.824911:0:29240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1484, 88 off124976 00000004:00080000:0.0:1763333177.824918:0:29240:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1281904568612ns, next at 1282258802447ns, rc = 0 00000040:00080000:0.0:1763333177.825338:0:29240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1485, 88 off125064 00000004:00080000:0.0:1763333177.825345:0:29240:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1281904995982ns, next at 1282258802447ns, rc = 0 00000100:00100000:3.0:1763333177.825915:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333177.825950:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613805952 00000100:00100000:3.0:1763333177.825959:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613805952 00010000:00010000:3.0:1763333177.826007:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57bea lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f63 expref: 15 pid: 8404 timeout: 1381 lvb_type: 0 00000100:00100000:3.0:1763333177.826049:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3147 00000100:00100000:3.0:1763333177.826059:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2421:x1848987613805952:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333177.826078:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333177.826083:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57bea lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x251:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f63 expref: 15 pid: 8404 timeout: 1381 lvb_type: 0 00010000:00010000:3.0:1763333177.826099:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57bea lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x251:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f63 expref: 15 pid: 8404 timeout: 1381 lvb_type: 0 00010000:00010000:3.0:1763333177.826129:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333177.826132:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333177.826138:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57d48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x251:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.826156:0:28428:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57d48 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x251:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.826182:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333177.826241:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2421:x1848987613805952:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 183us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333177.826249:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3147 00010000:00010000:2.0:1763333177.826916:0:29010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57bea lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f63 expref: 14 pid: 8404 timeout: 1381 lvb_type: 0 00000100:00100000:2.0:1763333177.826937:0:29010:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42ef9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:29010:1848987627297664:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333177.826976:0:29010:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57d48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.826989:0:29010:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57d48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.826997:0:29010:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57d48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.827008:0:29010:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57d48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.827018:0:29010:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57d48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.827054:0:29010:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763333177.827412:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+9:3654:x1848987627297152:12345-0@lo:6:osp-syn-1-1.0 Request processed in 7621us (8006us total) trans 17179871680 rc 0/0 00000100:00100000:2.0:1763333177.827432:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6752 00000004:00080000:1.0:1763333177.827640:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe469a3480/2, rc 0, transno 17179871680 00000100:00100000:1.0:1763333177.827650:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe469a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627297152:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763333177.828524:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333177.828609:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613806208 00000100:00100000:1.0:1763333177.828618:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613806208 00000100:00100000:1.0:1763333177.828678:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3260 00000100:00100000:1.0:1763333177.828689:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5004bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56902:x1848987613806208:12345-192.168.204.28@tcp:35:lfs.0 00010000:00010000:0.0:1763333177.828790:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333177.828802:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57d48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.828813:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff74203400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333177.828817:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57d48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.828827:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57d48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.828850:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57d48 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.828857:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57d48 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.828884:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333177.828887:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333177.828889:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1763333177.828935:0:29240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1486, 88 off125064 00000004:00080000:0.0:1763333177.828942:0:29240:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1281908593398ns, next at 1282771249577ns, rc = 0 00000004:00080000:1.0:1763333177.828976:0:6522:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x1c4:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1763333177.829027:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1487, 64 off125128 00000040:00080000:1.0:1763333177.829048:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1486, 64 off125128 00000040:00080000:1.0:1763333177.829058:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1487, 64 off125192 00000040:00080000:1.0:1763333177.829068:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1488, 64 off125192 00010000:00010000:1.0:1763333177.829133:0:6522:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74202a00/0xb32e3ef184c57d6b lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1c4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 00010000:00010000:1.0:1763333177.829148:0:6522:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74202a00/0xb32e3ef184c57d6b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT1 00010000:00010000:1.0:1763333177.829164:0:6522:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74202a00/0xb32e3ef184c57d6b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT1 00010000:00010000:1.0:1763333177.829171:0:6522:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74202a00/0xb32e3ef184c57d6b lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1c4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT1 00010000:00010000:1.0:1763333177.829176:0:6522:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74202a00/0xb32e3ef184c57d6b lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1c4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT1 00010000:00010000:1.0:1763333177.829181:0:6522:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74202a00/0xb32e3ef184c57d6b lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1c4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT1 00010000:00010000:1.0:1763333177.829205:0:6522:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763333177.829222:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333177.829228:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74202a00/0xb32e3ef184c57d6b lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1c4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT1 00010000:00010000:3.0:1763333177.829235:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff74202a00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333177.829237:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74202a00/0xb32e3ef184c57d6b lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1c4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT1 00010000:00010000:3.0:1763333177.829243:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74202a00/0xb32e3ef184c57d6b lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1c4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT1 00010000:00010000:3.0:1763333177.829254:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c4:0x0].0x0 (ffff92fe44cd0500) 00010000:00010000:3.0:1763333177.829257:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763333177.829261:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74202a00/0xb32e3ef184c57d6b lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1c4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT1 00010000:00010000:3.0:1763333177.829265:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff74202a00/0xb32e3ef184c57d6b lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1c4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT1 00010000:00010000:3.0:1763333177.829276:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333177.829277:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333177.829279:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763333177.829451:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5004bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:56902:x1848987613806208:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 762us (931us total) trans 4294972526 rc 0/0 00000100:00100000:1.0:1763333177.829460:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3260 00000001:00080000:2.0:1763333177.832264:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972527 is committed 00000004:00080000:2.0:1763333177.832288:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 976 committed 00000004:00080000:2.0:1763333177.832511:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 972 committed 00000004:00080000:2.0:1763333177.832526:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 971 committed 00000004:00080000:2.0:1763333177.832529:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 975 committed 00000100:00100000:0.0:1763333177.832730:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1763333177.832759:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44de0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627297920:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333177.832841:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333177.832896:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763333177.832905:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44de3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627297792:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333177.832929:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333177.832966:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627297920 00000100:00100000:0.0:1763333177.832976:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627297920 00000100:00100000:0.0:1763333177.833032:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627297792 00000100:00100000:0.0:1763333177.833035:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627297792 00000100:00100000:0.0:1763333177.833059:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6755 00000100:00100000:0.0:1763333177.833068:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+39:3653:x1848987627297920:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333177.833314:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+40:3653:x1848987627297920:12345-0@lo:2:osp-syn-0-1.0 Request processed in 245us (472us total) trans 21474838987 rc 0/0 00000100:00100000:0.0:1763333177.833321:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6755 00000100:00100000:0.0:1763333177.833344:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6756 00000100:00100000:0.0:1763333177.833380:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+39:3654:x1848987627297792:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333177.833466:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+40:3654:x1848987627297792:12345-0@lo:2:osp-syn-0-1.0 Request processed in 117us (536us total) trans 21474838988 rc 0/0 00000100:00100000:0.0:1763333177.833473:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6756 00000004:00080000:0.0:1763333177.833519:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44de0380/2, rc 0, transno 21474838987 00000100:00100000:0.0:1763333177.833529:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44de0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627297920:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1763333177.833550:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44de3100/2, rc 0, transno 21474838988 00000100:00100000:0.0:1763333177.833558:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44de3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627297792:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333177.833701:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763333177.833711:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42ef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627298048:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333177.833744:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333177.833787:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42efb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627298176:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333177.833811:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333177.834310:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333177.834410:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613806464 00000100:00100000:3.0:1763333177.834428:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613806464 00000100:00100000:3.0:1763333177.834484:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9553 00000100:00100000:3.0:1763333177.834495:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56902:x1848987613806464:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333177.834518:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333177.834555:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57d72 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969fe1 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.834659:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57d79 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333177.834676:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57d79 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.834688:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57d79 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.834703:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57d80 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333177.834709:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57d80 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.834715:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57d80 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.834867:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c57d87 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333177.834878:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c57d87 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.834884:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c57d87 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:3.0:1763333177.834900:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c7:0x0]: returning size 2 00010000:00010000:3.0:1763333177.835005:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c57d87 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.835014:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c57d87 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.835020:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c57d87 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.835026:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333177.835031:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c57d87 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.835039:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c57d87 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.835053:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c7:0x0].0x0 (ffff92ff4ad5ec00) 00010000:00010000:3.0:1763333177.835057:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1763333177.835062:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c57d87 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.835068:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c57d87 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.835087:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57d79 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.835094:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57d79 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.835099:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57d79 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.835110:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57d79 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.835115:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feaa00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333177.835117:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57d79 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.835123:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57d79 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.835128:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055a000) 00010000:00010000:3.0:1763333177.835130:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333177.835133:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57d79 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.835138:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57d79 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.835145:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57d80 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.835150:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57d80 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.835155:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57d80 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.835160:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333177.835162:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57d80 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.835168:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57d80 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.835177:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6055a500) 00010000:00010000:3.0:1763333177.835179:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333177.835182:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57d80 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.835187:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57d80 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.835236:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57d72 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fe1 expref: 249 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.835248:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055a000) 00010000:00010000:3.0:1763333177.835250:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763333177.835253:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57d72 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fe1 expref: 249 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.835265:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea000, rc 0) 00000100:00100000:3.0:1763333177.835340:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:56902:x1848987613806464:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 847us (1033us total) trans 4294972528 rc 301/301 00000100:00100000:3.0:1763333177.835386:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9553 00000100:00100000:0.0:1763333177.836249:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627298048 00000100:00100000:0.0:1763333177.836263:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627298048 00000100:00100000:0.0:1763333177.836538:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627298176 00000100:00100000:0.0:1763333177.836543:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627298176 00000100:00100000:1.0:1763333177.836643:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6757 00000100:00100000:1.0:1763333177.836656:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+10:3652:x1848987627298048:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333177.837492:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6758 00000100:00100000:0.0:1763333177.837506:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+11:3654:x1848987627298176:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333177.837655:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+12:3654:x1848987627298176:12345-0@lo:2:osp-syn-1-1.0 Request processed in 154us (3842us total) trans 17179871682 rc 0/0 00000100:00100000:0.0:1763333177.837664:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6758 00000004:00080000:0.0:1763333177.837731:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe42efb800/2, rc 0, transno 17179871682 00000100:00100000:0.0:1763333177.837747:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42efb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627298176:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333177.841888:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:3.0:1763333177.842003:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57d5d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c7:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fd3 expref: 247 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.842023:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c7:0x0].0x0 (ffff92ff4ad5ec00) 00010000:00010000:3.0:1763333177.842026:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763333177.842052:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57d4f lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fd3 expref: 247 pid: 29240 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1763333177.842082:0:29240:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57d5d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c7:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fd3 expref: 246 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.842130:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c7:0x0].0x0 (ffff92ff4ad5ec00) 00010000:00010000:3.0:1763333177.842133:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763333177.842136:0:29240:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45c84400, rc 0) 00000100:00100000:3.0:1763333177.842217:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:55917:x1848987613805568:12345-192.168.204.28@tcp:101:bash.0 Request processed in 21250us (21521us total) trans 4294972527 rc 0/0 00000100:00100000:3.0:1763333177.842227:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9551 00000100:00100000:3.0:1763333177.842268:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613806592 00000100:00100000:3.0:1763333177.842277:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613806592 00000100:00100000:3.0:1763333177.842326:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9554 00000100:00100000:3.0:1763333177.842335:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56902:x1848987613806592:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333177.842383:0:29240:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333177.842412:0:29240:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57d95 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1c7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969fe8 expref: -99 pid: 29240 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333177.842507:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+11:3652:x1848987627298048:12345-0@lo:2:osp-syn-1-1.0 Request processed in 5850us (8757us total) trans 17179871681 rc 0/0 00000100:00100000:1.0:1763333177.842518:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6757 00010000:00010000:3.0:1763333177.842539:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c57d9c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:3.0:1763333177.842553:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c57d9c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333177.842564:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c57d9c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00000004:00200000:3.0:1763333177.842601:0:29240:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c7:0x0]: returning size 2 00000004:00200000:3.0:1763333177.842607:0:29240:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763333177.842634:0:29240:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c57d9c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333177.842660:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57d95 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fe8 expref: 248 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.842685:0:29240:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c57d9c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fe8 expref: 247 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.842693:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c7:0x0].0x0 (ffff92ff4ad5ec00) 00010000:00010000:3.0:1763333177.842695:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333177.842698:0:29240:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe44d75400, rc 0) 00000100:00100000:3.0:1763333177.842726:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56902:x1848987613806592:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 392us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333177.842732:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9554 00000004:00080000:2.0:1763333177.842969:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe42ef8700/2, rc 0, transno 17179871681 00000100:00100000:2.0:1763333177.842994:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42ef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627298048:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333177.847685:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333177.849435:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613806720 00000100:00100000:1.0:1763333177.849460:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613806720 00000100:00100000:2.0:1763333177.850777:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.854511:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613806848 00000100:00100000:1.0:1763333177.854529:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6759 00000100:00100000:2.0:1763333177.854536:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613806848 00000100:00100000:1.0:1763333177.854550:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+27:55917:x1848987613806720:12345-192.168.204.28@tcp:101:bash.0 00000100:00100000:2.0:1763333177.854581:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6760 00010000:00010000:1.0:1763333177.854588:0:8407:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1763333177.854593:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50048700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+27:2418:x1848987613806848:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333177.854603:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333177.854621:0:8407:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff74203c00/0xb32e3ef184c57da3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x253:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969ff6 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.854630:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe45035a00/0xb32e3ef184c57daa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x253:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969fef expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333177.854660:0:8407:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x253:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333177.854694:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333177.854697:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333177.854713:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff74203c00/0xb32e3ef184c57da3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x253:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ff6 expref: 29 pid: 8407 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333177.854780:0:8404:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8404:1848987627298304:192.168.204.28@tcp:106: 00010000:00010000:1.0:1763333177.854858:0:8407:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92ff74203c00/0xb32e3ef184c57da3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x253:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ff6 expref: 29 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.854876:0:8407:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff74203c00, rc 0) 00000100:00100000:2.0:1763333177.854910:0:8404:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff58cbff00 going to sleep for 11 seconds 00000100:00100000:1.0:1763333177.854917:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:55917:x1848987613806720:12345-192.168.204.28@tcp:101:bash.0 Request processed in 374us (7248us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333177.854926:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6759 00000100:00100000:2.0:1763333177.858434:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333177.858561:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613806976 00000100:00100000:1.0:1763333177.858573:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613806976 00000100:00100000:1.0:1763333177.858657:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6761 00000100:00100000:1.0:1763333177.858670:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:55917:x1848987613806976:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333177.858697:0:28650:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333177.858728:0:28650:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57db1 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e36969ffd expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333177.858773:0:28650:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x253:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333177.858807:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333177.858810:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333177.858820:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57db1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ffd expref: 15 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.858840:0:28650:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57db1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ffd expref: 15 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.858855:0:28650:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff74203400, rc 0) 00000100:00100000:1.0:1763333177.858927:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:55917:x1848987613806976:12345-192.168.204.28@tcp:101:bash.0 Request processed in 260us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333177.858935:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6761 00002000:00010000:0.0:1763333177.859576:0:8404:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x253:0x0] updating lvb mtime: 0 -> 1763333178 00002000:00010000:0.0:1763333177.859582:0:8404:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x253:0x0] updating lvb atime: 0 -> 1763333178 00002000:00010000:0.0:1763333177.859585:0:8404:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x253:0x0] updating lvb ctime: 0 -> 1763333178 00000100:00100000:0.0:1763333177.859609:0:8404:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8404:1848987627298304:192.168.204.28@tcp:106: 00010000:00010000:0.0:1763333177.859661:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe45035a00/0xb32e3ef184c57daa lrc: 1/0,0 mode: --/PR res: [0x280000400:0x253:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fef expref: 28 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333177.859684:0:8404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe45035a00/0xb32e3ef184c57daa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x253:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fef expref: 28 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333177.859700:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45035a00, rc 0) 00000100:00100000:0.0:1763333177.861042:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50048700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+27:2418:x1848987613806848:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 6443us (10270us total) trans 0 rc 301/301 00000100:00100000:0.0:1763333177.861054:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6760 00000100:00100000:2.0:1763333177.865912:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.866345:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.867486:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333177.867570:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613807488 00000100:00100000:0.0:1763333177.867633:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613807488 00000100:00100000:0.0:1763333177.867714:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3261 00000100:00100000:0.0:1763333177.867727:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56902:x1848987613807488:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333177.868038:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:56902:x1848987613807488:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 313us (556us total) trans 4294972529 rc 0/0 00000100:00100000:0.0:1763333177.868046:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3261 00000100:00100000:3.0:1763333177.869201:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613807104 00000100:00100000:3.0:1763333177.869213:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613807104 00002000:00010000:2.0:1763333177.869344:0:16635:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/595 (0->18446744073709551615) 00002000:00100000:2.0:1763333177.869366:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe472f7100 with x1848987613807104 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333177.869383:0:16635:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe472f7100. 00000100:00100000:1.0:1763333177.869528:0:28429:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613807232 00000100:00100000:1.0:1763333177.869534:0:28429:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613807232 00002000:00010000:1.0:1763333177.869555:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/595 (0->18446744073709551615) 00002000:00100000:1.0:1763333177.869559:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe472f5180 with x1848987613807232 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333177.869567:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe472f5180. 00000100:00100000:2.0:1763333177.869623:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1661 00000100:00100000:2.0:1763333177.869635:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+27:2421:x1848987613807104:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:2.0:1763333177.869867:0:16635:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x253:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333177.869871:0:16635:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x253:0x0] updating lvb mtime from disk: 1763333178 -> 1763333178 00002000:00010000:2.0:1763333177.869874:0:16635:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x253:0x0] updating lvb atime from disk: 1763333178 -> 0 00002000:00010000:2.0:1763333177.869876:0:16635:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x253:0x0] updating lvb ctime from disk: 1763333178 -> 1763333178 00002000:00010000:2.0:1763333177.869879:0:16635:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x253:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333177.869951:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+28:2421:x1848987613807104:12345-192.168.204.28@tcp:10:bash.0 Request processed in 318us (4053us total) trans 21474838989 rc 0/0 00000100:00100000:2.0:1763333177.869958:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1661 00002000:00010000:2.0:1763333177.869963:0:16635:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/595 (0->18446744073709551615) 00002000:00100000:2.0:1763333177.869966:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe472f7100 with x1848987613807104 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333177.869970:0:16635:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe472f7100. 00000100:00100000:2.0:1763333177.869991:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1662 00000100:00100000:2.0:1763333177.869999:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2421:x1848987613807232:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:2.0:1763333177.870091:0:16635:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x253:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333177.870094:0:16635:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x253:0x0] updating lvb mtime from disk: 0 -> 1763333178 00002000:00010000:2.0:1763333177.870097:0:16635:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x253:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333177.870099:0:16635:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x253:0x0] updating lvb ctime from disk: 0 -> 1763333178 00002000:00010000:2.0:1763333177.870101:0:16635:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x253:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333177.870123:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2421:x1848987613807232:12345-192.168.204.28@tcp:10:bash.0 Request processed in 125us (3780us total) trans 17179871683 rc 0/0 00000100:00100000:2.0:1763333177.870129:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1662 00002000:00010000:2.0:1763333177.870132:0:16635:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/595 (0->18446744073709551615) 00002000:00100000:2.0:1763333177.870135:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe472f5180 with x1848987613807232 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333177.870138:0:16635:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe472f5180. 00000100:00100000:2.0:1763333177.878401:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333177.878522:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613807744 00000100:00100000:3.0:1763333177.878548:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613807744 00000100:00100000:3.0:1763333177.878618:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3262 00000100:00100000:3.0:1763333177.878630:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:55917:x1848987613807744:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:3.0:1763333177.879127:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:55917:x1848987613807744:12345-192.168.204.28@tcp:35:bash.0 Request processed in 497us (778us total) trans 4294972530 rc 0/0 00000100:00100000:3.0:1763333177.879136:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3262 00000100:00100000:1.0:1763333177.879458:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333177.879916:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613808000 00000100:00100000:3.0:1763333177.879923:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613808000 00000100:00100000:3.0:1763333177.879974:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9555 00000100:00100000:3.0:1763333177.879982:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:56902:x1848987613808000:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333177.880001:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333177.880031:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57db8 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a004 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.880116:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57dbf lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333177.880133:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57dbf lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.880145:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57dbf lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.880158:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57dc6 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333177.880165:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57dc6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.880171:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57dc6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.880286:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57dcd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333177.880296:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57dcd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.880303:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57dcd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:3.0:1763333177.880314:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c7:0x0]: returning size 5 00010000:00010000:3.0:1763333177.880442:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57dbf lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.880454:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57dbf lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.880459:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57dbf lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.880466:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57dbf lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.880473:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333177.880477:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57dbf lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.880485:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57dbf lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.880499:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055a000) 00010000:00010000:3.0:1763333177.880502:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333177.880508:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57dbf lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.880514:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c57dbf lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.880529:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57dc6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.880534:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57dc6 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.880539:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57dc6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.880544:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333177.880547:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57dc6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.880552:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57dc6 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.880558:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6055a500) 00010000:00010000:3.0:1763333177.880561:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333177.880564:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57dc6 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.880569:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57dc6 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.880612:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57db8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a004 expref: 252 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.880630:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57dcd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a004 expref: 251 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.880637:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c7:0x0].0x0 (ffff92ff4ad5ec00) 00010000:00010000:3.0:1763333177.880640:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333177.880643:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feaa00, rc 0) 00000100:00100000:3.0:1763333177.880696:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:56902:x1848987613808000:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 715us (1240us total) trans 4294972531 rc 0/0 00000100:00100000:3.0:1763333177.880704:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9555 00000100:00100000:1.0:1763333177.885472:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333177.885516:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333177.885625:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613808128 00000100:00100000:0.0:1763333177.885640:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613808128 00000100:00100000:0.0:1763333177.885730:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3263 00000100:00100000:0.0:1763333177.885743:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:56902:x1848987613808128:12345-192.168.204.28@tcp:33:lfs.0 00000100:00100000:0.0:1763333177.885984:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:56902:x1848987613808128:12345-192.168.204.28@tcp:33:lfs.0 Request processed in 243us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333177.885992:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3263 00000100:00100000:3.0:1763333177.886140:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613808256 00000100:00100000:3.0:1763333177.886147:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613808256 00000100:00100000:3.0:1763333177.886196:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 412 00000100:00100000:3.0:1763333177.886204:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:2419:x1848987613808256:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333177.886221:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333177.886253:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57dcd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a004 expref: 251 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333177.886278:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c7:0x0].0x0 (ffff92ff4ad5ec00) 00010000:00010000:3.0:1763333177.886285:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333177.886309:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:2419:x1848987613808256:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 106us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333177.886316:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 412 00000100:00100000:1.0:1763333177.892071:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.892396:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613808512 00000100:00100000:2.0:1763333177.892410:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613808512 00000100:00100000:2.0:1763333177.892494:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9556 00000100:00100000:2.0:1763333177.892507:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:56902:x1848987613808512:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333177.892593:0:29240:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333177.892631:0:29240:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45035a00/0xb32e3ef184c57ddb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1c7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a00b expref: -99 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.892790:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c57de2 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1c7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:2.0:1763333177.892809:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c57de2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c7:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333177.892823:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c57de2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c7:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00000004:00200000:2.0:1763333177.892839:0:29240:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c7:0x0]: returning size 5 00010000:00010000:2.0:1763333177.892997:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45035a00/0xb32e3ef184c57ddb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a00b expref: 253 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.893022:0:29240:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c57de2 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1c7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a00b expref: 252 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.893037:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c7:0x0].0x0 (ffff92ff4ad5ec00) 00010000:00010000:2.0:1763333177.893041:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763333177.893047:0:29240:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45034c00, rc 0) 00000100:00100000:2.0:1763333177.893173:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:56902:x1848987613808512:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 667us (1116us total) trans 4294972532 rc 0/0 00000100:00100000:2.0:1763333177.893182:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9556 00000100:00100000:1.0:1763333177.897772:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.897863:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613808768 00000100:00100000:2.0:1763333177.897879:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613808768 00000100:00100000:2.0:1763333177.897957:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3264 00000100:00100000:2.0:1763333177.897969:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc00c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:56902:x1848987613808768:12345-192.168.204.28@tcp:35:lfs.0 00000004:00010000:2.0:1763333177.898078:0:19668:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x1c7:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c57de2 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1c7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a00b expref: 252 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.898130:0:19668:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034800/0xb32e3ef184c57df0 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19668 initiator: MDT0 00010000:00010000:2.0:1763333177.898146:0:19668:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57d1e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fc5 expref: 252 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.898153:0:19668:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c57d9c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fe8 expref: 252 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.898161:0:19668:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57d5d lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x1c7:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fd3 expref: 252 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.898170:0:19668:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034800/0xb32e3ef184c57df0 lrc: 6/0,1 mode: --/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333177.898224:0:19668:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57d5d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c7:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fd3 expref: 252 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.898239:0:19668:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57d5d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1c7:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fd3 expref: 252 pid: 29240 timeout: 1381 lvb_type: 0 00000100:00100000:2.0:1763333177.898256:0:19668:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77b17100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:19668:1848987627298432:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333177.899766:0:19668:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c57d9c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fe8 expref: 252 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333177.899786:0:19668:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c57d9c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fe8 expref: 252 pid: 29240 timeout: 1381 lvb_type: 0 00000100:00100000:2.0:1763333177.899801:0:19668:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77b15180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:19668:1848987627298560:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333177.901242:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333177.901326:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613809024 00000100:00100000:3.0:1763333177.901339:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613809024 00000100:00100000:3.0:1763333177.901442:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9557 00000100:00100000:3.0:1763333177.901453:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:56907:x1848987613809024:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:3.0:1763333177.901530:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1763333177.901549:0:8606:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57d5d lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1c7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fd3 expref: 253 pid: 29240 timeout: 1381 lvb_type: 0 00010000:00010000:3.0:1763333177.901580:0:8606:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c57d9c lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fe8 expref: 253 pid: 29240 timeout: 1381 lvb_type: 0 00010000:00010000:3.0:1763333177.901595:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c7:0x0].0x0 (ffff92ff4ad5ec00) 00010000:00010000:3.0:1763333177.901600:0:8606:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034800/0xb32e3ef184c57df0 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19668 initiator: MDT1 00010000:00010000:3.0:1763333177.901611:0:8606:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034800/0xb32e3ef184c57df0 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 19668 initiator: MDT1 00010000:00010000:3.0:1763333177.901619:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034800/0xb32e3ef184c57df0 lrc: 5/0,1 mode: EX/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 19668 initiator: MDT1 00010000:00010000:3.0:1763333177.901643:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333177.901685:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57df7 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333177.901696:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57df7 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.901703:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57df7 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.901716:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57dfe lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333177.901723:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57dfe lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.901730:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57dfe lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.901835:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57e05 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333177.901843:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57e05 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.901849:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57e05 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00080000:3.0:1763333177.902176:0:8606:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x1c7:0x0] is inserted into orphan list, open count = 2 00010000:00010000:3.0:1763333177.902307:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57e05 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.902318:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57e05 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.902329:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57e05 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.902335:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333177.902339:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57e05 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.902382:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57e05 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.902394:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c7:0x0].0x0 (ffff92ff4ad5ec00) 00010000:00010000:3.0:1763333177.902396:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1763333177.902402:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57e05 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.902408:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57e05 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.902441:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57df7 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.902446:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57df7 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.902453:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57df7 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.902458:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57df7 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.902462:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feaa00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333177.902464:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57df7 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.902474:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57df7 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.902480:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055a000) 00010000:00010000:3.0:1763333177.902483:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333177.902486:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57df7 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.902491:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57df7 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000004:00010000:3.0:1763333177.902506:0:8606:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000baacd58f reply state 00000000f1ab2685 transno 4294972533 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57dfe lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.902516:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57dfe lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333177.902522:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6055a500) 00010000:00010000:3.0:1763333177.902525:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763333177.902528:0:8606:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763333177.902644:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+255:56907:x1848987613809024:12345-192.168.204.28@tcp:36:rm.0 Request processed in 1188us (1406us total) trans 4294972533 rc 0/0 00000100:00100000:3.0:1763333177.902654:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9557 00010000:00010000:2.0:1763333177.904105:0:19668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c57d1e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fc5 expref: 254 pid: 8606 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333177.904438:0:19668:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff58cbff00 going to sleep for 11 seconds 00010000:00010000:2.0:1763333177.906016:0:19668:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.204.28@tcp) returned -22 from blocking AST (req@0000000029bbb8f8 x1848987627298432) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57d5d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1c7:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fd3 expref: 253 pid: 29240 timeout: 1381 lvb_type: 0 00010000:00010000:2.0:1763333177.906043:0:19668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57d5d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c7:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fd3 expref: 253 pid: 29240 timeout: 1381 lvb_type: 0 00000100:00100000:2.0:1763333177.906059:0:19668:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77b17100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:19668:1848987627298432:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333177.909434:0:19668:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.204.28@tcp) returned -22 from blocking AST (req@00000000f81c4813 x1848987627298560) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c57d9c lrc: 1/0,0 mode: --/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fe8 expref: 252 pid: 29240 timeout: 1381 lvb_type: 0 00010000:00010000:2.0:1763333177.909465:0:19668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44d75400/0xb32e3ef184c57d9c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fe8 expref: 252 pid: 29240 timeout: 1381 lvb_type: 0 00000100:00100000:2.0:1763333177.909485:0:19668:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77b15180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:19668:1848987627298560:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333177.909523:0:19668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c7:0x0].0x0 (ffff92ff4ad5ec00) 00010000:00010000:2.0:1763333177.909533:0:19668:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034800/0xb32e3ef184c57df0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333177.909544:0:19668:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034800/0xb32e3ef184c57df0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333177.909550:0:19668:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034800/0xb32e3ef184c57df0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19668 initiator: MDT1 00000004:00020000:2.0:1763333177.909766:0:19668:0:(lod_lov.c:1523:lod_parse_striping()) lustre-MDT0001-mdtlov: can not set all stale mirrors for [0x240000404:0x1c7:0x0]: rc = -1 00010000:00010000:2.0:1763333177.909803:0:19668:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034800/0xb32e3ef184c57df0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333177.909811:0:19668:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034800/0xb32e3ef184c57df0 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333177.909818:0:19668:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034800/0xb32e3ef184c57df0 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333177.909825:0:19668:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45034800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333177.909829:0:19668:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034800/0xb32e3ef184c57df0 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333177.909837:0:19668:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034800/0xb32e3ef184c57df0 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333177.909852:0:19668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c7:0x0].0x0 (ffff92ff4ad5ec00) 00010000:00010000:2.0:1763333177.909855:0:19668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1763333177.909860:0:19668:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034800/0xb32e3ef184c57df0 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333177.909865:0:19668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034800/0xb32e3ef184c57df0 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1c7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333177.909876:0:19668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c7:0x0].0x0 (ffff92ff4ad5ec00) 00010000:00010000:2.0:1763333177.909879:0:19668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763333177.909884:0:19668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c57de2 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1c7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a00b expref: 251 pid: 29240 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333177.911076:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc00c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:56902:x1848987613808768:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 12127us (12336us total) trans 4294972534 rc -1/-1 00000100:00100000:2.0:1763333177.911674:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3264 00000100:00100000:1.0:1763333177.916569:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333177.916654:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613809152 00000100:00100000:0.0:1763333177.916667:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613809152 00000100:00100000:0.0:1763333177.916753:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9558 00000100:00100000:0.0:1763333177.916767:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:56902:x1848987613809152:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333177.916807:0:29240:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333177.916842:0:29240:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c57e0c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1c7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a012 expref: -99 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.916934:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c57e0c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a012 expref: 252 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.916951:0:29240:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85c00/0xb32e3ef184c57e0c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a012 expref: 252 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.916976:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c7:0x0].0x0 (ffff92fe44e12300) 00010000:00010000:0.0:1763333177.916980:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333177.916984:0:29240:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45c85c00, rc 0) 00000100:00100000:0.0:1763333177.917062:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:56902:x1848987613809152:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 298us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333177.917071:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9558 00000100:00100000:1.0:1763333177.928543:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333177.928598:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333177.928686:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613809408 00000100:00100000:2.0:1763333177.928700:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613809408 00000100:00100000:2.0:1763333177.928785:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3265 00000100:00100000:2.0:1763333177.928797:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:56902:x1848987613809408:12345-192.168.204.28@tcp:35:lfs.0 00000004:00080000:2.0:1763333177.929164:0:19668:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x1c7:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1763333177.929260:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1489, 64 off125256 00000040:00080000:2.0:1763333177.929287:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1488, 64 off125256 00000040:00080000:2.0:1763333177.929297:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1489, 64 off125320 00000040:00080000:2.0:1763333177.929306:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1490, 64 off125320 00010000:00010000:2.0:1763333177.929441:0:19668:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c57e13 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1c7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19668 initiator: MDT0 00010000:00010000:2.0:1763333177.929463:0:19668:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c57e13 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333177.929480:0:19668:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c57e13 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333177.929490:0:19668:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c57e13 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1c7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333177.929496:0:19668:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c57e13 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1c7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333177.929502:0:19668:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c57e13 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1c7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333177.929531:0:19668:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763333177.929563:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333177.929574:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c57e13 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1c7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19668 initiator: MDT1 00010000:00010000:3.0:1763333177.929582:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45034c00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333177.929586:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c57e13 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1c7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19668 initiator: MDT1 00010000:00010000:3.0:1763333177.929595:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c57e13 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1c7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 19668 initiator: MDT1 00010000:00010000:3.0:1763333177.929611:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c7:0x0].0x0 (ffff92fe44e12300) 00010000:00010000:3.0:1763333177.929615:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763333177.929620:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c57e13 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1c7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19668 initiator: MDT1 00010000:00010000:3.0:1763333177.929626:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c57e13 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1c7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19668 initiator: MDT1 00010000:00010000:3.0:1763333177.929639:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333177.929641:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333177.929643:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763333177.929782:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:56902:x1848987613809408:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 986us (1253us total) trans 4294972535 rc 0/0 00000100:00100000:2.0:1763333177.929792:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3265 00000100:00100000:0.0:1763333177.930064:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613809536 00000100:00100000:0.0:1763333177.930072:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613809536 00000100:00100000:0.0:1763333177.930124:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9559 00000100:00100000:0.0:1763333177.930133:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:56908:x1848987613809536:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333177.930148:0:29240:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333177.930173:0:29240:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57e1a lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a019 expref: -99 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.930241:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57e21 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:0.0:1763333177.930250:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57e21 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.930259:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57e21 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.930270:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57e28 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:0.0:1763333177.930276:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57e28 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.930282:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57e28 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.930319:0:29240:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57e21 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.930326:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57e21 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.930331:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57e21 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.930337:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57e21 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.930342:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c85600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333177.930381:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57e21 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.930389:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57e21 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.930398:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:0.0:1763333177.930401:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333177.930405:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57e21 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.930410:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57e21 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.930428:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57e28 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.930434:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57e28 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.930439:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57e28 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.930445:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c84400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333177.930447:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57e28 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.930452:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57e28 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.930458:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6055a500) 00010000:00010000:0.0:1763333177.930459:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333177.930462:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57e28 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.930466:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57e28 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.930489:0:29240:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57e1a lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a019 expref: 254 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.930499:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:0.0:1763333177.930501:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333177.930504:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57e1a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a019 expref: 254 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.930516:0:29240:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45c84c00, rc 0) 00000100:00100000:0.0:1763333177.930564:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:56908:x1848987613809536:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 432us (1967us total) trans 0 rc 301/301 00000100:00100000:0.0:1763333177.930571:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9559 00000100:00100000:1.0:1763333177.939688:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333177.939777:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613809664 00000100:00100000:0.0:1763333177.939793:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613809664 00000100:00100000:0.0:1763333177.939969:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9560 00000100:00100000:0.0:1763333177.939982:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:56908:x1848987613809664:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333177.939989:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333177.940015:0:29240:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333177.940048:0:29240:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57e2f lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a020 expref: -99 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.940142:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57e36 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:0.0:1763333177.940163:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57e36 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.940175:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57e36 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.940186:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57e3d lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:0.0:1763333177.940194:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57e3d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.940201:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57e3d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.940254:0:29240:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57e36 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.940262:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57e36 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.940269:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57e36 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.940275:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57e36 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.940283:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c84400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333177.940287:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57e36 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.940294:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57e36 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.940308:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:0.0:1763333177.940312:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333177.940318:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57e36 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.940324:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57e36 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.940341:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57e3d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.940369:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57e3d lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.940376:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57e3d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.940381:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c85600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333177.940384:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57e3d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.940389:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57e3d lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.940398:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6055a500) 00010000:00010000:0.0:1763333177.940400:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333177.940404:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57e3d lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.940410:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57e3d lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.940451:0:29240:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57e2f lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a020 expref: 254 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.940462:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:0.0:1763333177.940465:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333177.940469:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57e2f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a020 expref: 254 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.940485:0:29240:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45c84c00, rc 0) 00000100:00100000:0.0:1763333177.940768:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:56908:x1848987613809664:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 788us (1093us total) trans 0 rc 301/301 00000100:00100000:0.0:1763333177.940776:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9560 00000100:00100000:3.0:1763333177.946321:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333177.946485:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613809792 00000100:00100000:0.0:1763333177.946500:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613809792 00000100:00100000:0.0:1763333177.946578:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9561 00000100:00100000:0.0:1763333177.946590:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:56908:x1848987613809792:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333177.946619:0:29240:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333177.946650:0:29240:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c57e44 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a027 expref: -99 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.946736:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57e4b lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:0.0:1763333177.946753:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57e4b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333177.946767:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57e4b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00000004:00200000:0.0:1763333177.946829:0:29240:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1763333177.946834:0:29240:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763333177.946882:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c57e44 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a027 expref: 255 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.946900:0:29240:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57e4b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a027 expref: 254 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.946910:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12600) 00010000:00010000:0.0:1763333177.946913:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1763333177.946917:0:29240:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45c84600, rc 0) 00000100:00100000:0.0:1763333177.947046:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+254:56908:x1848987613809792:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 458us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333177.947055:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9561 00000100:00100000:3.0:1763333177.957606:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333177.958048:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613809920 00000100:00100000:0.0:1763333177.958063:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613809920 00000100:00100000:0.0:1763333177.958145:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9562 00000100:00100000:0.0:1763333177.958157:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+254:56908:x1848987613809920:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333177.958187:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333177.958215:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c57e52 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a02e expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.958303:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57e59 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333177.958321:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57e59 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.958336:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57e59 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.958395:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57e60 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333177.958404:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57e60 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.958412:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57e60 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.958473:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57e59 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.958481:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57e59 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.958489:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57e59 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.958497:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57e59 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.958504:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c84c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333177.958508:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57e59 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.958517:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57e59 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.958530:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12600) 00010000:00010000:0.0:1763333177.958534:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333177.958541:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57e59 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.958549:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57e59 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.958564:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57e60 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.958570:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57e60 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.958575:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57e60 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.958580:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c85600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333177.958583:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57e60 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.958589:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57e60 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.958596:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6055a500) 00010000:00010000:0.0:1763333177.958598:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333177.958602:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57e60 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.958608:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57e60 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.958642:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c57e52 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a02e expref: 255 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.958655:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12600) 00010000:00010000:0.0:1763333177.958658:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333177.958662:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c57e52 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a02e expref: 255 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.958672:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45c85e00, rc 0) 00000100:00100000:0.0:1763333177.958774:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+254:56908:x1848987613809920:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 619us (1183us total) trans 0 rc 301/301 00000100:00100000:0.0:1763333177.958783:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9562 00000100:00100000:1.0:1763333177.965000:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333177.965143:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613810176 00000100:00100000:0.0:1763333177.965159:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613810176 00000100:00100000:0.0:1763333177.965933:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9563 00000100:00100000:0.0:1763333177.965952:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+254:56909:x1848987613810176:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333177.965980:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333177.966009:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57e67 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a035 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.966110:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57e6e lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333177.966128:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57e6e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.966142:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57e6e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.966154:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57e75 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333177.966161:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57e75 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.966168:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57e75 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.966219:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57e6e lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.966227:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57e6e lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.966234:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57e6e lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.966242:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57e6e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.966249:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c84200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333177.966254:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57e6e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.966262:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57e6e lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.966276:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12600) 00010000:00010000:0.0:1763333177.966279:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333177.966285:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57e6e lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.966291:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57e6e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.966308:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57e75 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.966314:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57e75 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.966320:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57e75 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.966326:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333177.966329:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57e75 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.966336:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57e75 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.966342:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6055a500) 00010000:00010000:0.0:1763333177.966344:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333177.966374:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57e75 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.966381:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57e75 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.966426:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57e67 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a035 expref: 255 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.966439:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12600) 00010000:00010000:0.0:1763333177.966442:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763333177.966447:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57e67 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a035 expref: 255 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.966458:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45c84400, rc 0) 00000100:00100000:0.0:1763333177.966545:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+254:56909:x1848987613810176:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 600us (1560us total) trans 0 rc 301/301 00000100:00100000:0.0:1763333177.966555:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9563 00000100:00100000:3.0:1763333177.971289:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333177.971672:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613810432 00000100:00100000:0.0:1763333177.971686:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613810432 00000100:00100000:0.0:1763333177.972413:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9564 00000100:00100000:0.0:1763333177.972441:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+254:56908:x1848987613810432:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333177.972472:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333177.972475:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763333177.972510:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57e4b lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a027 expref: 254 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.972534:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12600) 00010000:00010000:0.0:1763333177.972548:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333177.972568:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c57e7c lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a03c expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.972705:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57e83 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333177.972721:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57e83 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.972732:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57e83 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.972745:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57e8a lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333177.972753:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57e8a lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.972759:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57e8a lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.973253:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57e91 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333177.973269:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57e91 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.973277:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57e91 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:0.0:1763333177.973290:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c9:0x0]: returning size 0 00010000:00010000:0.0:1763333177.973322:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57e83 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.973329:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57e83 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.973335:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57e83 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.973342:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57e83 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.973386:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333177.973391:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57e83 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.973399:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57e83 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.973407:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:0.0:1763333177.973410:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333177.973415:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57e83 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.973431:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57e83 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000004:00010000:0.0:1763333177.973449:0:8606:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000692f2a86 reply state 0000000006ff3899 transno 4294972536 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57e8a lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.973460:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57e8a lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333177.973466:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6055a500) 00010000:00010000:0.0:1763333177.973468:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333177.973472:0:8606:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763333177.973506:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c57e7c lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a03c expref: 256 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.973524:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57e91 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a03c expref: 255 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333177.973531:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c9:0x0].0x0 (ffff92fe44e12d00) 00010000:00010000:0.0:1763333177.973534:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333177.973536:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5e00, rc 0) 00000100:00100000:0.0:1763333177.973644:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+256:56908:x1848987613810432:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1212us (2371us total) trans 4294972536 rc 0/0 00000100:00100000:0.0:1763333177.973655:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9564 00000100:00100000:3.0:1763333177.979009:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333177.980317:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613810688 00000100:00100000:0.0:1763333177.980333:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613810688 00000100:00100000:1.0:1763333177.980508:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9565 00000100:00100000:1.0:1763333177.980523:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+256:56908:x1848987613810688:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333177.980561:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333177.980590:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff40030a00/0xb32e3ef184c57e9f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a043 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.980755:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57ea6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333177.980774:0:8606:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57e91 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a03c expref: 257 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.980784:0:8606:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57ea6 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.980828:0:8606:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57e91 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a03c expref: 257 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.980843:0:8606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57e91 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a03c expref: 257 pid: 8606 timeout: 1382 lvb_type: 0 00000100:00100000:1.0:1763333177.980864:0:8606:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627298816:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333177.980980:0:8606:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7dfb5e40 going to sleep for 11 seconds 00000100:00100000:1.0:1763333177.987912:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333177.988472:0:8606:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627298816:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333177.988513:0:8606:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57ea6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000100:00100000:2.0:1763333177.989778:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613810816 00000100:00100000:2.0:1763333177.989795:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613810816 00010000:00010000:2.0:1763333177.989854:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57e91 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a03c expref: 258 pid: 8606 timeout: 1382 lvb_type: 0 00000100:00100000:2.0:1763333177.989910:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3148 00000100:00100000:2.0:1763333177.989924:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+258:2421:x1848987613810816:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333177.989947:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333177.989965:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57e91 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a03c expref: 258 pid: 8606 timeout: 1382 lvb_type: 0 00010000:00010000:2.0:1763333177.989980:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57e91 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a03c expref: 258 pid: 8606 timeout: 1382 lvb_type: 0 00010000:00010000:2.0:1763333177.990008:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57e91 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a03c expref: 258 pid: 8606 timeout: 1382 lvb_type: 0 00010000:00010000:2.0:1763333177.990029:0:28428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c9:0x0].0x0 (ffff92fe44e12d00) 00010000:00010000:2.0:1763333177.990036:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57ea6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333177.990046:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57ea6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333177.990054:0:28428:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57ea6 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333177.990093:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333177.990177:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+257:2421:x1848987613810816:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 256us (2279us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333177.990187:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3148 00010000:00010000:1.0:1763333177.990898:0:8606:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57ea6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.990915:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57ea6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:1.0:1763333177.990958:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c9:0x0]: returning size 0 00000004:00080000:1.0:1763333177.991209:0:8606:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x255:0x0], index 1: 0 00000004:00080000:1.0:1763333177.991218:0:8606:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x255:0x0], index 0: 0 00000004:00080000:1.0:1763333177.991223:0:8606:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x256:0x0], index 0: 0 00000004:00080000:1.0:1763333177.991227:0:8606:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x256:0x0], index 1: 0 00010000:00010000:1.0:1763333177.991401:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57ea6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.991411:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57ea6 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.991427:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57ea6 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.991433:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4874aa00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333177.991438:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57ea6 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.991446:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57ea6 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.991459:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c9:0x0].0x0 (ffff92fe44e12d00) 00010000:00010000:1.0:1763333177.991463:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763333177.991468:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57ea6 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.991473:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57ea6 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333177.991541:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff40030a00/0xb32e3ef184c57e9f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1c9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a043 expref: 257 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.991551:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c9:0x0].0x0 (ffff92fe44e12d00) 00010000:00010000:1.0:1763333177.991554:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763333177.991557:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff40030a00/0xb32e3ef184c57e9f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a043 expref: 257 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333177.991574:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff40030a00, rc 0) 00000100:00100000:1.0:1763333177.991641:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+256:56908:x1848987613810688:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 11121us (12645us total) trans 4294972537 rc 301/301 00000100:00100000:1.0:1763333177.991649:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9565 00000100:00100000:1.0:1763333177.998634:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333177.998689:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333177.999037:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613811072 00000100:00100000:3.0:1763333177.999052:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613811072 00000100:00100000:2.0:1763333177.999557:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613811328 00000100:00100000:2.0:1763333177.999563:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613811328 00000100:00100000:2.0:1763333177.999610:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3266 00000100:00100000:2.0:1763333177.999620:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+257:56908:x1848987613811328:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333178.000094:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9566 00000100:00100000:0.0:1763333178.000109:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+258:56910:x1848987613811072:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333178.000120:0:29240:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333178.000147:0:29240:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57eb4 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a04a expref: -99 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.000239:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57ebb lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:0.0:1763333178.000254:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57ebb lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.000266:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57ebb lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.000275:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c57ec2 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:0.0:1763333178.000282:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c57ec2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.000288:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c57ec2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.000429:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57ec9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:0.0:1763333178.000437:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57ec9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.000443:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57ec9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00000004:00200000:0.0:1763333178.000455:0:29240:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c9:0x0]: returning size 0 00010000:00010000:0.0:1763333178.000516:0:29240:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57ebb lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.000524:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57ebb lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.000533:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57ebb lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.000540:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57ebb lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.000546:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333178.000550:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57ebb lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.000558:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57ebb lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.000571:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:0.0:1763333178.000575:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333178.000580:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57ebb lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.000586:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57ebb lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.000600:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c57ec2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.000605:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c57ec2 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.000610:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c57ec2 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.000615:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333178.000618:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c57ec2 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.000627:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c57ec2 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.000634:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6055a500) 00010000:00010000:0.0:1763333178.000636:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333178.000639:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c57ec2 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.000645:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c57ec2 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.000680:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57eb4 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a04a expref: 261 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.000700:0:29240:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57ec9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a04a expref: 260 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.000708:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c9:0x0].0x0 (ffff92fe44e12600) 00010000:00010000:0.0:1763333178.000710:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333178.000713:0:29240:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4a00, rc 0) 00000100:00100000:2.0:1763333178.000924:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+260:56908:x1848987613811328:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 1304us (2232us total) trans 4294972538 rc 0/0 00000100:00100000:2.0:1763333178.000933:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3266 00000100:00100000:0.0:1763333178.001209:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+259:56910:x1848987613811072:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1105us (2588us total) trans 4294972539 rc 0/0 00000100:00100000:0.0:1763333178.001216:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9566 00000100:00100000:1.0:1763333178.007460:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333178.007500:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333178.007556:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613811712 00000100:00100000:1.0:1763333178.007558:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333178.007572:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613811712 00000100:00100000:2.0:1763333178.007646:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613811584 00000100:00100000:2.0:1763333178.007651:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613811584 00000100:00100000:0.0:1763333178.007651:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613811840 00000100:00100000:0.0:1763333178.007654:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613811840 00000100:00100000:2.0:1763333178.007687:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3267 00000100:00100000:0.0:1763333178.007687:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6762 00000100:00100000:2.0:1763333178.007701:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+259:56908:x1848987613811584:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333178.007701:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+28:2418:x1848987613811712:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333178.007724:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333178.007752:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c57ed7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a051 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763333178.007782:0:8404:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x256:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333178.007802:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333178.007804:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333178.007815:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c57ed7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a051 expref: 29 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333178.007833:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c57ed7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a051 expref: 29 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333178.007847:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4800, rc 0) 00000100:00100000:0.0:1763333178.007908:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:2418:x1848987613811712:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 212us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333178.007915:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6762 00000100:00100000:2.0:1763333178.007921:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+260:56908:x1848987613811584:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 226us (478us total) trans 4294972540 rc 0/0 00000100:00100000:2.0:1763333178.007928:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3267 00000100:00100000:0.0:1763333178.007934:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6763 00000100:00100000:0.0:1763333178.007940:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2418:x1848987613811840:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333178.007961:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333178.007976:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57ede lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a058 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763333178.007991:0:8404:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x256:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333178.008000:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333178.008002:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333178.008006:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57ede lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a058 expref: 17 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333178.008018:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57ede lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a058 expref: 17 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333178.008026:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5e00, rc 0) 00000100:00100000:0.0:1763333178.008046:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2418:x1848987613811840:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 106us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333178.008052:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6763 00000100:00080000:1.0:1763333178.008116:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1763333178.008122:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1763333178.008124:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1763333178.012640:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.013026:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613812096 00000100:00100000:2.0:1763333178.013041:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613812096 00000100:00100000:2.0:1763333178.013121:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3268 00000100:00100000:2.0:1763333178.013132:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+260:56910:x1848987613812096:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333178.013490:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+261:56910:x1848987613812096:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 358us (862us total) trans 4294972541 rc 0/0 00000100:00100000:2.0:1763333178.013499:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3268 00000100:00100000:1.0:1763333178.016622:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333178.016739:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613812352 00000100:00100000:0.0:1763333178.016754:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613812352 00000100:00100000:0.0:1763333178.017484:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9567 00000100:00100000:0.0:1763333178.017498:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+261:55917:x1848987613812352:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333178.017523:0:29240:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333178.017527:0:29240:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763333178.017562:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57ec9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a04a expref: 261 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.017587:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c9:0x0].0x0 (ffff92fe44e12600) 00010000:00010000:0.0:1763333178.017599:0:29240:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333178.017621:0:29240:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57ee5 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a05f expref: -99 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.017770:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c57eec lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:0.0:1763333178.017785:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c57eec lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1c9:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.018138:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c57eec lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1c9:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00000004:00200000:0.0:1763333178.018157:0:29240:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c9:0x0]: returning size 0 00010000:00010000:0.0:1763333178.018299:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57ee5 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a05f expref: 263 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.018316:0:29240:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c57eec lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1c9:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a05f expref: 262 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.018324:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c9:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:0.0:1763333178.018326:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:0.0:1763333178.018329:0:29240:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5400, rc 0) 00000100:00100000:0.0:1763333178.019661:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+262:55917:x1848987613812352:12345-192.168.204.28@tcp:101:bash.0 Request processed in 1853us (2739us total) trans 4294972542 rc 0/0 00000100:00100000:0.0:1763333178.019677:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9567 00000100:00100000:1.0:1763333178.022066:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333178.022383:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613812608 00000100:00100000:0.0:1763333178.022396:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613812608 00000100:00100000:0.0:1763333178.022488:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9568 00000100:00100000:0.0:1763333178.022499:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+262:56910:x1848987613812608:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333178.022530:0:29240:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333178.022561:0:29240:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57efa lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a066 expref: -99 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.022669:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57f01 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:0.0:1763333178.022685:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57f01 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.022699:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57f01 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.022709:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57f08 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:0.0:1763333178.022716:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57f08 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.022722:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57f08 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.024090:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57f0f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:0.0:1763333178.024116:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57f0f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.024122:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57f0f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.024130:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57f0f lrc: 3/0,0 mode: --/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.024136:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c84200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333178.024140:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57f0f lrc: 3/0,0 mode: --/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.024148:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57f0f lrc: 4/0,0 mode: --/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.024167:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c9:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:0.0:1763333178.024175:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57f0f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.024183:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57f0f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00000004:00200000:0.0:1763333178.024203:0:29240:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c9:0x0]: returning size 0 00010000:00010000:0.0:1763333178.024319:0:29240:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57f01 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.024326:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57f01 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.024331:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57f01 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.024337:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57f01 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.024342:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c84600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333178.024376:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57f01 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.024383:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57f01 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.024394:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12f00) 00010000:00010000:0.0:1763333178.024396:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333178.024400:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57f01 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.024406:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57f01 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.024424:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57f08 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.024436:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57f08 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.024442:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57f08 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.024446:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c84400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333178.024449:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57f08 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.024455:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57f08 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.024463:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6055a500) 00010000:00010000:0.0:1763333178.024466:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333178.024469:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57f08 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.024475:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57f08 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.024530:0:29240:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57efa lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a066 expref: 264 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.024542:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12f00) 00010000:00010000:0.0:1763333178.024544:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763333178.024547:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57efa lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a066 expref: 264 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.024560:0:29240:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4400, rc 0) 00000100:00100000:0.0:1763333178.024652:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+263:56910:x1848987613812608:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 2154us (2597us total) trans 4294972543 rc 301/301 00000100:00100000:0.0:1763333178.024662:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9568 00000100:00100000:1.0:1763333178.027268:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333178.028161:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613812736 00000100:00100000:0.0:1763333178.028177:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613812736 00000100:00100000:0.0:1763333178.028250:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9569 00000100:00100000:0.0:1763333178.028262:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+263:55917:x1848987613812736:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333178.028291:0:29240:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333178.028318:0:29240:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c57f1d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a06d expref: -99 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.028562:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57f24 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:0.0:1763333178.028580:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57f24 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.028593:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57f24 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.028732:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c57f1d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a06d expref: 265 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.028753:0:29240:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57f24 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a06d expref: 264 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.028764:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c9:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:0.0:1763333178.028767:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763333178.028772:0:29240:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45c85600, rc 0) 00000100:00100000:0.0:1763333178.028863:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+264:55917:x1848987613812736:12345-192.168.204.28@tcp:101:bash.0 Request processed in 602us (1608us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333178.028876:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9569 00000100:00100000:2.0:1763333178.032488:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333178.032621:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613812992 00000100:00100000:1.0:1763333178.032635:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613812992 00000100:00100000:1.0:1763333178.032711:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3269 00000100:00100000:1.0:1763333178.032722:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+264:56910:x1848987613812992:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1763333178.033033:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+265:56910:x1848987613812992:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 313us (559us total) trans 4294972544 rc 0/0 00000100:00100000:1.0:1763333178.033041:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3269 00000100:00100000:2.0:1763333178.037903:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333178.038400:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613813248 00000100:00100000:1.0:1763333178.038424:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613813248 00000100:00100000:1.0:1763333178.038502:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9570 00000100:00100000:1.0:1763333178.038515:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+265:55917:x1848987613813248:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:1.0:1763333178.038596:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333178.038629:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c57eec lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1c9:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a05f expref: 265 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.038651:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c9:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:1.0:1763333178.038657:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333178.038883:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57f2b lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333178.038899:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57f2b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.038908:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57f2b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000001:00080000:1.0:1763333178.038968:0:8606:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294972545 00000004:00010000:1.0:1763333178.039001:0:8606:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000029bbb8f8 reply state 00000000df18e48b transno 4294972546 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57f2b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.039013:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57f2b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.039018:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c9:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:1.0:1763333178.039022:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333178.039024:0:8606:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763333178.039130:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+267:55917:x1848987613813248:12345-192.168.204.28@tcp:36:bash.0 Request processed in 617us (1243us total) trans 4294972546 rc 0/0 00000100:00100000:1.0:1763333178.039137:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9570 00000020:00080000:1.0:1763333178.039144:0:8606:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763333178.039994:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333178.041081:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613813504 00000100:00100000:0.0:1763333178.041096:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613813504 00000100:00100000:0.0:1763333178.041169:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9571 00000100:00100000:0.0:1763333178.041180:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+267:56910:x1848987613813504:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333178.041211:0:29240:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333178.041238:0:29240:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57f32 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a074 expref: -99 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.041337:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57f39 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:0.0:1763333178.041388:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57f39 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.041402:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57f39 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.041424:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57f40 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:0.0:1763333178.041434:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57f40 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.041441:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57f40 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.041581:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57f47 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:0.0:1763333178.041590:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57f47 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.041598:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57f47 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00000004:00200000:0.0:1763333178.041609:0:29240:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c9:0x0]: returning size 0 00010000:00010000:0.0:1763333178.041711:0:29240:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57f39 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.041719:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57f39 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.041725:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57f39 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.041731:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57f39 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.041737:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c84600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333178.041741:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57f39 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.041748:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57f39 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.041760:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12f00) 00010000:00010000:0.0:1763333178.041763:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333178.041769:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57f39 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.041774:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c57f39 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.041788:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57f40 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.041798:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57f40 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.041805:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57f40 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.041810:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c84200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333178.041813:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57f40 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.041819:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57f40 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.041825:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6055a500) 00010000:00010000:0.0:1763333178.041828:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333178.041831:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57f40 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.041836:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c57f40 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.041875:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84400/0xb32e3ef184c57f32 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a074 expref: 270 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.041895:0:29240:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57f47 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a074 expref: 269 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.041903:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c9:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:0.0:1763333178.041905:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333178.041908:0:29240:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45c84c00, rc 0) 00000100:00100000:0.0:1763333178.042022:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+269:56910:x1848987613813504:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 842us (2031us total) trans 4294972547 rc 0/0 00000100:00100000:0.0:1763333178.042031:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9571 00000100:00100000:2.0:1763333178.044967:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.045012:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333178.045578:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613813632 00000100:00100000:3.0:1763333178.045592:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613813632 00000100:00100000:3.0:1763333178.045662:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9572 00000100:00100000:3.0:1763333178.045671:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+269:55917:x1848987613813632:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333178.045701:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333178.045726:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57f55 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a07b expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.045795:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57f55 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a07b expref: 270 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.045811:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57f55 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a07b expref: 270 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.045832:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c9:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:3.0:1763333178.045836:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763333178.045840:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea200, rc 0) 00000100:00100000:3.0:1763333178.045919:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+270:55917:x1848987613813632:12345-192.168.204.28@tcp:101:bash.0 Request processed in 248us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333178.045926:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9572 00000100:00100000:1.0:1763333178.046163:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613813888 00000100:00100000:1.0:1763333178.046169:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613813888 00000100:00100000:1.0:1763333178.046208:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3270 00000100:00100000:1.0:1763333178.046215:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6b3ed850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+270:56910:x1848987613813888:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1763333178.046427:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6b3ed850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+271:56910:x1848987613813888:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 203us (1404us total) trans 4294972548 rc 0/0 00000100:00100000:1.0:1763333178.046433:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3270 00000100:00100000:2.0:1763333178.049825:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333178.049904:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613814016 00000100:00100000:0.0:1763333178.049918:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613814016 00000100:00100000:0.0:1763333178.050008:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3271 00000100:00100000:0.0:1763333178.050021:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+271:56910:x1848987613814016:12345-192.168.204.28@tcp:33:lfs.0 00000100:00100000:0.0:1763333178.050252:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+271:56910:x1848987613814016:12345-192.168.204.28@tcp:33:lfs.0 Request processed in 233us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333178.050261:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3271 00000100:00100000:3.0:1763333178.051017:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333178.051303:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613814272 00000100:00100000:0.0:1763333178.051313:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613814272 00000100:00100000:0.0:1763333178.051979:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9573 00000100:00100000:0.0:1763333178.051994:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+271:55917:x1848987613814272:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333178.052016:0:29240:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333178.052020:0:29240:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1763333178.052071:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57f55 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a07b expref: 271 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.052100:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57f47 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a074 expref: 270 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.052115:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c9:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:0.0:1763333178.052121:0:29240:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333178.052138:0:29240:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c57f5c lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a082 expref: -99 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.052208:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57f63 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:0.0:1763333178.052227:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57f63 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.052237:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57f63 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00000040:00080000:0.0:1763333178.052573:0:29240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1490, 88 off125408 00000004:00080000:0.0:1763333178.052585:0:29240:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1282132235551ns, next at 1282258802447ns, rc = 0 00000040:00080000:0.0:1763333178.052618:0:29240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1491, 88 off125408 00000004:00080000:0.0:1763333178.052625:0:29240:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1282132275906ns, next at 1282771249577ns, rc = 0 00000040:00080000:0.0:1763333178.052661:0:29240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1492, 88 off125496 00000004:00080000:0.0:1763333178.052666:0:29240:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1282132316946ns, next at 1282771249577ns, rc = 0 00000040:00080000:0.0:1763333178.052677:0:29240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1491, 88 off125496 00000004:00080000:0.0:1763333178.052680:0:29240:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1282132331546ns, next at 1282258802447ns, rc = 0 00000001:00080000:2.0:1763333178.060110:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972549 is committed 00000004:00080000:2.0:1763333178.060130:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 974 committed 00000004:00080000:2.0:1763333178.060153:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 978 committed 00000004:00080000:2.0:1763333178.060168:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 977 committed 00000004:00080000:2.0:1763333178.060171:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 973 committed 00010000:00010000:0.0:1763333178.060387:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57dfe lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.060402:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57dfe lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.060411:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57dfe lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.060428:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feb400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333178.060435:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57dfe lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.060445:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57dfe lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.060471:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6055a500) 00010000:00010000:0.0:1763333178.060477:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333178.060485:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57dfe lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.060492:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c57dfe lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.060519:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57e8a lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.060527:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57e8a lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.060535:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57e8a lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.060542:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333178.060546:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57e8a lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.060552:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57e8a lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.060561:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6055a500) 00010000:00010000:0.0:1763333178.060564:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333178.060569:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57e8a lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000100:00100000:3.0:1763333178.060570:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4920c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627299072:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1763333178.060576:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57e8a lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000100:00100000:2.0:1763333178.060597:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4920ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627298944:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1763333178.060604:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57f2b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.060613:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57f2b lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.060620:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57f2b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.060634:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4874ae00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333178.060641:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57f2b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.060648:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57f2b lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.060658:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c9:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:0.0:1763333178.060661:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333178.060668:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57f2b lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.060674:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57f2b lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000100:00100000:0.0:1763333178.060698:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4920fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627299328:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763333178.060743:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333178.060744:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4920df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627299200:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763333178.060817:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627298944 00000100:00100000:3.0:1763333178.060826:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627298944 00000100:00100000:3.0:1763333178.060904:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6764 00000100:00100000:3.0:1763333178.060916:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+11:3655:x1848987627298944:12345-0@lo:6:osp-syn-1-1.0 00000100:00080000:1.0:1763333178.060922:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:3.0:1763333178.060954:0:8407:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:591 count 1 00000100:00100000:0.0:1763333178.061038:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333178.061049:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4920d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627299456:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333178.061129:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627299712:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763333178.061136:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763333178.061190:0:8407:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57f6a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.061215:0:8407:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c57a9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969eec expref: 16 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.061226:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333178.061226:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57f63 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a082 expref: 247 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.061231:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333178.061237:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57f6a lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.061240:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c9:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:0.0:1763333178.061245:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763333178.061262:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c57f5c lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a082 expref: 247 pid: 29240 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1763333178.061282:0:8407:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c57a9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969eec expref: 16 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.061293:0:29240:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57f63 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a082 expref: 246 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.061300:0:8407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c57a9a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969eec expref: 16 pid: 8407 timeout: 1382 lvb_type: 0 00000100:00100000:3.0:1763333178.061314:0:8407:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4920dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8407:1848987627300480:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333178.061334:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c9:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:0.0:1763333178.061338:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763333178.061341:0:29240:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4400, rc 0) 00000100:00100000:0.0:1763333178.061404:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:55917:x1848987613814272:12345-192.168.204.28@tcp:101:bash.0 Request processed in 9415us (10390us total) trans 4294972549 rc 0/0 00000100:00100000:3.0:1763333178.061410:0:8407:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff6b0c2540 going to sleep for 11 seconds 00000100:00100000:0.0:1763333178.061427:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9573 00000100:00100000:2.0:1763333178.061542:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7dcff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627299968:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763333178.061568:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333178.061732:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627299200 00000100:00100000:1.0:1763333178.061739:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627299200 00000100:00100000:1.0:1763333178.061774:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627299456 00000100:00100000:1.0:1763333178.061777:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627299456 00000100:00100000:1.0:1763333178.061795:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6765 00000100:00100000:1.0:1763333178.061803:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+13:3653:x1848987627299200:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763333178.061819:0:28650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:595 count 1 00010000:00010000:1.0:1763333178.061836:0:28650:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57f71 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x253:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.061851:0:28650:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57db1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x253:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ffd expref: 16 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.061858:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333178.061860:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333178.061862:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57f71 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x253:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.061883:0:28650:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57db1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x253:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ffd expref: 16 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.061893:0:28650:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57db1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x253:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ffd expref: 16 pid: 28650 timeout: 1382 lvb_type: 0 00000100:00100000:1.0:1763333178.061903:0:28650:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff74036d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28650:1848987627300608:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333178.061939:0:28650:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff47e19780 going to sleep for 11 seconds 00000100:00100000:1.0:1763333178.061969:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6766 00000100:00100000:1.0:1763333178.061978:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+13:3655:x1848987627299456:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333178.062166:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+14:3655:x1848987627299456:12345-0@lo:2:osp-syn-1-1.0 Request processed in 189us (1032us total) trans 17179871684 rc 0/0 00000100:00100000:1.0:1763333178.062173:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6766 00000004:00080000:2.0:1763333178.062327:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4920d880/2, rc 0, transno 17179871684 00000100:00100000:2.0:1763333178.062335:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4920d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627299456:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333178.062344:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627299968 00000100:00100000:2.0:1763333178.062346:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1763333178.062376:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627299968 00000100:00100000:2.0:1763333178.062382:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627299840:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763333178.062425:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333178.062431:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6767 00000100:00100000:0.0:1763333178.062440:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+40:3655:x1848987627299968:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1763333178.062455:0:29010:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:595 count 1 00000100:00100000:2.0:1763333178.062456:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff74034a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627300352:0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1763333178.062477:0:29010:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57f78 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x253:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333178.062487:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1763333178.062498:0:29010:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff74203c00/0xb32e3ef184c57da3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x253:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ff6 expref: 28 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.062507:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333178.062509:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333178.062512:0:29010:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57f78 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x253:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333178.062528:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1763333178.062537:0:29010:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92ff74203c00/0xb32e3ef184c57da3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x253:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ff6 expref: 28 pid: 8407 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333178.062553:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4920c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627299584:0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1763333178.062557:0:29010:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92ff74203c00/0xb32e3ef184c57da3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x253:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ff6 expref: 28 pid: 8407 timeout: 1382 lvb_type: 0 00000100:00100000:0.0:1763333178.062573:0:29010:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44de1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:29010:1848987627300736:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333178.062597:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627299840 00000100:00100000:2.0:1763333178.062600:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333178.062602:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627299840 00000100:00100000:0.0:1763333178.062614:0:29010:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff49c92780 going to sleep for 11 seconds 00000100:00100000:2.0:1763333178.062625:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff74035880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627300096:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763333178.062629:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627300352 00000100:00100000:3.0:1763333178.062632:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627300352 00000100:00100000:0.0:1763333178.062639:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333178.062645:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627299072 00000100:00100000:3.0:1763333178.062649:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627299072 00000100:00100000:2.0:1763333178.062657:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333178.062660:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627299584 00000100:00100000:3.0:1763333178.062662:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627299584 00000100:00100000:3.0:1763333178.062673:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6768 00000100:00100000:3.0:1763333178.062680:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+42:3655:x1848987627299840:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763333178.062688:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1763333178.062698:0:8611:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:592 count 1 00000100:00100000:0.0:1763333178.062708:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff74035c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627300224:0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1763333178.062715:0:8611:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c57f7f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x250:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.062731:0:8611:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85400/0xb32e3ef184c57ca7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x250:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fa2 expref: 28 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.062740:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1763333178.062741:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763333178.062744:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333178.062749:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c57f7f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x250:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333178.062770:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627299328 00010000:00010000:3.0:1763333178.062774:0:8611:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85400/0xb32e3ef184c57ca7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x250:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fa2 expref: 28 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333178.062777:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627299328 00010000:00010000:3.0:1763333178.062788:0:8611:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85400/0xb32e3ef184c57ca7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x250:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fa2 expref: 28 pid: 8611 timeout: 1382 lvb_type: 0 00000100:00100000:3.0:1763333178.062800:0:8611:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4920e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8611:1848987627300864:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333178.062801:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627300096 00000100:00100000:0.0:1763333178.062807:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627300096 00000100:00100000:0.0:1763333178.062826:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627299712 00000100:00100000:0.0:1763333178.062829:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627299712 00000100:00100000:3.0:1763333178.062837:0:8611:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff6be073c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763333178.062843:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627300224 00000100:00100000:0.0:1763333178.062847:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627300224 00000100:00100000:3.0:1763333178.062865:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6769 00000100:00100000:0.0:1763333178.062874:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6770 00000100:00100000:3.0:1763333178.062877:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5004bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+45:3655:x1848987627300352:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333178.062887:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+16:3652:x1848987627299072:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1763333178.062905:0:8406:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:592 count 1 00010000:00010000:0.0:1763333178.062921:0:8406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57f86 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.062934:0:8406:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff74203600/0xb32e3ef184c57c8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f94 expref: 16 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.062941:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333178.062943:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333178.062946:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57f86 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333178.062986:0:28651:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x256:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333178.062990:0:28651:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x256:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763333178.062993:0:28651:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x256:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333178.062995:0:28651:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x256:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763333178.062998:0:28651:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x256:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333178.063066:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6771 00000100:00100000:1.0:1763333178.063075:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+16:3652:x1848987627299584:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1763333178.063139:0:28600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x256:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333178.063143:0:28600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x256:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763333178.063145:0:28600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x256:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333178.063147:0:28600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x256:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763333178.063149:0:28600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x256:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333178.063188:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5004bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+46:3655:x1848987627300352:12345-0@lo:2:osp-syn-0-1.0 Request processed in 313us (701us total) trans 21474838990 rc 0/0 00000100:00100000:1.0:1763333178.063193:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+17:3652:x1848987627299584:12345-0@lo:2:osp-syn-1-1.0 Request processed in 117us (590us total) trans 17179871685 rc 0/0 00000100:00100000:3.0:1763333178.063202:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6769 00000100:00100000:1.0:1763333178.063216:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6771 00000100:00100000:3.0:1763333178.063224:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6772 00000100:00100000:3.0:1763333178.063234:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+16:3654:x1848987627299328:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763333178.063240:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6773 00002000:00080000:3.0:1763333178.063249:0:28651:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:596 count 1 00000100:00100000:1.0:1763333178.063250:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50067b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+45:3652:x1848987627300096:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1763333178.063268:0:28600:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:596 count 1 00002000:00010000:3.0:1763333178.063282:0:28651:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x254:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333178.063289:0:28651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57f8d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333178.063289:0:28600:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x254:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333178.063299:0:28600:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe4874a600/0xb32e3ef184c57f94 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.063303:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333178.063306:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333178.063313:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333178.063314:0:28651:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57f8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.063316:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333178.063321:0:28600:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4874a600/0xb32e3ef184c57f94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.063333:0:28651:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57f8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.063336:0:28600:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4874a600/0xb32e3ef184c57f94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.063375:0:28600:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe4874a600/0xb32e3ef184c57f94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.063377:0:28651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57f8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.063396:0:28600:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4874a600/0xb32e3ef184c57f94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.063397:0:28651:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57f8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.063442:0:28651:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:2.0:1763333178.063513:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff74034a80/2, rc 0, transno 21474838990 00000100:00100000:2.0:1763333178.063521:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff74034a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627300352:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1763333178.063592:0:28600:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1763333178.063627:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+17:3654:x1848987627299328:12345-0@lo:6:osp-syn-1-1.0 Request processed in 395us (989us total) trans 17179871686 rc 0/0 00000100:00100000:3.0:1763333178.063634:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6772 00000100:00100000:3.0:1763333178.063653:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6774 00000100:00100000:3.0:1763333178.063661:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+46:3653:x1848987627299712:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763333178.063675:0:28651:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:591 count 1 00010000:00010000:3.0:1763333178.063689:0:28651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c57f9b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.063701:0:28651:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe48190200/0xb32e3ef184c57ced lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fb7 expref: 28 pid: 8404 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333178.063735:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50067b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+46:3652:x1848987627300096:12345-0@lo:6:osp-syn-0-1.0 Request processed in 487us (1077us total) trans 21474838991 rc 0/0 00000100:00100000:1.0:1763333178.063743:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6773 00000100:00100000:1.0:1763333178.063757:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6775 00000100:00100000:1.0:1763333178.063763:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+45:3653:x1848987627300224:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1763333178.063790:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333178.063792:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333178.063796:0:28651:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c57f9b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.063825:0:28651:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe48190200/0xb32e3ef184c57ced lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fb7 expref: 28 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.063837:0:28651:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe48190200/0xb32e3ef184c57ced lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fb7 expref: 28 pid: 8404 timeout: 1382 lvb_type: 0 00000100:00100000:1.0:1763333178.063848:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+46:3653:x1848987627300224:12345-0@lo:2:osp-syn-0-1.0 Request processed in 83us (1108us total) trans 21474838992 rc 0/0 00000100:00100000:3.0:1763333178.063853:0:28651:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4920f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28651:1848987627300992:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333178.063861:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6775 00000100:00080000:1.0:1763333178.063893:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1763333178.063903:0:28651:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff44fdf900 going to sleep for 11 seconds 00000004:00080000:1.0:1763333178.063922:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff74035c00/2, rc 0, transno 21474838992 00000100:00100000:1.0:1763333178.063928:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff74035c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627300224:0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1763333178.064104:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1763333178.064112:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57f8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.064121:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea200 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333178.064126:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57f8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.064388:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57f8d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.064423:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57f8d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.064432:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c57f8d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.064454:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333178.064458:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe4874a600/0xb32e3ef184c57f94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.064465:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4874a600 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333178.064468:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4874a600/0xb32e3ef184c57f94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.064474:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4874a600/0xb32e3ef184c57f94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.064483:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe4874a600/0xb32e3ef184c57f94 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.064489:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4874a600/0xb32e3ef184c57f94 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.064500:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333178.064501:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333178.064503:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333178.064601:0:8406:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92ff74203600/0xb32e3ef184c57c8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f94 expref: 16 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.064611:0:8406:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92ff74203600/0xb32e3ef184c57c8b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f94 expref: 16 pid: 8404 timeout: 1382 lvb_type: 0 00000100:00100000:0.0:1763333178.064623:0:8406:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42f0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8406:1848987627301120:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333178.064657:0:8406:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7dfb5e40 going to sleep for 11 seconds 00010000:00010000:0.0:1763333178.064669:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763333178.064692:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4920fb80/2, rc 0, transno 17179871686 00000100:00100000:0.0:1763333178.064697:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4920fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627299328:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1763333178.064813:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff74035880/2, rc 0, transno 21474838991 00000100:00100000:1.0:1763333178.064818:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff74035880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627300096:0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1763333178.064830:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4920c700/2, rc 0, transno 17179871685 00000100:00100000:1.0:1763333178.064833:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4920c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627299584:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333178.068385:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333178.068494:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613814400 00000100:00100000:1.0:1763333178.068508:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613814400 00000100:00100000:1.0:1763333178.068578:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6776 00000100:00100000:1.0:1763333178.068589:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75664380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:55917:x1848987613814400:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333178.068612:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333178.068640:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57fa2 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a089 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333178.068670:0:8404:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x255:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333178.068703:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333178.068707:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333178.068718:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57fa2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a089 expref: 18 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.068738:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57fa2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a089 expref: 18 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.068754:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4874aa00, rc 0) 00000100:00100000:1.0:1763333178.068840:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75664380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:55917:x1848987613814400:12345-192.168.204.28@tcp:101:bash.0 Request processed in 252us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333178.068850:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6776 00000100:00100000:2.0:1763333178.070168:0:8407:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4920dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8407:1848987627300480:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333178.070204:0:8407:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57f6a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333178.070312:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333178.070657:0:28650:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff74036d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28650:1848987627300608:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333178.070674:0:8611:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4920e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8611:1848987627300864:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333178.070676:0:28650:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57f71 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x253:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333178.070956:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613814528 00000100:00100000:2.0:1763333178.070963:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613814528 00010000:00010000:2.0:1763333178.071006:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c57a9a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969eec expref: 18 pid: 8407 timeout: 1382 lvb_type: 0 00000100:00100000:2.0:1763333178.071054:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3149 00000100:00100000:2.0:1763333178.071064:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2420:x1848987613814528:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333178.071082:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333178.071089:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c57a9a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969eec expref: 18 pid: 8407 timeout: 1382 lvb_type: 0 00010000:00010000:2.0:1763333178.071103:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c57a9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969eec expref: 18 pid: 8407 timeout: 1382 lvb_type: 0 00010000:00010000:2.0:1763333178.071130:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c57a9a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969eec expref: 18 pid: 8407 timeout: 1382 lvb_type: 0 00010000:00010000:2.0:1763333178.071147:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333178.071149:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333178.071154:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57f6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.071165:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57f6a lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.071196:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333178.071248:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2420:x1848987613814528:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 185us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333178.071258:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3149 00010000:00010000:2.0:1763333178.071286:0:8407:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57f6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.071295:0:8407:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57f6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.071308:0:8407:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57f6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.071317:0:8407:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57f6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.071336:0:8407:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763333178.071682:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+17:3655:x1848987627298944:12345-0@lo:6:osp-syn-1-1.0 Request processed in 10766us (10979us total) trans 17179871687 rc 0/0 00000100:00100000:2.0:1763333178.071691:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6764 00010000:00010000:2.0:1763333178.071723:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333178.071730:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57f6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.071739:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feaa00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333178.071744:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57f6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.071754:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57f6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.071767:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57f6a lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.071775:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c57f6a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.071795:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333178.071797:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333178.071799:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763333178.071834:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4920ca80/2, rc 0, transno 17179871687 00000100:00100000:2.0:1763333178.071841:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4920ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627298944:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763333178.071943:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.071962:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613814656 00000100:00100000:2.0:1763333178.071966:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613814656 00010000:00010000:2.0:1763333178.071986:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57db1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x253:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ffd expref: 17 pid: 28650 timeout: 1382 lvb_type: 0 00000100:00100000:2.0:1763333178.072010:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3150 00000100:00100000:2.0:1763333178.072018:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75667b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2418:x1848987613814656:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333178.072027:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333178.072032:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57db1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x253:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ffd expref: 17 pid: 28650 timeout: 1382 lvb_type: 0 00010000:00010000:2.0:1763333178.072048:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57db1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x253:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ffd expref: 17 pid: 28650 timeout: 1382 lvb_type: 0 00010000:00010000:2.0:1763333178.072062:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff74203400/0xb32e3ef184c57db1 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x253:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ffd expref: 17 pid: 28650 timeout: 1382 lvb_type: 0 00010000:00010000:2.0:1763333178.072072:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333178.072074:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333178.072078:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57f71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x253:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.072086:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57f71 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x253:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.072106:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333178.072133:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75667b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2418:x1848987613814656:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 115us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333178.072140:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3150 00000100:00100000:2.0:1763333178.072179:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.072194:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613814912 00000100:00100000:2.0:1763333178.072198:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613814912 00010000:00010000:2.0:1763333178.072214:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85400/0xb32e3ef184c57ca7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x250:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fa2 expref: 29 pid: 8611 timeout: 1382 lvb_type: 0 00000100:00100000:2.0:1763333178.072233:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3151 00000100:00100000:2.0:1763333178.072239:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50e68050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:2418:x1848987613814912:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333178.072251:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333178.072255:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85400/0xb32e3ef184c57ca7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x250:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fa2 expref: 29 pid: 8611 timeout: 1382 lvb_type: 0 00010000:00010000:2.0:1763333178.072264:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85400/0xb32e3ef184c57ca7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x250:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fa2 expref: 29 pid: 8611 timeout: 1382 lvb_type: 0 00010000:00010000:2.0:1763333178.072280:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85400/0xb32e3ef184c57ca7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x250:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fa2 expref: 29 pid: 8611 timeout: 1382 lvb_type: 0 00010000:00010000:2.0:1763333178.072291:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333178.072293:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333178.072297:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c57f7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x250:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.072305:0:6506:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c57f7f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x250:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.072317:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333178.072337:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50e68050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+28:2418:x1848987613814912:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 97us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333178.072344:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3151 00000100:00100000:2.0:1763333178.072466:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.072480:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613814784 00000100:00100000:2.0:1763333178.072483:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613814784 00010000:00010000:2.0:1763333178.072511:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92ff74203c00/0xb32e3ef184c57da3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x253:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ff6 expref: 28 pid: 8407 timeout: 1382 lvb_type: 0 00000100:00100000:2.0:1763333178.072538:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3152 00000100:00100000:2.0:1763333178.072545:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75667b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+28:2418:x1848987613814784:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333178.072553:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333178.072557:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92ff74203c00/0xb32e3ef184c57da3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x253:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ff6 expref: 28 pid: 8407 timeout: 1382 lvb_type: 0 00010000:00010000:2.0:1763333178.072567:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92ff74203c00/0xb32e3ef184c57da3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x253:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ff6 expref: 28 pid: 8407 timeout: 1382 lvb_type: 0 00010000:00010000:2.0:1763333178.072580:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333178.072582:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333178.072586:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57f78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x253:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.072594:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57f78 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x253:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.072606:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333178.072623:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75667b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+28:2418:x1848987613814784:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 79us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333178.072630:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3152 00000100:00100000:2.0:1763333178.072673:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.072687:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613815040 00000100:00100000:2.0:1763333178.072691:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613815040 00010000:00010000:2.0:1763333178.072706:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe48190200/0xb32e3ef184c57ced lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fb7 expref: 28 pid: 8404 timeout: 1382 lvb_type: 0 00000100:00100000:2.0:1763333178.072731:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3153 00000100:00100000:2.0:1763333178.072737:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75664700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+28:2419:x1848987613815040:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333178.072745:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333178.072748:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe48190200/0xb32e3ef184c57ced lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fb7 expref: 28 pid: 8404 timeout: 1382 lvb_type: 0 00010000:00010000:2.0:1763333178.072758:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe48190200/0xb32e3ef184c57ced lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fb7 expref: 28 pid: 8404 timeout: 1382 lvb_type: 0 00010000:00010000:2.0:1763333178.072770:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333178.072772:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333178.072775:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c57f9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.072784:0:6506:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c57f9b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.072794:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333178.072810:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75664700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+28:2419:x1848987613815040:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 73us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333178.072816:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3153 00010000:00010000:3.0:1763333178.073046:0:8611:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c57f7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.073059:0:8611:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c57f7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.073067:0:8611:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c57f7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.073077:0:8611:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c57f7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.073087:0:8611:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c57f7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.073114:0:8611:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763333178.073338:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+46:3655:x1848987627299840:12345-0@lo:6:osp-syn-0-1.0 Request processed in 10657us (10922us total) trans 21474838993 rc 0/0 00000100:00100000:3.0:1763333178.073373:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6768 00010000:00010000:3.0:1763333178.073434:0:28651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe48190200/0xb32e3ef184c57ced lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969fb7 expref: 27 pid: 8404 timeout: 1382 lvb_type: 0 00000100:00100000:3.0:1763333178.073446:0:28651:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4920f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28651:1848987627300992:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333178.073465:0:28651:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c57f9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.073473:0:28651:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c57f9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.073481:0:28651:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c57f9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.073488:0:28651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c57f9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.073494:0:28651:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c57f9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.073515:0:28651:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1763333178.073723:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+46:3653:x1848987627299712:12345-0@lo:6:osp-syn-0-1.0 Request processed in 10062us (11039us total) trans 21474838994 rc 0/0 00000100:00100000:3.0:1763333178.073730:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6774 00010000:00010000:3.0:1763333178.073754:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1763333178.073761:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c57f7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.073770:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea800 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333178.073774:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c57f7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.073784:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c57f7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.073798:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c57f7f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.073806:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c57f7f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.073826:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333178.073830:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c57f9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.073836:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feba00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333178.073840:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c57f9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.073848:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c57f9b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.073858:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c57f9b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.073865:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe42feba00/0xb32e3ef184c57f9b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.073879:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333178.073881:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333178.073883:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763333178.074021:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe472f1c00/2, rc 0, transno 21474838994 00000100:00100000:1.0:1763333178.074029:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627299712:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1763333178.074050:0:28650:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57f71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.074058:0:28650:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57f71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.074067:0:28650:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57f71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.074075:0:28650:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57f71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.074105:0:28650:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763333178.074278:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+17:3653:x1848987627299200:12345-0@lo:6:osp-syn-1-1.0 Request processed in 12475us (13239us total) trans 17179871688 rc 0/0 00000100:00100000:1.0:1763333178.074286:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6765 00000004:00080000:1.0:1763333178.074319:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4920df80/2, rc 0, transno 17179871688 00000100:00100000:1.0:1763333178.074325:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4920df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627299200:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1763333178.074508:0:29010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff74203c00/0xb32e3ef184c57da3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x253:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969ff6 expref: 26 pid: 8407 timeout: 1382 lvb_type: 0 00000100:00100000:0.0:1763333178.074524:0:29010:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44de1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:29010:1848987627300736:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333178.074542:0:29010:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57f78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.074551:0:29010:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57f78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.074558:0:29010:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57f78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.074573:0:29010:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57f78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.074581:0:29010:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57f78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.074611:0:29010:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1763333178.074743:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+46:3655:x1848987627299968:12345-0@lo:6:osp-syn-0-1.0 Request processed in 12305us (13173us total) trans 21474838995 rc 0/0 00000100:00100000:0.0:1763333178.074751:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6767 00000100:00100000:0.0:1763333178.074789:0:8406:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42f0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8406:1848987627301120:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333178.074804:0:8406:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57f86 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.074842:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1763333178.074849:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57f71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.074859:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4874ba00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333178.074863:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57f71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.074870:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57f71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.074887:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57f71 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.074895:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57f71 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.074913:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333178.074917:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57f78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.074922:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333178.074926:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57f78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.074932:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57f78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.074949:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57f78 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.074955:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57f78 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.074967:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333178.074968:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333178.074970:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333178.076538:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333178.076573:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763333178.076693:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe472f2d80/2, rc 0, transno 21474838993 00000100:00100000:2.0:1763333178.076707:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627299840:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1763333178.076726:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7dcff100/2, rc 0, transno 21474838995 00000100:00100000:2.0:1763333178.076731:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7dcff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627299968:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1763333178.078534:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333178.078583:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613815168 00000100:00100000:1.0:1763333178.078596:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613815168 00010000:00010000:1.0:1763333178.078655:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92ff74203600/0xb32e3ef184c57c8b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f94 expref: 16 pid: 8404 timeout: 1382 lvb_type: 0 00000100:00100000:2.0:1763333178.079252:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3154 00000100:00100000:2.0:1763333178.079270:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75666d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2418:x1848987613815168:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333178.079291:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333178.079299:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92ff74203600/0xb32e3ef184c57c8b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f94 expref: 16 pid: 8404 timeout: 1382 lvb_type: 0 00010000:00010000:2.0:1763333178.079315:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92ff74203600/0xb32e3ef184c57c8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f94 expref: 16 pid: 8404 timeout: 1382 lvb_type: 0 00010000:00010000:2.0:1763333178.079374:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff74203600/0xb32e3ef184c57c8b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36969f94 expref: 16 pid: 8404 timeout: 1382 lvb_type: 0 00010000:00010000:2.0:1763333178.079393:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333178.079395:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333178.079402:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57f86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.079414:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57f86 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.079464:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333178.079486:0:8406:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57f86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.079500:0:8406:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57f86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.079512:0:8406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57f86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.079521:0:8406:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57f86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333178.079549:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75666d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2418:x1848987613815168:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 285us (1025us total) trans 0 rc 0/0 00010000:00010000:0.0:1763333178.079551:0:8406:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763333178.079563:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3154 00000100:00100000:0.0:1763333178.080043:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+17:3652:x1848987627299072:12345-0@lo:6:osp-syn-1-1.0 Request processed in 17158us (17513us total) trans 17179871689 rc 0/0 00000100:00100000:0.0:1763333178.080054:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6770 00010000:00010000:0.0:1763333178.080082:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333178.080090:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57f86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.080099:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4a00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333178.080105:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57f86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.080115:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57f86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.080129:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57f86 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.080136:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c57f86 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.080156:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333178.080158:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333178.080159:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763333178.080245:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe4920c000/2, rc 0, transno 17179871689 00000100:00100000:1.0:1763333178.080254:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4920c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627299072:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763333178.082575:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333178.082633:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613815424 00000100:00100000:0.0:1763333178.082645:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613815424 00000100:00100000:0.0:1763333178.082712:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9574 00000100:00100000:0.0:1763333178.082722:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56911:x1848987613815424:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333178.082754:0:29240:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333178.082782:0:29240:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57fa9 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a090 expref: -99 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.082879:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57fb0 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:0.0:1763333178.082895:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57fb0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.082908:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57fb0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.082922:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c57fb7 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:0.0:1763333178.082929:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c57fb7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.082935:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c57fb7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.083085:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85400/0xb32e3ef184c57fbe lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:0.0:1763333178.083095:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85400/0xb32e3ef184c57fbe lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.083102:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85400/0xb32e3ef184c57fbe lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00000004:00200000:0.0:1763333178.083113:0:29240:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c9:0x0]: returning size 2 00010000:00010000:0.0:1763333178.083226:0:29240:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57fb0 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.083234:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57fb0 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.083240:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57fb0 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.083247:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57fb0 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.083253:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333178.083257:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57fb0 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.083265:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57fb0 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.083277:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe44e12f00) 00010000:00010000:0.0:1763333178.083280:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333178.083285:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57fb0 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.083291:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c57fb0 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.083305:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c57fb7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.083311:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c57fb7 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.083316:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c57fb7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.083321:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333178.083324:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c57fb7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.083329:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c57fb7 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.083336:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe44e12600) 00010000:00010000:0.0:1763333178.083339:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333178.083341:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c57fb7 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.085041:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c57fb7 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.085155:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c57fa9 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a090 expref: 249 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.085177:0:29240:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85400/0xb32e3ef184c57fbe lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a090 expref: 248 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.085185:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c9:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:0.0:1763333178.085188:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333178.085191:0:29240:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45c85400, rc 0) 00000100:00100000:0.0:1763333178.087497:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:56911:x1848987613815424:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 4757us (4915us total) trans 4294972550 rc 0/0 00000100:00100000:0.0:1763333178.087526:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9574 00000100:00100000:3.0:1763333178.087641:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333178.087814:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613815552 00000100:00100000:1.0:1763333178.087826:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613815552 00000100:00100000:1.0:1763333178.088513:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6777 00000100:00100000:1.0:1763333178.088529:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+26:55917:x1848987613815552:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333178.088555:0:8406:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333178.088584:0:8406:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57fcc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a097 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333178.088618:0:8406:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x255:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333178.088648:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333178.088652:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333178.088665:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57fcc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a097 expref: 27 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.088683:0:8406:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57fcc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a097 expref: 27 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.088698:0:8406:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4874ba00, rc 0) 00000100:00100000:1.0:1763333178.088774:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+27:55917:x1848987613815552:12345-192.168.204.28@tcp:101:bash.0 Request processed in 249us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333178.088781:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6777 00000100:00100000:3.0:1763333178.091815:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333178.091861:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333178.092729:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613815680 00000100:00100000:1.0:1763333178.092745:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613815680 00002000:00010000:1.0:1763333178.092802:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/597 (0->18446744073709551615) 00002000:00100000:1.0:1763333178.092808:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4920d180 with x1848987613815680 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333178.092822:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe4920d180. 00000100:00100000:1.0:1763333178.092849:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613815808 00000100:00100000:1.0:1763333178.092852:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613815808 00002000:00010000:1.0:1763333178.092867:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/597 (0->18446744073709551615) 00002000:00100000:1.0:1763333178.092870:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4920dc00 with x1848987613815808 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333178.092876:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe4920dc00. 00000100:00100000:1.0:1763333178.092909:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1663 00000100:00100000:1.0:1763333178.092923:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2421:x1848987613815680:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:1.0:1763333178.093159:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x255:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333178.093163:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x255:0x0] updating lvb mtime from disk: 0 -> 1763333178 00002000:00010000:1.0:1763333178.093166:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x255:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333178.093168:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x255:0x0] updating lvb ctime from disk: 0 -> 1763333178 00002000:00010000:1.0:1763333178.093171:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x255:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333178.093238:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2421:x1848987613815680:12345-192.168.204.28@tcp:10:bash.0 Request processed in 317us (1437us total) trans 17179871690 rc 0/0 00000100:00100000:1.0:1763333178.093246:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1663 00002000:00010000:1.0:1763333178.093249:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/597 (0->18446744073709551615) 00002000:00100000:1.0:1763333178.093252:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4920d180 with x1848987613815680 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333178.093256:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe4920d180. 00000100:00100000:1.0:1763333178.093272:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1664 00000100:00100000:1.0:1763333178.093278:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+27:2421:x1848987613815808:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:1.0:1763333178.093385:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x255:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333178.093388:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x255:0x0] updating lvb mtime from disk: 0 -> 1763333178 00002000:00010000:1.0:1763333178.093390:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x255:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333178.093392:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x255:0x0] updating lvb ctime from disk: 0 -> 1763333178 00002000:00010000:1.0:1763333178.093394:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x255:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333178.093412:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+28:2421:x1848987613815808:12345-192.168.204.28@tcp:10:bash.0 Request processed in 135us (1551us total) trans 21474838996 rc 0/0 00000100:00100000:1.0:1763333178.093429:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1664 00002000:00010000:1.0:1763333178.093431:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/597 (0->18446744073709551615) 00002000:00100000:1.0:1763333178.093434:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4920dc00 with x1848987613815808 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333178.093438:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe4920dc00. 00000100:00100000:2.0:1763333178.099433:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.100023:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333178.100094:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613816064 00000100:00100000:0.0:1763333178.100109:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613816064 00000100:00100000:0.0:1763333178.100176:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613816320 00000100:00100000:0.0:1763333178.100180:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613816320 00000100:00100000:0.0:1763333178.100217:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3272 00000100:00100000:0.0:1763333178.100228:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:56911:x1848987613816064:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333178.100246:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3273 00000100:00100000:3.0:1763333178.100255:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:55917:x1848987613816320:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:0.0:1763333178.100559:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:56911:x1848987613816064:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 332us (1152us total) trans 4294972551 rc 0/0 00000100:00100000:0.0:1763333178.100569:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3272 00000100:00100000:3.0:1763333178.100593:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:55917:x1848987613816320:12345-192.168.204.28@tcp:35:bash.0 Request processed in 338us (571us total) trans 4294972552 rc 0/0 00000100:00100000:3.0:1763333178.100599:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3273 00000100:00100000:2.0:1763333178.106069:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333178.106717:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613816576 00000100:00100000:0.0:1763333178.106732:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613816576 00000100:00100000:0.0:1763333178.106813:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9575 00000100:00100000:0.0:1763333178.106826:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:56911:x1848987613816576:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333178.106864:0:29240:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333178.106892:0:29240:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c57fd3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a09e expref: -99 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.107043:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57fda lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:0.0:1763333178.107062:0:29240:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85400/0xb32e3ef184c57fbe lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a090 expref: 251 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.107072:0:29240:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57fda lrc: 4/0,1 mode: --/CW res: [0x240000404:0x1c9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.107116:0:29240:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85400/0xb32e3ef184c57fbe lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a090 expref: 251 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.107131:0:29240:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85400/0xb32e3ef184c57fbe lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a090 expref: 251 pid: 29240 timeout: 1382 lvb_type: 0 00000100:00100000:0.0:1763333178.107147:0:29240:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42f0ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:29240:1848987627301248:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333178.107265:0:29240:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff49c92e40 going to sleep for 11 seconds 00000100:00100000:3.0:1763333178.113429:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333178.113471:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333178.113643:0:29240:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42f0ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:29240:1848987627301248:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333178.113682:0:29240:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57fda lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1c9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00000100:00100000:1.0:1763333178.113725:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613816832 00000100:00100000:1.0:1763333178.113735:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613816832 00000100:00100000:2.0:1763333178.114684:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613816960 00000100:00100000:2.0:1763333178.114693:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613816960 00010000:00010000:2.0:1763333178.114738:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85400/0xb32e3ef184c57fbe lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a090 expref: 253 pid: 29240 timeout: 1382 lvb_type: 0 00000100:00100000:2.0:1763333178.114786:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3155 00000100:00100000:2.0:1763333178.114796:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:2421:x1848987613816960:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333178.114817:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333178.114824:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85400/0xb32e3ef184c57fbe lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a090 expref: 253 pid: 29240 timeout: 1382 lvb_type: 0 00010000:00010000:2.0:1763333178.114836:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85400/0xb32e3ef184c57fbe lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a090 expref: 253 pid: 29240 timeout: 1382 lvb_type: 0 00010000:00010000:2.0:1763333178.114865:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85400/0xb32e3ef184c57fbe lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a090 expref: 253 pid: 29240 timeout: 1382 lvb_type: 0 00010000:00010000:2.0:1763333178.114886:0:28428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c9:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:2.0:1763333178.114892:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57fda lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1c9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333178.114904:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57fda lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1c9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333178.114913:0:28428:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57fda lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x1c9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333178.114941:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333178.115012:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:2421:x1848987613816960:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 216us (1539us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333178.115021:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3155 00000100:00100000:1.0:1763333178.115121:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9576 00000100:00100000:1.0:1763333178.115135:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:56912:x1848987613816832:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:0.0:1763333178.115205:0:29240:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57fda lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1c9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333178.115212:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1763333178.115215:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57fda lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1c9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333178.115237:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c57f63 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a082 expref: 251 pid: 29240 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1763333178.115250:0:29240:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c9:0x0]: returning size 5 00010000:00010000:1.0:1763333178.115257:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85600/0xb32e3ef184c57f24 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a06d expref: 250 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.115268:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c9:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:1.0:1763333178.115272:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333178.115319:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57fe8 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333178.115330:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57fe8 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.115339:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57fe8 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.115389:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57fef lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333178.115398:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57fef lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.115406:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57fef lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.115450:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c57fd3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a09e expref: 251 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.115468:0:29240:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57fda lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1c9:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a09e expref: 250 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.115476:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c9:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:0.0:1763333178.115479:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1763333178.115482:0:29240:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45c84c00, rc 0) 00010000:00010000:1.0:1763333178.115519:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c57ff6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00000100:00100000:0.0:1763333178.115524:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:56911:x1848987613816576:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 8699us (9469us total) trans 4294972553 rc 0/0 00000100:00100000:0.0:1763333178.115535:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9575 00010000:00010000:1.0:1763333178.115536:0:8606:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57fda lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x1c9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a09e expref: 250 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.115548:0:8606:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c57ff6 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.115603:0:8606:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57fda lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1c9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a09e expref: 249 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.115616:0:8606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57fda lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1c9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a09e expref: 249 pid: 29240 timeout: 1382 lvb_type: 0 00000100:00100000:1.0:1763333178.115633:0:8606:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff74036d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627301376:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333178.115705:0:8606:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff47e19780 going to sleep for 11 seconds 00000100:00100000:1.0:1763333178.118813:0:8606:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff74036d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627301376:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333178.118856:0:8606:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c57ff6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000100:00100000:1.0:1763333178.120191:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333178.120428:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333178.120523:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613817088 00000100:00100000:0.0:1763333178.120534:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613817088 00010000:00010000:0.0:1763333178.120587:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57fda lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1c9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a09e expref: 250 pid: 29240 timeout: 1382 lvb_type: 0 00000100:00100000:2.0:1763333178.120620:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613817216 00000100:00100000:2.0:1763333178.120625:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613817216 00000100:00100000:0.0:1763333178.120644:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3156 00000100:00100000:0.0:1763333178.120657:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74036d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:2420:x1848987613817088:12345-192.168.204.28@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1763333178.120663:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9577 00000100:00100000:2.0:1763333178.120668:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74035500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:56911:x1848987613817216:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333178.120675:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333178.120681:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57fda lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x1c9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a09e expref: 251 pid: 29240 timeout: 1382 lvb_type: 0 00010000:00010000:2.0:1763333178.120691:0:29240:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333178.120696:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57fda lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1c9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a09e expref: 251 pid: 29240 timeout: 1382 lvb_type: 0 00010000:00010000:2.0:1763333178.120711:0:29240:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034400/0xb32e3ef184c57ffd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a0a5 expref: -99 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.120722:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c57fda lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1c9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a09e expref: 252 pid: 29240 timeout: 1382 lvb_type: 0 00010000:00010000:0.0:1763333178.120740:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c9:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:0.0:1763333178.120745:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c57ff6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.120757:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c57ff6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.120764:0:6504:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c57ff6 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.120804:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333178.120835:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034800/0xb32e3ef184c58004 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:2.0:1763333178.120846:0:29240:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c57ff6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.120855:0:29240:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034800/0xb32e3ef184c58004 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333178.120869:0:29240:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c57ff6 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8606 initiator: MDT1 00000100:00100000:0.0:1763333178.120871:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74036d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:2420:x1848987613817088:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 216us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333178.120879:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3156 00010000:00010000:2.0:1763333178.120880:0:29240:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034800/0xb32e3ef184c58004 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333178.121134:0:8606:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c57ff6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.121142:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c57ff6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8606 initiator: MDT1 00000004:00080000:3.0:1763333178.121548:0:8606:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x1c9:0x0] is inserted into orphan list, open count = 1 00010000:00010000:3.0:1763333178.121659:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c57ff6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.121667:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c57ff6 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.121674:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c57ff6 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.121680:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4874a600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333178.121683:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c57ff6 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.121690:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c57ff6 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.121701:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c9:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:3.0:1763333178.121704:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1763333178.121706:0:8606:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034800/0xb32e3ef184c58004 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333178.121714:0:8606:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034800/0xb32e3ef184c58004 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333178.121719:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034800/0xb32e3ef184c58004 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333178.121745:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c57ff6 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.121752:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c57ff6 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.121770:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57fe8 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.121776:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57fe8 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.121781:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57fe8 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.121786:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57fe8 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.121791:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4874b000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333178.121793:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57fe8 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.121799:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57fe8 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.121807:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff4ad5e500) 00010000:00010000:3.0:1763333178.121810:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333178.121813:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57fe8 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.121818:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c57fe8 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000004:00010000:3.0:1763333178.121836:0:8606:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000abe79884 reply state 000000005f70b5da transno 4294972554 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57fef lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.121847:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57fef lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.121854:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff4ad5e300) 00010000:00010000:3.0:1763333178.121856:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763333178.121859:0:8606:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763333178.121942:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:56912:x1848987613816832:12345-192.168.204.28@tcp:36:rm.0 Request processed in 6809us (8535us total) trans 4294972554 rc 0/0 00000100:00100000:3.0:1763333178.121952:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9576 00010000:00010000:2.0:1763333178.122168:0:29240:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034800/0xb32e3ef184c58004 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333178.122177:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034800/0xb32e3ef184c58004 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00000004:00200000:2.0:1763333178.122209:0:29240:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c9:0x0]: returning size 5 00000004:00200000:2.0:1763333178.122215:0:29240:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763333178.122233:0:29240:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034800/0xb32e3ef184c58004 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333178.122263:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034400/0xb32e3ef184c57ffd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0a5 expref: 252 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.122279:0:29240:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034800/0xb32e3ef184c58004 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0a5 expref: 251 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.122286:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c9:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:2.0:1763333178.122289:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333178.122291:0:29240:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45034800, rc 0) 00000100:00100000:2.0:1763333178.122322:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74035500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:56911:x1848987613817216:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1653us (1905us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333178.122328:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9577 00000100:00100000:0.0:1763333178.126574:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.126676:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613817472 00000100:00100000:2.0:1763333178.126691:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613817472 00000100:00100000:2.0:1763333178.126774:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9578 00000100:00100000:2.0:1763333178.126786:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:56911:x1848987613817472:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333178.126816:0:29240:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333178.126842:0:29240:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c5800b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a0ac expref: -99 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.126983:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45035a00/0xb32e3ef184c58012 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:2.0:1763333178.127000:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45035a00/0xb32e3ef184c58012 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333178.127013:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45035a00/0xb32e3ef184c58012 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00000004:00200000:2.0:1763333178.127029:0:29240:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c9:0x0]: returning size 5 00010000:00010000:2.0:1763333178.127169:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c5800b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0ac expref: 254 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.127193:0:29240:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45035a00/0xb32e3ef184c58012 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1c9:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0ac expref: 253 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.127209:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c9:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:2.0:1763333178.127212:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763333178.127217:0:29240:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45035a00, rc 0) 00000100:00100000:2.0:1763333178.127307:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:56911:x1848987613817472:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 523us (750us total) trans 4294972555 rc 0/0 00000100:00100000:2.0:1763333178.127316:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9578 00000100:00100000:0.0:1763333178.133586:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333178.134065:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613817600 00000100:00100000:1.0:1763333178.134080:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613817600 00000100:00100000:1.0:1763333178.134162:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6778 00000100:00100000:1.0:1763333178.134174:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2420:x1848987613817600:12345-192.168.204.28@tcp:1:lfs.0 00010000:00010000:1.0:1763333178.134243:0:8406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c58020 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.134265:0:8406:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57fa2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a089 expref: 16 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.134273:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333178.134276:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333178.134280:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c58020 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.134327:0:8406:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57fa2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a089 expref: 16 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.134342:0:8406:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57fa2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a089 expref: 16 pid: 8404 timeout: 1382 lvb_type: 0 00000100:00100000:1.0:1763333178.134427:0:8406:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff74034380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8406:1848987627301504:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333178.134542:0:8406:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff47e19780 going to sleep for 11 seconds 00000100:00100000:1.0:1763333178.139422:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333178.139449:0:8406:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff74034380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8406:1848987627301504:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333178.139490:0:8406:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c58020 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333178.139516:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613817728 00000100:00100000:3.0:1763333178.139527:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613817728 00002000:00100000:3.0:1763333178.139594:0:28427:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x2c0000400:0x255:0x0] (0->4) req@ffff92ff74034e00 x1848987613817728/t0(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:489/0 lens 496/0 e 0 to 0 dl 1763333189 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763333178.139605:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff74034e00 with x1848987613817728 ext(0->4) 00010000:00010000:3.0:1763333178.139613:0:28427:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57fa2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a089 expref: 17 pid: 8404 timeout: 1382 lvb_type: 0 00010000:00010000:3.0:1763333178.139630:0:28427:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57fa2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a089 expref: 17 pid: 8404 timeout: 1382 lvb_type: 0 00002000:00010000:3.0:1763333178.139638:0:28427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92ff74034e00 00000100:00100000:3.0:1763333178.139680:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 112 00000100:00100000:3.0:1763333178.139692:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74034e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2420:x1848987613817728:12345-192.168.204.28@tcp:4:bash.0 00000100:00100000:3.0:1763333178.141329:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74034e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2420:x1848987613817728:12345-192.168.204.28@tcp:4:bash.0 Request processed in 1625us (1918us total) trans 17179871691 rc 0/0 00000100:00100000:3.0:1763333178.141346:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 112 00002000:00100000:3.0:1763333178.141387:0:28427:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x2c0000400:0x255:0x0] (0->4) req@ffff92ff74034e00 x1848987613817728/t17179871691(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:489/0 lens 496/448 e 0 to 0 dl 1763333189 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763333178.141410:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff74034e00 with x1848987613817728 ext(0->4) 00010000:00010000:3.0:1763333178.141472:0:28427:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57fa2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a089 expref: 19 pid: 8404 timeout: 1382 lvb_type: 0 00010000:00010000:3.0:1763333178.142632:0:28427:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57fa2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a089 expref: 19 pid: 8404 timeout: 1382 lvb_type: 0 00002000:00010000:3.0:1763333178.142651:0:28427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92ff74034e00 00000100:00100000:0.0:1763333178.145987:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333178.146288:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613817856 00000100:00100000:1.0:1763333178.146302:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613817856 00010000:00010000:1.0:1763333178.146392:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57fa2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a089 expref: 19 pid: 8404 timeout: 1382 lvb_type: 0 00000100:00100000:3.0:1763333178.146395:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333178.146445:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3157 00000100:00100000:1.0:1763333178.146456:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2419:x1848987613817856:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333178.146480:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1763333178.146503:0:28428:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x255:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:1.0:1763333178.146507:0:28428:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x255:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1763333178.146513:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57fa2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a089 expref: 19 pid: 8404 timeout: 1382 lvb_type: 0 00010000:00010000:1.0:1763333178.146528:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57fa2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a089 expref: 19 pid: 8404 timeout: 1382 lvb_type: 0 00010000:00010000:1.0:1763333178.146625:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c57fa2 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a089 expref: 19 pid: 8404 timeout: 1382 lvb_type: 0 00010000:00010000:1.0:1763333178.146647:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333178.146650:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333178.146658:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c58020 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.146669:0:28428:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c58020 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.147022:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333178.147233:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2419:x1848987613817856:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 776us (1259us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333178.147243:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3157 00010000:00010000:0.0:1763333178.147345:0:8406:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c58020 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.147379:0:8406:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c58020 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.147403:0:8406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c58020 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.147412:0:8406:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c58020 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.147428:0:8406:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c58020 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.147436:0:8406:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48190e00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333178.147440:0:8406:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c58020 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.147450:0:8406:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c58020 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.147465:0:8406:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c58020 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.147490:0:8406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe48190e00/0xb32e3ef184c58020 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333178.147557:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613817984 00000100:00100000:2.0:1763333178.147564:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613817984 00000100:00100000:2.0:1763333178.147617:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9579 00000100:00100000:2.0:1763333178.147625:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:56913:x1848987613817984:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333178.147649:0:29240:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333178.147675:0:29240:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c58027 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a0b3 expref: -99 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.147754:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034400/0xb32e3ef184c5802e lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:2.0:1763333178.147770:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034400/0xb32e3ef184c5802e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333178.147780:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034400/0xb32e3ef184c5802e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333178.147794:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c58035 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:2.0:1763333178.147801:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c58035 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00000100:00100000:1.0:1763333178.147883:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2420:x1848987613817600:12345-192.168.204.28@tcp:1:lfs.0 Request processed in 13711us (14312us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333178.147893:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6778 00010000:00010000:2.0:1763333178.148284:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c58035 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333178.149288:0:29240:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034400/0xb32e3ef184c5802e lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333178.149304:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034400/0xb32e3ef184c5802e lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333178.149311:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034400/0xb32e3ef184c5802e lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333178.149319:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034400/0xb32e3ef184c5802e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333178.149325:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45034400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333178.149331:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034400/0xb32e3ef184c5802e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333178.149339:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034400/0xb32e3ef184c5802e lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333178.149369:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a0be00) 00010000:00010000:2.0:1763333178.149373:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333178.149378:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034400/0xb32e3ef184c5802e lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333178.149386:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034400/0xb32e3ef184c5802e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333178.149408:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c58035 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333178.149427:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c58035 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333178.149434:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c58035 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333178.149439:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe44c38800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333178.149442:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c58035 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333178.149447:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c58035 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333178.149455:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff4ad5e300) 00010000:00010000:2.0:1763333178.149457:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333178.149460:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c58035 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333178.149465:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c58035 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333178.149507:0:29240:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c58027 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0b3 expref: 254 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.149518:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a0be00) 00010000:00010000:2.0:1763333178.149520:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333178.149523:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c58027 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0b3 expref: 254 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.149543:0:29240:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45034c00, rc 0) 00000100:00100000:2.0:1763333178.149626:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:56913:x1848987613817984:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 2000us (3228us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333178.149636:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9579 00000100:00100000:1.0:1763333178.150741:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.150790:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613818240 00000100:00100000:2.0:1763333178.150800:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613818240 00000100:00100000:2.0:1763333178.150901:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9580 00000100:00100000:2.0:1763333178.150912:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74035f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:56911:x1848987613818240:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:2.0:1763333178.151427:0:29240:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333178.151460:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034800/0xb32e3ef184c58004 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0a5 expref: 253 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.151482:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c9:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:2.0:1763333178.151487:0:29240:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333178.151525:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c5803c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:2.0:1763333178.151539:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c5803c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:2.0:1763333178.151549:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c5803c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00000040:00080000:2.0:1763333178.151833:0:29240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1492, 88 off125584 00000004:00080000:2.0:1763333178.151842:0:29240:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1282231492853ns, next at 1282258802447ns, rc = 0 00000040:00080000:2.0:1763333178.151889:0:29240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1493, 88 off125584 00000004:00080000:2.0:1763333178.151894:0:29240:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1282231545371ns, next at 1282771249577ns, rc = 0 00000040:00080000:2.0:1763333178.151921:0:29240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1494, 88 off125672 00000004:00080000:2.0:1763333178.151927:0:29240:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1282231577620ns, next at 1282771249577ns, rc = 0 00000040:00080000:2.0:1763333178.151937:0:29240:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1493, 88 off125672 00000004:00080000:2.0:1763333178.151941:0:29240:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1282231591828ns, next at 1282258802447ns, rc = 0 00000100:00100000:0.0:1763333178.158289:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333178.158371:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613818368 00000100:00100000:3.0:1763333178.158386:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613818368 00000100:00100000:3.0:1763333178.158504:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9581 00000100:00100000:3.0:1763333178.158515:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+254:56913:x1848987613818368:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333178.158542:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333178.158572:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff40030a00/0xb32e3ef184c58043 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a0ba expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.158653:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff40030600/0xb32e3ef184c5804a lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333178.158669:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff40030600/0xb32e3ef184c5804a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.158680:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff40030600/0xb32e3ef184c5804a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.158693:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c58051 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333178.158703:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c58051 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.158709:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c58051 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.158756:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff40030600/0xb32e3ef184c5804a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.158762:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff40030600/0xb32e3ef184c5804a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.158767:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff40030600/0xb32e3ef184c5804a lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.158774:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff40030600/0xb32e3ef184c5804a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.158780:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff40030600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333178.158784:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff40030600/0xb32e3ef184c5804a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.158791:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff40030600/0xb32e3ef184c5804a lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.158803:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055ae00) 00010000:00010000:3.0:1763333178.158806:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333178.158810:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff40030600/0xb32e3ef184c5804a lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.158816:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff40030600/0xb32e3ef184c5804a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.158831:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c58051 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.158837:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c58051 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.158843:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c58051 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.158848:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4874aa00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333178.158851:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c58051 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.158856:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c58051 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.158860:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57fef lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.158872:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57fef lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.158878:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57fef lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.159052:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff4ad5e300) 00010000:00010000:3.0:1763333178.159056:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333178.159059:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c58051 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.159065:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c58051 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.159097:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff40030a00/0xb32e3ef184c58043 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0ba expref: 255 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.159108:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055ae00) 00010000:00010000:3.0:1763333178.159110:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333178.159113:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff40030a00/0xb32e3ef184c58043 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0ba expref: 255 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.159128:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff40030a00, rc 0) 00010000:00010000:2.0:1763333178.159173:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4874ae00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333178.159177:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57fef lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.159184:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57fef lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.159192:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff4ad5e300) 00010000:00010000:2.0:1763333178.159194:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333178.159197:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57fef lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.159203:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c57fef lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000100:00100000:3.0:1763333178.159212:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+254:56913:x1848987613818368:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 699us (947us total) trans 0 rc 301/301 00000100:00100000:3.0:1763333178.159221:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9581 00000001:00080000:1.0:1763333178.159276:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972556 is committed 00000004:00080000:1.0:1763333178.159286:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 976 committed 00000100:00100000:2.0:1763333178.160305:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627301632:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333178.160432:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333178.160508:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627301632 00000100:00100000:0.0:1763333178.160516:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627301632 00000100:00100000:0.0:1763333178.160564:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6779 00000100:00100000:0.0:1763333178.160572:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+17:3655:x1848987627301632:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333178.161012:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+18:3655:x1848987627301632:12345-0@lo:2:osp-syn-1-1.0 Request processed in 439us (578us total) trans 17179871692 rc 0/0 00000100:00100000:0.0:1763333178.161021:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6779 00000004:00080000:1.0:1763333178.161022:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 980 committed 00000004:00080000:1.0:1763333178.161040:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 979 committed 00000004:00080000:1.0:1763333178.161043:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 975 committed 00000100:00100000:1.0:1763333178.161094:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627301760:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333178.161128:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333178.161198:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627301760 00000100:00100000:0.0:1763333178.161203:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627301760 00000004:00010000:1.0:1763333178.161224:0:29240:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c3f19b21 reply state 00000000f933678d transno 4294972556 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c5803c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00000100:00100000:0.0:1763333178.161224:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6780 00000100:00100000:0.0:1763333178.161229:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74035180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+18:3652:x1848987627301760:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1763333178.161247:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c5803c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333178.161256:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c9:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:1.0:1763333178.161259:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1763333178.161264:0:29240:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00002000:00010000:0.0:1763333178.161288:0:8406:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x256:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333178.161292:0:8406:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x256:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763333178.161294:0:8406:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x256:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333178.161296:0:8406:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x256:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763333178.161298:0:8406:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x256:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333178.161343:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74035180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+19:3652:x1848987627301760:12345-0@lo:2:osp-syn-1-1.0 Request processed in 113us (214us total) trans 17179871693 rc 0/0 00000100:00100000:0.0:1763333178.161371:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6780 00000100:00100000:0.0:1763333178.161405:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627301888:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333178.161422:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627302016:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333178.161486:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333178.161494:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333178.161514:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627301888 00000100:00100000:3.0:1763333178.161518:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627302016 00000100:00100000:0.0:1763333178.161518:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627301888 00000100:00100000:3.0:1763333178.161521:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627302016 00000004:00080000:2.0:1763333178.161573:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44e04700/2, rc 0, transno 17179871692 00000100:00100000:2.0:1763333178.161579:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627301632:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333178.161752:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6781 00000100:00100000:0.0:1763333178.161759:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e0f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+47:3653:x1848987627301888:12345-0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1763333178.161767:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44e06300/2, rc 0, transno 17179871693 00000100:00100000:1.0:1763333178.161771:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627301760:0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1763333178.161839:0:8406:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x255:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333178.161842:0:8406:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x255:0x0] updating lvb mtime from disk: 1763333178 -> 1763333178 00002000:00010000:0.0:1763333178.161844:0:8406:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x255:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333178.161847:0:8406:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x255:0x0] updating lvb ctime from disk: 1763333178 -> 1763333178 00002000:00010000:0.0:1763333178.161849:0:8406:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x255:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333178.161875:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e0f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+48:3653:x1848987627301888:12345-0@lo:2:osp-syn-0-1.0 Request processed in 117us (389us total) trans 21474838997 rc 0/0 00000100:00100000:0.0:1763333178.161881:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6781 00000100:00100000:0.0:1763333178.162077:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6782 00000100:00100000:0.0:1763333178.162084:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+47:3654:x1848987627302016:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1763333178.162127:0:8406:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x256:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333178.162130:0:8406:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x256:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763333178.162132:0:8406:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x256:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333178.162134:0:8406:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x256:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763333178.162136:0:8406:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x256:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333178.162161:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+48:3654:x1848987627302016:12345-0@lo:2:osp-syn-0-1.0 Request processed in 77us (665us total) trans 21474838998 rc 0/0 00000100:00100000:0.0:1763333178.162165:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6782 00000004:00080000:0.0:1763333178.162277:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44e07100/2, rc 0, transno 21474838997 00000100:00100000:0.0:1763333178.162281:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627301888:0@lo:2:osp-syn-0-1.0 00010000:00080000:1.0:1763333178.162282:0:29240:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1763333178.162298:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74035f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56911:x1848987613818240:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 11387us (11563us total) trans 4294972556 rc 0/0 00000100:00100000:1.0:1763333178.162306:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9580 00010000:00010000:1.0:1763333178.162334:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c5803c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333178.162344:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c5803c lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00000004:00080000:3.0:1763333178.162447:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44e05880/2, rc 0, transno 21474838998 00000100:00100000:3.0:1763333178.162452:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627302016:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1763333178.162693:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c5803c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333178.162700:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe44c39000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333178.162704:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c5803c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333178.162712:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c5803c lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333178.162726:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c9:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:1.0:1763333178.162730:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763333178.162735:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c5803c lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333178.162742:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c5803c lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00000100:00100000:0.0:1763333178.166822:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333178.166893:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.167692:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613818496 00000100:00100000:2.0:1763333178.167708:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613818496 00000100:00100000:3.0:1763333178.167729:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613818624 00000100:00100000:3.0:1763333178.167734:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613818624 00000100:00100000:3.0:1763333178.167789:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9582 00000100:00100000:2.0:1763333178.167795:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9583 00000100:00100000:3.0:1763333178.167801:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56913:x1848987613818624:12345-192.168.204.28@tcp:101:lfs.0 00000100:00100000:2.0:1763333178.167802:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+246:56911:x1848987613818496:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333178.167834:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333178.167834:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333178.167860:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c5805f lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a0c8 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.167860:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c58058 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a0c1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.167926:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c58058 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0c1 expref: 248 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.167935:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c58066 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333178.167944:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c58066 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.167944:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c58058 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0c1 expref: 248 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.167964:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c9:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:2.0:1763333178.167968:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333178.167973:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe44c38800, rc 0) 00000100:00100000:2.0:1763333178.168057:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:56911:x1848987613818496:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 254us (1251us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333178.168065:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9583 00010000:00010000:3.0:1763333178.168255:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c58066 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:3.0:1763333178.168305:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1763333178.168311:0:8606:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1763333178.168407:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c5805f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0c8 expref: 248 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.168439:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c58066 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0c8 expref: 247 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.168447:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055ae00) 00010000:00010000:3.0:1763333178.168450:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1763333178.168452:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4874b000, rc 0) 00000100:00100000:3.0:1763333178.168479:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56913:x1848987613818624:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 681us (1585us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333178.168485:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9582 00000100:00100000:1.0:1763333178.173869:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333178.173956:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613818752 00000100:00100000:3.0:1763333178.173970:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613818752 00000100:00100000:3.0:1763333178.174051:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9584 00000100:00100000:3.0:1763333178.174064:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74034000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56913:x1848987613818752:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333178.174093:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333178.174128:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c5806d lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a0cf expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.174225:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c58074 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333178.174243:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c58074 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.174256:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c58074 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.174272:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff40030a00/0xb32e3ef184c5807b lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333178.174290:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff40030a00/0xb32e3ef184c5807b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.174297:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff40030a00/0xb32e3ef184c5807b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.174346:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c58074 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.174398:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c58074 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.174405:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c58074 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.174412:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c58074 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.174427:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4874ae00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333178.174432:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c58074 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.174440:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c58074 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.174453:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055ae00) 00010000:00010000:3.0:1763333178.174457:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333178.174463:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c58074 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.174470:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874ae00/0xb32e3ef184c58074 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.174487:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff40030a00/0xb32e3ef184c5807b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.174493:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff40030a00/0xb32e3ef184c5807b lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.174499:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff40030a00/0xb32e3ef184c5807b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.174504:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff40030a00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333178.174507:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff40030a00/0xb32e3ef184c5807b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.174512:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff40030a00/0xb32e3ef184c5807b lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.174519:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6055af00) 00010000:00010000:3.0:1763333178.174522:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333178.174524:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff40030a00/0xb32e3ef184c5807b lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.174530:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff40030a00/0xb32e3ef184c5807b lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.174571:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c5806d lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0cf expref: 248 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.174583:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055ae00) 00010000:00010000:3.0:1763333178.174585:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333178.174589:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874a600/0xb32e3ef184c5806d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0cf expref: 248 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.174598:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4874a600, rc 0) 00000100:00100000:3.0:1763333178.174680:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74034000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:56913:x1848987613818752:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 619us (825us total) trans 0 rc 301/301 00000100:00100000:3.0:1763333178.174689:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9584 00000100:00100000:1.0:1763333178.177959:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333178.178398:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333178.178491:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613818880 00000100:00100000:3.0:1763333178.178504:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613818880 00000100:00100000:3.0:1763333178.178562:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613819136 00000100:00100000:3.0:1763333178.178565:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613819136 00000100:00100000:3.0:1763333178.178596:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9585 00000100:00100000:3.0:1763333178.178605:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74036300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:56911:x1848987613818880:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333178.178630:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333178.178655:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff40030600/0xb32e3ef184c58082 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a0d6 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.178745:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c58089 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333178.178762:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c58089 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.178774:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c58089 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:3.0:1763333178.178830:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1c9:0x0]: returning size 5 00000004:00200000:3.0:1763333178.178835:0:8606:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763333178.178857:0:8606:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c58089 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.178885:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff40030600/0xb32e3ef184c58082 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0d6 expref: 250 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.178909:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c58089 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0d6 expref: 249 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.178926:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c9:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:3.0:1763333178.178929:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1763333178.178934:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4874aa00, rc 0) 00000100:00100000:3.0:1763333178.179001:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74036300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:56911:x1848987613818880:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 396us (1069us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333178.179009:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9585 00000100:00100000:3.0:1763333178.179031:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9586 00000100:00100000:3.0:1763333178.179037:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74037100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:56913:x1848987613819136:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333178.179045:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333178.179048:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763333178.179069:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874b000/0xb32e3ef184c58066 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0c8 expref: 248 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.179079:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055ae00) 00010000:00010000:3.0:1763333178.179090:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333178.179100:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c58090 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a0dd expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.179189:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c58097 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333178.179197:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c58097 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.179205:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c58097 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.179218:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5809e lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333178.179226:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5809e lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.179232:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5809e lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.179827:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c580a5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333178.179840:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c580a5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.179850:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c580a5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:3.0:1763333178.179860:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ca:0x0]: returning size 0 00010000:00010000:3.0:1763333178.179912:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c58097 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.179921:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c58097 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.179929:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c58097 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.179937:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c58097 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.179947:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333178.179953:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c58097 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.179962:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c58097 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.179978:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055ad00) 00010000:00010000:3.0:1763333178.179981:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333178.179985:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c58097 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.179992:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c58097 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000004:00010000:3.0:1763333178.180004:0:8606:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b2960230 reply state 0000000021cbdf03 transno 4294972557 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5809e lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.180015:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5809e lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.180021:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6055a500) 00010000:00010000:3.0:1763333178.180024:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763333178.180026:0:8606:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763333178.180855:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c58090 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0dd expref: 250 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.180887:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c580a5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0dd expref: 249 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.180895:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ca:0x0].0x0 (ffff92ff6055a000) 00010000:00010000:2.0:1763333178.180898:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333178.180900:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feb400, rc 0) 00000100:00100000:2.0:1763333178.180985:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74037100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:56913:x1848987613819136:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1946us (2586us total) trans 4294972557 rc 0/0 00000100:00100000:2.0:1763333178.180995:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9586 00000100:00100000:1.0:1763333178.183848:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.184055:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613819264 00000100:00100000:2.0:1763333178.184070:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613819264 00000100:00100000:2.0:1763333178.184197:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6783 00000100:00100000:2.0:1763333178.184210:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74037480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2421:x1848987613819264:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333178.184236:0:28651:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333178.184271:0:28651:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c580b3 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a0e4 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763333178.184302:0:28651:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x255:0x0] initial LVB size: 5, mtime: 0x691a543a, atime: 0x0, ctime: 0x691a543a, blocks: 0x8 00010000:00010000:2.0:1763333178.184328:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333178.184331:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333178.184345:0:28651:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c580b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0e4 expref: 18 pid: 28651 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333178.184454:0:28651:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c580b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0e4 expref: 18 pid: 28651 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333178.184478:0:28651:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe44c39000, rc 0) 00000100:00100000:2.0:1763333178.184563:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74037480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2421:x1848987613819264:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 356us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333178.184575:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6783 00000100:00100000:1.0:1763333178.189583:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.189706:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613819520 00000100:00100000:2.0:1763333178.189722:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613819520 00000100:00100000:2.0:1763333178.189809:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9587 00000100:00100000:2.0:1763333178.189822:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:56913:x1848987613819520:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333178.189857:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333178.189886:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034800/0xb32e3ef184c580ba lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a0eb expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.190043:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c580c1 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333178.190063:0:8606:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c580a5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0dd expref: 251 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.190073:0:8606:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c580c1 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.190124:0:8606:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c580a5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0dd expref: 251 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.190140:0:8606:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c580a5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0dd expref: 251 pid: 8606 timeout: 1382 lvb_type: 0 00000100:00100000:2.0:1763333178.190158:0:8606:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627302144:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333178.190302:0:8606:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff6b0c2540 going to sleep for 11 seconds 00000100:00100000:1.0:1763333178.194687:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333178.195021:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613819648 00000100:00100000:3.0:1763333178.195038:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613819648 00010000:00010000:3.0:1763333178.195099:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c580a5 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0dd expref: 252 pid: 8606 timeout: 1382 lvb_type: 0 00000100:00100000:3.0:1763333178.195154:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3158 00000100:00100000:3.0:1763333178.195165:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50e6b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:2420:x1848987613819648:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333178.195185:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333178.195194:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c580a5 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0dd expref: 252 pid: 8606 timeout: 1382 lvb_type: 0 00010000:00010000:3.0:1763333178.195210:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c580a5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0dd expref: 252 pid: 8606 timeout: 1382 lvb_type: 0 00010000:00010000:3.0:1763333178.195249:0:28428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ca:0x0].0x0 (ffff92ff6055a000) 00010000:00010000:3.0:1763333178.195256:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c580c1 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.195270:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c580c1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.195279:0:28428:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c580c1 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.195309:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333178.195423:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50e6b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:2420:x1848987613819648:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 251us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333178.195432:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3158 00010000:00010000:2.0:1763333178.195711:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c580a5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0dd expref: 252 pid: 8606 timeout: 1382 lvb_type: 0 00000100:00100000:2.0:1763333178.195730:0:8606:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8606:1848987627302144:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333178.195757:0:8606:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c580c1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.195768:0:8606:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c580c1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.195774:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c580c1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:2.0:1763333178.195805:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ca:0x0]: returning size 0 00000004:00080000:2.0:1763333178.197393:0:8606:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x257:0x0], index 0: 0 00000004:00080000:2.0:1763333178.197411:0:8606:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x257:0x0], index 1: 0 00000004:00080000:2.0:1763333178.197428:0:8606:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x258:0x0], index 1: 0 00000004:00080000:2.0:1763333178.197432:0:8606:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x258:0x0], index 0: 0 00010000:00010000:2.0:1763333178.198093:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c580c1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.198111:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c580c1 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.198120:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c580c1 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.198127:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45034c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333178.198132:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c580c1 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.198142:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c580c1 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.198166:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ca:0x0].0x0 (ffff92ff6055a000) 00010000:00010000:2.0:1763333178.198169:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333178.198174:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c580c1 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.198181:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c580c1 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.198263:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034800/0xb32e3ef184c580ba lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1ca:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0eb expref: 251 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.198276:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ca:0x0].0x0 (ffff92ff6055a000) 00010000:00010000:2.0:1763333178.198278:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763333178.198282:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034800/0xb32e3ef184c580ba lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1ca:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0eb expref: 251 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.198300:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45034800, rc 0) 00000100:00100000:2.0:1763333178.198453:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:56913:x1848987613819520:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 8633us (8884us total) trans 4294972558 rc 301/301 00000100:00100000:2.0:1763333178.198466:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9587 00000100:00100000:1.0:1763333178.203048:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.205490:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613819904 00000100:00100000:2.0:1763333178.205516:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613819904 00000100:00100000:2.0:1763333178.205627:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3274 00000100:00100000:2.0:1763333178.205640:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74034380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:56913:x1848987613819904:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333178.206058:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74034380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:56913:x1848987613819904:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 420us (3021us total) trans 4294972559 rc 0/0 00000100:00100000:2.0:1763333178.206068:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3274 00000100:00100000:3.0:1763333178.209541:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333178.209678:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613820160 00000100:00100000:1.0:1763333178.209692:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613820160 00000100:00100000:1.0:1763333178.209769:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3275 00000100:00100000:1.0:1763333178.209781:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:56913:x1848987613820160:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1763333178.210119:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:56913:x1848987613820160:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 339us (593us total) trans 4294972560 rc 0/0 00000100:00100000:1.0:1763333178.210127:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3275 00000100:00100000:1.0:1763333178.217843:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.218384:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613820416 00000100:00100000:2.0:1763333178.218398:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613820416 00000100:00100000:2.0:1763333178.218482:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9588 00000100:00100000:2.0:1763333178.218492:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:55917:x1848987613820416:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333178.218524:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333178.218553:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c580cf lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a0f2 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.218731:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034400/0xb32e3ef184c580d6 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333178.218748:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034400/0xb32e3ef184c580d6 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.218761:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034400/0xb32e3ef184c580d6 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.218778:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c580dd lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333178.218786:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c580dd lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.218792:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c580dd lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.218870:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c580e4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333178.218877:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c580e4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.218884:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c580e4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:2.0:1763333178.218895:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ca:0x0]: returning size 0 00010000:00010000:2.0:1763333178.219229:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034400/0xb32e3ef184c580d6 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.219237:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034400/0xb32e3ef184c580d6 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.219247:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034400/0xb32e3ef184c580d6 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.219254:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034400/0xb32e3ef184c580d6 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.219260:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45034400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333178.219264:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034400/0xb32e3ef184c580d6 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.219273:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034400/0xb32e3ef184c580d6 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.219287:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a0bc00) 00010000:00010000:2.0:1763333178.219290:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333178.219296:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034400/0xb32e3ef184c580d6 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.219303:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034400/0xb32e3ef184c580d6 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.219322:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c580dd lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.219327:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c580dd lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.219332:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c580dd lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.219336:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700ce00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333178.219339:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c580dd lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.220055:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c580dd lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.220074:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6055a500) 00010000:00010000:2.0:1763333178.220077:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333178.220082:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c580dd lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.220089:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c580dd lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.221263:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45034c00/0xb32e3ef184c580cf lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0f2 expref: 255 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.221303:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c580e4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0f2 expref: 254 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.221311:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ca:0x0].0x0 (ffff92fe43a0ba00) 00010000:00010000:0.0:1763333178.221314:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333178.221317:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4700c200, rc 0) 00000100:00100000:0.0:1763333178.221437:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+254:55917:x1848987613820416:12345-192.168.204.28@tcp:101:bash.0 Request processed in 2944us (3607us total) trans 4294972561 rc 0/0 00000100:00100000:0.0:1763333178.221446:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9588 00000100:00100000:2.0:1763333178.224312:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333178.224527:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613820544 00000100:00100000:0.0:1763333178.224543:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613820544 00000100:00100000:1.0:1763333178.224664:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9589 00000100:00100000:1.0:1763333178.224678:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+254:55917:x1848987613820544:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333178.224712:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333178.224740:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c580f2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a0f9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.224789:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c580f9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333178.224806:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c580f9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333178.224819:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c580f9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333178.225031:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c580f2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0f9 expref: 256 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.225051:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c580f9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0f9 expref: 255 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.225061:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ca:0x0].0x0 (ffff92fe43a0ba00) 00010000:00010000:1.0:1763333178.225064:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763333178.225068:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48190200, rc 0) 00000100:00100000:1.0:1763333178.225193:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+255:55917:x1848987613820544:12345-192.168.204.28@tcp:101:bash.0 Request processed in 518us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333178.225201:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9589 00000100:00100000:3.0:1763333178.228778:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.228964:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613820800 00000100:00100000:2.0:1763333178.228980:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613820800 00000100:00100000:2.0:1763333178.229081:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9590 00000100:00100000:2.0:1763333178.229092:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+255:55917:x1848987613820800:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:2.0:1763333178.229167:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333178.229211:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c580e4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0f2 expref: 255 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.229241:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ca:0x0].0x0 (ffff92fe43a0ba00) 00010000:00010000:2.0:1763333178.229250:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333178.229588:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c58100 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333178.229605:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c58100 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.229617:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c58100 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000001:00080000:2.0:1763333178.229684:0:6519:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294972562 00000004:00010000:2.0:1763333178.229713:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000af46c59f reply state 000000000e55881f transno 4294972563 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c58100 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.229726:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c58100 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.229732:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ca:0x0].0x0 (ffff92fe43a0ba00) 00010000:00010000:2.0:1763333178.229735:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333178.229738:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763333178.229868:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+257:55917:x1848987613820800:12345-192.168.204.28@tcp:36:bash.0 Request processed in 775us (1105us total) trans 4294972563 rc 0/0 00000100:00100000:2.0:1763333178.229878:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9590 00000020:00080000:2.0:1763333178.229885:0:6519:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763333178.233126:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.233195:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613820928 00000100:00100000:2.0:1763333178.233213:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613820928 00000100:00100000:2.0:1763333178.233301:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9591 00000100:00100000:2.0:1763333178.233312:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+257:55917:x1848987613820928:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333178.233344:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333178.233407:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c600/0xb32e3ef184c58107 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a100 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.233520:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c600/0xb32e3ef184c58107 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a100 expref: 258 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.233543:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c600/0xb32e3ef184c58107 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a100 expref: 258 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.233571:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ca:0x0].0x0 (ffff92fe43a0ba00) 00010000:00010000:2.0:1763333178.233576:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333178.233583:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4700c600, rc 0) 00000100:00100000:2.0:1763333178.233683:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+258:55917:x1848987613820928:12345-192.168.204.28@tcp:101:bash.0 Request processed in 372us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333178.233693:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9591 00000100:00100000:1.0:1763333178.237815:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333178.238622:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613821184 00000100:00100000:0.0:1763333178.238641:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613821184 00000100:00100000:0.0:1763333178.238765:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9592 00000100:00100000:0.0:1763333178.238784:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+258:55917:x1848987613821184:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333178.238815:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333178.238820:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763333178.238868:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c600/0xb32e3ef184c58107 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a100 expref: 258 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.238901:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ca:0x0].0x0 (ffff92fe43a0ba00) 00010000:00010000:0.0:1763333178.238909:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333178.238931:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85400/0xb32e3ef184c5810e lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a107 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.238998:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c58115 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333178.239018:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c58115 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ca:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.239033:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c58115 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ca:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000040:00080000:0.0:1763333178.241308:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1495, 88 off125760 00000004:00080000:0.0:1763333178.241327:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1282320978002ns, next at 1282771249577ns, rc = 0 00000040:00080000:0.0:1763333178.241425:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1494, 88 off125760 00000004:00080000:0.0:1763333178.241434:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1282321084146ns, next at 1282258802447ns, rc = 0 00000040:00080000:0.0:1763333178.241465:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1495, 88 off125848 00000004:00080000:0.0:1763333178.241471:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1282321121993ns, next at 1282258802447ns, rc = 0 00000040:00080000:0.0:1763333178.241486:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1496, 88 off125848 00000004:00080000:0.0:1763333178.241490:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1282321141458ns, next at 1282771249577ns, rc = 0 00000001:00080000:3.0:1763333178.245102:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972564 is committed 00000004:00080000:3.0:1763333178.245124:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 982 committed 00000004:00080000:3.0:1763333178.245147:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 978 committed 00000004:00080000:3.0:1763333178.245160:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 977 committed 00000004:00080000:3.0:1763333178.245163:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 981 committed 00010000:00010000:1.0:1763333178.245240:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5809e lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.245255:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5809e lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.245265:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5809e lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.245277:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feaa00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333178.245283:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5809e lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.245291:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5809e lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.245312:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff6055a500) 00010000:00010000:1.0:1763333178.245316:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333178.245323:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5809e lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.245330:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5809e lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.245396:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c58100 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333178.245403:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c58100 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333178.245408:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c58100 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333178.245420:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700de00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333178.245423:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c58100 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333178.245429:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c58100 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333178.245438:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ca:0x0].0x0 (ffff92fe43a0ba00) 00010000:00010000:1.0:1763333178.245441:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333178.245444:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c58100 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333178.245450:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c58100 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000100:00100000:3.0:1763333178.245683:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627302272:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333178.245835:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333178.245913:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627302272 00000100:00100000:3.0:1763333178.245922:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627302272 00000100:00100000:1.0:1763333178.246264:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627302400:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333178.246300:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333178.246390:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627302400 00000100:00100000:2.0:1763333178.246396:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627302400 00000100:00100000:3.0:1763333178.246499:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6784 00000100:00100000:3.0:1763333178.246511:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+20:3655:x1848987627302272:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333178.247073:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6785 00000100:00100000:2.0:1763333178.247085:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+21:3652:x1848987627302400:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333178.247202:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+22:3652:x1848987627302400:12345-0@lo:2:osp-syn-1-1.0 Request processed in 119us (900us total) trans 17179871695 rc 0/0 00000004:00080000:1.0:1763333178.247267:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe472f0a80/2, rc 0, transno 17179871695 00000100:00100000:1.0:1763333178.247274:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627302400:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333178.247309:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6785 00000100:00100000:3.0:1763333178.247441:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+21:3655:x1848987627302272:12345-0@lo:2:osp-syn-1-1.0 Request processed in 932us (1606us total) trans 17179871694 rc 0/0 00000100:00100000:3.0:1763333178.247450:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6784 00000004:00080000:2.0:1763333178.247572:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe472f1f80/2, rc 0, transno 17179871694 00000100:00100000:2.0:1763333178.247577:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627302272:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333178.249664:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1763333178.249702:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe469a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627302656:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333178.249806:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1763333178.249956:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c58115 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1ca:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a107 expref: 250 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.249972:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ca:0x0].0x0 (ffff92fe43a0ba00) 00010000:00010000:0.0:1763333178.249976:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763333178.250001:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85400/0xb32e3ef184c5810e lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a107 expref: 250 pid: 8606 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1763333178.250030:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c58115 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1ca:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a107 expref: 249 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.250083:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ca:0x0].0x0 (ffff92fe43a0ba00) 00010000:00010000:0.0:1763333178.250086:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763333178.250089:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45c84600, rc 0) 00000100:00100000:0.0:1763333178.250528:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:55917:x1848987613821184:12345-192.168.204.28@tcp:101:bash.0 Request processed in 11747us (12725us total) trans 4294972564 rc 0/0 00000100:00100000:0.0:1763333178.250539:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9592 00000100:00100000:3.0:1763333178.250902:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627302656 00000100:00100000:3.0:1763333178.250913:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627302656 00000100:00100000:3.0:1763333178.250986:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6786 00000100:00100000:3.0:1763333178.250997:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+48:3655:x1848987627302656:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333178.251078:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763333178.251097:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42f0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627302528:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333178.251153:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333178.251192:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627302528 00000100:00100000:1.0:1763333178.251197:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627302528 00000100:00100000:1.0:1763333178.251226:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6787 00000100:00100000:1.0:1763333178.251233:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+50:3652:x1848987627302528:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333178.251242:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+50:3655:x1848987627302656:12345-0@lo:2:osp-syn-0-1.0 Request processed in 245us (1435us total) trans 21474838999 rc 0/0 00000100:00100000:3.0:1763333178.251251:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6786 00000004:00080000:3.0:1763333178.251307:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe469a0a80/2, rc 0, transno 21474838999 00000100:00100000:3.0:1763333178.251314:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe469a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627302656:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333178.251323:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+50:3652:x1848987627302528:12345-0@lo:2:osp-syn-0-1.0 Request processed in 88us (169us total) trans 21474839000 rc 0/0 00000100:00100000:1.0:1763333178.251331:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6787 00000004:00080000:1.0:1763333178.251386:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe42f0d180/2, rc 0, transno 21474839000 00000100:00100000:1.0:1763333178.251391:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42f0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627302528:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333178.254986:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333178.255168:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613821312 00000100:00100000:0.0:1763333178.255181:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613821312 00000100:00100000:0.0:1763333178.255259:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6788 00000100:00100000:0.0:1763333178.255270:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1370b1d7-8612-4b90-ab37-e53288bbf9fd+28:55917:x1848987613821312:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333178.255295:0:29010:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333178.255324:0:29010:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c5811c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a10e expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763333178.255493:0:29010:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x257:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333178.255523:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333178.255526:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333178.255538:0:29010:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c5811c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a10e expref: 29 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.255558:0:29010:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c5811c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a10e expref: 29 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.255572:0:29010:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45c84400, rc 0) 00000100:00100000:0.0:1763333178.255648:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:55917:x1848987613821312:12345-192.168.204.28@tcp:101:bash.0 Request processed in 379us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333178.255660:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6788 00000100:00100000:0.0:1763333178.261679:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.262842:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613821440 00000100:00100000:2.0:1763333178.262859:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613821440 00000100:00100000:2.0:1763333178.262946:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6789 00000100:00100000:2.0:1763333178.262959:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:55917:x1848987613821440:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333178.262985:0:29010:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333178.263013:0:29010:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c58123 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a115 expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763333178.263043:0:29010:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x257:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763333178.263071:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333178.263074:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333178.263085:0:29010:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c58123 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a115 expref: 19 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.263108:0:29010:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c58123 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a115 expref: 19 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.263122:0:29010:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4700c200, rc 0) 00000100:00100000:2.0:1763333178.263197:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:55917:x1848987613821440:12345-192.168.204.28@tcp:101:bash.0 Request processed in 241us (1534us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333178.263204:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6789 00000100:00100000:1.0:1763333178.268299:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333178.268394:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613821568 00000100:00100000:3.0:1763333178.268409:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613821568 00000100:00100000:1.0:1763333178.268409:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.268481:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613821696 00000100:00100000:2.0:1763333178.268487:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613821696 00002000:00010000:3.0:1763333178.268524:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/599 (0->18446744073709551615) 00002000:00010000:2.0:1763333178.268524:0:16635:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/599 (0->18446744073709551615) 00002000:00100000:3.0:1763333178.268530:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe438ab100 with x1848987613821568 ext(0->18446744073709551615) 00002000:00100000:2.0:1763333178.268530:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe438a9180 with x1848987613821696 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333178.268546:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe438ab100. 00002000:00010000:2.0:1763333178.268546:0:16635:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe438a9180. 00000100:00100000:3.0:1763333178.268593:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1665 00000100:00100000:3.0:1763333178.268605:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:2420:x1848987613821568:12345-192.168.204.28@tcp:10:bash.0 00000100:00100000:2.0:1763333178.268608:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1666 00000100:00100000:2.0:1763333178.268615:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2420:x1848987613821696:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:2.0:1763333178.268841:0:16635:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x257:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333178.268845:0:16635:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x257:0x0] updating lvb mtime from disk: 0 -> 1763333178 00002000:00010000:2.0:1763333178.268847:0:16635:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x257:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333178.268850:0:16635:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x257:0x0] updating lvb ctime from disk: 0 -> 1763333178 00002000:00010000:2.0:1763333178.268852:0:16635:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x257:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1763333178.268863:0:28427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x257:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333178.268866:0:28427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x257:0x0] updating lvb mtime from disk: 0 -> 1763333178 00002000:00010000:3.0:1763333178.268868:0:28427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x257:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333178.268870:0:28427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x257:0x0] updating lvb ctime from disk: 0 -> 1763333178 00002000:00010000:3.0:1763333178.268872:0:28427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x257:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333178.269177:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2420:x1848987613821696:12345-192.168.204.28@tcp:10:bash.0 Request processed in 560us (766us total) trans 17179871696 rc 0/0 00000100:00100000:3.0:1763333178.269185:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:2420:x1848987613821568:12345-192.168.204.28@tcp:10:bash.0 Request processed in 571us (897us total) trans 21474839001 rc 0/0 00000100:00100000:2.0:1763333178.269187:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1666 00002000:00010000:2.0:1763333178.269192:0:16635:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/599 (0->18446744073709551615) 00002000:00100000:2.0:1763333178.269195:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe438a9180 with x1848987613821696 ext(0->18446744073709551615) 00000100:00100000:3.0:1763333178.269197:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1665 00002000:00010000:3.0:1763333178.269199:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/599 (0->18446744073709551615) 00002000:00100000:3.0:1763333178.269202:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe438ab100 with x1848987613821568 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333178.269202:0:16635:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe438a9180. 00002000:00010000:3.0:1763333178.269206:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe438ab100. 00000100:00100000:1.0:1763333178.269854:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333178.269926:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613821824 00000100:00100000:3.0:1763333178.269934:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613821824 00000100:00100000:3.0:1763333178.270475:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6790 00000100:00100000:3.0:1763333178.270487:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2418:x1848987613821824:12345-192.168.204.28@tcp:23:lfs.0 00000100:00100000:3.0:1763333178.270615:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2418:x1848987613821824:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 130us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333178.270623:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6790 00000100:00100000:0.0:1763333178.276009:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333178.276077:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333178.276333:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613821952 00000100:00100000:3.0:1763333178.276392:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613821952 00000100:00100000:3.0:1763333178.276566:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6791 00000100:00100000:3.0:1763333178.276579:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2421:x1848987613821952:12345-192.168.204.28@tcp:23:lfs.0 00000100:00100000:3.0:1763333178.276756:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2421:x1848987613821952:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 179us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333178.276765:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6791 00000100:00100000:2.0:1763333178.277249:0:35317:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613822208 00000100:00100000:2.0:1763333178.277256:0:35317:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613822208 00000100:00100000:2.0:1763333178.277313:0:35317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3276 00000100:00100000:2.0:1763333178.277322:0:35317:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6b3eec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:55917:x1848987613822208:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:2.0:1763333178.277787:0:35317:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6b3eec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:55917:x1848987613822208:12345-192.168.204.28@tcp:35:bash.0 Request processed in 464us (1707us total) trans 4294972565 rc 0/0 00000100:00100000:2.0:1763333178.277796:0:35317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3276 00000100:00100000:0.0:1763333178.287756:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333178.288030:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613822336 00000100:00100000:3.0:1763333178.288045:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613822336 00000100:00100000:3.0:1763333178.288475:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1667 00000100:00100000:3.0:1763333178.288489:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2420:x1848987613822336:12345-192.168.204.28@tcp:3:lfs.0 00010000:00010000:3.0:1763333178.288558:0:28427:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5812a lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x255:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.288586:0:28427:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333178.288589:0:28427:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333178.288598:0:28427:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5812a lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x255:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.288616:0:28427:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5812a lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x255:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.288776:0:28427:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5812a lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x255:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.288786:0:28427:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5812a lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x255:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.288795:0:28427:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5812a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x255:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.288803:0:28427:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea200 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333178.288809:0:28427:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5812a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x255:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.288820:0:28427:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5812a lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x255:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.288841:0:28427:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5812a lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x255:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.288849:0:28427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5812a lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x255:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333178.288945:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2420:x1848987613822336:12345-192.168.204.28@tcp:3:lfs.0 Request processed in 459us (1205us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1763333178.288954:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1667 00000100:00100000:1.0:1763333178.299976:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333178.300273:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613822464 00000100:00100000:0.0:1763333178.300287:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613822464 00000100:00100000:3.0:1763333178.301169:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333178.302183:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613822592 00000100:00100000:0.0:1763333178.302199:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613822592 00000100:00100000:0.0:1763333178.302283:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9593 00000100:00100000:0.0:1763333178.302296:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:56914:x1848987613822464:12345-192.168.204.28@tcp:101:rm.0 00010000:00010000:0.0:1763333178.302331:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333178.302390:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85400/0xb32e3ef184c58131 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a11c expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.302509:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c58138 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333178.302527:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c58138 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.302542:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c58138 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.302558:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c5813f lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333178.302565:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c5813f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.302572:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c5813f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.302680:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c58146 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333178.302690:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c58146 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.302697:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c58146 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:0.0:1763333178.302748:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ca:0x0]: returning size 5 00000004:00200000:0.0:1763333178.302753:0:8606:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763333178.302779:0:8606:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c58146 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.302794:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c58146 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.302803:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c58138 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.302810:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c58138 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.302817:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c58138 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.302824:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c58138 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.302831:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c84c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333178.302836:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c58138 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.302845:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c58138 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.302860:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44800) 00010000:00010000:0.0:1763333178.302864:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333178.302871:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c58138 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.302877:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84c00/0xb32e3ef184c58138 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.302894:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c5813f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.302900:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c5813f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.302905:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c5813f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.302910:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c84200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333178.302913:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c5813f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.302918:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c5813f lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.302924:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b44300) 00010000:00010000:0.0:1763333178.302927:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333178.302929:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c5813f lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.302935:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84200/0xb32e3ef184c5813f lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.302968:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85400/0xb32e3ef184c58131 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a11c expref: 253 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.302987:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c58146 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a11c expref: 252 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.302995:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ca:0x0].0x0 (ffff92fe43a0ba00) 00010000:00010000:0.0:1763333178.302998:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333178.303001:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45c85e00, rc 0) 00000100:00100000:0.0:1763333178.303086:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:56914:x1848987613822464:12345-192.168.204.28@tcp:101:rm.0 Request processed in 793us (3127us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333178.303095:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9593 00000100:00100000:0.0:1763333178.303123:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9594 00000100:00100000:0.0:1763333178.303132:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:56911:x1848987613822592:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333178.303143:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333178.303155:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5814d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a123 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.303177:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c58154 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333178.303187:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c58154 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.303194:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c58154 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.303300:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5814d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a123 expref: 253 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.303315:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5c00/0xb32e3ef184c58154 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a123 expref: 252 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.303323:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c9:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:0.0:1763333178.303326:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763333178.303328:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5c00, rc 0) 00000100:00100000:0.0:1763333178.303384:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:56911:x1848987613822592:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 253us (2226us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333178.303391:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9594 00000100:00100000:3.0:1763333178.309475:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333178.309475:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.309586:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613822976 00000100:00100000:2.0:1763333178.309601:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613822976 00000100:00100000:2.0:1763333178.309674:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9595 00000100:00100000:2.0:1763333178.309686:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:56914:x1848987613822976:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:2.0:1763333178.309761:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1763333178.309799:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c58115 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1ca:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a107 expref: 252 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.309826:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c58146 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a11c expref: 251 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.309840:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c580f9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ca:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0f9 expref: 250 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.309853:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ca:0x0].0x0 (ffff92fe43a0ba00) 00010000:00010000:2.0:1763333178.309867:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333178.309909:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c5815b lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333178.309925:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c5815b lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.309965:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c5815b lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.309979:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c58162 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333178.309986:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c58162 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.309991:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c58162 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.310102:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c600/0xb32e3ef184c58169 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333178.310110:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c600/0xb32e3ef184c58169 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.310116:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c600/0xb32e3ef184c58169 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000040:00080000:2.0:1763333178.310709:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1497, 64 off125912 00000040:00080000:2.0:1763333178.310739:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1496, 64 off125912 00000004:00080000:2.0:1763333178.310745:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1282390396271ns, next at 1283390392964ns, rc = 0 00000040:00080000:2.0:1763333178.310756:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1497, 64 off125976 00000040:00080000:2.0:1763333178.310766:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1498, 64 off125976 00010000:00010000:2.0:1763333178.310843:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c58170 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333178.310854:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c58170 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ca:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.310863:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c58170 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ca:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.310872:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c58170 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1ca:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.310878:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c58170 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1ca:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.310884:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c58170 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1ca:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.310915:0:6519:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763333178.310942:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c600/0xb32e3ef184c58169 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.310949:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c600/0xb32e3ef184c58169 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1ca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.310955:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c600/0xb32e3ef184c58169 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1ca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.310961:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700c600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333178.310963:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333178.310967:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c600/0xb32e3ef184c58169 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1ca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333178.310975:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c58170 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1ca:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.310978:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c600/0xb32e3ef184c58169 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1ca:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333178.310992:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4742e000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333178.310998:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ca:0x0].0x0 (ffff92ff7dcb6600) 00010000:00010000:2.0:1763333178.311003:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:0.0:1763333178.311166:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613822720 00000100:00100000:0.0:1763333178.311176:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613822720 00000100:00100000:0.0:1763333178.311256:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1668 00000100:00100000:0.0:1763333178.311266:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:2421:x1848987613822720:12345-192.168.204.28@tcp:4:lfs.0 00010000:00010000:0.0:1763333178.311296:0:28427:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c58177 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x256:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.311313:0:28427:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c57ed7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x256:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a051 expref: 30 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333178.311321:0:28427:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333178.311323:0:28427:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333178.311327:0:28427:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c58177 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x256:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.311389:0:28427:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c57ed7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x256:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a051 expref: 30 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333178.311404:0:28427:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c57ed7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x256:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a051 expref: 30 pid: 8404 timeout: 1382 lvb_type: 1 00000100:00100000:0.0:1763333178.311440:0:28427:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff6bc12680 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_012:lustre-OST0000_UUID:28427:1848987627302784:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333178.311561:0:28427:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff49c92780 going to sleep for 11 seconds 00010000:00010000:2.0:1763333178.314506:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c600/0xb32e3ef184c58169 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1ca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.314527:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c600/0xb32e3ef184c58169 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1ca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.314799:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c5815b lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.314809:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c5815b lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.314814:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c5815b lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.314821:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c5815b lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.314828:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700ce00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333178.314832:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c5815b lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.314841:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c5815b lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.314861:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff7dcb6c00) 00010000:00010000:2.0:1763333178.314865:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333178.314869:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c5815b lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.314874:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c5815b lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:2.0:1763333178.314895:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000ca7fa77 reply state 000000004a43ff1a transno 4294972566 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c58162 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.314909:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c58162 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.314917:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff7dcb6900) 00010000:00010000:2.0:1763333178.315117:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333178.315123:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763333178.315253:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c58170 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1ca:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333178.315265:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c58170 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1ca:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333178.315277:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ca:0x0].0x0 (ffff92ff7dcb6600) 00000100:00100000:2.0:1763333178.315280:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:56914:x1848987613822976:12345-192.168.204.28@tcp:36:rm.0 Request processed in 5587us (5810us total) trans 4294972566 rc 0/0 00010000:00010000:3.0:1763333178.315281:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763333178.315285:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c58170 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1ca:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333178.315295:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c58170 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1ca:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT1 00000100:00100000:2.0:1763333178.315298:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9595 00010000:00010000:3.0:1763333178.315324:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333178.315328:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333178.315331:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763333178.316171:0:28427:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff6bc12680 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_012:lustre-OST0000_UUID:28427:1848987627302784:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333178.316211:0:28427:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c58177 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x256:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333178.318653:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.318788:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613823104 00000100:00100000:2.0:1763333178.318803:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613823104 00010000:00010000:2.0:1763333178.318861:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c57ed7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x256:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a051 expref: 31 pid: 8404 timeout: 1382 lvb_type: 1 00000100:00100000:2.0:1763333178.318915:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3159 00000100:00100000:2.0:1763333178.318988:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+31:2420:x1848987613823104:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333178.319010:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333178.319041:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c57ed7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x256:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a051 expref: 31 pid: 8404 timeout: 1382 lvb_type: 1 00010000:00010000:2.0:1763333178.319057:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c57ed7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x256:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a051 expref: 31 pid: 8404 timeout: 1382 lvb_type: 1 00010000:00010000:2.0:1763333178.319089:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c57ed7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x256:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a051 expref: 31 pid: 8404 timeout: 1382 lvb_type: 1 00010000:00010000:2.0:1763333178.319108:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333178.319112:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333178.319118:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c58177 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x256:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.319129:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c58177 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x256:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.319173:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333178.319481:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:2420:x1848987613823104:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 496us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333178.319491:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3159 00010000:00010000:0.0:1763333178.320112:0:28427:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c58177 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.320126:0:28427:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c58177 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1763333178.324516:0:24714:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839002 is committed 00000001:00080000:1.0:1763333178.324556:0:24714:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839000 is committed 00002000:00010000:1.0:1763333178.325170:0:28427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x256:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:1.0:1763333178.325176:0:28427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x256:0x0] updating lvb mtime from disk: 0 -> 1763333178 00002000:00010000:1.0:1763333178.325180:0:28427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x256:0x0] updating lvb ctime from disk: 0 -> 1763333178 00002000:00010000:1.0:1763333178.325182:0:28427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x256:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1763333178.325201:0:28427:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c58177 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.325216:0:28427:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c58177 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.325227:0:28427:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c58177 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.325236:0:28427:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333178.325241:0:28427:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c58177 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.325316:0:28427:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c58177 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.325343:0:28427:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c58177 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.325458:0:28427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c58177 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28427 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333178.325598:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+11:2421:x1848987613822720:12345-192.168.204.28@tcp:4:lfs.0 Request processed in 14324us (16130us total) trans 21474839002 rc 0/0 00000100:00100000:1.0:1763333178.325617:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1668 00000100:00100000:0.0:1763333178.346995:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.348268:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613823232 00000100:00100000:2.0:1763333178.348286:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613823232 00000100:00100000:2.0:1763333178.348420:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9596 00000100:00100000:2.0:1763333178.348434:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:56915:x1848987613823232:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333178.348585:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333178.348624:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c5817e lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a12a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.348719:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c58185 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333178.348737:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c58185 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.348749:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c58185 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.348762:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c5818c lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333178.348770:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c5818c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.348777:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c5818c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.348836:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c58185 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.348844:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c58185 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.348851:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c58185 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.348858:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c58185 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.348865:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4742f400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333178.348870:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c58185 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.348878:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c58185 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.348969:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31900) 00010000:00010000:2.0:1763333178.348973:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333178.348980:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c58185 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.349052:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c58185 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.349070:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c5818c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.349076:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c5818c lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.349082:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c5818c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.349087:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4742fc00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333178.349089:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c5818c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.349094:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c5818c lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.349100:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff7dcb6900) 00010000:00010000:2.0:1763333178.349102:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333178.349105:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c5818c lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.349110:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c5818c lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.349140:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c5817e lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a12a expref: 252 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.349150:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31900) 00010000:00010000:2.0:1763333178.349152:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333178.349155:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c5817e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a12a expref: 252 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.349168:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4742fa00, rc 0) 00000100:00100000:2.0:1763333178.349254:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:56915:x1848987613823232:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 824us (2273us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333178.349263:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9596 00000100:00100000:3.0:1763333178.355930:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.356759:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613823360 00000100:00100000:2.0:1763333178.356778:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613823360 00000100:00100000:2.0:1763333178.356874:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9597 00000100:00100000:2.0:1763333178.356889:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:56915:x1848987613823360:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333178.356920:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333178.356957:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c58193 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a131 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.357073:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c5819a lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333178.357094:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c5819a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.357110:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c5819a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.357126:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c600/0xb32e3ef184c581a1 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333178.357135:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c600/0xb32e3ef184c581a1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.357142:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c600/0xb32e3ef184c581a1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.357202:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c5819a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.357210:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c5819a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.357218:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c5819a lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.357230:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c5819a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.357236:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700ce00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333178.357242:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c5819a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.357251:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c5819a lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.357265:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31600) 00010000:00010000:2.0:1763333178.357269:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333178.357274:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c5819a lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.357280:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c5819a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.357300:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c600/0xb32e3ef184c581a1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.357306:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c600/0xb32e3ef184c581a1 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.357312:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c600/0xb32e3ef184c581a1 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.357317:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700c600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333178.357320:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c600/0xb32e3ef184c581a1 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.357327:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c600/0xb32e3ef184c581a1 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.357339:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff7dcb6900) 00010000:00010000:2.0:1763333178.357342:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333178.357345:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c600/0xb32e3ef184c581a1 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.357387:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c600/0xb32e3ef184c581a1 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.357440:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c58193 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a131 expref: 252 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.357453:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31600) 00010000:00010000:2.0:1763333178.357457:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333178.357474:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c58193 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a131 expref: 252 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.357493:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4742e000, rc 0) 00000100:00100000:2.0:1763333178.357595:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:56915:x1848987613823360:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 708us (1679us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333178.357604:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9597 00000100:00100000:1.0:1763333178.365522:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333178.365583:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333178.365678:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613823488 00000100:00100000:3.0:1763333178.365694:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613823488 00000100:00100000:3.0:1763333178.365764:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613823744 00000100:00100000:3.0:1763333178.365768:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613823744 00000100:00100000:3.0:1763333178.365802:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9598 00000100:00100000:3.0:1763333178.365813:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:56915:x1848987613823488:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333178.365844:0:29240:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1763333178.365848:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9599 00000100:00100000:0.0:1763333178.365865:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:56911:x1848987613823744:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:3.0:1763333178.365877:0:29240:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c581a8 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a138 expref: -99 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.365928:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333178.365943:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c581af lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:3.0:1763333178.365961:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c581af lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.365973:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4874aa00/0xb32e3ef184c58089 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1c9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0d6 expref: 253 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.365975:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c581af lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.366011:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c9:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:0.0:1763333178.366019:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00200000:3.0:1763333178.366045:0:29240:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1763333178.366052:0:29240:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763333178.366085:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c581b6 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333178.366102:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c581a8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a138 expref: 253 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.366103:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c581b6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.366124:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c581b6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.366130:0:29240:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c581af lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a138 expref: 252 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.366149:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055ae00) 00010000:00010000:3.0:1763333178.366152:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1763333178.366155:0:29240:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea800, rc 0) 00000100:00100000:3.0:1763333178.366255:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:56915:x1848987613823488:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 442us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333178.366264:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9598 00000004:00010000:0.0:1763333178.366878:0:8606:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000069d7efe5 reply state 000000006ac33767 transno 4294972567 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c581b6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.366897:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c581b6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.366904:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c9:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:0.0:1763333178.366907:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333178.366911:0:8606:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763333178.366996:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:56911:x1848987613823744:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 1137us (1410us total) trans 4294972567 rc 0/0 00000100:00100000:0.0:1763333178.367004:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9599 00000100:00100000:1.0:1763333178.377634:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333178.377916:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333178.378034:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613823872 00000100:00100000:0.0:1763333178.378048:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613823872 00000100:00100000:0.0:1763333178.378135:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6792 00000100:00100000:0.0:1763333178.378149:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1370b1d7-8612-4b90-ab37-e53288bbf9fd+11:56911:x1848987613823872:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333178.378176:0:29010:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333178.378207:0:29010:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c581bd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a13f expref: -99 pid: 29010 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763333178.378238:0:29010:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x256:0x0] initial LVB size: 4096, mtime: 0x691a543a, atime: 0x0, ctime: 0x691a543a, blocks: 0x8 00010000:00010000:0.0:1763333178.378267:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333178.378271:0:29010:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333178.378281:0:29010:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c581bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a13f expref: 12 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.378302:0:29010:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c581bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a13f expref: 12 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.378324:0:29010:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4000, rc 0) 00000100:00100000:0.0:1763333178.378448:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:56911:x1848987613823872:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 301us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333178.378467:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6792 00000100:00100000:2.0:1763333178.379217:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613824000 00000100:00100000:2.0:1763333178.379229:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613824000 00000100:00100000:2.0:1763333178.379294:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9600 00000100:00100000:2.0:1763333178.379304:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:56915:x1848987613824000:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333178.379329:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333178.379375:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c600/0xb32e3ef184c581c4 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a146 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.379480:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c581cb lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333178.379497:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c581cb lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.379510:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c581cb lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.379525:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c581d2 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333178.379533:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c581d2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.379539:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c581d2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.379591:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c581cb lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.379600:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c581cb lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.379607:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c581cb lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.379614:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c581cb lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.380135:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700ce00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333178.380141:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c581cb lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.380153:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c581cb lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.380167:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055ae00) 00010000:00010000:2.0:1763333178.380170:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333178.380175:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c581cb lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.380182:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ce00/0xb32e3ef184c581cb lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.380201:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c581d2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.380207:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c581d2 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.380576:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c581d2 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.380583:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4742e000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333178.380586:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c581d2 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.380593:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c581d2 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.380601:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff7dcb6900) 00010000:00010000:2.0:1763333178.380604:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333178.380607:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c581d2 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.380612:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c581d2 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.380659:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c600/0xb32e3ef184c581c4 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a146 expref: 254 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.380671:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055ae00) 00010000:00010000:2.0:1763333178.380673:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333178.380677:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700c600/0xb32e3ef184c581c4 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a146 expref: 254 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.380685:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4700c600, rc 0) 00000100:00100000:2.0:1763333178.380770:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:56915:x1848987613824000:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1465us (2852us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333178.380779:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9600 00000100:00100000:1.0:1763333178.386713:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333178.386913:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613824128 00000100:00100000:3.0:1763333178.386926:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613824128 00000100:00100000:3.0:1763333178.387195:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6793 00000100:00100000:3.0:1763333178.387206:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:56911:x1848987613824128:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333178.387230:0:28650:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333178.387255:0:28650:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c581d9 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a14d expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.387291:0:28650:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57ede lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x256:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a058 expref: 21 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333178.387300:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333178.387303:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333178.387308:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c581d9 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a14d expref: 21 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.387515:0:28650:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57ede lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x256:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a058 expref: 21 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333178.387532:0:28650:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57ede lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x256:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a058 expref: 21 pid: 8404 timeout: 1382 lvb_type: 1 00000100:00100000:3.0:1763333178.387549:0:28650:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7400c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28650:1848987627302912:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333178.387652:0:28650:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff5c588b40 going to sleep for 11 seconds 00000100:00100000:1.0:1763333178.389128:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333178.390152:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613824384 00000100:00100000:0.0:1763333178.390166:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613824384 00000100:00100000:2.0:1763333178.391319:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9601 00000100:00100000:2.0:1763333178.391339:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:56915:x1848987613824384:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333178.391381:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333178.391385:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763333178.391434:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c581af lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a138 expref: 253 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.391458:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff6055ae00) 00010000:00010000:2.0:1763333178.391473:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333178.391496:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c581e0 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a154 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.391633:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c581e7 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333178.391653:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c581e7 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.391665:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c581e7 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.391677:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c581ee lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333178.391684:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c581ee lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.391689:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c581ee lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000100:00100000:1.0:1763333178.392181:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333178.392383:0:28650:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7400c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28650:1848987627302912:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333178.392439:0:28650:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c581d9 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a14d expref: 21 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.392597:0:28650:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea200, rc 0) 00000100:00100000:3.0:1763333178.392668:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:56911:x1848987613824128:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 5464us (5969us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333178.392677:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6793 00010000:00010000:2.0:1763333178.392771:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c581f5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333178.392782:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c581f5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.392792:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c581f5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:2.0:1763333178.392804:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1cc:0x0]: returning size 0 00010000:00010000:2.0:1763333178.392839:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c581e7 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.392846:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c581e7 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.392852:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c581e7 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.392859:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c581e7 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.392866:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4742fa00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333178.392870:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c581e7 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.392878:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c581e7 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.392890:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43a31600) 00010000:00010000:2.0:1763333178.392894:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333178.392898:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c581e7 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.392904:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c581e7 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000004:00010000:2.0:1763333178.392917:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000203c38cf reply state 0000000030731ad5 transno 4294972568 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c581ee lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.392930:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c581ee lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.392936:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff7dcb6900) 00010000:00010000:2.0:1763333178.392939:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333178.392942:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763333178.392978:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c581e0 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a154 expref: 255 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.392996:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c581f5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a154 expref: 254 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.393002:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1cc:0x0].0x0 (ffff92fe43a31900) 00010000:00010000:2.0:1763333178.393005:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333178.393007:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4742f400, rc 0) 00000100:00100000:2.0:1763333178.393035:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+255:56915:x1848987613824384:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1704us (3917us total) trans 4294972568 rc 0/0 00000100:00100000:2.0:1763333178.393042:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9601 00000100:00100000:0.0:1763333178.393133:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613824512 00000100:00100000:0.0:1763333178.393144:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613824512 00010000:00010000:0.0:1763333178.393182:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57ede lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x256:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a058 expref: 21 pid: 8404 timeout: 1382 lvb_type: 1 00000100:00100000:0.0:1763333178.393223:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3160 00000100:00100000:0.0:1763333178.393233:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2420:x1848987613824512:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333178.393247:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333178.393268:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57ede lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x256:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a058 expref: 21 pid: 8404 timeout: 1382 lvb_type: 1 00010000:00010000:0.0:1763333178.393281:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57ede lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x256:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a058 expref: 21 pid: 8404 timeout: 1382 lvb_type: 1 00010000:00010000:0.0:1763333178.393298:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c57ede lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x256:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a058 expref: 21 pid: 8404 timeout: 1382 lvb_type: 1 00010000:00010000:0.0:1763333178.393309:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333178.393311:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333178.393318:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c581d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a14d expref: 20 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.393327:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c581d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a14d expref: 20 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.393425:0:6504:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c581d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a14d expref: 20 pid: 28650 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333178.393442:0:6504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff6bc12680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6504:1848987627303040:192.168.204.28@tcp:105: 00000100:00100000:0.0:1763333178.393507:0:6504:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff49c92e40 going to sleep for 11 seconds 00000100:00100000:1.0:1763333178.396711:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333178.396862:0:6504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff6bc12680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6504:1848987627303040:192.168.204.28@tcp:105: 00010000:00010000:0.0:1763333178.396899:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333178.396993:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2420:x1848987613824512:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 3760us (4814us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333178.397007:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3160 00000100:00100000:1.0:1763333178.397139:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613824640 00000100:00100000:1.0:1763333178.397148:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613824640 00002000:00010000:1.0:1763333178.397196:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/598 (5->18446744073709551615) 00002000:00100000:1.0:1763333178.397201:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7e00ca80 with x1848987613824640 ext(5->18446744073709551615) 00002000:00010000:1.0:1763333178.397217:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7e00ca80. 00000100:00100000:1.0:1763333178.397244:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1669 00000100:00100000:1.0:1763333178.397254:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:2421:x1848987613824640:12345-192.168.204.28@tcp:10:lfs.0 00000100:00100000:0.0:1763333178.398123:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.398176:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613824768 00000100:00100000:2.0:1763333178.398184:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613824768 00002000:00010000:2.0:1763333178.398214:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/598 (0->18446744073709551615) 00002000:00100000:2.0:1763333178.398218:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff6bc12680 with x1848987613824768 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333178.398227:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff6bc12680. 00000100:00100000:2.0:1763333178.398263:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1670 00000100:00100000:2.0:1763333178.398272:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2421:x1848987613824768:12345-192.168.204.28@tcp:10:lfs.0 00002000:00010000:2.0:1763333178.398479:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x256:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333178.398483:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x256:0x0] updating lvb mtime from disk: 0 -> 1763333178 00002000:00010000:2.0:1763333178.398486:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x256:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333178.398489:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x256:0x0] updating lvb ctime from disk: 0 -> 1763333178 00002000:00010000:2.0:1763333178.398491:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x256:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333178.398541:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2421:x1848987613824768:12345-192.168.204.28@tcp:10:lfs.0 Request processed in 269us (424us total) trans 17179871697 rc 0/0 00000100:00100000:2.0:1763333178.398549:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1670 00002000:00010000:2.0:1763333178.398553:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/598 (0->18446744073709551615) 00002000:00100000:2.0:1763333178.398556:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff6bc12680 with x1848987613824768 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333178.398561:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff6bc12680. 00000100:00100000:3.0:1763333178.398615:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.398919:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613825024 00000100:00100000:2.0:1763333178.398925:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613825024 00000100:00100000:2.0:1763333178.398973:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9602 00000100:00100000:2.0:1763333178.398981:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+255:56915:x1848987613825024:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333178.399004:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333178.399034:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c58203 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1cc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a15b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.399164:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c5820a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1cc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333178.399185:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c581f5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a154 expref: 256 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.399196:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c5820a lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1cc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.399241:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c581f5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a154 expref: 256 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.399256:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c581f5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a154 expref: 256 pid: 6519 timeout: 1382 lvb_type: 0 00000100:00100000:2.0:1763333178.399270:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff74034380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627303168:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333178.399381:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff44fdf900 going to sleep for 11 seconds 00002000:00010000:1.0:1763333178.399574:0:28427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x256:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:1.0:1763333178.399579:0:28427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x256:0x0] updating lvb mtime from disk: 1763333178 -> 1763333178 00002000:00010000:1.0:1763333178.399582:0:28427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x256:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333178.399584:0:28427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x256:0x0] updating lvb ctime from disk: 1763333178 -> 1763333178 00002000:00010000:1.0:1763333178.399586:0:28427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x256:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1763333178.399638:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2421:x1848987613824640:12345-192.168.204.28@tcp:10:lfs.0 Request processed in 2385us (2942us total) trans 21474839003 rc 0/0 00000100:00100000:1.0:1763333178.399648:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1669 00002000:00010000:1.0:1763333178.399654:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/598 (5->18446744073709551615) 00002000:00100000:1.0:1763333178.399658:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7e00ca80 with x1848987613824640 ext(5->18446744073709551615) 00002000:00010000:1.0:1763333178.399666:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7e00ca80. 00000100:00100000:1.0:1763333178.402757:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.402772:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff74034380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627303168:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333178.402809:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c5820a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1cc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000100:00100000:0.0:1763333178.402884:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613825152 00000100:00100000:0.0:1763333178.402894:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613825152 00010000:00010000:0.0:1763333178.402942:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c581f5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a154 expref: 257 pid: 6519 timeout: 1382 lvb_type: 0 00000100:00100000:1.0:1763333178.403099:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333178.403280:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3161 00000100:00100000:1.0:1763333178.403293:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+257:2420:x1848987613825152:12345-192.168.204.28@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1763333178.403294:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613825408 00000100:00100000:2.0:1763333178.403299:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613825408 00010000:00010000:1.0:1763333178.403312:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333178.403319:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c581f5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a154 expref: 258 pid: 6519 timeout: 1382 lvb_type: 0 00010000:00010000:1.0:1763333178.403334:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c581f5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a154 expref: 258 pid: 6519 timeout: 1382 lvb_type: 0 00000100:00100000:2.0:1763333178.403340:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9603 00000100:00100000:2.0:1763333178.403371:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+258:56911:x1848987613825408:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:1.0:1763333178.403384:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742f400/0xb32e3ef184c581f5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a154 expref: 258 pid: 6519 timeout: 1382 lvb_type: 0 00010000:00010000:1.0:1763333178.403405:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1cc:0x0].0x0 (ffff92fe43a31900) 00010000:00010000:1.0:1763333178.403420:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c5820a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1cc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333178.403431:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c5820a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1cc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333178.403439:0:6504:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c5820a lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1cc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.403481:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c58211 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333178.403494:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c58211 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.403503:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c58211 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00010000:2.0:1763333178.403661:0:8606:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004c8d6158 reply state 00000000b44ca5f8 transno 4294972569 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c58211 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.403675:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c58211 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.403681:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c9:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:2.0:1763333178.403683:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333178.403686:0:8606:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763333178.403824:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+259:56911:x1848987613825408:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 476us (725us total) trans 4294972569 rc 0/0 00000100:00100000:2.0:1763333178.403833:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9603 00010000:00010000:1.0:1763333178.403845:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333178.403863:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c5820a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1cc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000100:00100000:1.0:1763333178.403867:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+258:2420:x1848987613825152:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 578us (1116us total) trans 0 rc 0/0 00010000:00010000:2.0:1763333178.403871:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c5820a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1cc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000100:00100000:1.0:1763333178.403879:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3161 00000004:00200000:2.0:1763333178.403892:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1cc:0x0]: returning size 0 00000004:00080000:2.0:1763333178.404088:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x259:0x0], index 1: 0 00000004:00080000:2.0:1763333178.404095:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x259:0x0], index 0: 0 00000004:00080000:2.0:1763333178.404100:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x25a:0x0], index 0: 0 00000004:00080000:2.0:1763333178.404104:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x25a:0x0], index 1: 0 00010000:00010000:2.0:1763333178.404202:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c5820a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1cc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.404212:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c5820a lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1cc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.404219:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c5820a lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1cc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.404226:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333178.404231:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c5820a lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1cc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.404239:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c5820a lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1cc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.404249:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1cc:0x0].0x0 (ffff92fe43a31900) 00010000:00010000:2.0:1763333178.404252:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333178.404257:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c5820a lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1cc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.404263:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c5820a lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1cc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.404308:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c58203 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1cc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a15b expref: 258 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.404319:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1cc:0x0].0x0 (ffff92fe43a31900) 00010000:00010000:2.0:1763333178.404321:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763333178.404326:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96400/0xb32e3ef184c58203 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1cc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a15b expref: 258 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.404341:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96400, rc 0) 00000100:00100000:2.0:1763333178.404405:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+257:56915:x1848987613825024:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 5424us (5790us total) trans 4294972570 rc 301/301 00000100:00100000:2.0:1763333178.404422:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9602 00000100:00100000:1.0:1763333178.406934:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333178.407185:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613825536 00000100:00100000:3.0:1763333178.407199:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613825536 00000100:00100000:0.0:1763333178.407527:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6794 00000100:00100000:0.0:1763333178.407545:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2421:x1848987613825536:12345-192.168.204.28@tcp:2:lfs.0 00002000:00010000:0.0:1763333178.407765:0:29010:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x255:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1763333178.407770:0:29010:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x255:0x0] updating lvb mtime from disk: 1763333178 -> 1763333178 00002000:00010000:0.0:1763333178.407772:0:29010:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x255:0x0] updating lvb atime from disk: 0 -> 1763333178 00002000:00010000:0.0:1763333178.407776:0:29010:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x255:0x0] updating lvb ctime from disk: 1763333178 -> 1763333178 00002000:00010000:0.0:1763333178.407779:0:29010:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x255:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1763333178.407870:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2421:x1848987613825536:12345-192.168.204.28@tcp:2:lfs.0 Request processed in 333us (950us total) trans 17179871698 rc 0/0 00000100:00100000:0.0:1763333178.407878:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6794 00000100:00100000:1.0:1763333178.408223:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333178.408501:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613825792 00000100:00100000:3.0:1763333178.408509:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613825792 00000100:00100000:3.0:1763333178.408592:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3277 00000100:00100000:3.0:1763333178.408602:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+257:56915:x1848987613825792:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333178.408917:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+258:56915:x1848987613825792:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 316us (696us total) trans 4294972571 rc 0/0 00000100:00100000:3.0:1763333178.408925:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3277 00000100:00100000:1.0:1763333178.411936:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333178.412118:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613826048 00000100:00100000:3.0:1763333178.412132:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613826048 00000100:00100000:3.0:1763333178.412609:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3278 00000100:00100000:3.0:1763333178.412623:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+258:56915:x1848987613826048:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333178.412904:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+259:56915:x1848987613826048:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 284us (981us total) trans 4294972572 rc 0/0 00000100:00100000:3.0:1763333178.412912:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3278 00000100:00100000:0.0:1763333178.413079:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333178.413178:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613826304 00000100:00100000:0.0:1763333178.413184:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613826304 00000100:00100000:0.0:1763333178.413224:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3279 00000100:00100000:0.0:1763333178.413323:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50048700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+259:56911:x1848987613826304:12345-192.168.204.28@tcp:35:lfs.0 00000004:00010000:0.0:1763333178.413387:0:19668:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x240000404:0x1c9:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45035a00/0xb32e3ef184c58012 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1c9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0ac expref: 259 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.414030:0:19668:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5821f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19668 initiator: MDT0 00010000:00010000:0.0:1763333178.414048:0:19668:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c58058 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0c1 expref: 259 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.414059:0:19668:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5821f lrc: 4/0,1 mode: --/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333178.414102:0:19668:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c58058 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0c1 expref: 259 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.414117:0:19668:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c58058 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0c1 expref: 259 pid: 6519 timeout: 1382 lvb_type: 0 00000100:00100000:0.0:1763333178.414132:0:19668:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff5004bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:19668:1848987627303296:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333178.414220:0:19668:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff49c92e40 going to sleep for 11 seconds 00000100:00100000:0.0:1763333178.416756:0:19668:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff5004bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:19668:1848987627303296:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333178.416799:0:19668:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5821f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19668 initiator: MDT1 00000100:00100000:1.0:1763333178.417992:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333178.418298:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613826432 00000100:00100000:3.0:1763333178.418309:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613826432 00010000:00010000:3.0:1763333178.419007:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c58058 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0c1 expref: 260 pid: 6519 timeout: 1382 lvb_type: 0 00000100:00100000:3.0:1763333178.419073:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3162 00000100:00100000:3.0:1763333178.419085:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+260:2420:x1848987613826432:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333178.419108:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333178.419115:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c58058 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0c1 expref: 260 pid: 6519 timeout: 1382 lvb_type: 0 00010000:00010000:3.0:1763333178.419132:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c58058 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0c1 expref: 260 pid: 6519 timeout: 1382 lvb_type: 0 00010000:00010000:3.0:1763333178.419162:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe44c38800/0xb32e3ef184c58058 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0c1 expref: 260 pid: 6519 timeout: 1382 lvb_type: 0 00010000:00010000:3.0:1763333178.419184:0:28428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c9:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:3.0:1763333178.419191:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5821f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19668 initiator: MDT1 00010000:00010000:3.0:1763333178.419202:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5821f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 19668 initiator: MDT1 00010000:00010000:3.0:1763333178.419212:0:28428:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5821f lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 19668 initiator: MDT1 00010000:00010000:3.0:1763333178.419242:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333178.419320:0:19668:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5821f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333178.419329:0:19668:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5821f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19668 initiator: MDT1 00000100:00100000:3.0:1763333178.419334:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+259:2420:x1848987613826432:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 251us (1350us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333178.419341:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3162 00000040:00080000:0.0:1763333178.419914:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1498, 88 off126064 00000004:00080000:0.0:1763333178.419926:0:19668:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1282499576662ns, next at 1283390392964ns, rc = 0 00000040:00080000:0.0:1763333178.420160:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1499, 88 off126064 00000004:00080000:0.0:1763333178.420167:0:19668:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1282499817952ns, next at 1282771249577ns, rc = 0 00000040:00080000:0.0:1763333178.420190:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1500, 88 off126152 00000004:00080000:0.0:1763333178.420194:0:19668:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1282499845449ns, next at 1282771249577ns, rc = 0 00000040:00080000:0.0:1763333178.420205:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1499, 88 off126152 00000004:00080000:0.0:1763333178.420208:0:19668:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1282499859573ns, next at 1283390392964ns, rc = 0 00000100:00100000:1.0:1763333178.422677:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.424215:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613826688 00000100:00100000:2.0:1763333178.424232:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613826688 00000100:00100000:2.0:1763333178.424323:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9604 00000100:00100000:2.0:1763333178.424335:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+260:55917:x1848987613826688:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333178.424386:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333178.424426:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c58226 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a162 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.424609:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5822d lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333178.424628:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5822d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.424642:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5822d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.424655:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c58234 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333178.424663:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c58234 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.424671:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c58234 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.424743:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c5823b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333178.424752:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c5823b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.424760:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c5823b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:2.0:1763333178.424771:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1cc:0x0]: returning size 0 00010000:00010000:2.0:1763333178.424894:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5822d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.424903:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5822d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.424909:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5822d lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.424917:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5822d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.430314:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333178.430324:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5822d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.430336:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5822d lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.430375:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff621ac600) 00010000:00010000:2.0:1763333178.430378:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333178.430385:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5822d lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.430394:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c5822d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.430430:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c58234 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.430443:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c58234 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.430451:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c58234 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.430455:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333178.430458:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c58234 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.430464:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c58234 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.430471:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff7dcb6900) 00010000:00010000:2.0:1763333178.430473:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333178.430476:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c58234 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.430481:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c58234 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.430558:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c58226 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a162 expref: 263 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.430584:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c5823b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a162 expref: 262 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.430592:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1cc:0x0].0x0 (ffff92ff621aca00) 00010000:00010000:2.0:1763333178.430594:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333178.430596:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96000, rc 0) 00000100:00100000:2.0:1763333178.430703:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+262:55917:x1848987613826688:12345-192.168.204.28@tcp:101:bash.0 Request processed in 6368us (8036us total) trans 4294972574 rc 0/0 00000100:00100000:2.0:1763333178.430714:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9604 00000001:00080000:3.0:1763333178.432038:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972573 is committed 00000004:00080000:3.0:1763333178.432052:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 981 committed 00000004:00080000:3.0:1763333178.432083:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 984 committed 00000004:00080000:3.0:1763333178.432100:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 983 committed 00000004:00080000:3.0:1763333178.432103:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 980 committed 00000004:00080000:3.0:1763333178.432126:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 979 committed 00000100:00100000:3.0:1763333178.432442:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff5004bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627303424:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763333178.432524:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333178.432577:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763333178.432584:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff75664700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627303808:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333178.432614:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333178.432642:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e00f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627303936:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763333178.432667:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333178.432700:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763333178.432707:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e121180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627304320:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333178.432727:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333178.432762:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627303424 00000100:00100000:3.0:1763333178.432770:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627303424 00000100:00100000:3.0:1763333178.432823:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627303808 00000100:00100000:3.0:1763333178.432827:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627303808 00000100:00100000:3.0:1763333178.432849:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627303936 00000100:00100000:3.0:1763333178.432853:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627303936 00000100:00100000:1.0:1763333178.432853:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627304320 00000100:00100000:1.0:1763333178.432860:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627304320 00000100:00100000:3.0:1763333178.432888:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6795 00000100:00100000:1.0:1763333178.432901:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6796 00000100:00100000:3.0:1763333178.432903:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+6:3655:x1848987627303424:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763333178.432914:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3655:x1848987627303808:12345-0@lo:2:osp-syn-0-1.0 00002000:00080000:3.0:1763333178.432940:0:28651:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:599 count 1 00010000:00010000:3.0:1763333178.432975:0:28651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c58249 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x257:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.433002:0:28651:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c5811c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a10e expref: 12 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.433018:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333178.433021:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333178.433026:0:28651:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c58249 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.433061:0:28651:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c5811c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a10e expref: 12 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.433079:0:28651:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c5811c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a10e expref: 12 pid: 29010 timeout: 1382 lvb_type: 0 00000100:00100000:3.0:1763333178.433092:0:28651:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7400ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28651:1848987627304448:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333178.433166:0:28651:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe439ddf00 going to sleep for 11 seconds 00000100:00100000:3.0:1763333178.433186:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6797 00000100:00100000:3.0:1763333178.433194:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+22:3655:x1848987627303936:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763333178.433214:0:8611:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:599 count 1 00002000:00010000:1.0:1763333178.433234:0:8406:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x256:0x0] updating lvb size from disk: 5 -> 5 00010000:00010000:3.0:1763333178.433235:0:8611:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c58250 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x257:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333178.433240:0:8406:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x256:0x0] updating lvb mtime from disk: 1763333178 -> 1763333178 00002000:00010000:1.0:1763333178.433247:0:8406:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x256:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333178.433253:0:8406:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x256:0x0] updating lvb ctime from disk: 1763333178 -> 1763333178 00002000:00010000:1.0:1763333178.433256:0:8406:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x256:0x0] updating lvb blocks from disk: 8 -> 8 00010000:00010000:3.0:1763333178.433259:0:8611:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c58123 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a115 expref: 21 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.433268:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333178.433269:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333178.433272:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c58250 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.433300:0:8611:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c58123 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a115 expref: 21 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.433313:0:8611:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c58123 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a115 expref: 21 pid: 29010 timeout: 1382 lvb_type: 0 00000100:00100000:1.0:1763333178.433314:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+7:3655:x1848987627303808:12345-0@lo:2:osp-syn-0-1.0 Request processed in 402us (698us total) trans 21474839004 rc 0/0 00000100:00100000:1.0:1763333178.433334:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6796 00000100:00100000:3.0:1763333178.433336:0:8611:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7400d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8611:1848987627304576:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333178.433395:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6798 00000100:00100000:3.0:1763333178.433396:0:8611:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe439dd780 going to sleep for 11 seconds 00000100:00100000:1.0:1763333178.433407:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+22:3655:x1848987627304320:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1763333178.433497:0:8406:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x256:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333178.433501:0:8406:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x256:0x0] updating lvb mtime from disk: 1763333178 -> 1763333178 00002000:00010000:1.0:1763333178.433503:0:8406:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x256:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333178.433506:0:8406:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x256:0x0] updating lvb ctime from disk: 1763333178 -> 1763333178 00002000:00010000:1.0:1763333178.433509:0:8406:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x256:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333178.433520:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff50067b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627303552:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763333178.433542:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+23:3655:x1848987627304320:12345-0@lo:2:osp-syn-1-1.0 Request processed in 138us (812us total) trans 17179871699 rc 0/0 00000100:00100000:1.0:1763333178.433550:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6798 00000100:00100000:0.0:1763333178.433563:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1763333178.433654:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c58162 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.433664:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c58162 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.433672:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c58162 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.433679:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700de00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333178.433684:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c58162 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.433693:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c58162 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.433711:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff7dcb6900) 00010000:00010000:2.0:1763333178.433714:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333178.433720:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c58162 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.433726:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700de00/0xb32e3ef184c58162 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.433749:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c581b6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.433755:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c581b6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.433760:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c581b6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.433766:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333178.433769:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c581b6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.433774:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c581b6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.433782:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c9:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:2.0:1763333178.433784:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333178.433787:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c581b6 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.433793:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c581b6 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.433803:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c581ee lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.433808:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c581ee lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.433813:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c581ee lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.433817:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4742fc00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333178.433820:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c581ee lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.433826:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c581ee lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.433832:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff7dcb6900) 00010000:00010000:2.0:1763333178.433836:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333178.433838:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c581ee lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.433844:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c581ee lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.433860:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c58211 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.433866:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c58211 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.433872:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c58211 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.433877:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333178.433879:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c58211 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.433885:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c58211 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.433892:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c9:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:2.0:1763333178.433895:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333178.433898:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c58211 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.433903:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a97000/0xb32e3ef184c58211 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000100:00100000:0.0:1763333178.435149:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e00e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627304064:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763333178.435184:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627303552 00000100:00100000:2.0:1763333178.435195:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627303552 00000100:00100000:0.0:1763333178.435212:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333178.435240:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1763333178.435249:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff75667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627303680:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333178.435251:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627304064 00000100:00100000:2.0:1763333178.435256:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627304064 00000100:00100000:0.0:1763333178.435278:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333178.435286:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6799 00000100:00100000:0.0:1763333178.435293:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627304192:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1763333178.435299:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+7:3652:x1848987627303552:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763333178.435321:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:2.0:1763333178.435332:0:8407:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:600 count 1 00000100:00100000:0.0:1763333178.435374:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627303680 00000100:00100000:0.0:1763333178.435379:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627303680 00002000:00010000:2.0:1763333178.435391:0:8407:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x258:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763333178.435402:0:8407:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58257 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333178.435403:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627304192 00000100:00100000:0.0:1763333178.435420:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627304192 00010000:00010000:2.0:1763333178.435427:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333178.435431:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333178.435438:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58257 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333178.435439:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6800 00000100:00100000:0.0:1763333178.435450:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75664380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+24:3652:x1848987627304064:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1763333178.435460:0:8407:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58257 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1763333178.435466:0:8406:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:600 count 1 00010000:00010000:2.0:1763333178.435475:0:8407:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58257 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.435484:0:8407:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58257 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763333178.435493:0:8406:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x258:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333178.435500:0:8406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5825e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.435505:0:8407:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763333178.435515:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333178.435517:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333178.435521:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5825e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.435532:0:8406:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5825e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.435541:0:8406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5825e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.435550:0:8406:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5825e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.435570:0:8406:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1763333178.435807:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75664380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+25:3652:x1848987627304064:12345-0@lo:6:osp-syn-1-1.0 Request processed in 358us (595us total) trans 17179871700 rc 0/0 00000100:00100000:0.0:1763333178.435820:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6800 00000100:00100000:0.0:1763333178.435842:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6801 00000100:00100000:0.0:1763333178.435849:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+9:3652:x1848987627303680:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1763333178.435930:0:8406:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x255:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333178.435934:0:8406:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x255:0x0] updating lvb mtime from disk: 1763333178 -> 1763333178 00002000:00010000:0.0:1763333178.435938:0:8406:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x255:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333178.435940:0:8406:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x255:0x0] updating lvb ctime from disk: 1763333178 -> 1763333178 00002000:00010000:0.0:1763333178.435943:0:8406:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x255:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333178.436852:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6802 00000100:00100000:1.0:1763333178.436870:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+24:3652:x1848987627304192:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1763333178.436982:0:8404:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x255:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1763333178.436986:0:8404:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x255:0x0] updating lvb mtime from disk: 1763333178 -> 1763333178 00002000:00010000:1.0:1763333178.436988:0:8404:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x255:0x0] updating lvb atime from disk: 1763333178 -> 1763333178 00002000:00010000:1.0:1763333178.436991:0:8404:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x255:0x0] updating lvb ctime from disk: 1763333178 -> 1763333178 00002000:00010000:1.0:1763333178.436993:0:8404:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x255:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763333178.438328:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.438455:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+10:3652:x1848987627303552:12345-0@lo:6:osp-syn-0-1.0 Request processed in 3156us (4888us total) trans 21474839005 rc 0/0 00000100:00100000:2.0:1763333178.438468:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6799 00010000:00010000:2.0:1763333178.438515:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1763333178.438527:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58257 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.438545:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4742f400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333178.438550:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58257 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.438564:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58257 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333178.438590:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+9:3652:x1848987627303680:12345-0@lo:2:osp-syn-0-1.0 Request processed in 2738us (3308us total) trans 21474839006 rc 0/0 00010000:00010000:2.0:1763333178.438593:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58257 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333178.438604:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6801 00010000:00010000:2.0:1763333178.438609:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58257 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.438636:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333178.438642:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5825e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.438649:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4a00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333178.438653:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5825e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.438660:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5825e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.438671:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5825e lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.438683:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5825e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.438698:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333178.438699:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333178.438702:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333178.438791:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763333178.438838:0:3652:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474839000 gen 2 00000004:00080000:0.0:1763333178.438846:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44e04000, transno 21474838943 00000004:00080000:0.0:1763333178.438857:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44e05180, transno 21474838944 00000004:00080000:0.0:1763333178.438861:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff77b16300, transno 21474838945 00000004:00080000:0.0:1763333178.438863:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44e06a00, transno 21474838946 00000004:00080000:0.0:1763333178.438867:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff6bc12d80, transno 21474838947 00000004:00080000:0.0:1763333178.438870:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff6bc10a80, transno 21474838948 00000004:00080000:0.0:1763333178.438873:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff6bc10380, transno 21474838949 00000004:00080000:0.0:1763333178.438875:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff6bc12300, transno 21474838950 00000004:00080000:0.0:1763333178.438878:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe49608700, transno 21474838952 00000004:00080000:0.0:1763333178.438881:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe49608a80, transno 21474838953 00000004:00080000:0.0:1763333178.438883:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4960bb80, transno 21474838954 00000004:00080000:0.0:1763333178.438886:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4960b100, transno 21474838955 00000004:00080000:0.0:1763333178.438889:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff75665f80, transno 21474838958 00000004:00080000:0.0:1763333178.438892:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff75667100, transno 21474838959 00000004:00080000:0.0:1763333178.438896:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46a6d180, transno 21474838960 00000004:00080000:0.0:1763333178.438899:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46a6c700, transno 21474838961 00000004:00080000:0.0:1763333178.438902:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46e2fb80, transno 21474838965 00000004:00080000:0.0:1763333178.438905:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46e2dc00, transno 21474838966 00000004:00080000:0.0:1763333178.438908:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46e2ed80, transno 21474838967 00000004:00080000:0.0:1763333178.438911:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46e2ca80, transno 21474838968 00000004:00080000:0.0:1763333178.438914:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff77b14380, transno 21474838969 00000004:00080000:0.0:1763333178.438917:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff77b16680, transno 21474838970 00000004:00080000:0.0:1763333178.438919:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff77b14a80, transno 21474838971 00000004:00080000:0.0:1763333178.438922:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff77b15500, transno 21474838972 00000004:00080000:0.0:1763333178.438926:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44e19880, transno 21474838975 00000004:00080000:0.0:1763333178.438929:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe43998000, transno 21474838976 00000004:00080000:0.0:1763333178.438943:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe42efb480, transno 21474838978 00000004:00080000:0.0:1763333178.438947:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe42efb100, transno 21474838979 00000004:00080000:0.0:1763333178.438960:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe469a1180, transno 21474838983 00000004:00080000:0.0:1763333178.438963:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe469a1500, transno 21474838984 00000004:00080000:0.0:1763333178.438967:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe469a0000, transno 21474838985 00000004:00080000:0.0:1763333178.438969:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe469a1c00, transno 21474838986 00000004:00080000:0.0:1763333178.438973:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44de0380, transno 21474838987 00000004:00080000:0.0:1763333178.438975:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44de3100, transno 21474838988 00000004:00080000:0.0:1763333178.438978:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff74034a80, transno 21474838990 00000004:00080000:0.0:1763333178.438981:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff74035880, transno 21474838991 00000004:00080000:0.0:1763333178.438984:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff74035c00, transno 21474838992 00000004:00080000:0.0:1763333178.438987:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe472f2d80, transno 21474838993 00000004:00080000:0.0:1763333178.438989:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe472f1c00, transno 21474838994 00000004:00080000:0.0:1763333178.438992:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7dcff100, transno 21474838995 00000004:00080000:0.0:1763333178.438995:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44e07100, transno 21474838997 00000004:00080000:0.0:1763333178.438998:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44e05880, transno 21474838998 00000004:00080000:0.0:1763333178.439001:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe469a0a80, transno 21474838999 00000004:00080000:0.0:1763333178.439004:0:3652:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe42f0d180, transno 21474839000 00000100:00100000:0.0:1763333178.439013:0:3652:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff92ff75667b80 x1848987627303680/t21474839006(21474839006) o2->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763333194 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1763333178.439025:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff75667b80/2, rc 0, transno 21474839006 00000100:00100000:0.0:1763333178.439031:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff75667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627303680:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333178.439496:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+25:3652:x1848987627304192:12345-0@lo:2:osp-syn-1-1.0 Request processed in 2631us (4172us total) trans 17179871701 rc 0/0 00000100:00100000:1.0:1763333178.439505:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6802 00000004:00080000:1.0:1763333178.439574:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7e121180/2, rc 0, transno 17179871699 00000100:00100000:1.0:1763333178.439579:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e121180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627304320:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1763333178.439593:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff75664700/2, rc 0, transno 21474839004 00000100:00100000:1.0:1763333178.439597:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff75664700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627303808:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1763333178.439739:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7e123b80/2, rc 0, transno 17179871701 00000100:00100000:0.0:1763333178.439745:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627304192:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1763333178.439758:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff50067b80/2, rc 0, transno 21474839005 00000100:00100000:0.0:1763333178.439762:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff50067b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627303552:0@lo:6:osp-syn-0-1.0 00000004:00080000:0.0:1763333178.439772:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7e00e680/2, rc 0, transno 17179871700 00000100:00100000:0.0:1763333178.439776:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e00e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627304064:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1763333178.440111:0:8604:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 4 in progress, 1 in flight, 44 done 00000004:00010000:0.0:1763333178.440170:0:19668:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000fb948ab reply state 00000000286edadc transno 4294972573 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5821f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333178.440193:0:19668:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5821f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333178.440204:0:19668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c9:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:0.0:1763333178.440207:0:19668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1763333178.440211:0:19668:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763333178.440218:0:19668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c9:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:0.0:1763333178.440220:0:19668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763333178.440226:0:19668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45035a00/0xb32e3ef184c58012 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1c9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0ac expref: 248 pid: 29240 timeout: 0 lvb_type: 0 00010000:00080000:0.0:1763333178.440380:0:19668:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1763333178.440395:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50048700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:56911:x1848987613826304:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 27164us (27317us total) trans 4294972573 rc 0/0 00000100:00100000:0.0:1763333178.440418:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3279 00010000:00010000:1.0:1763333178.440509:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5821f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19668 initiator: MDT1 00010000:00010000:1.0:1763333178.440519:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5821f lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19668 initiator: MDT1 00010000:00010000:1.0:1763333178.440530:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5821f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19668 initiator: MDT1 00010000:00010000:1.0:1763333178.440537:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333178.440542:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5821f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19668 initiator: MDT1 00000100:00100000:2.0:1763333178.440544:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613826816 00000100:00100000:2.0:1763333178.440556:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613826816 00010000:00010000:1.0:1763333178.440558:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5821f lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19668 initiator: MDT1 00010000:00010000:1.0:1763333178.440572:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c9:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:1.0:1763333178.440574:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763333178.440578:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5821f lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19668 initiator: MDT1 00010000:00010000:1.0:1763333178.440588:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5821f lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19668 initiator: MDT1 00000100:00100000:2.0:1763333178.441758:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9605 00000100:00100000:2.0:1763333178.441781:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:55917:x1848987613826816:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333178.441811:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333178.441839:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c58265 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a169 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.441885:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99000/0xb32e3ef184c5826c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333178.441899:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99000/0xb32e3ef184c5826c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.441913:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99000/0xb32e3ef184c5826c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000100:00100000:3.0:1763333178.441991:0:28651:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7400ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28651:1848987627304448:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333178.442019:0:28651:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c58249 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.442062:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c58265 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a169 expref: 249 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333178.442069:0:8611:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7400d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8611:1848987627304576:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333178.442084:0:8611:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c58250 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.442088:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99000/0xb32e3ef184c5826c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a169 expref: 248 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.442109:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1cc:0x0].0x0 (ffff92ff621aca00) 00010000:00010000:2.0:1763333178.442112:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763333178.442116:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff73a99000, rc 0) 00000100:00100000:2.0:1763333178.442182:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:55917:x1848987613826816:12345-192.168.204.28@tcp:101:bash.0 Request processed in 408us (3862us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333178.442190:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9605 00000100:00100000:3.0:1763333178.443342:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333178.443428:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333178.446580:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613826944 00000100:00100000:1.0:1763333178.446599:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613826944 00010000:00010000:1.0:1763333178.446670:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c58123 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a115 expref: 22 pid: 29010 timeout: 1382 lvb_type: 0 00000100:00100000:1.0:1763333178.446729:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613827072 00000100:00100000:1.0:1763333178.446733:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613827072 00000100:00100000:0.0:1763333178.446752:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3163 00010000:00010000:1.0:1763333178.446755:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c5811c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a10e expref: 13 pid: 29010 timeout: 1382 lvb_type: 0 00000100:00100000:0.0:1763333178.446772:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2421:x1848987613826944:12345-192.168.204.28@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1763333178.446788:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3164 00010000:00010000:0.0:1763333178.446797:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1763333178.446798:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2421:x1848987613827072:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333178.446808:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c58123 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x257:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a115 expref: 22 pid: 29010 timeout: 1382 lvb_type: 0 00010000:00010000:1.0:1763333178.446813:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333178.446822:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c5811c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x257:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a10e expref: 13 pid: 29010 timeout: 1382 lvb_type: 0 00010000:00010000:0.0:1763333178.446829:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c58123 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x257:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a115 expref: 22 pid: 29010 timeout: 1382 lvb_type: 0 00010000:00010000:1.0:1763333178.446840:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c5811c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x257:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a10e expref: 13 pid: 29010 timeout: 1382 lvb_type: 0 00010000:00010000:0.0:1763333178.446867:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c58123 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x257:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a115 expref: 22 pid: 29010 timeout: 1382 lvb_type: 0 00010000:00010000:1.0:1763333178.446870:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c5811c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x257:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a10e expref: 13 pid: 29010 timeout: 1382 lvb_type: 0 00010000:00010000:1.0:1763333178.446902:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333178.446902:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333178.446906:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333178.446907:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333178.446916:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c58250 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.446917:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c58249 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.446940:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c58249 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.446940:0:6506:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c58250 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.446993:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333178.446993:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333178.447087:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:2421:x1848987613827072:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 290us (3657us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333178.447096:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3164 00010000:00010000:1.0:1763333178.447137:0:28651:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c58249 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.447147:0:28651:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c58249 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.447158:0:28651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c58249 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.447167:0:28651:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c58249 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.447203:0:28651:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763333178.447559:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333178.447569:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c58249 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.447580:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333178.447586:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c58249 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.447597:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c58249 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.447612:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c58249 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.447620:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c58249 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.447645:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333178.447647:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333178.447649:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763333178.447752:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2421:x1848987613826944:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 986us (4415us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333178.447760:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3163 00010000:00010000:0.0:1763333178.447788:0:8611:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c58250 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.447798:0:8611:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c58250 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.447806:0:8611:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c58250 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.447814:0:8611:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c58250 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.447839:0:8611:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763333178.448053:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+25:3655:x1848987627303936:12345-0@lo:6:osp-syn-1-1.0 Request processed in 14859us (15383us total) trans 17179871702 rc 0/0 00000100:00100000:0.0:1763333178.448062:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6797 00010000:00010000:3.0:1763333178.448314:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333178.448321:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c58250 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.448329:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea800 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333178.448333:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c58250 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.448340:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c58250 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.448387:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c58250 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.448399:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c58250 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.448432:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333178.448433:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333178.448435:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763333178.449720:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7e00f800/2, rc 0, transno 17179871702 00000100:00100000:2.0:1763333178.449736:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e00f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627303936:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763333178.452937:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.453015:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.453053:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613827200 00000100:00100000:2.0:1763333178.453066:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613827200 00000100:00100000:2.0:1763333178.453135:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613827456 00000100:00100000:2.0:1763333178.453140:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613827456 00000100:00100000:2.0:1763333178.453167:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9606 00000100:00100000:2.0:1763333178.453178:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74034380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:56911:x1848987613827200:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333178.453211:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333178.453242:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99200/0xb32e3ef184c58273 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a170 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.453332:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99200/0xb32e3ef184c58273 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a170 expref: 250 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.453371:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99200/0xb32e3ef184c58273 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a170 expref: 250 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.453399:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c9:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:2.0:1763333178.453403:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333178.453415:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff73a99200, rc 0) 00000100:00100000:2.0:1763333178.453480:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74034380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:56911:x1848987613827200:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 305us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333178.453489:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9606 00000100:00100000:2.0:1763333178.453512:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9607 00000100:00100000:2.0:1763333178.453518:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74034a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:55917:x1848987613827456:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:2.0:1763333178.453565:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333178.453588:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c5823b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a162 expref: 249 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.453602:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1cc:0x0].0x0 (ffff92ff621aca00) 00010000:00010000:2.0:1763333178.453605:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333178.453838:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99800/0xb32e3ef184c5827a lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1cc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333178.453849:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99800/0xb32e3ef184c5827a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1cc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.453859:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99800/0xb32e3ef184c5827a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1cc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000001:00080000:2.0:1763333178.453910:0:6519:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294972575 00000004:00010000:2.0:1763333178.453932:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002d362d2f reply state 0000000095efab4d transno 4294972576 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99800/0xb32e3ef184c5827a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1cc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.453945:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99800/0xb32e3ef184c5827a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1cc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.453953:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1cc:0x0].0x0 (ffff92ff621aca00) 00010000:00010000:2.0:1763333178.453955:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333178.453958:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763333178.454015:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74034a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:55917:x1848987613827456:12345-192.168.204.28@tcp:36:bash.0 Request processed in 497us (1000us total) trans 4294972576 rc 0/0 00000100:00100000:2.0:1763333178.454023:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9607 00000020:00080000:2.0:1763333178.454027:0:6519:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763333178.455202:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+9:3655:x1848987627303424:12345-0@lo:6:osp-syn-0-1.0 Request processed in 22294us (22668us total) trans 21474839007 rc 0/0 00000100:00100000:1.0:1763333178.455219:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6795 00000004:00080000:2.0:1763333178.457235:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff5004bb80/2, rc 0, transno 21474839007 00000100:00100000:2.0:1763333178.457253:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff5004bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627303424:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763333178.457672:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333178.458300:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613827584 00000100:00100000:3.0:1763333178.458315:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613827584 00000100:00100000:3.0:1763333178.458456:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9608 00000100:00100000:3.0:1763333178.458469:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:55917:x1848987613827584:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333178.458498:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333178.458528:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c58281 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1cc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a177 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.458609:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c58281 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1cc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a177 expref: 252 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.458629:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c58281 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1cc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a177 expref: 252 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.458653:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1cc:0x0].0x0 (ffff92ff621aca00) 00010000:00010000:3.0:1763333178.458657:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763333178.458661:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feaa00, rc 0) 00000100:00100000:3.0:1763333178.458745:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:55917:x1848987613827584:12345-192.168.204.28@tcp:101:bash.0 Request processed in 278us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333178.458755:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9608 00000100:00100000:3.0:1763333178.459443:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333178.459777:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613827840 00000100:00100000:0.0:1763333178.459786:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613827840 00000100:00100000:0.0:1763333178.459840:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3280 00000100:00100000:0.0:1763333178.459851:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:56911:x1848987613827840:12345-192.168.204.28@tcp:35:lfs.0 00000004:00080000:0.0:1763333178.460159:0:19668:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x1c9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1763333178.460243:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1500, 64 off126216 00000040:00080000:0.0:1763333178.460270:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1501, 64 off126216 00000040:00080000:0.0:1763333178.460280:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1502, 64 off126280 00000040:00080000:0.0:1763333178.460290:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1501, 64 off126280 00010000:00010000:0.0:1763333178.460430:0:19668:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c58288 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19668 initiator: MDT0 00010000:00010000:0.0:1763333178.460447:0:19668:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c58288 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333178.460461:0:19668:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c58288 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1c9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333178.460471:0:19668:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c58288 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1c9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333178.460477:0:19668:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c58288 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1c9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333178.460483:0:19668:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c58288 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1c9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333178.460508:0:19668:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763333178.460597:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763333178.460607:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c58288 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1c9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333178.460617:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4800 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333178.460622:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c58288 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1c9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333178.460632:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c58288 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1c9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333178.460647:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1c9:0x0].0x0 (ffff92fe44e12400) 00010000:00010000:2.0:1763333178.460650:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1763333178.460654:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c58288 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1c9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333178.460660:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4800/0xb32e3ef184c58288 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1c9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333178.460672:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333178.460675:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763333178.460678:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763333178.460736:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:56911:x1848987613827840:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 885us (1295us total) trans 4294972577 rc 0/0 00000100:00100000:0.0:1763333178.460746:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3280 00000100:00100000:3.0:1763333178.473162:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333178.473221:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333178.473896:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613828096 00000100:00100000:0.0:1763333178.473897:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613828352 00000100:00100000:0.0:1763333178.473911:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613828352 00000100:00100000:1.0:1763333178.473912:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613828096 00000100:00100000:1.0:1763333178.474326:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9609 00000100:00100000:0.0:1763333178.474336:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9610 00000100:00100000:1.0:1763333178.474343:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+254:55917:x1848987613828096:12345-192.168.204.28@tcp:101:bash.0 00000100:00100000:0.0:1763333178.474383:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+254:56911:x1848987613828352:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333178.474404:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333178.474433:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763333178.474440:0:29240:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333178.474472:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c58281 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1cc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a177 expref: 254 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.474472:0:29240:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5828f lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a185 expref: -99 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.474507:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1cc:0x0].0x0 (ffff92ff621aca00) 00010000:00010000:1.0:1763333178.474513:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333178.474524:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c58296 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1cc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a17e expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.474578:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c5829d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1cc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:0.0:1763333178.474594:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c582a4 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:1.0:1763333178.474595:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c5829d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1cc:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.474614:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c582a4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333178.474618:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c5829d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1cc:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.474627:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c582a4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.474644:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c582ab lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:0.0:1763333178.474651:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c582ab lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.474658:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c582ab lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.474809:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c582b2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:0.0:1763333178.474818:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c582b2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.474825:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c582b2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00000004:00200000:0.0:1763333178.474836:0:29240:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1cc:0x0]: returning size 0 00000040:00080000:1.0:1763333178.474916:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1502, 88 off126368 00000004:00080000:1.0:1763333178.474927:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1282554577257ns, next at 1283390392964ns, rc = 0 00000040:00080000:1.0:1763333178.474971:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1503, 88 off126368 00000004:00080000:1.0:1763333178.474976:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1282554626707ns, next at 1282771249577ns, rc = 0 00000040:00080000:1.0:1763333178.475001:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1504, 88 off126456 00000004:00080000:1.0:1763333178.475006:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1282554656905ns, next at 1282771249577ns, rc = 0 00000040:00080000:1.0:1763333178.475015:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1503, 88 off126456 00000004:00080000:1.0:1763333178.475018:0:8606:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1282554669541ns, next at 1283390392964ns, rc = 0 00010000:00010000:0.0:1763333178.476057:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c582b2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.476071:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c582b2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.476078:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c582b2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.476085:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333178.476090:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c582b2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.476097:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c582b2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.476114:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1cc:0x0].0x0 (ffff92ff621aca00) 00010000:00010000:0.0:1763333178.476117:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1763333178.476121:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c582b2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.476127:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c582b2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.476147:0:29240:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c582a4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.476153:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c582a4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.476158:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c582a4 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.476164:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c582a4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.476169:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4a00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333178.476171:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c582a4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.476176:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c582a4 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.476183:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44100) 00010000:00010000:0.0:1763333178.476186:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333178.476189:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c582a4 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.476194:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c582a4 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.476205:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c582ab lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.476211:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c582ab lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.476217:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c582ab lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.476222:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333178.476225:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c582ab lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.476230:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c582ab lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.476237:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b44200) 00010000:00010000:0.0:1763333178.476240:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333178.476242:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c582ab lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.476247:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c582ab lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.476306:0:29240:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5828f lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a185 expref: 256 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.476316:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44100) 00010000:00010000:0.0:1763333178.476318:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763333178.476321:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5828f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a185 expref: 256 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.476337:0:29240:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5400, rc 0) 00000100:00100000:0.0:1763333178.476889:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+255:56911:x1848987613828352:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 2539us (3663us total) trans 4294972578 rc 301/301 00000100:00100000:0.0:1763333178.476899:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9610 00000100:00100000:2.0:1763333178.486256:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333178.486612:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613828480 00000100:00100000:0.0:1763333178.486626:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613828480 00000100:00100000:0.0:1763333178.486704:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9611 00000100:00100000:0.0:1763333178.486716:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74035880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+256:56911:x1848987613828480:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333178.486744:0:29240:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333178.486773:0:29240:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c582c0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1cc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a18c expref: -99 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.489426:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c582c7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:0.0:1763333178.489455:0:29240:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c5829d lrc: 2/0,1 mode: EX/EX res: [0x240000404:0x1cc:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.489467:0:29240:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c582c7 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.489493:0:29240:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c5829d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1cc:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 8606 initiator: MDT1 00010000:00010000:0.0:1763333178.489507:0:29240:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c582c7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00000001:00080000:3.0:1763333178.496194:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972579 is committed 00000004:00080000:3.0:1763333178.496220:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 983 committed 00000004:00080000:3.0:1763333178.496242:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 986 committed 00000100:00100000:0.0:1763333178.496471:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77b15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627305088:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333178.496561:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333178.496620:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763333178.496626:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627304704:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763333178.496645:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333178.496672:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77b14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627304960:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333178.496692:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333178.496723:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1763333178.496728:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627304832:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763333178.496750:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1763333178.496779:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99800/0xb32e3ef184c5827a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1cc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00000100:00100000:0.0:1763333178.496781:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627305088 00000100:00100000:0.0:1763333178.496790:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627305088 00010000:00010000:2.0:1763333178.496803:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99800/0xb32e3ef184c5827a lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1cc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.496811:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99800/0xb32e3ef184c5827a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1cc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.496817:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff73a99800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333178.496822:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99800/0xb32e3ef184c5827a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1cc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.496829:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99800/0xb32e3ef184c5827a lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1cc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00000100:00100000:0.0:1763333178.496845:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627304704 00000100:00100000:0.0:1763333178.496848:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627304704 00010000:00010000:2.0:1763333178.496850:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1cc:0x0].0x0 (ffff92ff621aca00) 00010000:00010000:2.0:1763333178.496853:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333178.496857:0:3639:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c582c7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00000100:00100000:0.0:1763333178.496865:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627304960 00000100:00100000:0.0:1763333178.496867:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627304960 00010000:00010000:2.0:1763333178.496872:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99800/0xb32e3ef184c5827a lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1cc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.496879:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99800/0xb32e3ef184c5827a lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1cc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00000100:00100000:0.0:1763333178.496880:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627304832 00000100:00100000:0.0:1763333178.496882:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627304832 00000100:00100000:0.0:1763333178.496903:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6803 00000100:00100000:0.0:1763333178.496913:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+28:3654:x1848987627305088:12345-0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1763333178.496979:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 985 committed 00000100:00100000:1.0:1763333178.497095:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e121500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627305472:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1763333178.497125:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333178.497145:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1763333178.497147:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+29:3654:x1848987627305088:12345-0@lo:2:osp-syn-1-1.0 Request processed in 234us (585us total) trans 17179871703 rc 0/0 00000100:00100000:1.0:1763333178.497150:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e120000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627305344:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763333178.497156:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6803 00000100:00100000:1.0:1763333178.497169:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333178.497175:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627305472 00000100:00100000:0.0:1763333178.497178:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627305472 00000100:00100000:1.0:1763333178.497188:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e121880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627305600:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333178.497193:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627305344 00000100:00100000:0.0:1763333178.497195:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627305344 00000100:00100000:0.0:1763333178.497206:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6804 00000100:00100000:1.0:1763333178.497208:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333178.497212:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+28:3654:x1848987627304704:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1763333178.497227:0:8611:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:597 count 1 00000004:00080000:1.0:1763333178.497240:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff77b15500/2, rc 0, transno 17179871703 00000100:00100000:1.0:1763333178.497246:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77b15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627305088:0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1763333178.497248:0:8611:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c582ce lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333178.497253:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1763333178.497258:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e122d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627305216:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1763333178.497269:0:8611:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c580b3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x255:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0e4 expref: 20 pid: 28651 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1763333178.497275:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1763333178.497279:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333178.497282:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333178.497287:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c582ce lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333178.497314:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627305600 00000100:00100000:1.0:1763333178.497317:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627305600 00010000:00010000:0.0:1763333178.497317:0:8611:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c580b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x255:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0e4 expref: 20 pid: 28651 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333178.497332:0:8611:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c580b3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x255:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0e4 expref: 20 pid: 28651 timeout: 1382 lvb_type: 1 00000100:00100000:1.0:1763333178.497333:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627305216 00000100:00100000:1.0:1763333178.497336:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627305216 00000100:00100000:0.0:1763333178.497345:0:8611:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff6bc10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8611:1848987627305728:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333178.497369:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6805 00000100:00100000:1.0:1763333178.497376:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+28:3653:x1848987627304960:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333178.497450:0:8611:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff6be073c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763333178.497470:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6806 00000100:00100000:1.0:1763333178.497473:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+29:3653:x1848987627304960:12345-0@lo:2:osp-syn-1-1.0 Request processed in 97us (780us total) trans 17179871704 rc 0/0 00000100:00100000:0.0:1763333178.497477:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+29:3653:x1848987627304832:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763333178.497480:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6805 00002000:00080000:0.0:1763333178.497492:0:29013:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:598 count 1 00000100:00100000:1.0:1763333178.497494:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6807 00000100:00100000:1.0:1763333178.497499:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+12:3653:x1848987627305472:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1763333178.497506:0:29013:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c582d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.497519:0:29013:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c581d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a14d expref: 20 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.497525:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333178.497527:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333178.497530:0:29013:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c582d5 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.497548:0:29013:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c581d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a14d expref: 20 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.497558:0:29013:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c581d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a14d expref: 20 pid: 28650 timeout: 1382 lvb_type: 0 00000100:00100000:0.0:1763333178.497567:0:29013:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff6bc10380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:29013:1848987627305856:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333178.497589:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+13:3653:x1848987627305472:12345-0@lo:2:osp-syn-0-1.0 Request processed in 90us (463us total) trans 21474839008 rc 0/0 00000100:00100000:0.0:1763333178.497589:0:29013:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff6be07780 going to sleep for 11 seconds 00000100:00100000:1.0:1763333178.497595:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6807 00000100:00100000:1.0:1763333178.497607:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6808 00000100:00100000:1.0:1763333178.497613:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+12:3653:x1848987627305344:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763333178.498296:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6809 00000100:00100000:0.0:1763333178.498310:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+12:3654:x1848987627305600:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333178.498503:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+13:3654:x1848987627305600:12345-0@lo:2:osp-syn-0-1.0 Request processed in 197us (1292us total) trans 21474839009 rc 0/0 00000100:00100000:0.0:1763333178.498510:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6809 00000100:00100000:0.0:1763333178.498527:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6810 00000100:00100000:0.0:1763333178.498535:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+12:3654:x1848987627305216:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1763333178.498547:0:17605:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:597 count 1 00010000:00010000:0.0:1763333178.498564:0:17605:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c582dc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x255:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.498579:0:17605:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57fcc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x255:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a097 expref: 11 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.498587:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333178.498590:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333178.498593:0:17605:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c582dc lrc: 4/0,1 mode: --/PW res: [0x280000400:0x255:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.498618:0:17605:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57fcc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x255:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a097 expref: 11 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.498629:0:17605:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57fcc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x255:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a097 expref: 11 pid: 8406 timeout: 1382 lvb_type: 0 00000100:00100000:0.0:1763333178.498639:0:17605:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff6bc12300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17605:1848987627305984:192.168.204.28@tcp:104: 00000004:00080000:3.0:1763333178.498810:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 982 committed 00000100:00100000:0.0:1763333178.499374:0:17605:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff801ac180 going to sleep for 11 seconds 00002000:00080000:1.0:1763333178.500940:0:28600:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:598 count 1 00010000:00010000:1.0:1763333178.500980:0:28600:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe48191800/0xb32e3ef184c582e3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x256:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.501010:0:28600:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c581bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x256:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a13f expref: 11 pid: 29010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.501019:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333178.501021:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333178.501025:0:28600:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe48191800/0xb32e3ef184c582e3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x256:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1763333178.501198:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7e121880/2, rc 0, transno 21474839009 00010000:00010000:1.0:1763333178.501205:0:28600:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c581bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x256:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a13f expref: 11 pid: 29010 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333178.501208:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e121880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627305600:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1763333178.501220:0:28600:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c581bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x256:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a13f expref: 11 pid: 29010 timeout: 1382 lvb_type: 0 00000100:00100000:1.0:1763333178.501240:0:28600:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e121c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28600:1848987627306112:192.168.204.28@tcp:104: 00000004:00080000:2.0:1763333178.501503:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7e121500/2, rc 0, transno 21474839008 00000100:00100000:2.0:1763333178.501510:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e121500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627305472:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1763333178.501540:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff77b14a80/2, rc 0, transno 17179871704 00000100:00100000:2.0:1763333178.501545:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77b14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627304960:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333178.502191:0:28600:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff47e19780 going to sleep for 11 seconds 00010000:00010000:1.0:1763333178.502283:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c5829d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1cc:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a17e expref: 251 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.502299:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1cc:0x0].0x0 (ffff92ff621aca00) 00010000:00010000:1.0:1763333178.502303:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763333178.502308:0:8606:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c582c7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333178.502319:0:8606:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c582c7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333178.502327:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c582c7 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333178.502397:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191600/0xb32e3ef184c58296 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1cc:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a17e expref: 251 pid: 8606 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763333178.502431:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c5829d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1cc:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a17e expref: 250 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.502471:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48190200, rc 0) 00000100:00100000:1.0:1763333178.502522:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:55917:x1848987613828096:12345-192.168.204.28@tcp:101:bash.0 Request processed in 28184us (29374us total) trans 4294972579 rc 0/0 00010000:00010000:0.0:1763333178.502527:0:29240:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c582c7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00000100:00100000:1.0:1763333178.502533:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9609 00010000:00010000:0.0:1763333178.502536:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c582c7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00000004:00200000:0.0:1763333178.502604:0:29240:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1cc:0x0]: returning size 2 00000004:00200000:0.0:1763333178.502609:0:29240:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763333178.502634:0:29240:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c582c7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.502663:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c582c0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1cc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a18c expref: 250 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.502676:0:29240:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c582c7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a18c expref: 249 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.502687:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1cc:0x0].0x0 (ffff92ff621aca00) 00010000:00010000:0.0:1763333178.502690:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1763333178.502692:0:29240:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff4148ee00, rc 0) 00000100:00100000:0.0:1763333178.502739:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74035880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:56911:x1848987613828480:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 16026us (16496us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333178.502746:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9611 00000100:00100000:0.0:1763333178.507979:0:8611:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff6bc10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8611:1848987627305728:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333178.508034:0:8611:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c582ce lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333178.515456:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333178.515503:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.515523:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613828608 00000100:00100000:2.0:1763333178.515536:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613828608 00010000:00010000:2.0:1763333178.515593:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c580b3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x255:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0e4 expref: 21 pid: 28651 timeout: 1382 lvb_type: 1 00000100:00100000:1.0:1763333178.515607:0:28600:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e121c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28600:1848987627306112:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333178.515630:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613828864 00000100:00100000:2.0:1763333178.515633:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613828864 00010000:00010000:1.0:1763333178.515636:0:28600:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe48191800/0xb32e3ef184c582e3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x256:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.515644:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c581d9 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a14d expref: 22 pid: 28650 timeout: 1382 lvb_type: 0 00000100:00100000:2.0:1763333178.515674:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3165 00000100:00100000:2.0:1763333178.515685:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff820e2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2421:x1848987613828608:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333178.515840:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333178.515849:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c580b3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x255:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0e4 expref: 22 pid: 28651 timeout: 1382 lvb_type: 1 00010000:00010000:2.0:1763333178.515863:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c580b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x255:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0e4 expref: 22 pid: 28651 timeout: 1382 lvb_type: 1 00010000:00010000:2.0:1763333178.515892:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe44c39000/0xb32e3ef184c580b3 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x255:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a0e4 expref: 22 pid: 28651 timeout: 1382 lvb_type: 1 00010000:00010000:2.0:1763333178.515927:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333178.515930:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333178.515936:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c582ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.515948:0:6506:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c582ce lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.515977:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333178.516039:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff820e2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2421:x1848987613828608:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 355us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333178.516048:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3165 00000100:00100000:2.0:1763333178.516107:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3166 00000100:00100000:2.0:1763333178.516114:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e123480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2419:x1848987613828864:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333178.516122:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333178.516127:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c581d9 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a14d expref: 20 pid: 28650 timeout: 1382 lvb_type: 0 00010000:00010000:2.0:1763333178.516136:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c581d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a14d expref: 20 pid: 28650 timeout: 1382 lvb_type: 0 00010000:00010000:2.0:1763333178.516151:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333178.516152:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333178.516156:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c582d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.516164:0:6506:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c582d5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.516178:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333178.516197:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e123480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2419:x1848987613828864:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 83us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333178.516204:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3166 00010000:00010000:0.0:1763333178.516558:0:29013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c581d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a14d expref: 19 pid: 28650 timeout: 1382 lvb_type: 0 00000100:00100000:0.0:1763333178.516572:0:29013:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff6bc10380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:29013:1848987627305856:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333178.516592:0:29013:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c582d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.516601:0:29013:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c582d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.516609:0:29013:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c582d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.516620:0:29013:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c582d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333178.516629:0:17605:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff6bc12300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17605:1848987627305984:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333178.516629:0:29013:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c582d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.516648:0:17605:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c582dc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x255:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.516648:0:29013:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763333178.516968:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+29:3653:x1848987627304832:12345-0@lo:6:osp-syn-1-1.0 Request processed in 19489us (20215us total) trans 17179871705 rc 0/0 00000100:00100000:0.0:1763333178.516977:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6806 00000004:00080000:3.0:1763333178.517005:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff77b16680/2, rc 0, transno 17179871705 00010000:00010000:0.0:1763333178.517006:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1763333178.517013:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627304832:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1763333178.517013:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c582d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.517021:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe467bf200 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333178.517026:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c582d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.517036:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c582d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.517052:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c582d5 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.517059:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c582d5 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.517078:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333178.517080:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333178.517082:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333178.517094:0:8611:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c582ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.517102:0:8611:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c582ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.517110:0:8611:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c582ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.517117:0:8611:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c582ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.517140:0:8611:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763333178.517389:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+29:3654:x1848987627304704:12345-0@lo:6:osp-syn-1-1.0 Request processed in 20176us (20741us total) trans 17179871706 rc 0/0 00000100:00100000:0.0:1763333178.517397:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6804 00000004:00080000:0.0:1763333178.517442:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff77b14380/2, rc 0, transno 17179871706 00000100:00100000:0.0:1763333178.517447:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627304704:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1763333178.517966:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333178.517974:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c582ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.517982:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff4148e600 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333178.517985:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c582ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.517992:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c582ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.518007:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c582ce lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.518019:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c582ce lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.518038:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333178.518039:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333178.518041:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763333178.520595:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.521224:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333178.523367:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613829120 00000100:00100000:1.0:1763333178.523367:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613828992 00000100:00100000:3.0:1763333178.523385:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613829120 00000100:00100000:1.0:1763333178.523385:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613828992 00010000:00010000:3.0:1763333178.523455:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c581bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x256:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a13f expref: 13 pid: 29010 timeout: 1382 lvb_type: 0 00000100:00100000:2.0:1763333178.523482:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333178.523502:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3167 00000100:00100000:3.0:1763333178.523512:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2420:x1848987613829120:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333178.523532:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333178.523538:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c581bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x256:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a13f expref: 13 pid: 29010 timeout: 1382 lvb_type: 0 00010000:00010000:3.0:1763333178.523553:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c581bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x256:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a13f expref: 13 pid: 29010 timeout: 1382 lvb_type: 0 00000100:00100000:0.0:1763333178.523575:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613829248 00000100:00100000:0.0:1763333178.523582:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613829248 00010000:00010000:3.0:1763333178.523583:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c581bd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x256:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a13f expref: 13 pid: 29010 timeout: 1382 lvb_type: 0 00010000:00010000:3.0:1763333178.523607:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333178.523609:0:28428:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333178.523616:0:28428:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe48191800/0xb32e3ef184c582e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x256:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333178.523627:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6811 00010000:00010000:3.0:1763333178.523631:0:28428:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe48191800/0xb32e3ef184c582e3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x256:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333178.523637:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:55917:x1848987613829248:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333178.523672:0:8611:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333178.523673:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333178.523708:0:8611:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe467be000/0xb32e3ef184c582ea lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a19a expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763333178.523737:0:8611:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x259:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1763333178.523743:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:2420:x1848987613829120:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 229us (2518us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333178.523753:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3167 00010000:00010000:0.0:1763333178.523760:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333178.523764:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333178.523772:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe467be000/0xb32e3ef184c582ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a19a expref: 20 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.523789:0:8611:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe467be000/0xb32e3ef184c582ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a19a expref: 20 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.523801:0:8611:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe467be000, rc 0) 00000100:00100000:0.0:1763333178.523829:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:55917:x1848987613829248:12345-192.168.204.28@tcp:101:bash.0 Request processed in 195us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333178.523836:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6811 00000100:00100000:2.0:1763333178.524114:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:1.0:1763333178.524797:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57fcc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x255:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a097 expref: 12 pid: 8406 timeout: 1382 lvb_type: 0 00000100:00100000:1.0:1763333178.524839:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3168 00000100:00100000:1.0:1763333178.524853:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74035c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:2420:x1848987613828992:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333178.524867:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333178.524872:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57fcc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x255:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a097 expref: 11 pid: 8406 timeout: 1382 lvb_type: 0 00010000:00010000:1.0:1763333178.524885:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57fcc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x255:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a097 expref: 11 pid: 8406 timeout: 1382 lvb_type: 0 00010000:00010000:1.0:1763333178.524905:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4874ba00/0xb32e3ef184c57fcc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x255:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a097 expref: 11 pid: 8406 timeout: 1382 lvb_type: 0 00010000:00010000:1.0:1763333178.524919:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333178.524921:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333178.524924:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c582dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x255:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.524934:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c582dc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x255:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.524962:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333178.524996:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74035c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+10:2420:x1848987613828992:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 150us (4424us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333178.525003:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3168 00010000:00010000:1.0:1763333178.525032:0:28600:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe48191800/0xb32e3ef184c582e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.525042:0:28600:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe48191800/0xb32e3ef184c582e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.525051:0:28600:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe48191800/0xb32e3ef184c582e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.525058:0:28600:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe48191800/0xb32e3ef184c582e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.525077:0:28600:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763333178.525488:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+13:3653:x1848987627305344:12345-0@lo:6:osp-syn-0-1.0 Request processed in 27873us (28315us total) trans 21474839010 rc 0/0 00000100:00100000:1.0:1763333178.525497:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6808 00000004:00080000:1.0:1763333178.525553:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7e120000/2, rc 0, transno 21474839010 00000100:00100000:1.0:1763333178.525560:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e120000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627305344:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1763333178.525582:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333178.525589:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe48191800/0xb32e3ef184c582e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.525603:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48191800 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333178.525608:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe48191800/0xb32e3ef184c582e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.525617:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe48191800/0xb32e3ef184c582e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.525628:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe48191800/0xb32e3ef184c582e3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.525635:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe48191800/0xb32e3ef184c582e3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.525654:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333178.525655:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333178.525657:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333178.526953:0:17605:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c582dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.526976:0:17605:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c582dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.526988:0:17605:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c582dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.526997:0:17605:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c582dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.527035:0:17605:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763333178.527329:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+13:3654:x1848987627305216:12345-0@lo:6:osp-syn-0-1.0 Request processed in 28791us (30048us total) trans 21474839011 rc 0/0 00000100:00100000:3.0:1763333178.527340:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6810 00010000:00010000:1.0:1763333178.528271:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333178.528284:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c582dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.528296:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe467bf600 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333178.528300:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c582dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.528310:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c582dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.528339:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c582dc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.528365:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c582dc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.528392:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333178.528394:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333178.528396:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763333178.528992:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7e122d80/2, rc 0, transno 21474839011 00000100:00100000:0.0:1763333178.529005:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e122d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627305216:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763333178.529048:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613828736 00000100:00100000:0.0:1763333178.529057:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613828736 00000100:00100000:0.0:1763333178.529140:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9612 00000100:00100000:0.0:1763333178.529152:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:56911:x1848987613828736:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333178.529185:0:29240:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333178.529212:0:29240:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c582f1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1cc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a193 expref: -99 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.529286:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c582f1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1cc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a193 expref: 250 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.529303:0:29240:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c582f1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1cc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a193 expref: 250 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.529329:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1cc:0x0].0x0 (ffff92ff621aca00) 00010000:00010000:0.0:1763333178.529333:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763333178.529337:0:29240:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe467bf200, rc 0) 00000100:00100000:0.0:1763333178.529447:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:56911:x1848987613828736:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 297us (5333us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333178.529454:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9612 00000100:00100000:1.0:1763333178.538465:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333178.538501:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333178.538967:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.539068:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613829376 00000100:00100000:2.0:1763333178.539082:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613829376 00000100:00100000:0.0:1763333178.539237:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613829632 00000100:00100000:0.0:1763333178.539242:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613829632 00000100:00100000:0.0:1763333178.539325:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 413 00000100:00100000:0.0:1763333178.539337:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:2421:x1848987613829632:12345-192.168.204.28@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1763333178.539447:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613829504 00000100:00100000:2.0:1763333178.539451:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613829504 00000100:00100000:2.0:1763333178.539475:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6812 00000100:00100000:2.0:1763333178.539484:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2418:x1848987613829376:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333178.539504:0:28600:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333178.539528:0:28600:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c582f8 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x259:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a1a1 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333178.539618:0:28600:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe45180a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28600:1848987627306240:192.168.204.28@tcp:106: 00000100:00100000:2.0:1763333178.539732:0:28600:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff5c588b40 going to sleep for 11 seconds 00010000:00010000:0.0:1763333178.539976:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333178.540009:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c582f1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1cc:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a193 expref: 250 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.540030:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1cc:0x0].0x0 (ffff92ff621aca00) 00010000:00010000:0.0:1763333178.540036:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333178.540089:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:2421:x1848987613829632:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 753us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333178.540097:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 413 00000100:00100000:0.0:1763333178.540135:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6813 00000100:00100000:0.0:1763333178.540147:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+10:55917:x1848987613829504:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333178.540159:0:29013:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333178.540179:0:29013:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c582ff lrc: 2/0,0 mode: --/PW res: [0x280000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a1a8 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763333178.540213:0:29013:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x259:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333178.540233:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333178.540236:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333178.540248:0:29013:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c582ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1a8 expref: 11 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.540264:0:29013:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c582ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1a8 expref: 11 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.540277:0:29013:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe467bf600, rc 0) 00000100:00100000:0.0:1763333178.540298:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+11:55917:x1848987613829504:12345-192.168.204.28@tcp:101:bash.0 Request processed in 155us (1797us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333178.540304:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6813 00002000:00010000:0.0:1763333178.547167:0:28600:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000400:0x259:0x0] updating lvb mtime: 0 -> 1763333178 00002000:00010000:0.0:1763333178.547179:0:28600:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000400:0x259:0x0] updating lvb atime: 0 -> 1763333178 00002000:00010000:0.0:1763333178.547182:0:28600:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000400:0x259:0x0] updating lvb ctime: 0 -> 1763333178 00000100:00100000:0.0:1763333178.547211:0:28600:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe45180a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28600:1848987627306240:192.168.204.28@tcp:106: 00010000:00010000:0.0:1763333178.547258:0:28600:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c582f8 lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0x259:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1a1 expref: 21 pid: 28600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333178.547287:0:28600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c582f8 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x259:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1a1 expref: 21 pid: 28600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333178.547302:0:28600:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5e00, rc 0) 00000100:00100000:0.0:1763333178.547415:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2418:x1848987613829376:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 7924us (8957us total) trans 0 rc 301/301 00000100:00100000:0.0:1763333178.547427:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6812 00000100:00100000:3.0:1763333178.553021:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333178.553144:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613829760 00000100:00100000:1.0:1763333178.553159:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613829760 00002000:00010000:1.0:1763333178.553211:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/601 (0->18446744073709551615) 00002000:00100000:1.0:1763333178.553217:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7400c000 with x1848987613829760 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333178.553233:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff7400c000. 00000100:00100000:1.0:1763333178.553277:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1671 00000100:00100000:1.0:1763333178.553288:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2421:x1848987613829760:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:1.0:1763333178.553580:0:28427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x259:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333178.553585:0:28427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x259:0x0] updating lvb mtime from disk: 1763333178 -> 1763333178 00002000:00010000:1.0:1763333178.553589:0:28427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x259:0x0] updating lvb atime from disk: 1763333178 -> 0 00002000:00010000:1.0:1763333178.553591:0:28427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x259:0x0] updating lvb ctime from disk: 1763333178 -> 1763333178 00002000:00010000:1.0:1763333178.553594:0:28427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x259:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333178.553672:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2421:x1848987613829760:12345-192.168.204.28@tcp:10:bash.0 Request processed in 384us (666us total) trans 17179871707 rc 0/0 00000100:00100000:1.0:1763333178.553682:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1671 00002000:00010000:1.0:1763333178.553687:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/601 (0->18446744073709551615) 00002000:00100000:1.0:1763333178.553690:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7400c000 with x1848987613829760 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333178.553695:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff7400c000. 00000100:00100000:2.0:1763333178.556788:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333178.556844:0:28429:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613829888 00000100:00100000:0.0:1763333178.556858:0:28429:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613829888 00002000:00010000:0.0:1763333178.556915:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/601 (0->18446744073709551615) 00002000:00100000:0.0:1763333178.556921:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45183b80 with x1848987613829888 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333178.556937:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe45183b80. 00000100:00100000:3.0:1763333178.557150:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.557246:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613830144 00000100:00100000:2.0:1763333178.557251:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613830144 00000100:00100000:1.0:1763333178.557280:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1672 00000100:00100000:1.0:1763333178.557300:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+11:2420:x1848987613829888:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:1.0:1763333178.557565:0:28427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x259:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333178.557569:0:28427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x259:0x0] updating lvb mtime from disk: 0 -> 1763333178 00002000:00010000:1.0:1763333178.557571:0:28427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x259:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333178.557573:0:28427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x259:0x0] updating lvb ctime from disk: 0 -> 1763333178 00002000:00010000:1.0:1763333178.557576:0:28427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x259:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333178.557640:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:2420:x1848987613829888:12345-192.168.204.28@tcp:10:bash.0 Request processed in 349us (868us total) trans 21474839012 rc 0/0 00000100:00100000:1.0:1763333178.557646:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1672 00002000:00010000:1.0:1763333178.557651:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/601 (0->18446744073709551615) 00002000:00100000:1.0:1763333178.557654:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45183b80 with x1848987613829888 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333178.557658:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe45183b80. 00000100:00100000:3.0:1763333178.557861:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3281 00000100:00100000:1.0:1763333178.557900:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6b3ee850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:56911:x1848987613830144:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1763333178.558106:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6b3ee850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:56911:x1848987613830144:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 235us (956us total) trans 4294972580 rc 0/0 00000100:00100000:1.0:1763333178.558113:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3281 00000100:00100000:3.0:1763333178.563830:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.563830:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333178.563944:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613830656 00000100:00100000:0.0:1763333178.563958:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613830656 00000100:00100000:0.0:1763333178.564017:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3282 00000100:00100000:0.0:1763333178.564029:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:55917:x1848987613830656:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:0.0:1763333178.564441:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:55917:x1848987613830656:12345-192.168.204.28@tcp:35:bash.0 Request processed in 413us (623us total) trans 4294972581 rc 0/0 00000100:00100000:0.0:1763333178.564450:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3282 00000100:00100000:0.0:1763333178.564484:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613830400 00000100:00100000:0.0:1763333178.564488:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613830400 00000100:00100000:0.0:1763333178.564527:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9613 00000100:00100000:0.0:1763333178.564535:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:56911:x1848987613830400:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333178.564547:0:29240:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333178.564581:0:29240:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c58306 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a1af expref: -99 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.564665:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c5830d lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:0.0:1763333178.564683:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c5830d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.564697:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c5830d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.564711:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c58314 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:0.0:1763333178.564718:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c58314 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.564723:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c58314 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.564826:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5831b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:0.0:1763333178.564837:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5831b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.564844:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5831b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00000004:00200000:0.0:1763333178.564856:0:29240:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1cc:0x0]: returning size 5 00010000:00010000:0.0:1763333178.564916:0:29240:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c5830d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.564924:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c5830d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.564936:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c5830d lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.564943:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c5830d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.564949:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff4148e600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333178.564953:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c5830d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.564962:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c5830d lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.564974:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44900) 00010000:00010000:0.0:1763333178.564977:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333178.564983:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c5830d lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.564990:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e600/0xb32e3ef184c5830d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.565003:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c58314 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.565009:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c58314 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.565015:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c58314 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.565019:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff4148e200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333178.565022:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c58314 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.565027:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c58314 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.565033:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b44700) 00010000:00010000:0.0:1763333178.565035:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333178.565038:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c58314 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.565043:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148e200/0xb32e3ef184c58314 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.565079:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe467bf200/0xb32e3ef184c58306 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1af expref: 254 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.565095:0:29240:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5831b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1af expref: 253 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.565102:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1cc:0x0].0x0 (ffff92ff621aca00) 00010000:00010000:0.0:1763333178.565104:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333178.565107:0:29240:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e800, rc 0) 00000100:00100000:0.0:1763333178.565154:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:56911:x1848987613830400:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 620us (1337us total) trans 4294972582 rc 0/0 00000100:00100000:0.0:1763333178.565162:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9613 00000100:00100000:3.0:1763333178.577446:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333178.577597:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613830912 00000100:00100000:0.0:1763333178.577612:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613830912 00000100:00100000:0.0:1763333178.577694:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9614 00000100:00100000:0.0:1763333178.577706:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:56916:x1848987613830912:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:0.0:1763333178.577782:0:29240:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1763333178.577816:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c5829d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1cc:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a17e expref: 253 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.577837:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5831b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1af expref: 252 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.577848:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff4148ee00/0xb32e3ef184c582c7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a18c expref: 251 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.577859:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99000/0xb32e3ef184c5826c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1cc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a169 expref: 250 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.577872:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1cc:0x0].0x0 (ffff92ff621aca00) 00010000:00010000:0.0:1763333178.577883:0:29240:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333178.577916:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c58329 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:0.0:1763333178.577930:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c58329 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.577939:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c58329 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.577949:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58330 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:0.0:1763333178.577954:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58330 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.577960:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58330 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.578060:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c58337 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1cc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:0.0:1763333178.578068:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c58337 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1cc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.578075:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c58337 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1cc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00000004:00080000:0.0:1763333178.578428:0:29240:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x240000404:0x1cc:0x0] is inserted into orphan list, open count = 1 00010000:00010000:0.0:1763333178.578536:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c58337 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1cc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.578550:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c58337 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1cc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.578557:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c58337 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1cc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.578563:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333178.578568:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c58337 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1cc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.578576:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c58337 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1cc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.578600:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1cc:0x0].0x0 (ffff92fe43b44b00) 00010000:00010000:0.0:1763333178.578603:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1763333178.578608:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c58337 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1cc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.578615:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f600/0xb32e3ef184c58337 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1cc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.578634:0:29240:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c58329 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.578640:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c58329 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.578645:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c58329 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.578650:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c58329 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.578654:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333178.578657:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c58329 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.578662:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c58329 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.578670:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92fe43b44900) 00010000:00010000:0.0:1763333178.578673:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333178.578675:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c58329 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.578681:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c58329 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00000004:00010000:0.0:1763333178.578692:0:29240:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f6f9e3e9 reply state 00000000061de535 transno 4294972583 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58330 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.578703:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58330 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.578710:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b44700) 00010000:00010000:0.0:1763333178.578712:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333178.578715:0:29240:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763333178.581311:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:56916:x1848987613830912:12345-192.168.204.28@tcp:36:rm.0 Request processed in 3590us (3863us total) trans 4294972583 rc 0/0 00000100:00100000:0.0:1763333178.581328:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9614 00000100:00100000:2.0:1763333178.581566:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333178.583517:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613831040 00000100:00100000:1.0:1763333178.583537:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613831040 00000100:00100000:1.0:1763333178.583635:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3283 00000100:00100000:1.0:1763333178.583647:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45181500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:56911:x1848987613831040:12345-192.168.204.28@tcp:33:lfs.0 00000100:00100000:1.0:1763333178.583890:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45181500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:56911:x1848987613831040:12345-192.168.204.28@tcp:33:lfs.0 Request processed in 243us (2325us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333178.583898:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3283 00000100:00100000:3.0:1763333178.587248:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333178.587308:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613831296 00000100:00100000:0.0:1763333178.587322:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613831296 00000100:00100000:0.0:1763333178.587439:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9615 00000100:00100000:0.0:1763333178.587451:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:56911:x1848987613831296:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333178.587482:0:29240:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333178.587517:0:29240:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5833e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1cc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a1b6 expref: -99 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.587669:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c58345 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1cc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:0.0:1763333178.587685:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c58345 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1cc:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:0.0:1763333178.587698:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c58345 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1cc:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00000004:00200000:0.0:1763333178.587726:0:29240:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1cc:0x0]: returning size 5 00010000:00010000:0.0:1763333178.587867:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5833e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1cc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1b6 expref: 254 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.587889:0:29240:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c58345 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1cc:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1b6 expref: 253 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.587898:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1cc:0x0].0x0 (ffff92fe43b44400) 00010000:00010000:0.0:1763333178.587901:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763333178.587905:0:29240:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f800, rc 0) 00000100:00100000:0.0:1763333178.587987:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:56911:x1848987613831296:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 538us (794us total) trans 4294972584 rc 0/0 00000100:00100000:0.0:1763333178.587994:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9615 00000100:00100000:2.0:1763333178.597562:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333178.599595:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613831552 00000100:00100000:0.0:1763333178.599626:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613831552 00000100:00100000:1.0:1763333178.600679:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3284 00000100:00100000:1.0:1763333178.600692:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:56911:x1848987613831552:12345-192.168.204.28@tcp:35:lfs.0 00000004:00010000:1.0:1763333178.600875:0:19668:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x1cc:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c58345 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1cc:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1b6 expref: 253 pid: 29240 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333178.601501:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:1.0:1763333178.602656:0:19668:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c58353 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1cc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19668 initiator: MDT0 00010000:00010000:1.0:1763333178.602680:0:19668:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c58353 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1cc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19668 initiator: MDT1 00010000:00010000:1.0:1763333178.602692:0:19668:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c58353 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1cc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19668 initiator: MDT1 00000004:00020000:1.0:1763333178.602900:0:19668:0:(lod_lov.c:1523:lod_parse_striping()) lustre-MDT0001-mdtlov: can not set all stale mirrors for [0x240000404:0x1cc:0x0]: rc = -1 00010000:00010000:1.0:1763333178.602934:0:19668:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c58353 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1cc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19668 initiator: MDT1 00010000:00010000:1.0:1763333178.602942:0:19668:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c58353 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1cc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19668 initiator: MDT1 00000100:00100000:2.0:1763333178.603124:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613831680 00000100:00100000:2.0:1763333178.603137:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613831680 00010000:00010000:1.0:1763333178.603416:0:19668:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c58353 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1cc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19668 initiator: MDT1 00010000:00010000:1.0:1763333178.603425:0:19668:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48190200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333178.603430:0:19668:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c58353 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1cc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19668 initiator: MDT1 00010000:00010000:1.0:1763333178.603439:0:19668:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c58353 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1cc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19668 initiator: MDT1 00000100:00100000:3.0:1763333178.603445:0:29240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9616 00010000:00010000:1.0:1763333178.603453:0:19668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1cc:0x0].0x0 (ffff92fe43b44400) 00010000:00010000:1.0:1763333178.603457:0:19668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00000100:00100000:3.0:1763333178.603459:0:29240:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+254:56917:x1848987613831680:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333178.603463:0:19668:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c58353 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1cc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19668 initiator: MDT1 00010000:00010000:1.0:1763333178.603469:0:19668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c58353 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1cc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19668 initiator: MDT1 00010000:00010000:1.0:1763333178.603481:0:19668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1cc:0x0].0x0 (ffff92fe43b44400) 00010000:00010000:3.0:1763333178.603484:0:29240:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333178.603484:0:19668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763333178.603488:0:19668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f800/0xb32e3ef184c58345 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1cc:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1b6 expref: 254 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.603508:0:29240:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5835a lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a1bd expref: -99 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.603586:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c58361 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:3.0:1763333178.603594:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c58361 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333178.603602:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c58361 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333178.603612:0:29240:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c58368 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29240 initiator: MDT0 00010000:00010000:3.0:1763333178.603619:0:29240:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c58368 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333178.603625:0:29240:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c58368 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333178.603667:0:29240:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c58361 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333178.603673:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c58361 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333178.603679:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c58361 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333178.603685:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c58361 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00000100:00100000:1.0:1763333178.603685:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+255:56911:x1848987613831552:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 2995us (6139us total) trans 4294972585 rc -1/-1 00010000:00010000:3.0:1763333178.603691:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333178.603693:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c58361 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00000100:00100000:1.0:1763333178.603696:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3284 00010000:00010000:3.0:1763333178.603699:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c58361 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333178.603720:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff62250a00) 00010000:00010000:3.0:1763333178.603722:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333178.603724:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c58361 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333178.603729:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c58361 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333178.603739:0:29240:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c58368 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333178.603745:0:29240:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c58368 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333178.603749:0:29240:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c58368 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333178.603754:0:29240:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feb400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333178.603756:0:29240:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c58368 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333178.603765:0:29240:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c58368 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333178.603771:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b44700) 00010000:00010000:3.0:1763333178.603773:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333178.603776:0:29240:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c58368 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333178.603781:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feb400/0xb32e3ef184c58368 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:3.0:1763333178.603804:0:29240:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5835a lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1bd expref: 254 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.603814:0:29240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff62250a00) 00010000:00010000:3.0:1763333178.603817:0:29240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333178.603820:0:29240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c5835a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1bd expref: 254 pid: 29240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.603831:0:29240:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea800, rc 0) 00000100:00100000:3.0:1763333178.603853:0:29240:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:56917:x1848987613831680:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 398us (2355us total) trans 0 rc 301/301 00000100:00100000:3.0:1763333178.603859:0:29240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9616 00000100:00100000:2.0:1763333178.607089:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.607144:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333178.607310:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613831808 00000100:00100000:3.0:1763333178.607324:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613831808 00000100:00100000:2.0:1763333178.607860:0:29240:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613831936 00000100:00100000:2.0:1763333178.607868:0:29240:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613831936 00000100:00100000:3.0:1763333178.607911:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9617 00000100:00100000:3.0:1763333178.607926:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+254:56911:x1848987613831808:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333178.607972:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333178.608011:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5836f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1cc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a1c4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.608093:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5836f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1cc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1c4 expref: 255 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.608111:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feba00/0xb32e3ef184c5836f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1cc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1c4 expref: 255 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.608134:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1cc:0x0].0x0 (ffff92ff62250b00) 00010000:00010000:3.0:1763333178.608138:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763333178.608142:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feba00, rc 0) 00000100:00100000:3.0:1763333178.608228:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+255:56911:x1848987613831808:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 305us (1153us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333178.608236:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9617 00000100:00100000:3.0:1763333178.608262:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9618 00000100:00100000:3.0:1763333178.608269:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+254:56917:x1848987613831936:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333178.608277:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333178.608288:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c58376 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a1cb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.608376:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5837d lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333178.608386:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5837d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333178.608396:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5837d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333178.608424:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99000/0xb32e3ef184c58384 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333178.608432:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99000/0xb32e3ef184c58384 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333178.608438:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99000/0xb32e3ef184c58384 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333178.608488:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5837d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333178.608495:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5837d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333178.608502:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5837d lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333178.608509:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5837d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333178.608515:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feaa00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333178.608519:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5837d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333178.608528:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5837d lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333178.608541:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff62250e00) 00010000:00010000:3.0:1763333178.608543:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333178.608548:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5837d lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333178.608554:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5837d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333178.608573:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99000/0xb32e3ef184c58384 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333178.608579:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99000/0xb32e3ef184c58384 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333178.608585:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99000/0xb32e3ef184c58384 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333178.608590:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff73a99000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333178.608593:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99000/0xb32e3ef184c58384 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333178.608598:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99000/0xb32e3ef184c58384 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333178.608606:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b44700) 00010000:00010000:3.0:1763333178.608609:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333178.608612:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99000/0xb32e3ef184c58384 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333178.608618:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99000/0xb32e3ef184c58384 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333178.608647:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c58376 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1cb expref: 255 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.608658:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff62250e00) 00010000:00010000:3.0:1763333178.608661:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333178.608664:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c58376 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1cb expref: 255 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.608682:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea200, rc 0) 00000100:00100000:3.0:1763333178.608723:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+254:56917:x1848987613831936:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 453us (1577us total) trans 0 rc 301/301 00000100:00100000:3.0:1763333178.608729:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9618 00000100:00100000:1.0:1763333178.612944:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333178.613069:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.613162:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613832192 00000100:00100000:2.0:1763333178.613176:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613832192 00000100:00100000:2.0:1763333178.613252:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3285 00000100:00100000:2.0:1763333178.613264:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+254:56911:x1848987613832192:12345-192.168.204.28@tcp:35:lfs.0 00000004:00080000:2.0:1763333178.613676:0:19668:0:(mdd_object.c:3993:mdd_close()) Object [0x240000404:0x1cc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1763333178.613757:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1504, 64 off126520 00000040:00080000:2.0:1763333178.613782:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1505, 64 off126520 00000040:00080000:2.0:1763333178.613789:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1506, 64 off126584 00000040:00080000:2.0:1763333178.613796:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1505, 64 off126584 00010000:00010000:2.0:1763333178.613872:0:19668:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5838b lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1cc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19668 initiator: MDT0 00010000:00010000:2.0:1763333178.613891:0:19668:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5838b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1cc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333178.613904:0:19668:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5838b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1cc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333178.613913:0:19668:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5838b lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1cc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333178.613920:0:19668:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5838b lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1cc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333178.613927:0:19668:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5838b lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1cc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19668 initiator: MDT1 00010000:00010000:2.0:1763333178.613950:0:19668:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763333178.614167:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+255:56911:x1848987613832192:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 903us (1236us total) trans 4294972586 rc 0/0 00000100:00100000:2.0:1763333178.614175:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3285 00010000:00010000:0.0:1763333178.615023:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333178.615037:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5838b lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1cc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333178.615048:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333178.615053:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5838b lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1cc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333178.615070:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5838b lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1cc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333178.615093:0:8422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1cc:0x0].0x0 (ffff92ff62250b00) 00010000:00010000:0.0:1763333178.615096:0:8422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763333178.615102:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5838b lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1cc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333178.615109:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c5838b lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1cc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19668 initiator: MDT1 00010000:00010000:0.0:1763333178.615129:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333178.615131:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333178.615133:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763333178.615894:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613832320 00000100:00100000:3.0:1763333178.615909:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613832320 00000100:00100000:3.0:1763333178.616007:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9619 00000100:00100000:3.0:1763333178.616018:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+255:56917:x1848987613832320:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333178.616045:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333178.616074:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99800/0xb32e3ef184c58392 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a1d2 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.616155:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a98c00/0xb32e3ef184c58399 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333178.616169:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a98c00/0xb32e3ef184c58399 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.616180:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a98c00/0xb32e3ef184c58399 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:3.0:1763333178.616237:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1763333178.616243:0:8606:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1763333178.616282:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99800/0xb32e3ef184c58392 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1d2 expref: 257 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.616302:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a98c00/0xb32e3ef184c58399 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1d2 expref: 256 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.616314:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff62250a00) 00010000:00010000:3.0:1763333178.616317:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1763333178.616320:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff73a98c00, rc 0) 00000100:00100000:3.0:1763333178.616437:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+256:56917:x1848987613832320:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 421us (3368us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333178.616445:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9619 00000100:00100000:1.0:1763333178.630164:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.630252:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613832448 00000100:00100000:2.0:1763333178.630266:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613832448 00000100:00100000:2.0:1763333178.630341:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9620 00000100:00100000:2.0:1763333178.630424:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+256:56917:x1848987613832448:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333178.630457:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333178.630485:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c583a0 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a1d9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.630577:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c583a7 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333178.630593:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c583a7 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.630607:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c583a7 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.630618:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c583ae lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333178.630625:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c583ae lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.630630:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c583ae lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.630686:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c583a7 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.630693:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c583a7 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.630699:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c583a7 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.630835:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c583a7 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.630846:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333178.630851:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c583a7 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.630861:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c583a7 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.630875:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff62250a00) 00010000:00010000:2.0:1763333178.630878:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333178.630885:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c583a7 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.630891:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c583a7 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.630908:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c583ae lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.630913:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c583ae lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.630919:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c583ae lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.630924:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4a00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333178.630926:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c583ae lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.630932:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c583ae lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.630938:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b44700) 00010000:00010000:2.0:1763333178.630941:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333178.630944:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c583ae lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.630949:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c583ae lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.630983:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c583a0 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1d9 expref: 257 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.630993:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff62250a00) 00010000:00010000:2.0:1763333178.630995:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333178.630998:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c583a0 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1d9 expref: 257 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.631009:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4400, rc 0) 00000100:00100000:2.0:1763333178.631104:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+256:56917:x1848987613832448:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 682us (955us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333178.631113:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9620 00000100:00100000:0.0:1763333178.638399:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333178.638591:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613832704 00000100:00100000:3.0:1763333178.638606:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613832704 00000100:00100000:3.0:1763333178.638689:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9621 00000100:00100000:3.0:1763333178.638702:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+256:56917:x1848987613832704:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333178.638731:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333178.638735:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763333178.638776:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a98c00/0xb32e3ef184c58399 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1d2 expref: 256 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.638808:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff62250a00) 00010000:00010000:3.0:1763333178.638823:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333178.638844:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99800/0xb32e3ef184c583b5 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a1e0 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.638990:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99000/0xb32e3ef184c583bc lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333178.639005:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99000/0xb32e3ef184c583bc lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.639016:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99000/0xb32e3ef184c583bc lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.639033:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a98600/0xb32e3ef184c583c3 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333178.639040:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a98600/0xb32e3ef184c583c3 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.639046:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a98600/0xb32e3ef184c583c3 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.639637:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c583ca lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:3.0:1763333178.639650:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c583ca lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.639658:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c583ca lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:3.0:1763333178.639669:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ce:0x0]: returning size 0 00010000:00010000:3.0:1763333178.639701:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99000/0xb32e3ef184c583bc lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.639708:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99000/0xb32e3ef184c583bc lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.639714:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99000/0xb32e3ef184c583bc lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.639721:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99000/0xb32e3ef184c583bc lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.639727:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff73a99000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333178.639732:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99000/0xb32e3ef184c583bc lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.639744:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99000/0xb32e3ef184c583bc lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.639754:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff62250e00) 00010000:00010000:3.0:1763333178.639757:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333178.639761:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99000/0xb32e3ef184c583bc lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.639767:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99000/0xb32e3ef184c583bc lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000004:00010000:3.0:1763333178.639781:0:8606:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003e04fc18 reply state 000000009f53a5bf transno 4294972587 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a98600/0xb32e3ef184c583c3 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.639793:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a98600/0xb32e3ef184c583c3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:3.0:1763333178.639799:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b44700) 00010000:00010000:3.0:1763333178.639802:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763333178.639805:0:8606:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763333178.639844:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a99800/0xb32e3ef184c583b5 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1e0 expref: 258 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.639862:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c583ca lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1e0 expref: 257 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.639869:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ce:0x0].0x0 (ffff92ff62250000) 00010000:00010000:3.0:1763333178.639872:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333178.639874:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea200, rc 0) 00000100:00100000:3.0:1763333178.646058:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+258:56917:x1848987613832704:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 7339us (7656us total) trans 4294972587 rc 0/0 00000100:00100000:3.0:1763333178.646079:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9621 00000100:00100000:0.0:1763333178.649303:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.649442:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613833088 00000100:00100000:2.0:1763333178.649457:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613833088 00000100:00100000:2.0:1763333178.649536:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9622 00000100:00100000:2.0:1763333178.649547:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+258:56918:x1848987613833088:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333178.649578:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333178.649606:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c583d8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1ce:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a1ee expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.649765:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c583df lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333178.649786:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c583df lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.649801:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c583df lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:2.0:1763333178.649815:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ce:0x0]: returning size 0 00010000:00010000:2.0:1763333178.653746:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c583d8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1ce:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1ee expref: 261 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.653783:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c583df lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1ee expref: 260 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.653795:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ce:0x0].0x0 (ffff92ff62250000) 00010000:00010000:2.0:1763333178.653799:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333178.653805:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4a00, rc 0) 00000100:00100000:3.0:1763333178.655838:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333178.655904:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613833216 00000100:00100000:3.0:1763333178.655917:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613833216 00000100:00100000:3.0:1763333178.655986:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9623 00000100:00100000:3.0:1763333178.655997:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+261:56917:x1848987613833216:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333178.656024:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333178.656052:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c583ed lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1ce:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a1e7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.656198:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c583f4 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ce:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333178.656216:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c583ca lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1e0 expref: 262 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.656225:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c583df lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1ee expref: 262 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.656233:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c583f4 lrc: 5/0,1 mode: --/EX res: [0x240000404:0x1ce:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333178.656277:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c583df lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1ee expref: 262 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.656294:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c583df lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1ee expref: 262 pid: 8606 timeout: 1382 lvb_type: 0 00000100:00100000:3.0:1763333178.656310:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77a3f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627306368:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333178.656459:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c583ca lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1e0 expref: 262 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.656469:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c583ca lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1e0 expref: 262 pid: 8606 timeout: 1382 lvb_type: 0 00000100:00100000:3.0:1763333178.656479:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77a3e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627306496:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333178.656504:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe439dd840 going to sleep for 11 seconds 00000100:00100000:2.0:1763333178.656760:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+262:56918:x1848987613833088:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 7211us (7467us total) trans 4294972588 rc 0/0 00000100:00100000:2.0:1763333178.656771:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9622 00000100:00100000:3.0:1763333178.660082:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77a3f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627306368:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333178.660104:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77a3e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6519:1848987627306496:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333178.660139:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c583f4 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ce:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000100:00100000:3.0:1763333178.662337:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333178.662939:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333178.662992:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333178.663054:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613833600 00000100:00100000:1.0:1763333178.663071:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613833600 00000100:00100000:1.0:1763333178.663140:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3286 00000100:00100000:1.0:1763333178.663151:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6b3ec450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+262:56918:x1848987613833600:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333178.663391:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613833344 00000100:00100000:2.0:1763333178.663397:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613833344 00000100:00100000:0.0:1763333178.663399:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613833728 00000100:00100000:0.0:1763333178.663411:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613833728 00010000:00010000:2.0:1763333178.663441:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c583df lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1ee expref: 264 pid: 8606 timeout: 1382 lvb_type: 0 00010000:00010000:0.0:1763333178.663441:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c583ca lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1e0 expref: 264 pid: 8606 timeout: 1382 lvb_type: 0 00000100:00100000:2.0:1763333178.663478:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3169 00000100:00100000:2.0:1763333178.663486:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+264:2421:x1848987613833344:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333178.663501:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333178.663508:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c583df lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1ee expref: 264 pid: 8606 timeout: 1382 lvb_type: 0 00000100:00100000:0.0:1763333178.663527:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3170 00010000:00010000:2.0:1763333178.663532:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c583df lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1ee expref: 264 pid: 8606 timeout: 1382 lvb_type: 0 00000100:00100000:0.0:1763333178.663534:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+264:2419:x1848987613833728:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333178.663543:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333178.663548:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c583ca lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1e0 expref: 264 pid: 8606 timeout: 1382 lvb_type: 0 00010000:00010000:2.0:1763333178.663561:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c583df lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1ee expref: 264 pid: 8606 timeout: 1382 lvb_type: 0 00010000:00010000:0.0:1763333178.663602:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c583ca lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1e0 expref: 263 pid: 8606 timeout: 1382 lvb_type: 0 00010000:00010000:0.0:1763333178.663620:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c583ca lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1e0 expref: 263 pid: 8606 timeout: 1382 lvb_type: 0 00010000:00010000:0.0:1763333178.663635:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ce:0x0].0x0 (ffff92ff62250000) 00010000:00010000:0.0:1763333178.663641:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c583f4 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ce:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333178.663652:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c583f4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ce:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333178.663660:0:6506:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c583f4 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x1ce:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.663734:0:8423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ce:0x0].0x0 (ffff92ff62250000) 00010000:00010000:2.0:1763333178.663739:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333178.663759:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333178.663807:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c583f4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ce:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:3.0:1763333178.663817:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c583f4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ce:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:3.0:1763333178.663849:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ce:0x0]: returning size 0 00000100:00100000:2.0:1763333178.663887:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+262:2421:x1848987613833344:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 401us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333178.663895:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3169 00000100:00100000:0.0:1763333178.664011:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+261:2419:x1848987613833728:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 476us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333178.664019:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3170 00000100:00100000:1.0:1763333178.664143:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6b3ec450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+261:56918:x1848987613833600:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 994us (1823us total) trans 4294972589 rc 0/0 00000100:00100000:1.0:1763333178.664156:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3286 00000004:00080000:2.0:1763333178.664298:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x25b:0x0], index 0: 0 00000004:00080000:2.0:1763333178.664306:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x25b:0x0], index 1: 0 00000004:00080000:2.0:1763333178.664311:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x25c:0x0], index 1: 0 00000004:00080000:2.0:1763333178.664315:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x25c:0x0], index 0: 0 00010000:00010000:1.0:1763333178.665028:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c583f4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ce:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333178.665040:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c583f4 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1ce:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333178.665047:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c583f4 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1ce:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333178.665053:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333178.665058:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c583f4 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1ce:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333178.665066:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c583f4 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1ce:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333178.665081:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ce:0x0].0x0 (ffff92ff62250000) 00010000:00010000:1.0:1763333178.665084:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763333178.665087:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c583f4 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1ce:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333178.665094:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea800/0xb32e3ef184c583f4 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1ce:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333178.665152:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c583ed lrc: 1/0,0 mode: --/CR res: [0x240000404:0x1ce:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1e7 expref: 261 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.665163:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ce:0x0].0x0 (ffff92ff62250000) 00010000:00010000:1.0:1763333178.665166:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763333178.665170:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42feaa00/0xb32e3ef184c583ed lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1ce:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1e7 expref: 261 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.665189:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feaa00, rc 0) 00000100:00100000:1.0:1763333178.665247:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+260:56917:x1848987613833216:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 9252us (9423us total) trans 4294972590 rc 301/301 00000100:00100000:1.0:1763333178.665255:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9623 00000100:00100000:3.0:1763333178.667942:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333178.668003:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.668128:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613833984 00000100:00100000:0.0:1763333178.668128:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613834240 00000100:00100000:2.0:1763333178.668141:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613833984 00000100:00100000:0.0:1763333178.668141:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613834240 00000100:00100000:2.0:1763333178.668208:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9624 00000100:00100000:0.0:1763333178.668208:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3287 00000100:00100000:2.0:1763333178.668219:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+261:56918:x1848987613833984:12345-192.168.204.28@tcp:101:lfs.0 00000100:00100000:0.0:1763333178.668219:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+261:56917:x1848987613834240:12345-192.168.204.28@tcp:35:lfs.0 00010000:00010000:2.0:1763333178.668286:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333178.668321:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c58402 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a1f5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.668478:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c58409 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333178.668495:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c58409 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.668509:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c58409 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.668520:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c58410 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333178.668527:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c58410 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.668533:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c58410 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.668655:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c58417 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333178.668665:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c58417 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.668672:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c58417 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.668781:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c58409 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.668789:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c58409 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.668795:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c58409 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.668802:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c58409 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.668808:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333178.668813:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c58409 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.668822:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c58409 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.668836:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff621ac600) 00010000:00010000:2.0:1763333178.668840:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333178.668845:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c58409 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.668852:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c58409 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.668866:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c58410 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.668872:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c58410 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.668877:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c58410 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.668881:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333178.668884:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c58410 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.668889:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c58410 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.668895:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b44700) 00010000:00010000:2.0:1763333178.668898:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333178.668901:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c58410 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.668911:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c58410 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:2.0:1763333178.668963:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c58402 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1f5 expref: 264 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.668983:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c58417 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1f5 expref: 263 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.668992:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ce:0x0].0x0 (ffff92ff621acb00) 00010000:00010000:2.0:1763333178.668994:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333178.668997:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4000, rc 0) 00000100:00100000:2.0:1763333178.669087:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+263:56918:x1848987613833984:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 869us (1158us total) trans 4294972591 rc 0/0 00000100:00100000:2.0:1763333178.669097:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9624 00000100:00100000:0.0:1763333178.670201:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+263:56917:x1848987613834240:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 1976us (2189us total) trans 4294972592 rc 0/0 00000100:00100000:0.0:1763333178.670215:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3287 00000100:00100000:1.0:1763333178.672564:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333178.673765:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333178.673871:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333178.673943:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613834624 00000100:00100000:1.0:1763333178.673957:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613834624 00000100:00100000:1.0:1763333178.674015:0:17605:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613834752 00000100:00100000:1.0:1763333178.674019:0:17605:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613834752 00000100:00100000:1.0:1763333178.674042:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6814 00000100:00100000:1.0:1763333178.674053:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2420:x1848987613834624:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333178.674077:0:17605:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333178.674106:0:17605:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe48191600/0xb32e3ef184c58425 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a1fc expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333178.674137:0:17605:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x25c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333178.674163:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333178.674166:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333178.674178:0:17605:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe48191600/0xb32e3ef184c58425 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1fc expref: 22 pid: 17605 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333178.674200:0:17605:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe48191600/0xb32e3ef184c58425 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1fc expref: 22 pid: 17605 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333178.674225:0:17605:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48191600, rc 0) 00000100:00100000:1.0:1763333178.674294:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2420:x1848987613834624:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 243us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333178.674302:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6814 00000100:00100000:1.0:1763333178.674323:0:17605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6815 00000100:00100000:1.0:1763333178.674329:0:17605:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73165c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:2420:x1848987613834752:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333178.674337:0:17605:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333178.674373:0:17605:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe48190e00/0xb32e3ef184c5842c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a203 expref: -99 pid: 17605 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333178.674390:0:17605:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x25c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333178.674401:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333178.674402:0:17605:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333178.674418:0:17605:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe48190e00/0xb32e3ef184c5842c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a203 expref: 13 pid: 17605 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333178.674431:0:17605:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe48190e00/0xb32e3ef184c5842c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a203 expref: 13 pid: 17605 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333178.674439:0:17605:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48190e00, rc 0) 00000100:00100000:1.0:1763333178.674459:0:17605:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73165c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2420:x1848987613834752:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 130us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333178.674465:0:17605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6815 00000100:00100000:3.0:1763333178.675010:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613834496 00000100:00100000:3.0:1763333178.675020:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613834496 00000100:00100000:1.0:1763333178.676001:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3288 00000100:00100000:1.0:1763333178.676014:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+263:56917:x1848987613834496:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:1.0:1763333178.677945:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+264:56917:x1848987613834496:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 1918us (5379us total) trans 4294972593 rc 0/0 00000100:00100000:1.0:1763333178.677961:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3288 00000100:00100000:1.0:1763333178.678463:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.678548:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613835008 00000100:00100000:2.0:1763333178.678561:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613835008 00000100:00100000:2.0:1763333178.678628:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3289 00000100:00100000:2.0:1763333178.678641:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73166300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+264:56918:x1848987613835008:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333178.678908:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73166300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+265:56918:x1848987613835008:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 269us (446us total) trans 4294972594 rc 0/0 00000100:00100000:2.0:1763333178.678915:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3289 00000100:00100000:0.0:1763333178.684662:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.685050:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613835264 00000100:00100000:2.0:1763333178.685065:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613835264 00000100:00100000:0.0:1763333178.685083:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.685332:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613835520 00000100:00100000:2.0:1763333178.685336:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613835520 00000100:00100000:2.0:1763333178.685411:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9625 00000100:00100000:2.0:1763333178.685424:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+266:55917:x1848987613835264:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333178.685457:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1763333178.685460:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9626 00010000:00010000:2.0:1763333178.685461:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00100000:1.0:1763333178.685470:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+266:56918:x1848987613835520:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333178.685480:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333178.685495:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4000/0xb32e3ef184c58417 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1f5 expref: 266 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.685504:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c58433 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a211 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.685517:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ce:0x0].0x0 (ffff92ff621acb00) 00010000:00010000:2.0:1763333178.685528:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333178.685535:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5843a lrc: 2/0,0 mode: --/CW res: [0x240000404:0x1ce:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a20a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.685607:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c58441 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333178.685622:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c58441 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.685633:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c58441 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.685639:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c58448 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x1ce:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333178.685644:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c5844f lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333178.685647:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c58448 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1ce:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333178.685652:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c5844f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.685654:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c58448 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x1ce:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333178.685659:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c5844f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000004:00200000:2.0:1763333178.685665:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ce:0x0]: returning size 0 00010000:00010000:1.0:1763333178.685762:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5845d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:1.0:1763333178.685777:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5845d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.685783:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5845d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.685865:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c5843a lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1ce:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a20a expref: 269 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.685881:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c58448 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x1ce:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a20a expref: 268 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.685889:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ce:0x0].0x0 (ffff92ff621ac600) 00010000:00010000:2.0:1763333178.685892:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:2.0:1763333178.685895:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5400, rc 0) 00010000:00010000:1.0:1763333178.685936:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5845d lrc: 3/0,0 mode: --/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.685944:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333178.685957:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5845d lrc: 3/0,0 mode: --/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.685967:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5845d lrc: 4/0,0 mode: --/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.685975:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ce:0x0].0x0 (ffff92ff621ac600) 00010000:00010000:1.0:1763333178.685981:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5845d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.685987:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5845d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000004:00200000:1.0:1763333178.686000:0:8606:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ce:0x0]: returning size 0 00010000:00010000:1.0:1763333178.686042:0:8606:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c58441 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.686049:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c58441 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.686054:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c58441 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.686059:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c58441 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.686064:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48191800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333178.686066:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c58441 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.686071:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c58441 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.686079:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff4ad5e100) 00010000:00010000:1.0:1763333178.686082:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333178.686084:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c58441 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.686090:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48191800/0xb32e3ef184c58441 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.686098:0:8606:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c5844f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.686104:0:8606:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c5844f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.686109:0:8606:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c5844f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.686114:0:8606:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdea00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333178.686117:0:8606:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c5844f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.686122:0:8606:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c5844f lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.686129:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b44700) 00010000:00010000:1.0:1763333178.686131:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333178.686134:0:8606:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c5844f lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.686139:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c5844f lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.686166:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c58433 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a211 expref: 269 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.686175:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff4ad5e100) 00010000:00010000:1.0:1763333178.686177:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763333178.686181:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c58433 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a211 expref: 269 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.686193:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48190200, rc 0) 00000100:00100000:2.0:1763333178.686805:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+268:55917:x1848987613835264:12345-192.168.204.28@tcp:101:bash.0 Request processed in 1380us (2158us total) trans 4294972595 rc 0/0 00000100:00100000:2.0:1763333178.686816:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9625 00000100:00100000:1.0:1763333178.687514:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+267:56918:x1848987613835520:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 2042us (2427us total) trans 4294972596 rc 301/301 00000100:00100000:1.0:1763333178.687523:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9626 00000100:00100000:1.0:1763333178.692932:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.692994:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613835648 00000100:00100000:2.0:1763333178.693007:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613835648 00000100:00100000:1.0:1763333178.693057:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.693092:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9627 00000100:00100000:2.0:1763333178.693104:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73165880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+267:55917:x1848987613835648:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1763333178.693144:0:8606:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333178.693176:0:8606:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5846b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a218 expref: -99 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.693224:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c58472 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333178.693243:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c58472 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00000100:00100000:0.0:1763333178.693248:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613835904 00000100:00100000:0.0:1763333178.693253:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613835904 00010000:00010000:2.0:1763333178.693256:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c58472 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000100:00100000:0.0:1763333178.693301:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3290 00000100:00100000:0.0:1763333178.693308:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73165f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+269:56918:x1848987613835904:12345-192.168.204.28@tcp:35:lfs.0 00010000:00010000:2.0:1763333178.693437:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c5846b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a218 expref: 270 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.693458:0:8606:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c58472 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a218 expref: 269 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.693469:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ce:0x0].0x0 (ffff92ff621ac600) 00010000:00010000:2.0:1763333178.693472:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763333178.693476:0:8606:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4400, rc 0) 00000100:00100000:0.0:1763333178.693688:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73165f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+270:56918:x1848987613835904:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 378us (628us total) trans 4294972597 rc 0/0 00000100:00100000:0.0:1763333178.693698:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3290 00000100:00100000:2.0:1763333178.694507:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73165880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+269:55917:x1848987613835648:12345-192.168.204.28@tcp:101:bash.0 Request processed in 1403us (1587us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333178.694517:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9627 00000100:00100000:1.0:1763333178.701786:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333178.702153:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333178.702266:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613836032 00000100:00100000:0.0:1763333178.702281:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613836032 00000100:00100000:0.0:1763333178.702382:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3291 00000100:00100000:0.0:1763333178.702396:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73164000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+269:56918:x1848987613836032:12345-192.168.204.28@tcp:33:lfs.0 00000100:00100000:0.0:1763333178.702646:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73164000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+269:56918:x1848987613836032:12345-192.168.204.28@tcp:33:lfs.0 Request processed in 252us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333178.702655:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3291 00000100:00100000:2.0:1763333178.703049:0:8606:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613836288 00000100:00100000:2.0:1763333178.703056:0:8606:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613836288 00000100:00100000:2.0:1763333178.703095:0:8606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9628 00000100:00100000:2.0:1763333178.703102:0:8606:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+269:55917:x1848987613836288:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:2.0:1763333178.703143:0:8606:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333178.703179:0:8606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c58448 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x1ce:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a20a expref: 269 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.703200:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ce:0x0].0x0 (ffff92ff621ac600) 00010000:00010000:2.0:1763333178.703207:0:8606:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333178.703444:0:8606:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c58479 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1ce:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8606 initiator: MDT0 00010000:00010000:2.0:1763333178.703460:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c58479 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ce:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.703470:0:8606:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c58479 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ce:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00000001:00080000:2.0:1763333178.703522:0:8606:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294972598 00000004:00010000:2.0:1763333178.703548:0:8606:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006949d0e5 reply state 0000000080909e7c transno 4294972599 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c58479 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ce:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.703561:0:8606:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c58479 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1ce:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:2.0:1763333178.703568:0:8606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ce:0x0].0x0 (ffff92ff621ac600) 00010000:00010000:2.0:1763333178.703570:0:8606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333178.703573:0:8606:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763333178.703640:0:8606:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+271:55917:x1848987613836288:12345-192.168.204.28@tcp:36:bash.0 Request processed in 536us (1487us total) trans 4294972599 rc 0/0 00000100:00100000:2.0:1763333178.703647:0:8606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9628 00000020:00080000:2.0:1763333178.703651:0:8606:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763333178.711164:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333178.711343:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613836416 00000100:00100000:3.0:1763333178.711392:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613836416 00000100:00100000:3.0:1763333178.711470:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9629 00000100:00100000:3.0:1763333178.711480:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+271:55917:x1848987613836416:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333178.711512:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333178.711538:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c58480 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x1ce:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a21f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.711624:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c58480 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1ce:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a21f expref: 272 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.711642:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c58480 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1ce:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a21f expref: 272 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.711663:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ce:0x0].0x0 (ffff92ff621ac600) 00010000:00010000:3.0:1763333178.711666:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763333178.711672:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea000, rc 0) 00000100:00100000:3.0:1763333178.712979:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+272:55917:x1848987613836416:12345-192.168.204.28@tcp:101:bash.0 Request processed in 1490us (1822us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333178.712993:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9629 00000100:00100000:3.0:1763333178.719624:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333178.719767:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613836672 00000100:00100000:0.0:1763333178.719781:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613836672 00000100:00100000:0.0:1763333178.719849:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9630 00000100:00100000:0.0:1763333178.719866:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+272:55917:x1848987613836672:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1763333178.719893:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333178.719898:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763333178.719933:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe42fea000/0xb32e3ef184c58480 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1ce:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a21f expref: 272 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.719965:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ce:0x0].0x0 (ffff92ff621ac600) 00010000:00010000:0.0:1763333178.719971:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333178.719989:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c58487 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1ce:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a226 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.720051:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5848e lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ce:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333178.720066:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5848e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ce:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:0.0:1763333178.720077:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5848e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ce:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000040:00080000:0.0:1763333178.720417:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1507, 88 off126672 00000004:00080000:0.0:1763333178.720428:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1282800078918ns, next at 1282771249577ns, rc = 0 00000040:00080000:0.0:1763333178.720461:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1506, 88 off126672 00000004:00080000:0.0:1763333178.720465:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1282800116138ns, next at 1283390392964ns, rc = 0 00000040:00080000:0.0:1763333178.720496:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1507, 88 off126760 00000004:00080000:0.0:1763333178.720500:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1282800151487ns, next at 1283390392964ns, rc = 0 00000040:00080000:0.0:1763333178.720510:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1508, 88 off126760 00000004:00080000:0.0:1763333178.720513:0:6519:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1282800163888ns, next at 1282771249577ns, rc = 0 00000001:00080000:2.0:1763333178.724624:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972600 is committed 00000004:00080000:2.0:1763333178.724642:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 988 committed 00000004:00080000:2.0:1763333178.724664:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 985 committed 00000004:00080000:2.0:1763333178.724683:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 984 committed 00000004:00080000:2.0:1763333178.724686:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 987 committed 00010000:00010000:1.0:1763333178.724799:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58330 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333178.724815:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58330 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333178.724823:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58330 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333178.724830:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7ec00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333178.724837:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58330 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333178.724845:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58330 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333178.724867:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b44700) 00010000:00010000:1.0:1763333178.724870:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333178.724876:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58330 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333178.724882:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58330 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29240 initiator: MDT1 00010000:00010000:1.0:1763333178.724905:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a98600/0xb32e3ef184c583c3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00000100:00100000:0.0:1763333178.724905:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42efb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627307008:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1763333178.724911:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a98600/0xb32e3ef184c583c3 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.724916:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a98600/0xb32e3ef184c583c3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.724920:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff73a98600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333178.724923:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a98600/0xb32e3ef184c583c3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.724928:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a98600/0xb32e3ef184c583c3 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.724935:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92fe43b44700) 00010000:00010000:1.0:1763333178.724937:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333178.724940:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a98600/0xb32e3ef184c583c3 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.724948:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff73a98600/0xb32e3ef184c583c3 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.724968:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c58479 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x1ce:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.724973:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c58479 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x1ce:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.724978:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c58479 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1ce:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.724983:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4a00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333178.724985:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c58479 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x1ce:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.724990:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c58479 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x1ce:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8606 initiator: MDT1 00000100:00100000:0.0:1763333178.724996:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1763333178.724997:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ce:0x0].0x0 (ffff92ff621ac600) 00010000:00010000:1.0:1763333178.725000:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333178.725003:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c58479 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x1ce:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00010000:00010000:1.0:1763333178.725007:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c58479 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x1ce:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8606 initiator: MDT1 00000100:00100000:1.0:1763333178.725027:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46a6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627306880:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1763333178.725036:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763333178.725041:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff75667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627306624:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763333178.725061:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333178.725124:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46a6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627306752:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1763333178.725225:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627307008 00000100:00100000:3.0:1763333178.725234:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627307008 00000100:00100000:3.0:1763333178.725278:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627306880 00000100:00100000:3.0:1763333178.725281:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627306880 00000100:00100000:3.0:1763333178.725298:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6816 00000100:00100000:3.0:1763333178.725306:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+14:3654:x1848987627307008:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1763333178.725536:0:28600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x25c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333178.725540:0:28600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x25c:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763333178.725542:0:28600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x25c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333178.725545:0:28600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x25c:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763333178.725547:0:28600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x25c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333178.727861:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77a3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627307392:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1763333178.727879:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333178.727925:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627307520:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1763333178.727928:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333178.727960:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333178.727961:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1763333178.727968:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627307264:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1763333178.727977:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763333178.727983:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77a3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627307136:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1763333178.727992:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333178.728031:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627306624 00000100:00100000:1.0:1763333178.728039:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627307392 00000100:00100000:0.0:1763333178.728041:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627306624 00000100:00100000:1.0:1763333178.728042:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627307392 00000100:00100000:1.0:1763333178.728092:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627307520 00000100:00100000:1.0:1763333178.728096:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627307520 00000100:00100000:2.0:1763333178.728245:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333178.728272:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+16:3654:x1848987627307008:12345-0@lo:2:osp-syn-0-1.0 Request processed in 2964us (3274us total) trans 21474839013 rc 0/0 00000100:00100000:3.0:1763333178.728286:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6816 00000100:00100000:1.0:1763333178.728515:0:29013:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627307264 00000100:00100000:3.0:1763333178.728517:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627306752 00000100:00100000:3.0:1763333178.728520:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627306752 00000100:00100000:1.0:1763333178.728520:0:29013:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627307264 00000100:00100000:1.0:1763333178.728539:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6817 00000100:00100000:3.0:1763333178.728544:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6818 00000100:00100000:1.0:1763333178.728549:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e0f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+16:3653:x1848987627306880:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1763333178.728550:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73166d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+31:3653:x1848987627307392:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1763333178.728756:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73166d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+32:3653:x1848987627307392:12345-0@lo:2:osp-syn-1-1.0 Request processed in 205us (827us total) trans 17179871708 rc 0/0 00000100:00100000:3.0:1763333178.728763:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6818 00000100:00100000:1.0:1763333178.728777:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e0f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+17:3653:x1848987627306880:12345-0@lo:2:osp-syn-0-1.0 Request processed in 231us (3715us total) trans 21474839014 rc 0/0 00000100:00100000:3.0:1763333178.728779:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6819 00000100:00100000:3.0:1763333178.728785:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+17:3654:x1848987627306624:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763333178.728785:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6817 00002000:00080000:3.0:1763333178.728811:0:28600:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:601 count 1 00010000:00010000:3.0:1763333178.728837:0:28600:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c58495 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x259:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.728861:0:28600:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c582ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x259:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1a8 expref: 12 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.728869:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333178.728872:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333178.728876:0:28600:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c58495 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x259:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.728914:0:28600:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c582ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x259:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1a8 expref: 12 pid: 29013 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333178.728917:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6820 00000100:00100000:1.0:1763333178.728923:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+31:3654:x1848987627307520:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1763333178.728937:0:28600:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c582ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x259:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1a8 expref: 12 pid: 29013 timeout: 1382 lvb_type: 0 00000100:00100000:3.0:1763333178.728962:0:28600:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77a3c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28600:1848987627307648:192.168.204.28@tcp:104: 00002000:00010000:1.0:1763333178.728978:0:29013:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x25c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333178.728981:0:29013:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x25c:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763333178.728984:0:29013:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x25c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333178.728986:0:29013:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x25c:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763333178.728988:0:29013:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x25c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333178.729589:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+32:3654:x1848987627307520:12345-0@lo:2:osp-syn-1-1.0 Request processed in 662us (1634us total) trans 17179871709 rc 0/0 00000100:00100000:1.0:1763333178.729599:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6820 00000100:00100000:1.0:1763333178.729619:0:29013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6821 00000100:00100000:1.0:1763333178.729626:0:29013:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73165500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+31:3653:x1848987627307264:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1763333178.729642:0:29013:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:602 count 1 00002000:00010000:1.0:1763333178.729667:0:29013:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x25a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333178.729673:0:29013:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5849c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.729683:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333178.729686:0:29013:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333178.729692:0:29013:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5849c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.729706:0:29013:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5849c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.729717:0:29013:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5849c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.729726:0:29013:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5849c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.729753:0:29013:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763333178.729922:0:28600:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe439ddf00 going to sleep for 11 seconds 00000100:00100000:3.0:1763333178.729979:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6822 00000100:00100000:1.0:1763333178.729979:0:29013:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73165500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+32:3653:x1848987627307264:12345-0@lo:6:osp-syn-1-1.0 Request processed in 353us (1984us total) trans 17179871710 rc 0/0 00000100:00100000:1.0:1763333178.729985:0:29013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6821 00000100:00100000:3.0:1763333178.729988:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+16:3652:x1848987627306752:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1763333178.730005:0:28650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:602 count 1 00010000:00010000:1.0:1763333178.730018:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1763333178.730025:0:28650:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x25a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333178.730026:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5849c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.730030:0:28650:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c584a3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.730035:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf200 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333178.730039:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333178.730039:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5849c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.730040:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333178.730044:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c584a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.730055:0:28650:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c584a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.730056:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5849c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.730063:0:28650:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c584a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.730069:0:28650:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c584a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.730076:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5849c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.730084:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5849c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 29013 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.730087:0:28650:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763333178.730100:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333178.730104:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c584a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.730110:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feb400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333178.730113:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c584a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.730120:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c584a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.730129:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c584a3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.730136:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c584a3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.730154:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333178.730156:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333178.730158:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763333178.730223:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+17:3652:x1848987627306752:12345-0@lo:6:osp-syn-0-1.0 Request processed in 236us (1978us total) trans 21474839015 rc 0/0 00000100:00100000:3.0:1763333178.730230:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6822 00010000:00010000:1.0:1763333178.730271:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763333178.730287:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333178.730326:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627307136 00000100:00100000:0.0:1763333178.730340:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627307136 00000100:00100000:0.0:1763333178.730396:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6823 00000100:00100000:0.0:1763333178.730413:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73165c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+32:3654:x1848987627307136:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1763333178.730426:0:8611:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:601 count 1 00010000:00010000:0.0:1763333178.730442:0:8611:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c584aa lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x259:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.730457:0:8611:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe467be000/0xb32e3ef184c582ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x259:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a19a expref: 21 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.730464:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333178.730466:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333178.730469:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c584aa lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x259:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.730501:0:8611:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe467be000/0xb32e3ef184c582ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x259:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a19a expref: 21 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.730512:0:8611:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe467be000/0xb32e3ef184c582ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x259:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a19a expref: 21 pid: 8611 timeout: 1382 lvb_type: 0 00000100:00100000:0.0:1763333178.730525:0:8611:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7dcff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8611:1848987627307776:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333178.730575:0:8611:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff6be07780 going to sleep for 11 seconds 00010000:00010000:0.0:1763333178.730642:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5848e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1ce:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a226 expref: 250 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.730655:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ce:0x0].0x0 (ffff92ff621ac600) 00010000:00010000:0.0:1763333178.730659:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763333178.730677:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c58487 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1ce:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a226 expref: 250 pid: 6519 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1763333178.730692:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5848e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x1ce:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a226 expref: 249 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.730722:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ce:0x0].0x0 (ffff92ff621ac600) 00010000:00010000:0.0:1763333178.730724:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763333178.730727:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f000, rc 0) 00000100:00100000:0.0:1763333178.730751:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:55917:x1848987613836672:12345-192.168.204.28@tcp:101:bash.0 Request processed in 10894us (11144us total) trans 4294972600 rc 0/0 00000100:00100000:0.0:1763333178.730759:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9630 00000004:00080000:3.0:1763333178.731326:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe46a6d180/2, rc 0, transno 21474839015 00000100:00100000:3.0:1763333178.731334:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46a6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627306752:0@lo:6:osp-syn-0-1.0 00000004:00080000:0.0:1763333178.731466:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff77a3d500/2, rc 0, transno 17179871710 00000100:00100000:0.0:1763333178.731473:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627307264:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1763333178.731485:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff77a3e680/2, rc 0, transno 17179871708 00000100:00100000:0.0:1763333178.731489:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77a3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627307392:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1763333178.731499:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe46a6c700/2, rc 0, transno 21474839014 00000100:00100000:0.0:1763333178.731503:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46a6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627306880:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1763333178.735777:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff77a3fb80/2, rc 0, transno 17179871709 00000100:00100000:1.0:1763333178.735798:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627307520:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1763333178.735818:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe42efb480/2, rc 0, transno 21474839013 00000100:00100000:1.0:1763333178.735822:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42efb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627307008:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1763333178.736150:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.736191:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.736222:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613836928 00000100:00100000:2.0:1763333178.736232:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613836928 00010000:00010000:2.0:1763333178.736280:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c582ff lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x259:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1a8 expref: 13 pid: 29013 timeout: 1382 lvb_type: 0 00000100:00100000:2.0:1763333178.736315:0:6506:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613837056 00000100:00100000:2.0:1763333178.736319:0:6506:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613837056 00010000:00010000:2.0:1763333178.736334:0:6506:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe467be000/0xb32e3ef184c582ea lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x259:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a19a expref: 22 pid: 8611 timeout: 1382 lvb_type: 0 00000100:00100000:2.0:1763333178.736388:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3171 00000100:00100000:2.0:1763333178.736399:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff800da050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2418:x1848987613836928:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333178.736428:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333178.736435:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c582ff lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x259:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1a8 expref: 13 pid: 29013 timeout: 1382 lvb_type: 0 00010000:00010000:2.0:1763333178.736455:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c582ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x259:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1a8 expref: 13 pid: 29013 timeout: 1382 lvb_type: 0 00010000:00010000:2.0:1763333178.736489:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333178.736492:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333178.736498:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c58495 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x259:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.736509:0:6506:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c58495 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x259:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.736538:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333178.736605:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff800da050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2418:x1848987613836928:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 207us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333178.736615:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3171 00000100:00100000:2.0:1763333178.736679:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3172 00000100:00100000:2.0:1763333178.736687:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45181500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2418:x1848987613837056:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333178.736696:0:6506:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333178.736700:0:6506:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe467be000/0xb32e3ef184c582ea lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0x259:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a19a expref: 22 pid: 8611 timeout: 1382 lvb_type: 0 00010000:00010000:2.0:1763333178.736710:0:6506:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe467be000/0xb32e3ef184c582ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x259:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a19a expref: 22 pid: 8611 timeout: 1382 lvb_type: 0 00010000:00010000:2.0:1763333178.736725:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333178.736727:0:6506:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333178.736731:0:6506:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c584aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x259:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.736738:0:6506:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c584aa lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x259:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333178.736752:0:6506:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333178.736774:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45181500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2418:x1848987613837056:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 89us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333178.736781:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3172 00010000:00010000:0.0:1763333178.738548:0:8611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe467be000/0xb32e3ef184c582ea lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x259:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a19a expref: 21 pid: 8611 timeout: 1382 lvb_type: 0 00000100:00100000:0.0:1763333178.738573:0:8611:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7dcff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8611:1848987627307776:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333178.738615:0:8611:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c584aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.738632:0:8611:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c584aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.738641:0:8611:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c584aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.738653:0:8611:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c584aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.738662:0:8611:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c584aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.738698:0:8611:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763333178.738725:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333178.738736:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c584aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.738744:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333178.738748:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c584aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.738758:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c584aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.738779:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c584aa lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.738786:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c584aa lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.738809:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333178.738811:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333178.738813:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763333178.739088:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73165c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+33:3654:x1848987627307136:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8683us (8798us total) trans 17179871711 rc 0/0 00000100:00100000:0.0:1763333178.739100:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6823 00000004:00080000:1.0:1763333178.739111:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff77a3c700/2, rc 0, transno 17179871711 00000100:00100000:1.0:1763333178.739118:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77a3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627307136:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1763333178.740846:0:28600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c582ff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x259:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1a8 expref: 12 pid: 29013 timeout: 1382 lvb_type: 0 00000100:00100000:3.0:1763333178.740869:0:28600:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77a3c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28600:1848987627307648:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333178.740897:0:28600:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c58495 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.740908:0:28600:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c58495 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.740916:0:28600:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c58495 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.740927:0:28600:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c58495 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.740940:0:28600:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c58495 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.740976:0:28600:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763333178.741277:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+17:3654:x1848987627306624:12345-0@lo:6:osp-syn-0-1.0 Request processed in 12490us (13396us total) trans 21474839016 rc 0/0 00000100:00100000:3.0:1763333178.741289:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6819 00000004:00080000:1.0:1763333178.741307:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff75667100/2, rc 0, transno 21474839016 00000100:00100000:1.0:1763333178.741313:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff75667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627306624:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1763333178.741612:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333178.741624:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c58495 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.741633:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feaa00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333178.741637:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c58495 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.741647:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c58495 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.741676:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c58495 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.741683:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c58495 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333178.741707:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333178.741709:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333178.741710:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763333178.742061:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333178.742108:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333178.742345:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613837184 00000100:00100000:3.0:1763333178.742383:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613837184 00000100:00100000:3.0:1763333178.742449:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6824 00000100:00100000:3.0:1763333178.742459:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:55917:x1848987613837184:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1763333178.742483:0:28600:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333178.742511:0:28600:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c584b1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a234 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333178.742535:0:28600:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x25b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333178.742558:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333178.742560:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333178.742570:0:28600:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c584b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a234 expref: 13 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.742586:0:28600:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c584b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a234 expref: 13 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333178.742598:0:28600:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea800, rc 0) 00000100:00100000:3.0:1763333178.742657:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:55917:x1848987613837184:12345-192.168.204.28@tcp:101:bash.0 Request processed in 198us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333178.742665:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6824 00000100:00100000:1.0:1763333178.742797:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613837312 00000100:00100000:1.0:1763333178.742803:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613837312 00000100:00100000:1.0:1763333178.742849:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9631 00000100:00100000:1.0:1763333178.742856:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+249:56919:x1848987613837312:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333178.742875:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333178.742892:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c584b8 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a22d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.742983:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c584bf lrc: 3/1,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333178.742997:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c584bf lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333178.743007:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c584bf lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333178.743022:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c584c6 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333178.743028:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c584c6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333178.743035:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c584c6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333178.743172:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c584cd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333178.743182:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c584cd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333178.743189:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c584cd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00000004:00200000:1.0:1763333178.743200:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x1ce:0x0]: returning size 2 00010000:00010000:1.0:1763333178.743309:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c584bf lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333178.743316:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c584bf lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333178.743322:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c584bf lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333178.743329:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c584bf lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333178.743336:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdfe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333178.743341:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c584bf lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333178.743382:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c584bf lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333178.743394:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff4ad5e100) 00010000:00010000:1.0:1763333178.743398:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333178.743411:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c584bf lrc: 3/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333178.743418:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c584bf lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333178.743434:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c584c6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333178.743440:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c584c6 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333178.743446:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c584c6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333178.743450:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdea00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333178.743453:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c584c6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333178.743458:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c584c6 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333178.743465:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff4ad5e500) 00010000:00010000:1.0:1763333178.743467:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333178.743470:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c584c6 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333178.743475:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c584c6 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT1 00010000:00010000:1.0:1763333178.743522:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c584b8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a22d expref: 252 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.743537:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c584cd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a22d expref: 251 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.743544:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ce:0x0].0x0 (ffff92ff621ac600) 00010000:00010000:1.0:1763333178.743547:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333178.743549:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48190200, rc 0) 00000100:00100000:1.0:1763333178.743603:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:56919:x1848987613837312:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 746us (1492us total) trans 4294972601 rc 0/0 00000100:00100000:1.0:1763333178.743610:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9631 00000100:00100000:2.0:1763333178.748485:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.748534:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333178.748726:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613837440 00000100:00100000:3.0:1763333178.748741:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613837440 00000100:00100000:3.0:1763333178.748810:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613837568 00000100:00100000:3.0:1763333178.748813:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613837568 00000100:00100000:3.0:1763333178.748840:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6825 00000100:00100000:3.0:1763333178.748850:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2420:x1848987613837440:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333178.748875:0:28600:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333178.748900:0:28600:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c584db lrc: 2/0,0 mode: --/PR res: [0x280000400:0x25b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a23b expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333178.748992:0:28600:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77a3c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28600:1848987627307904:192.168.204.28@tcp:106: 00000100:00100000:3.0:1763333178.749099:0:28600:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe439ddcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1763333178.749184:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6826 00000100:00100000:1.0:1763333178.749196:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:55917:x1848987613837568:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1763333178.749207:0:8406:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333178.749226:0:8406:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c584e2 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a242 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333178.749252:0:8406:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x25b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333178.749271:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333178.749274:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333178.749285:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c584e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a242 expref: 22 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.749302:0:8406:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c584e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a242 expref: 22 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333178.749316:0:8406:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48191800, rc 0) 00000100:00100000:1.0:1763333178.749378:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:55917:x1848987613837568:12345-192.168.204.28@tcp:101:bash.0 Request processed in 185us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333178.749386:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6826 00002000:00010000:3.0:1763333178.764227:0:28600:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x25b:0x0] updating lvb mtime: 0 -> 1763333179 00002000:00010000:3.0:1763333178.764241:0:28600:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x25b:0x0] updating lvb atime: 0 -> 1763333178 00002000:00010000:3.0:1763333178.764244:0:28600:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x25b:0x0] updating lvb ctime: 0 -> 1763333179 00000100:00100000:3.0:1763333178.764275:0:28600:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77a3c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28600:1848987627307904:192.168.204.28@tcp:106: 00010000:00010000:3.0:1763333178.764323:0:28600:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c584db lrc: 1/0,0 mode: --/PR res: [0x280000400:0x25b:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a23b expref: 14 pid: 28600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333178.764394:0:28600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c584db lrc: 0/0,0 mode: --/PR res: [0x280000400:0x25b:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a23b expref: 14 pid: 28600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333178.764419:0:28600:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42fea200, rc 0) 00000100:00100000:3.0:1763333178.764499:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2420:x1848987613837440:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 15649us (16028us total) trans 0 rc 301/301 00000100:00100000:3.0:1763333178.764511:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6825 00000100:00100000:2.0:1763333178.776122:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.776172:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333178.776331:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613837696 00000100:00100000:0.0:1763333178.776331:0:28429:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613837824 00000100:00100000:1.0:1763333178.776344:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613837696 00000100:00100000:0.0:1763333178.776344:0:28429:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613837824 00002000:00010000:1.0:1763333178.776429:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/603 (0->18446744073709551615) 00002000:00100000:1.0:1763333178.776435:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe44e18380 with x1848987613837696 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333178.776451:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe44e18380. 00000100:00100000:1.0:1763333178.776493:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1673 00000100:00100000:1.0:1763333178.776504:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2421:x1848987613837696:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:1.0:1763333178.776737:0:28427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x25b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333178.776741:0:28427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x25b:0x0] updating lvb mtime from disk: 1763333179 -> 1763333179 00002000:00010000:1.0:1763333178.776744:0:28427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x25b:0x0] updating lvb atime from disk: 1763333178 -> 0 00002000:00010000:1.0:1763333178.776746:0:28427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x25b:0x0] updating lvb ctime from disk: 1763333179 -> 1763333179 00002000:00010000:1.0:1763333178.776749:0:28427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x25b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333178.776837:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2421:x1848987613837696:12345-192.168.204.28@tcp:10:bash.0 Request processed in 333us (729us total) trans 21474839017 rc 0/0 00000100:00100000:1.0:1763333178.776847:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1673 00002000:00010000:1.0:1763333178.776852:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/603 (0->18446744073709551615) 00002000:00100000:1.0:1763333178.776855:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe44e18380 with x1848987613837696 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333178.776860:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe44e18380. 00000100:00100000:2.0:1763333178.778377:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00002000:00010000:0.0:1763333178.778455:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/603 (0->18446744073709551615) 00002000:00100000:0.0:1763333178.778462:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe44e19f80 with x1848987613837824 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333178.778475:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe44e19f80. 00000100:00100000:0.0:1763333178.778520:0:28429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1674 00000100:00100000:0.0:1763333178.778539:0:28429:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2420:x1848987613837824:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:0.0:1763333178.778741:0:28429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x25b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333178.778745:0:28429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x25b:0x0] updating lvb mtime from disk: 0 -> 1763333179 00002000:00010000:0.0:1763333178.778747:0:28429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x25b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333178.778750:0:28429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x25b:0x0] updating lvb ctime from disk: 0 -> 1763333179 00002000:00010000:0.0:1763333178.778752:0:28429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x25b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333178.778820:0:28429:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2420:x1848987613837824:12345-192.168.204.28@tcp:10:bash.0 Request processed in 289us (2645us total) trans 17179871712 rc 0/0 00000100:00100000:0.0:1763333178.778828:0:28429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1674 00002000:00010000:0.0:1763333178.778834:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/603 (0->18446744073709551615) 00002000:00100000:0.0:1763333178.778837:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe44e19f80 with x1848987613837824 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333178.778841:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe44e19f80. 00000100:00100000:3.0:1763333178.778913:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613838080 00000100:00100000:3.0:1763333178.778923:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613838080 00000100:00100000:3.0:1763333178.778974:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3292 00000100:00100000:3.0:1763333178.778981:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6b3ecc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+251:56919:x1848987613838080:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333178.779184:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6b3ecc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:56919:x1848987613838080:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 203us (845us total) trans 4294972602 rc 0/0 00000100:00100000:3.0:1763333178.779192:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3292 00000100:00100000:0.0:1763333178.795306:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333178.795447:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613838336 00000100:00100000:2.0:1763333178.795465:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613838336 00000100:00100000:2.0:1763333178.795550:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3293 00000100:00100000:2.0:1763333178.795563:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:55917:x1848987613838336:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:2.0:1763333178.795908:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:55917:x1848987613838336:12345-192.168.204.28@tcp:35:bash.0 Request processed in 347us (619us total) trans 4294972603 rc 0/0 00000100:00100000:2.0:1763333178.795916:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3293 00010000:00010000:1.0:1763333178.960662:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333179.987586:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333181.011569:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763333181.520670:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe49608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627308416:0@lo:400:kworker.0 00000100:00100000:2.0:1763333181.520743:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333181.520789:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe49609880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1848987627308928:0@lo:400:kworker.0 00000100:00100000:2.0:1763333181.520814:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333181.520830:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4399b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1848987627309440:0@lo:400:kworker.0 00000100:00100000:2.0:1763333181.520850:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333181.520874:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1763333181.520881:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5e37baad-59e1-47e8-a7d1-7559d772e0ab:3654:1848987627308032:0@lo:400:kworker.0 00000100:00100000:2.0:1763333181.520908:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333181.520931:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe49608a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627308544:0@lo:400:kworker.0 00000100:00100000:2.0:1763333181.520949:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333181.520965:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe49608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1848987627309056:0@lo:400:kworker.0 00000100:00100000:2.0:1763333181.520984:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333181.520999:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4399a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1848987627309568:0@lo:400:kworker.0 00000100:00100000:2.0:1763333181.521016:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333181.521043:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627308416 00000100:00100000:2.0:1763333181.521050:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627308416 00000100:00100000:2.0:1763333181.521102:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627309440 00000100:00100000:2.0:1763333181.521105:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627309440 00000100:00100000:2.0:1763333181.521124:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627308544 00000100:00100000:2.0:1763333181.521128:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627308544 00000100:00100000:2.0:1763333181.521147:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 905 00000100:00100000:2.0:1763333181.521156:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+17:3654:x1848987627308416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763333181.521211:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+17:3654:x1848987627308416:12345-0@lo:400:kworker.0 Request processed in 56us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333181.521220:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 905 00000100:00100000:1.0:1763333181.521230:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1848987627308288:0@lo:400:kworker.0 00000100:00100000:2.0:1763333181.521242:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 906 00000100:00100000:2.0:1763333181.521250:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43998380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3654:x1848987627309440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1763333181.521268:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333181.521293:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43998380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3654:x1848987627309440:12345-0@lo:400:kworker.0 Request processed in 43us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333181.521295:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4960b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1848987627308800:0@lo:400:kworker.0 00000100:00100000:2.0:1763333181.521307:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 906 00000100:00100000:2.0:1763333181.521324:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 907 00000100:00100000:1.0:1763333181.521328:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333181.521336:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+33:3654:x1848987627308544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1763333181.521346:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe43998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1848987627309312:0@lo:400:kworker.0 00000100:00100000:2.0:1763333181.521409:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+33:3654:x1848987627308544:12345-0@lo:400:kworker.0 Request processed in 75us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333181.521419:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 907 00000100:00100000:1.0:1763333181.521420:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333181.521437:0:29010:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627309312 00000100:00100000:2.0:1763333181.521442:0:29010:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627309312 00000100:00100000:1.0:1763333181.521448:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1763333181.521456:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627308160:0@lo:400:kworker.0 00000100:00100000:2.0:1763333181.521468:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 908 00000100:00100000:2.0:1763333181.521477:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3653:x1848987627309312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1763333181.521483:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333181.521509:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4960bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1848987627308672:0@lo:400:kworker.0 00000100:00100000:2.0:1763333181.521517:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3653:x1848987627309312:12345-0@lo:400:kworker.0 Request processed in 40us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333181.521524:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 908 00000100:00100000:1.0:1763333181.521535:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333181.521551:0:32351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627308032 00000100:00100000:2.0:1763333181.521556:0:32351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627308032 00000100:00100000:1.0:1763333181.521559:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe49609180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1848987627309184:0@lo:400:kworker.0 00000100:00100000:2.0:1763333181.521585:0:32351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1763333181.521589:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333181.521597:0:32351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dfa6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e37baad-59e1-47e8-a7d1-7559d772e0ab+23:3654:x1848987627308032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1763333181.521628:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe43998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1848987627309312:0@lo:400:kworker.0 00000100:00100000:2.0:1763333181.521634:0:32351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dfa6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e37baad-59e1-47e8-a7d1-7559d772e0ab+23:3654:x1848987627308032:12345-0@lo:400:kworker.0 Request processed in 37us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333181.521642:0:32351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1763333181.521679:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627308928 00000100:00100000:2.0:1763333181.521684:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627308928 00000100:00100000:2.0:1763333181.521704:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627309056 00000100:00100000:2.0:1763333181.521706:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627309056 00000100:00100000:2.0:1763333181.521718:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627309568 00000100:00100000:2.0:1763333181.521720:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627309568 00000100:00100000:2.0:1763333181.521730:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627308288 00000100:00100000:2.0:1763333181.521733:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627308288 00000100:00100000:2.0:1763333181.521745:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627308800 00000100:00100000:2.0:1763333181.521747:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627308800 00000100:00100000:1.0:1763333181.521762:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627308672 00000100:00100000:2.0:1763333181.521769:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1498 00000100:00100000:1.0:1763333181.521769:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627308672 00000100:00100000:2.0:1763333181.521779:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4399bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1848987627308928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1763333181.521806:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1499 00000100:00100000:2.0:1763333181.521816:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4399bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1848987627308928:12345-0@lo:400:kworker.0 Request processed in 37us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333181.521818:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1848987627309056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763333181.521832:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1498 00000100:00100000:2.0:1763333181.521849:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1500 00000100:00100000:2.0:1763333181.521858:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1848987627309568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1763333181.521867:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1848987627309056:12345-0@lo:400:kworker.0 Request processed in 52us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333181.521875:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1499 00000100:00100000:1.0:1763333181.521895:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1501 00000100:00100000:2.0:1763333181.521896:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1848987627309568:12345-0@lo:400:kworker.0 Request processed in 37us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333181.521905:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73166a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1848987627308288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763333181.521906:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1500 00000100:00100000:2.0:1763333181.521926:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1502 00000100:00100000:2.0:1763333181.521935:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73167100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1848987627308800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1763333181.521951:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73166a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1848987627308288:12345-0@lo:400:kworker.0 Request processed in 47us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333181.521959:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1501 00000100:00100000:2.0:1763333181.521972:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73167100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1848987627308800:12345-0@lo:400:kworker.0 Request processed in 37us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333181.521979:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1503 00000100:00100000:1.0:1763333181.521987:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73165f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1848987627308672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1763333181.522016:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73165f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1848987627308672:12345-0@lo:400:kworker.0 Request processed in 30us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333181.522113:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627308160 00000100:00100000:3.0:1763333181.522118:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627308160 00000100:00100000:3.0:1763333181.522150:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627309184 00000100:00100000:3.0:1763333181.522153:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627309184 00000100:00100000:0.0:1763333181.522161:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1422 00000100:00100000:0.0:1763333181.522175:0:7798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73166300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3653:x1848987627308160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1763333181.522177:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1423 00000100:00100000:3.0:1763333181.522189:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff73164000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1848987627309184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1763333181.522224:0:7798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73166300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3653:x1848987627308160:12345-0@lo:400:kworker.0 Request processed in 54us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333181.522232:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1422 00000100:00100000:3.0:1763333181.522241:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff73164000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1848987627309184:12345-0@lo:400:kworker.0 Request processed in 53us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333181.522249:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1423 00000100:00100000:3.0:1763333181.525006:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627309696:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1763333181.525086:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333181.525143:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763333181.525152:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627309824:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1763333181.525181:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333181.525218:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627309696 00000100:00100000:3.0:1763333181.525227:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627309696 00000100:00100000:3.0:1763333181.525278:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 784 00000100:00100000:3.0:1763333181.525287:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+33:3652:x1848987627309696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1763333181.525318:0:8408:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 484926784 pending 28672 free 3919179776 avail 3687657472 00000100:00100000:3.0:1763333181.525394:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+33:3652:x1848987627309696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333181.525405:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 784 00000100:00100000:3.0:1763333181.525432:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627309824 00000100:00100000:3.0:1763333181.525436:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627309824 00000100:00100000:3.0:1763333181.525461:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1424 00000100:00100000:3.0:1763333181.525467:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3652:x1848987627309824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1763333181.525491:0:6525:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445888000 avail 1299648512 00000100:00100000:3.0:1763333181.525521:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3652:x1848987627309824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 54us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333181.525527:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1424 00000100:00100000:3.0:1763333181.525572:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627309824:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1763333181.525587:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627309696:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1763333181.525640:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1763333181.525646:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1763333181.525649:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1763333181.525652:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1763333181.525681:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1848987627309952:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1763333181.525706:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333181.525732:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5e37baad-59e1-47e8-a7d1-7559d772e0ab:3654:1848987627308032:0@lo:400:kworker.0 00000100:00100000:3.0:1763333181.525744:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe49608a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627308544:0@lo:400:kworker.0 00000100:00100000:3.0:1763333181.525755:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe49608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1848987627309056:0@lo:400:kworker.0 00000100:00100000:3.0:1763333181.525766:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4399a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1848987627309568:0@lo:400:kworker.0 00000100:00100000:3.0:1763333181.525778:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe49608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627308416:0@lo:400:kworker.0 00000100:00100000:3.0:1763333181.525789:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe49609880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1848987627308928:0@lo:400:kworker.0 00000100:00100000:3.0:1763333181.525800:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4399b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1848987627309440:0@lo:400:kworker.0 00000100:00100000:3.0:1763333181.525835:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627309952 00000100:00100000:3.0:1763333181.525839:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627309952 00000100:00100000:3.0:1763333181.525868:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1425 00000100:00100000:3.0:1763333181.525875:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1848987627309952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1763333181.525898:0:6524:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445949440 avail 1299709952 00000100:00100000:3.0:1763333181.525947:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1848987627309952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333181.525953:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1425 00000100:00100000:3.0:1763333181.525982:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1848987627309952:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1763333181.526045:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627308160:0@lo:400:kworker.0 00000100:00100000:3.0:1763333181.526058:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4960bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1848987627308672:0@lo:400:kworker.0 00000100:00100000:3.0:1763333181.526069:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe49609180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1848987627309184:0@lo:400:kworker.0 00000100:00100000:3.0:1763333181.526080:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1848987627308288:0@lo:400:kworker.0 00000100:00100000:3.0:1763333181.526091:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4960b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1848987627308800:0@lo:400:kworker.0 00000100:00100000:2.0:1763333181.528409:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1502 00000100:00100000:1.0:1763333181.529548:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1503 00010000:00010000:1.0:1763333182.032549:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763333182.034545:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4399b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627310080:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1763333182.034619:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333182.034695:0:10996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627310080 00000100:00100000:2.0:1763333182.034702:0:10996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627310080 00000100:00100000:2.0:1763333182.034747:0:10996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 785 00000100:00100000:2.0:1763333182.034755:0:10996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+17:3655:x1848987627310080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1763333182.034785:0:10996:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 28672 granted 484926784 pending 0 free 3920236544 avail 3688714240 00000100:00100000:2.0:1763333182.034822:0:10996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+17:3655:x1848987627310080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333182.034829:0:10996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 785 00000100:00100000:2.0:1763333182.034874:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4399b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627310080:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1763333182.038025:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe46e2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1848987627310208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1763333182.038100:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333182.038961:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627310208 00000100:00100000:2.0:1763333182.038972:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627310208 00000100:00100000:2.0:1763333182.039025:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 786 00000100:00100000:2.0:1763333182.039033:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1848987627310208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1763333182.039056:0:8408:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 28672 granted 484926784 pending 0 free 3920236544 avail 3688714240 00000100:00100000:2.0:1763333182.039107:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1848987627310208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (1008us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333182.039114:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 786 00000100:00100000:0.0:1763333182.039201:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe46e2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1848987627310208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1763333182.042439:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1763333182.042474:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1848987627310336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1763333182.042552:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333182.042599:0:10996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627310336 00000100:00100000:0.0:1763333182.042606:0:10996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627310336 00000100:00100000:0.0:1763333182.042651:0:10996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 787 00000100:00100000:0.0:1763333182.042660:0:10996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1848987627310336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1763333182.042684:0:10996:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 484926784 pending 28672 free 3919179776 avail 3687657472 00000100:00100000:0.0:1763333182.042726:0:10996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1848987627310336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333182.042734:0:10996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 787 00000100:00100000:0.0:1763333182.042781:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1848987627310336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1763333182.396009:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333182.396055:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333182.396096:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333182.396142:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333182.396173:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333182.396207:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613838720 00000100:00100000:1.0:1763333182.396207:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613838976 00000100:00100000:2.0:1763333182.396218:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613838720 00000100:00100000:1.0:1763333182.396218:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613838976 00000100:00100000:0.0:1763333182.396257:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613838592 00000100:00100000:0.0:1763333182.396262:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613838592 00000100:00100000:2.0:1763333182.396310:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1504 00000100:00100000:1.0:1763333182.396314:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613838848 00000100:00100000:1.0:1763333182.396319:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613838848 00000100:00100000:2.0:1763333182.396324:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:2421:x1848987613838720:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1763333182.396403:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 909 00000100:00100000:1.0:1763333182.396413:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2421:x1848987613838976:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1763333182.396451:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:2421:x1848987613838720:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 130us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333182.396452:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2421:x1848987613838976:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 40us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333182.396467:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1504 00000100:00100000:1.0:1763333182.396468:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 909 00000100:00100000:1.0:1763333182.396493:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 910 00000100:00100000:1.0:1763333182.396501:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74039500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2421:x1848987613838848:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1763333182.396529:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74039500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2421:x1848987613838848:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 30us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333182.396536:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 910 00000100:00100000:0.0:1763333182.396640:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1505 00000100:00100000:0.0:1763333182.396649:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74038a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2421:x1848987613838592:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1763333182.396677:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74038a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2421:x1848987613838592:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 31us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333182.396683:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1505 00000100:00080000:1.0:1763333182.396918:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1763333182.396924:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1763333182.396926:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1763333182.396928:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1763333182.396946:0:32350:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613838464 00000100:00100000:1.0:1763333182.396952:0:32350:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613838464 00000100:00100000:1.0:1763333182.400460:0:32350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 157 00000100:00100000:1.0:1763333182.400480:0:32350:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dfa7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae3ba77-d588-4a44-b5f9-fbec4e33064f+9:2421:x1848987613838464:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1763333182.400552:0:32350:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dfa7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae3ba77-d588-4a44-b5f9-fbec4e33064f+9:2421:x1848987613838464:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 79us (4554us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333182.400564:0:32350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 157 00010000:00010000:1.0:1763333183.057498:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763333183.473480:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333183.474773:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613839232 00000100:00100000:1.0:1763333183.474786:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613839232 00000100:00100000:1.0:1763333183.474848:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9632 00000100:00100000:1.0:1763333183.474860:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+253:57342:x1848987613839232:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:1.0:1763333183.474915:0:6520:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1763333183.474944:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f000/0xb32e3ef184c5848e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1ce:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a226 expref: 253 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333183.474966:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe48190200/0xb32e3ef184c584cd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a22d expref: 252 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333183.474981:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe46ac4400/0xb32e3ef184c58472 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1ce:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a218 expref: 251 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333183.474994:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ce:0x0].0x0 (ffff92ff621ac600) 00010000:00010000:1.0:1763333183.475006:0:6520:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333183.475035:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c584e9 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333183.475048:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c584e9 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1763333183.475058:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c584e9 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1763333183.475069:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c584f0 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333183.475080:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c584f0 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1763333183.475087:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c584f0 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1763333183.475166:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c584f7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x1ce:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333183.475174:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c584f7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ce:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1763333183.475181:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c584f7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ce:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00000040:00080000:1.0:1763333183.475477:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1509, 64 off126824 00000004:00080000:1.0:1763333183.475488:0:6520:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1287555138362ns, next at 1288555135528ns, rc = 0 00000040:00080000:1.0:1763333183.475511:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1508, 64 off126824 00000004:00080000:1.0:1763333183.475517:0:6520:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1287555167706ns, next at 1288555166630ns, rc = 0 00000040:00080000:1.0:1763333183.475528:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1509, 64 off126888 00000040:00080000:1.0:1763333183.475538:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1510, 64 off126888 00010000:00010000:1.0:1763333183.475590:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c584fe lrc: 3/0,1 mode: --/PW res: [0x240000404:0x1ce:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333183.475599:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c584fe lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ce:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1763333183.475606:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c584fe lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x1ce:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1763333183.475615:0:6520:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c584fe lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1ce:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1763333183.475626:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c584fe lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x1ce:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1763333183.475632:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c584fe lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1ce:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1763333183.475658:0:6520:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763333183.475676:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c584f7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x1ce:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1763333183.475682:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c584f7 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x1ce:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1763333183.475688:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c584f7 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1ce:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1763333183.475694:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdfe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333183.475698:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c584f7 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x1ce:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1763333183.475705:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c584f7 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x1ce:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1763333183.475714:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ce:0x0].0x0 (ffff92ff4ad5e900) 00010000:00010000:1.0:1763333183.475717:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763333183.475720:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c584f7 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x1ce:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1763333183.475726:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c584f7 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x1ce:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1763333183.475840:0:6520:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c584e9 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1763333183.475852:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c584e9 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1763333183.475857:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c584e9 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1763333183.475863:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c584e9 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1763333183.475867:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333183.475871:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c584e9 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1763333183.475876:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c584e9 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1763333183.475884:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0x0 (ffff92ff4ad5e100) 00010000:00010000:1.0:1763333183.475887:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333183.475890:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c584e9 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1763333183.475895:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c584e9 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00000004:00010000:1.0:1763333183.475906:0:6520:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f4ee3c30 reply state 00000000b5956cf3 transno 4294972604 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c584f0 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1763333183.475916:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c584f0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1763333183.475921:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff4ad5e500) 00010000:00010000:1.0:1763333183.475924:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333183.475926:0:6520:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763333183.476011:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:57342:x1848987613839232:12345-192.168.204.28@tcp:36:rm.0 Request processed in 1153us (2542us total) trans 4294972604 rc 0/0 00000100:00100000:1.0:1763333183.476020:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9632 00010000:00010000:0.0:1763333183.476701:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333183.476710:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c584fe lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1ce:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1763333183.476717:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700ee00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333183.476720:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c584fe lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x1ce:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1763333183.476727:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c584fe lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x1ce:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1763333183.476738:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1ce:0x0].0x0 (ffff92ff4ad5e900) 00010000:00010000:0.0:1763333183.476741:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763333183.476744:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c584fe lrc: 1/0,0 mode: --/PW res: [0x240000404:0x1ce:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1763333183.476750:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c584fe lrc: 0/0,0 mode: --/PW res: [0x240000404:0x1ce:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1763333183.476764:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333183.476766:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333183.476768:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333184.081155:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1763333184.083535:0:26035:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871712 is committed 00000001:00080000:2.0:1763333184.083548:0:26035:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871711 is committed 00000001:00080000:1.0:1763333184.083800:0:24714:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839017 is committed 00000001:00080000:1.0:1763333184.083806:0:24714:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839016 is committed 00000001:02000400:3.0:1763333185.010268:0:35517:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 70a: flr mode fsx test ================ 17:46:23 (1763333183) 00010000:00010000:1.0:1763333185.104865:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1763333185.117953:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972604 is committed 00000004:00080000:2.0:1763333185.117972:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 986 committed 00000004:00080000:2.0:1763333185.117990:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 989 committed 00010000:00010000:0.0:1763333185.118072:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c584f0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1763333185.118089:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c584f0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1763333185.118098:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c584f0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1763333185.118105:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdea00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333185.118111:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c584f0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1763333185.118120:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c584f0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1763333185.118141:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x5:0x0].0xcca0c426 (ffff92ff4ad5e500) 00010000:00010000:0.0:1763333185.118145:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333185.118152:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c584f0 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1763333185.118158:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4abdea00/0xb32e3ef184c584f0 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 00000100:00100000:0.0:1763333185.118337:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1763333185.118388:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627310464:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1763333185.118473:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333185.118555:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627310464 00000100:00100000:0.0:1763333185.118565:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627310464 00000100:00100000:0.0:1763333185.118636:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6827 00000100:00100000:0.0:1763333185.118648:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1848987627310464:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1763333185.118680:0:8406:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:603 count 1 00010000:00010000:0.0:1763333185.118712:0:8406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c58505 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333185.118735:0:8406:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c584b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a234 expref: 10 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333185.118744:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333185.118747:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763333185.118751:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c58505 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333185.118784:0:8406:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c584b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a234 expref: 10 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333185.118800:0:8406:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c584b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a234 expref: 10 pid: 28600 timeout: 1389 lvb_type: 0 00000100:00100000:0.0:1763333185.118812:0:8406:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e04000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8406:1848987627310592:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333185.118880:0:8406:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff439ff000 going to sleep for 11 seconds 00000100:00080000:0.0:1763333185.118894:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1763333185.119082:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1763333185.119095:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627310720:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1763333185.119130:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333185.119500:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627310720 00000100:00100000:3.0:1763333185.119507:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627310720 00000100:00100000:3.0:1763333185.119564:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6828 00000100:00100000:3.0:1763333185.119574:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7403b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3654:x1848987627310720:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1763333185.119674:0:28650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:603 count 1 00010000:00010000:3.0:1763333185.119697:0:28650:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5850c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x25b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333185.119716:0:28650:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c584e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a242 expref: 12 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333185.119723:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333185.119724:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333185.119727:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5850c lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x25b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333185.119748:0:28650:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c584e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x25b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a242 expref: 12 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333185.119758:0:28650:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c584e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x25b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a242 expref: 12 pid: 8406 timeout: 1389 lvb_type: 0 00000100:00100000:3.0:1763333185.119769:0:28650:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4960b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28650:1848987627310848:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333185.119815:0:28650:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff801ea9c0 going to sleep for 11 seconds 00000100:00080000:2.0:1763333185.122618:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1763333185.123090:0:8406:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e04000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8406:1848987627310592:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333185.123125:0:8406:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c58505 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333185.125193:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333185.125378:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613839360 00000100:00100000:3.0:1763333185.125397:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613839360 00000100:00080000:2.0:1763333185.125453:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1763333185.125481:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c584b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a234 expref: 11 pid: 28600 timeout: 1389 lvb_type: 0 00000100:00100000:3.0:1763333185.125538:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3173 00000100:00100000:3.0:1763333185.125551:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+11:2420:x1848987613839360:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333185.125574:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333185.125582:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c584b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a234 expref: 11 pid: 28600 timeout: 1389 lvb_type: 0 00010000:00010000:3.0:1763333185.125606:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c584b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a234 expref: 11 pid: 28600 timeout: 1389 lvb_type: 0 00010000:00010000:3.0:1763333185.125642:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c584b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a234 expref: 11 pid: 28600 timeout: 1389 lvb_type: 0 00010000:00010000:3.0:1763333185.125663:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333185.125666:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333185.125672:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c58505 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333185.125685:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c58505 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333185.125726:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333185.125816:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+10:2420:x1848987613839360:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 267us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333185.125826:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3173 00010000:00010000:0.0:1763333185.126017:0:8406:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c58505 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333185.126028:0:8406:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c58505 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333185.126039:0:8406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c58505 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333185.126047:0:8406:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c58505 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333185.126074:0:8406:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763333185.126488:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3655:x1848987627310464:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7841us (8012us total) trans 21474839018 rc 0/0 00000100:00100000:0.0:1763333185.126498:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6827 00000100:00100000:2.0:1763333185.126768:0:3655:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474839016 gen 2 00000004:00080000:2.0:1763333185.126782:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff75664700, transno 21474839004 00010000:00010000:3.0:1763333185.126786:0:6507:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763333185.126796:0:6507:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c58505 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1763333185.126798:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff50067b80, transno 21474839005 00000004:00080000:2.0:1763333185.126807:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff75667b80, transno 21474839006 00010000:00010000:3.0:1763333185.126814:0:6507:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f000 already unused, calling callback (ffffffffc0b79b40) 00000004:00080000:2.0:1763333185.126815:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff5004bb80, transno 21474839007 00000004:00080000:2.0:1763333185.126825:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7e121500, transno 21474839008 00010000:00010000:3.0:1763333185.126826:0:6507:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c58505 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1763333185.126830:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7e121880, transno 21474839009 00000004:00080000:2.0:1763333185.126839:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7e120000, transno 21474839010 00000004:00080000:2.0:1763333185.126847:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7e122d80, transno 21474839011 00010000:00010000:3.0:1763333185.126851:0:6507:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c58505 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1763333185.126854:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe42efb480, transno 21474839013 00000004:00080000:2.0:1763333185.126864:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46a6c700, transno 21474839014 00000004:00080000:2.0:1763333185.126873:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe46a6d180, transno 21474839015 00000004:00080000:2.0:1763333185.126878:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff75667100, transno 21474839016 00010000:00010000:3.0:1763333185.126886:0:6507:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c58505 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333185.126891:0:3655:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff92fe44e05180 x1848987627310464/t21474839018(21474839018) o6->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1763333201 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1763333185.126913:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c58505 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1763333185.126925:0:3655:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe44e05180/2, rc 0, transno 21474839018 00000100:00100000:2.0:1763333185.126936:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627310464:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1763333185.126942:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333185.126946:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763333185.126948:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763333185.127170:0:8604:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 1 changes, 1 in progress, 0 in flight, 12 done 00000100:00100000:3.0:1763333185.129497:0:28650:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4960b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28650:1848987627310848:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333185.129542:0:28650:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5850c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x25b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333185.134155:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333185.134225:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613839488 00000100:00100000:3.0:1763333185.134244:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613839488 00000100:00100000:2.0:1763333185.134303:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:3.0:1763333185.134339:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c584e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x25b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a242 expref: 13 pid: 8406 timeout: 1389 lvb_type: 0 00000100:00100000:3.0:1763333185.134413:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3174 00000100:00100000:3.0:1763333185.134466:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2420:x1848987613839488:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333185.134489:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333185.134496:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c584e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x25b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a242 expref: 13 pid: 8406 timeout: 1389 lvb_type: 0 00010000:00010000:3.0:1763333185.134513:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c584e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x25b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a242 expref: 13 pid: 8406 timeout: 1389 lvb_type: 0 00010000:00010000:3.0:1763333185.134542:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe48191800/0xb32e3ef184c584e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x25b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a242 expref: 13 pid: 8406 timeout: 1389 lvb_type: 0 00010000:00010000:3.0:1763333185.134558:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333185.134560:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333185.134567:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5850c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333185.134577:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5850c lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x25b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333185.134614:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333185.134650:0:28650:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5850c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333185.134676:0:28650:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5850c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333185.134689:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:2420:x1848987613839488:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 263us (541us total) trans 0 rc 0/0 00010000:00010000:2.0:1763333185.134697:0:28650:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5850c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333185.134702:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3174 00010000:00010000:2.0:1763333185.134716:0:28650:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5850c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333185.134741:0:28650:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763333185.134994:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333185.135004:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5850c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333185.135015:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea200 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333185.135020:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5850c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333185.135031:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5850c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333185.135044:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7403b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+6:3654:x1848987627310720:12345-0@lo:6:osp-syn-1-1.0 Request processed in 15468us (15909us total) trans 17179871713 rc 0/0 00010000:00010000:0.0:1763333185.135046:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5850c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333185.135064:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe42fea200/0xb32e3ef184c5850c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333185.135066:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6828 00010000:00010000:0.0:1763333185.135103:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333185.135105:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333185.135107:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763333185.135142:0:3654:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179871711 gen 2 00000004:00080000:2.0:1763333185.135149:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe469a0380, transno 17179871677 00000004:00080000:2.0:1763333185.135170:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe469a2a00, transno 17179871678 00000004:00080000:2.0:1763333185.135174:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe469a0700, transno 17179871679 00000004:00080000:2.0:1763333185.135179:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe469a3480, transno 17179871680 00000004:00080000:2.0:1763333185.135183:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe42ef8700, transno 17179871681 00000004:00080000:2.0:1763333185.135187:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe42efb800, transno 17179871682 00000004:00080000:2.0:1763333185.135190:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4920d880, transno 17179871684 00000004:00080000:2.0:1763333185.135194:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4920c700, transno 17179871685 00000004:00080000:2.0:1763333185.135197:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4920fb80, transno 17179871686 00000004:00080000:2.0:1763333185.135202:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4920ca80, transno 17179871687 00000004:00080000:2.0:1763333185.135209:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4920df80, transno 17179871688 00000100:00100000:1.0:1763333185.135213:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613839616 00000004:00080000:2.0:1763333185.135214:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe4920c000, transno 17179871689 00000004:00080000:2.0:1763333185.135222:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44e04700, transno 17179871692 00000100:00100000:1.0:1763333185.135223:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613839616 00000004:00080000:2.0:1763333185.135226:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44e06300, transno 17179871693 00000004:00080000:2.0:1763333185.135233:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe472f1f80, transno 17179871694 00000004:00080000:2.0:1763333185.135236:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe472f0a80, transno 17179871695 00000004:00080000:2.0:1763333185.135241:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7e121180, transno 17179871699 00000004:00080000:2.0:1763333185.135247:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7e00e680, transno 17179871700 00000004:00080000:2.0:1763333185.135249:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7e123b80, transno 17179871701 00000004:00080000:2.0:1763333185.135251:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff7e00f800, transno 17179871702 00000004:00080000:2.0:1763333185.135258:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff77b15500, transno 17179871703 00000004:00080000:2.0:1763333185.135261:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff77b14a80, transno 17179871704 00000004:00080000:2.0:1763333185.135267:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff77b16680, transno 17179871705 00000004:00080000:2.0:1763333185.135271:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff77b14380, transno 17179871706 00000004:00080000:2.0:1763333185.135274:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff77a3e680, transno 17179871708 00000004:00080000:2.0:1763333185.135278:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff77a3fb80, transno 17179871709 00000004:00080000:2.0:1763333185.135294:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff77a3d500, transno 17179871710 00000100:00100000:1.0:1763333185.135301:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9633 00000004:00080000:2.0:1763333185.135303:0:3654:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff77a3c700, transno 17179871711 00000100:00100000:1.0:1763333185.135318:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:57503:x1848987613839616:12345-192.168.204.28@tcp:41:stat.0 00000100:00100000:2.0:1763333185.135319:0:3654:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff92ff77a3f100 x1848987627310720/t17179871713(17179871713) o6->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1763333201 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1763333185.135345:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff77a3f100/2, rc 0, transno 17179871713 00000100:00100000:2.0:1763333185.135383:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627310720:0@lo:6:osp-syn-1-1.0 00000004:00000024:1.0:1763333185.135434:0:6520:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 7839416320 avail 7376314368 00000100:00100000:1.0:1763333185.135500:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:57503:x1848987613839616:12345-192.168.204.28@tcp:41:stat.0 Request processed in 189us (1197us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333185.135508:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9633 00000100:00080000:1.0:1763333185.135532:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1763333185.135539:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1763333185.135856:0:9836:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 1 changes, 1 in progress, 0 in flight, 28 done 00000100:00100000:2.0:1763333185.193066:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333185.195029:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613839744 00000100:00100000:0.0:1763333185.195050:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613839744 00000100:00100000:0.0:1763333185.195140:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9634 00000100:00100000:0.0:1763333185.195154:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:57507:x1848987613839744:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333185.195184:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333185.195213:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c58513 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a249 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333185.195316:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5851a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333185.195335:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5851a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333185.195367:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5851a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333185.195384:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c58521 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333185.195391:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c58521 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333185.195397:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c58521 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333185.195460:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5851a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333185.195468:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5851a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333185.195474:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5851a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333185.195481:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5851a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333185.195488:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333185.195492:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5851a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333185.195500:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5851a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333185.195513:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ff8016f600) 00010000:00010000:0.0:1763333185.195517:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333185.195522:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5851a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333185.195528:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c5851a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333185.195541:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c58521 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333185.195546:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c58521 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333185.195552:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c58521 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333185.195557:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333185.195560:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c58521 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333185.195565:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c58521 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333185.195572:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x85409d3b (ffff92fe43b44900) 00010000:00010000:0.0:1763333185.195574:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333185.195577:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c58521 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333185.195582:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c58521 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333185.195615:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c58513 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a249 expref: 21 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333185.195625:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ff8016f600) 00010000:00010000:0.0:1763333185.195627:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333185.195630:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c58513 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a249 expref: 21 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333185.195640:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e000, rc 0) 00000100:00100000:0.0:1763333185.195729:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:57507:x1848987613839744:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 578us (2679us total) trans 0 rc 301/301 00000100:00100000:0.0:1763333185.195738:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9634 00000100:00100000:2.0:1763333185.204584:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333185.204997:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613840000 00000100:00100000:3.0:1763333185.205012:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613840000 00000100:00100000:3.0:1763333185.207850:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9635 00000100:00100000:3.0:1763333185.207870:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:57507:x1848987613840000:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:3.0:1763333185.207969:0:6520:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333185.208002:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b07a00/0xb32e3ef184c39762 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e36960261 expref: 20 pid: 8606 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333185.208020:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ff8016f600) 00010000:00010000:3.0:1763333185.208025:0:6520:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333185.208106:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c58528 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:3.0:1763333185.208121:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c58528 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:3.0:1763333185.208132:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c58528 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00010000:00010000:3.0:1763333185.208147:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c5852f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x85409d3b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:3.0:1763333185.208153:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c5852f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:3.0:1763333185.208159:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c5852f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00000040:00080000:3.0:1763333185.209926:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd0:0x2:0x0].8, 2160 off42584 00000040:00080000:3.0:1763333185.210044:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000405:0x2:0x0].5, 2360 off42624 00000004:00080000:3.0:1763333185.210052:0:6520:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff92ff801ea9c0 with version 15 00000004:00080000:2.0:1763333185.210253:0:32360:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff92ff499ad300 version 15 rpc_version 15 00000020:00100000:2.0:1763333185.210305:0:32360:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1763333185.210320:0:32360:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff92ff7569f480 x1848987627311104/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 4224/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1763333185.210386:0:32360:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7569f480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:32360:1848987627311104:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1763333185.210541:0:32360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333185.210577:0:32360:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff74009300 going to sleep for 11 seconds 00000100:00100000:3.0:1763333185.211300:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627311104 00000100:00100000:3.0:1763333185.211310:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627311104 00000100:00100000:3.0:1763333185.211391:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1426 00000100:00100000:3.0:1763333185.211401:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:32360:x1848987627311104:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1763333185.212079:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:32360:x1848987627311104:12345-0@lo:1000:osp_up1-0.0 Request processed in 678us (1537us total) trans 4294972605 rc 0/0 00000100:00100000:3.0:1763333185.212088:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1426 00000100:00100000:1.0:1763333185.212296:0:32360:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7569f480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:32360:1848987627311104:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1763333185.214826:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c58536 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x54:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:3.0:1763333185.214852:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c58536 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:3.0:1763333185.214866:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c58536 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00010000:00010000:3.0:1763333185.214889:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c5853d lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:3.0:1763333185.214896:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c5853d lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:3.0:1763333185.214902:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c5853d lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00010000:00010000:3.0:1763333185.214953:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff92fe42fea200/0xb32e3ef184c58544 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6520 initiator: MDT0 00010000:00010000:3.0:1763333185.214961:0:6520:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff92fe42fea200/0xb32e3ef184c58544 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6520 initiator: MDT0 00010000:00010000:3.0:1763333185.214972:0:6520:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff92fe42fea200/0xb32e3ef184c58544 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6520 initiator: MDT0 00000100:00100000:3.0:1763333185.215001:0:6520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4960b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6520:1848987627311232:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1763333185.215077:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333185.215128:0:6520:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe44e82600 going to sleep for 11 seconds 00000100:00100000:0.0:1763333185.215197:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627311232 00000100:00100000:0.0:1763333185.215207:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627311232 00000100:00100000:0.0:1763333185.215279:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1427 00000100:00100000:0.0:1763333185.215299:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6520:x1848987627311232:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1763333185.215325:0:6524:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333185.215371:0:6524:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5854b lrc: 2/0,0 mode: --/PW res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb32e3ef184c58544 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333185.215398:0:6524:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5854b lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb32e3ef184c58544 expref: 7 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333185.215411:0:6524:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5854b lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb32e3ef184c58544 expref: 7 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333185.215420:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff92fe43b44900) 00010000:00010000:0.0:1763333185.215423:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333185.215427:0:6524:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e000, rc 0) 00000100:00100000:0.0:1763333185.215480:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6520:x1848987627311232:12345-0@lo:101:mdt00_001.0 Request processed in 183us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333185.215487:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1427 00000100:00100000:1.0:1763333185.215608:0:6520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4960b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6520:1848987627311232:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1763333185.215624:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff92fe42fea200/0xb32e3ef184c58544 lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb32e3ef184c5854b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333185.215637:0:6520:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff92fe42fea200/0xb32e3ef184c58544 lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb32e3ef184c5854b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1763333185.215660:0:6520:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000eaddaa32 reply state 000000008676a46d transno 8589935402 ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c5853d lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.215678:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c5853d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.215684:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0x0 (ffff92ff42c64400) 00010000:00010000:1.0:1763333185.215687:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333185.215690:0:6520:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763333185.215698:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff92fe42fea200/0xb32e3ef184c58544 lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb32e3ef184c5854b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333185.215705:0:6520:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff92fe42fea200/0xb32e3ef184c58544 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb32e3ef184c5854b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1763333185.215717:0:6520:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x240000405:0x6:0x0] 00000004:00010000:1.0:1763333185.215724:0:6520:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000eaddaa32 reply state 000000008676a46d transno 8589935402 ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c58536 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.215732:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c58536 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.215738:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff92ff42c64000) 00010000:00010000:1.0:1763333185.215741:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333185.215742:0:6520:0:(service.c:177:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1763333185.215748:0:6520:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x54:0x0]: returning size 4096 00010000:00010000:1.0:1763333185.215759:0:6520:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c58528 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.215766:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c58528 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.215772:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c58528 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.215778:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c58528 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.215785:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feaa00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333185.215790:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c58528 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.215799:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c58528 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.215809:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ff8016f600) 00010000:00010000:1.0:1763333185.215812:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333185.215816:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c58528 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.215823:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c58528 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 00000004:00010000:1.0:1763333185.215840:0:6520:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000eaddaa32 reply state 000000008676a46d transno 8589935402 ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c5852f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.215848:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c5852f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.215854:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x85409d3b (ffff92ff42c64900) 00010000:00010000:1.0:1763333185.215857:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333185.215858:0:6520:0:(service.c:177:ptlrpc_save_lock()) nlocks 2 00000100:00100000:1.0:1763333185.215949:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:57507:x1848987613840000:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 8085us (11378us total) trans 8589935402 rc 0/0 00000100:00100000:1.0:1763333185.215958:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9635 00000100:00100000:0.0:1763333185.268428:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333185.268522:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613840128 00000100:00100000:1.0:1763333185.268542:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613840128 00000100:00100000:1.0:1763333185.268647:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9636 00000100:00100000:1.0:1763333185.268659:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:57510:x1848987613840128:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333185.268696:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333185.268725:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c58552 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a250 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333185.268817:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700e400/0xb32e3ef184c58559 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.268834:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700e400/0xb32e3ef184c58559 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.268848:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700e400/0xb32e3ef184c58559 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00000004:00200000:1.0:1763333185.268920:0:6520:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1763333185.268925:0:6520:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763333185.268951:0:6520:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700e400/0xb32e3ef184c58559 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.268981:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c58552 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a250 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333185.269022:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700e400/0xb32e3ef184c58559 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a250 expref: 22 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333185.269032:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ff8016f600) 00010000:00010000:1.0:1763333185.269036:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1763333185.269041:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4700e400, rc 0) 00000100:00100000:1.0:1763333185.269134:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:57510:x1848987613840128:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 477us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333185.269142:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9636 00000100:00100000:2.0:1763333185.282150:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333185.283072:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613840256 00000100:00100000:1.0:1763333185.283088:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613840256 00000100:00100000:2.0:1763333185.283777:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9637 00000100:00100000:2.0:1763333185.283797:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:57510:x1848987613840256:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333185.283827:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333185.283855:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c58560 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a257 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333185.283950:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c58567 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333185.283969:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c58567 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333185.283982:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c58567 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333185.283997:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5856e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333185.284004:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5856e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333185.284011:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5856e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333185.284123:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c58575 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x54:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333185.284132:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c58575 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333185.284139:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c58575 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT0 00000004:00200000:2.0:1763333185.284240:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x54:0x0]: returning size 4096 00000004:00200000:2.0:1763333185.284246:0:12741:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1763333185.284271:0:12741:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c58575 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333185.284298:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c58567 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333185.284305:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c58567 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333185.284312:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c58567 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333185.284319:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c58567 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333185.284326:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5e00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333185.284331:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c58567 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333185.284340:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c58567 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333185.284380:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ff8016f600) 00010000:00010000:2.0:1763333185.284384:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333185.284390:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c58567 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333185.284397:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c58567 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333185.284413:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5856e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333185.284419:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5856e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333185.284425:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5856e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333185.284431:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac5400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333185.284434:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5856e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333185.284441:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5856e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333185.284448:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x85409d3b (ffff92ff42c64900) 00010000:00010000:2.0:1763333185.284450:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333185.284453:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5856e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333185.284460:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac5400/0xb32e3ef184c5856e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333185.284491:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c58560 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a257 expref: 24 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333185.284506:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac4400/0xb32e3ef184c58575 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a257 expref: 23 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333185.284514:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff92ff42c64000) 00010000:00010000:2.0:1763333185.284516:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1763333185.284519:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4400, rc 0) 00000100:00100000:2.0:1763333185.284618:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:57510:x1848987613840256:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 827us (2485us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333185.284639:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9637 00000100:00100000:2.0:1763333185.297580:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333185.297844:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613840384 00000100:00100000:1.0:1763333185.297863:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613840384 00000100:00100000:1.0:1763333185.297970:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9638 00000100:00100000:1.0:1763333185.297983:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:57510:x1848987613840384:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333185.299515:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333185.299566:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c5857c lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a25e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333185.299691:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c58583 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.299712:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c58583 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.299728:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c58583 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00000004:00200000:1.0:1763333185.299805:0:6520:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x6:0x0]: returning size 4096 00000004:00200000:1.0:1763333185.299812:0:6520:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1763333185.299864:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c5857c lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a25e expref: 25 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333185.299892:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c58583 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a25e expref: 24 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333185.299902:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0x0 (ffff92ff42c64400) 00010000:00010000:1.0:1763333185.299906:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1763333185.299910:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4700f400, rc 0) 00000100:00100000:1.0:1763333185.300026:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:57510:x1848987613840384:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 2042us (2453us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333185.300039:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9638 00000100:00100000:0.0:1763333185.307749:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333185.308160:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613840512 00000100:00100000:1.0:1763333185.308175:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613840512 00000100:00100000:1.0:1763333185.308268:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9639 00000100:00100000:1.0:1763333185.308291:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+247:57510:x1848987613840512:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333185.308328:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333185.308391:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c5858a lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a265 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333185.308482:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58591 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.308501:0:6520:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5854b lrc: 2/0,0 mode: PW/PW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb32e3ef184c58544 expref: 6 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333185.308511:0:6520:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58591 lrc: 4/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1763333185.308558:0:6520:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5854b lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb32e3ef184c58544 expref: 6 pid: 6524 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333185.308579:0:6520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe4399a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6520:1848987627311360:0@lo:104: 00000100:00100000:1.0:1763333185.308662:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333185.308719:0:6520:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7dcc7240 going to sleep for 11 seconds 00000100:00100000:3.0:1763333185.308771:0:6502:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1763333185.308802:0:6502:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627311360 00000100:00100000:3.0:1763333185.308812:0:6502:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627311360 00000100:00100000:3.0:1763333185.308876:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1763333185.308886:0:6502:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46f06c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6520:x1848987627311360:12345-0@lo:104: 00010000:00010000:3.0:1763333185.308904:0:6502:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff92fe42fea200/0xb32e3ef184c58544 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb32e3ef184c5854b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333185.308987:0:6502:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1763333185.308993:0:6502:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46f06c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6520:x1848987627311360:12345-0@lo:104: Request processed in 110us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333185.309001:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:2.0:1763333185.309273:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1763333185.310330:0:6520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe4399a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6520:1848987627311360:0@lo:104: 00010000:00010000:0.0:1763333185.310386:0:6520:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58591 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:1.0:1763333185.310724:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333185.310736:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff92fe42fea200/0xb32e3ef184c58544 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb32e3ef184c5854b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333185.310747:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea200 already unused, calling callback (ffffffffc17c0290) 00010000:00010000:1.0:1763333185.310756:0:6508:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff92fe42fea200/0xb32e3ef184c58544 lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb32e3ef184c5854b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1763333185.310766:0:6508:0:(mdt_handler.c:3944:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff92fe42fea200/0xb32e3ef184c58544 lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb32e3ef184c5854b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333185.310820:0:6508:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff92fe42fea200/0xb32e3ef184c58544 lrc: 2/0,0 mode: --/PW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb32e3ef184c5854b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333185.310828:0:6508:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1763333185.310894:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1763333185.311368:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff92fe42fea200/0xb32e3ef184c58544 lrc: 1/0,0 mode: --/PW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb32e3ef184c5854b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333185.311378:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff92fe42fea200/0xb32e3ef184c58544 lrc: 0/0,0 mode: --/PW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb32e3ef184c5854b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333185.311418:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333185.311420:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333185.311422:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763333185.311544:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe43998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1848987627311488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1763333185.311639:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333185.313495:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627311488 00000100:00100000:3.0:1763333185.313512:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627311488 00010000:00010000:3.0:1763333185.313564:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5854b lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb32e3ef184c58544 expref: 7 pid: 6524 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333185.313604:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3175 00000100:00100000:3.0:1763333185.313612:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+7:3653:x1848987627311488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1763333185.313630:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1763333185.322523:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972605 is committed 00010000:00010000:3.0:1763333185.322699:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e000/0xb32e3ef184c5854b lrc: 0/0,0 mode: --/PW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb32e3ef184c58544 expref: 6 pid: 6524 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333185.322725:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff92fe43b44900) 00010000:00010000:3.0:1763333185.322731:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58591 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1763333185.322740:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58591 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1763333185.322748:0:6504:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58591 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT1 00010000:00010000:3.0:1763333185.322800:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333185.322898:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1848987627311488:12345-0@lo:103:ldlm_bl.0 Request processed in 9284us (11269us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333185.322908:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3175 00010000:00010000:0.0:1763333185.323006:0:6520:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58591 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00010000:00010000:0.0:1763333185.323016:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58591 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 00000004:00200000:0.0:1763333185.323076:0:6520:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x6:0x0]: returning size 4096 00000004:00200000:0.0:1763333185.323081:0:6520:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763333185.323123:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700fe00/0xb32e3ef184c5858a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a265 expref: 249 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333185.323139:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58591 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a265 expref: 248 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333185.323148:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff92fe43b44900) 00010000:00010000:0.0:1763333185.323150:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1763333185.323153:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4700ee00, rc 0) 00000100:00100000:0.0:1763333185.323211:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:57510:x1848987613840512:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 14933us (15478us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333185.323219:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9639 00000100:00100000:2.0:1763333185.323332:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe43998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1848987627311488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1763333185.339630:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333185.339737:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613840640 00000100:00100000:0.0:1763333185.339748:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613840640 00000100:00100000:0.0:1763333185.339817:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9640 00000100:00100000:0.0:1763333185.339828:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:57510:x1848987613840640:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333185.339850:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333185.339873:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c58598 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a26c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333185.339940:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5859f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1763333185.339953:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5859f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1763333185.339963:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5859f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1763333185.339979:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c585a6 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1763333185.339985:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c585a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1763333185.339993:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c585a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1763333185.340063:0:6520:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5859f lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1763333185.340070:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5859f lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1763333185.340076:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5859f lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1763333185.340083:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5859f lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1763333185.340088:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333185.340093:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5859f lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1763333185.340101:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5859f lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1763333185.340113:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0x0 (ffff92ff42c64400) 00010000:00010000:0.0:1763333185.340116:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333185.340120:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5859f lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1763333185.340126:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c5859f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1763333185.340139:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c585a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1763333185.340145:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c585a6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1763333185.340151:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c585a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1763333185.340155:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333185.340158:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c585a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1763333185.340163:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c585a6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1763333185.340170:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0xdd396665 (ffff92fe43b44b00) 00010000:00010000:0.0:1763333185.340172:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333185.340175:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c585a6 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1763333185.340180:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c585a6 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1763333185.340212:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c58598 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a26c expref: 25 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333185.340222:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0x0 (ffff92ff42c64400) 00010000:00010000:0.0:1763333185.340224:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333185.340227:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c58598 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a26c expref: 25 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333185.340241:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7fe00, rc 0) 00000100:00100000:0.0:1763333185.340817:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:57510:x1848987613840640:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 989us (1196us total) trans 0 rc 301/301 00000100:00100000:0.0:1763333185.340825:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9640 00000100:00100000:3.0:1763333185.344973:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333185.345072:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613840768 00000100:00100000:0.0:1763333185.345085:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613840768 00000100:00100000:0.0:1763333185.345159:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9641 00000100:00100000:0.0:1763333185.345169:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4960bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:57510:x1848987613840768:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333185.345191:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333185.345213:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c585ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a273 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333185.345301:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c585b4 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x54:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1763333185.345317:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c585b4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1763333185.345327:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c585b4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00000004:00200000:0.0:1763333185.346754:0:6520:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x54:0x0]: returning size 4096 00000004:00200000:0.0:1763333185.346761:0:6520:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1763333185.346785:0:6520:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c585b4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1763333185.346816:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c585ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a273 expref: 26 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333185.346836:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f800/0xb32e3ef184c585b4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a273 expref: 25 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333185.346844:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff92ff42c64000) 00010000:00010000:0.0:1763333185.346846:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1763333185.346850:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f800, rc 0) 00000100:00100000:0.0:1763333185.349419:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4960bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:57510:x1848987613840768:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 4239us (4444us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333185.349432:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9641 00000100:00100000:3.0:1763333185.362116:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333185.362215:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613841024 00000100:00100000:0.0:1763333185.362226:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613841024 00000100:00100000:0.0:1763333185.362301:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9642 00000100:00100000:0.0:1763333185.362312:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49609880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:57510:x1848987613841024:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333185.362334:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333185.362338:0:6520:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763333185.362524:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c58583 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a25e expref: 25 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333185.362543:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0x0 (ffff92ff42c64400) 00010000:00010000:0.0:1763333185.362549:0:6520:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333185.362563:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c585bb lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a27a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333185.362665:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c585c2 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1763333185.362679:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c585c2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1763333185.362689:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c585c2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1763333185.362702:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c585c9 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1763333185.362708:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c585c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1763333185.362714:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c585c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1763333185.363073:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c585d0 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1763333185.363082:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c585d0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1763333185.363090:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c585d0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00000004:00200000:0.0:1763333185.363100:0:6520:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x55:0x0]: returning size 0 00010000:00010000:0.0:1763333185.363123:0:6520:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c585c2 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1763333185.363130:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c585c2 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1763333185.363136:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c585c2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1763333185.363143:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c585c2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1763333185.363148:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333185.363152:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c585c2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1763333185.363159:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c585c2 lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1763333185.363167:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0x0 (ffff92ff42c64400) 00010000:00010000:0.0:1763333185.363170:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333185.363174:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c585c2 lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1763333185.363180:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c585c2 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 00000004:00010000:0.0:1763333185.363190:0:6520:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004e7e38a5 reply state 000000007b48f770 transno 8589935403 ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c585c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1763333185.363201:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c585c9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1763333185.363207:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0xdd396665 (ffff92fe43b44b00) 00010000:00010000:0.0:1763333185.363210:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333185.363212:0:6520:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763333185.363239:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c585bb lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a27a expref: 27 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333185.363253:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c585d0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a27a expref: 26 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333185.363260:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92fe43b44300) 00010000:00010000:0.0:1763333185.363263:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333185.363265:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e800, rc 0) 00000100:00100000:0.0:1763333185.369945:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49609880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+27:57510:x1848987613841024:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 7624us (7826us total) trans 8589935403 rc 0/0 00000100:00100000:0.0:1763333185.369959:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9642 00000100:00100000:2.0:1763333185.385071:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333185.385110:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613841280 00000100:00100000:0.0:1763333185.385120:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613841280 00000100:00100000:0.0:1763333185.385192:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9643 00000100:00100000:0.0:1763333185.385203:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+27:57510:x1848987613841280:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333185.385230:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333185.385254:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c585de lrc: 2/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a281 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333185.385455:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c585e5 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1763333185.385550:0:6520:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c585d0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a27a expref: 28 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333185.385560:0:6520:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c585e5 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:0.0:1763333185.385593:0:6520:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c585d0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a27a expref: 28 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333185.385606:0:6520:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c585d0 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a27a expref: 28 pid: 6520 timeout: 1389 lvb_type: 0 00000100:00100000:0.0:1763333185.385620:0:6520:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe44e04000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1848987627311616:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333185.385707:0:6520:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4ce84b40 going to sleep for 11 seconds 00000100:00100000:0.0:1763333185.390896:0:6520:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe44e04000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1848987627311616:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333185.390955:0:6520:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c585e5 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00000100:00100000:2.0:1763333185.391429:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333185.391686:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613841408 00000100:00100000:3.0:1763333185.391698:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613841408 00010000:00010000:3.0:1763333185.391786:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c585d0 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a27a expref: 29 pid: 6520 timeout: 1389 lvb_type: 0 00000100:00100000:3.0:1763333185.391903:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3176 00000100:00100000:3.0:1763333185.391914:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:2421:x1848987613841408:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333185.391941:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333185.391949:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c585d0 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a27a expref: 29 pid: 6520 timeout: 1389 lvb_type: 0 00010000:00010000:3.0:1763333185.391963:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c585d0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a27a expref: 29 pid: 6520 timeout: 1389 lvb_type: 0 00010000:00010000:3.0:1763333185.391989:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e800/0xb32e3ef184c585d0 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a27a expref: 29 pid: 6520 timeout: 1389 lvb_type: 0 00010000:00010000:3.0:1763333185.392008:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92fe43b44300) 00010000:00010000:3.0:1763333185.392013:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c585e5 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00010000:00010000:3.0:1763333185.392024:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c585e5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 00010000:00010000:3.0:1763333185.392032:0:6504:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c585e5 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 00010000:00010000:3.0:1763333185.392074:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333185.392147:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+28:2421:x1848987613841408:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 233us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333185.392156:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3176 00010000:00010000:1.0:1763333185.392442:0:6520:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c585e5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.392450:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c585e5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00000004:00200000:1.0:1763333185.392479:0:6520:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x55:0x0]: returning size 0 00000004:00080000:1.0:1763333185.392729:0:6520:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x95:0x0], index 0: 0 00000004:00080000:1.0:1763333185.392738:0:6520:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x96:0x0], index 1: 0 00010000:00010000:1.0:1763333185.392901:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c585e5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.392911:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c585e5 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.392929:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c585e5 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.392936:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333185.392940:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c585e5 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.392948:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c585e5 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.392960:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92fe43b44300) 00010000:00010000:1.0:1763333185.392963:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763333185.392967:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c585e5 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.392973:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c585e5 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.393032:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c585de lrc: 1/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a281 expref: 28 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333185.393043:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92fe43b44300) 00010000:00010000:1.0:1763333185.393046:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763333185.393050:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c585de lrc: 0/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a281 expref: 28 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333185.393067:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f200, rc 0) 00000100:00100000:1.0:1763333185.393103:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+27:57510:x1848987613841280:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 7903us (8043us total) trans 8589935404 rc 301/301 00000100:00100000:1.0:1763333185.393112:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9643 00000100:00100000:3.0:1763333185.398459:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333185.398906:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613841664 00000100:00100000:2.0:1763333185.398922:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613841664 00000100:00100000:2.0:1763333185.399003:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3294 00000100:00100000:2.0:1763333185.399015:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+27:57510:x1848987613841664:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333185.399493:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+28:57510:x1848987613841664:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 478us (1050us total) trans 8589935405 rc 0/0 00000100:00100000:2.0:1763333185.399504:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3294 00000100:00100000:2.0:1763333185.408618:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333185.408907:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613841920 00000100:00100000:3.0:1763333185.408923:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613841920 00000100:00100000:3.0:1763333185.409004:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3295 00000100:00100000:3.0:1763333185.409015:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+28:57510:x1848987613841920:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333185.410542:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:57510:x1848987613841920:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 1519us (1930us total) trans 8589935406 rc 0/0 00000100:00100000:3.0:1763333185.410558:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3295 00000100:00100000:0.0:1763333185.489504:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333185.489624:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613842176 00000100:00100000:1.0:1763333185.489637:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613842176 00000100:00100000:1.0:1763333185.489717:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9644 00000100:00100000:1.0:1763333185.489729:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:57511:x1848987613842176:12345-192.168.204.28@tcp:101:fsx.0 00010000:00010000:1.0:1763333185.489763:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333185.489791:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c585f3 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a288 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333185.489978:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c585fa lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.489997:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c585fa lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.490011:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c585fa lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.490024:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c58601 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.490031:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c58601 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.490038:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c58601 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.490112:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58608 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.490120:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58608 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.490126:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58608 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00000004:00200000:1.0:1763333185.490143:0:6520:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x55:0x0]: returning size 0 00010000:00010000:1.0:1763333185.490254:0:6520:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c585fa lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.490262:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c585fa lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.490269:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c585fa lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.490290:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c585fa lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.490298:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700f400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333185.490303:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c585fa lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.490311:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c585fa lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.490326:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0x0 (ffff92ff42c64400) 00010000:00010000:1.0:1763333185.490329:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333185.490336:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c585fa lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.490343:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c585fa lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.490409:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c58601 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.490416:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c58601 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.490427:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c58601 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.490432:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700fe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333185.490435:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c58601 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.490441:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c58601 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.490448:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0xdd396665 (ffff92fe43b44b00) 00010000:00010000:1.0:1763333185.490451:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333185.490454:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c58601 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.490460:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c58601 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.490525:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c585f3 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a288 expref: 32 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333185.490540:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58608 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a288 expref: 31 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333185.490548:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333185.490550:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333185.490552:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4700f000, rc 0) 00000100:00100000:1.0:1763333185.490642:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+31:57511:x1848987613842176:12345-192.168.204.28@tcp:101:fsx.0 Request processed in 914us (1154us total) trans 8589935407 rc 0/0 00000100:00100000:1.0:1763333185.490651:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9644 00000100:00100000:2.0:1763333185.495790:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333185.495911:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613842304 00000100:00100000:0.0:1763333185.495924:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613842304 00000100:00100000:0.0:1763333185.496043:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9645 00000100:00100000:0.0:1763333185.496056:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+31:57511:x1848987613842304:12345-192.168.204.28@tcp:101:fsx.0 00010000:00010000:0.0:1763333185.496094:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333185.496592:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58616 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a28f expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333185.496640:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5861d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333185.496658:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5861d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333185.496672:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5861d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333185.496829:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58616 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a28f expref: 33 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333185.496850:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5861d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a28f expref: 32 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333185.496860:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:0.0:1763333185.496863:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763333185.496867:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f600, rc 0) 00000100:00100000:0.0:1763333185.498930:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+32:57511:x1848987613842304:12345-192.168.204.28@tcp:101:fsx.0 Request processed in 2859us (3140us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333185.498950:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9645 00000100:00100000:3.0:1763333185.505880:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333185.505988:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613842560 00000100:00100000:0.0:1763333185.506002:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613842560 00000100:00100000:0.0:1763333185.506088:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9646 00000100:00100000:0.0:1763333185.506101:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+32:57511:x1848987613842560:12345-192.168.204.28@tcp:36:fsx.0 00010000:00010000:0.0:1763333185.506175:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333185.506211:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58608 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a288 expref: 32 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333185.506233:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:0.0:1763333185.506239:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333185.506520:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c58624 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333185.506535:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c58624 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333185.506546:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c58624 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT0 00000001:00080000:0.0:1763333185.506599:0:12741:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935408 00000004:00010000:0.0:1763333185.506621:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000dc9f81b0 reply state 0000000007aad7a7 transno 8589935409 ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c58624 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333185.506634:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c58624 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333185.506641:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:0.0:1763333185.506644:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333185.506646:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763333185.506762:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+34:57511:x1848987613842560:12345-192.168.204.28@tcp:36:fsx.0 Request processed in 663us (900us total) trans 8589935409 rc 0/0 00000100:00100000:0.0:1763333185.506771:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9646 00000020:00080000:0.0:1763333185.506776:0:12741:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763333185.513002:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333185.513135:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613842688 00000100:00100000:1.0:1763333185.513149:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613842688 00000100:00100000:1.0:1763333185.513228:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9647 00000100:00100000:1.0:1763333185.513241:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+34:57511:x1848987613842688:12345-192.168.204.28@tcp:101:fsx.0 00010000:00010000:1.0:1763333185.513289:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333185.513319:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c5862b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a296 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333185.513440:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c5862b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a296 expref: 35 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333185.513457:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c5862b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a296 expref: 35 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333185.513480:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333185.513484:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763333185.513488:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4700e000, rc 0) 00000100:00100000:1.0:1763333185.513566:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+35:57511:x1848987613842688:12345-192.168.204.28@tcp:101:fsx.0 Request processed in 327us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333185.513574:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9647 00000100:00100000:3.0:1763333185.516295:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333185.516434:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613842816 00000100:00100000:2.0:1763333185.516447:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613842816 00000100:00100000:2.0:1763333185.517159:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6829 00000100:00100000:2.0:1763333185.517176:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49608a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+10:57511:x1848987613842816:12345-192.168.204.28@tcp:101:fsx.0 00010000:00010000:2.0:1763333185.517199:0:28650:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333185.517231:0:28650:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c58632 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a29d expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763333185.517261:0:28650:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x95:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763333185.517305:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333185.517309:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333185.517321:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c58632 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a29d expref: 11 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333185.517342:0:28650:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c58632 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a29d expref: 11 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333185.517409:0:28650:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5e00, rc 0) 00000100:00100000:2.0:1763333185.517502:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49608a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+11:57511:x1848987613842816:12345-192.168.204.28@tcp:101:fsx.0 Request processed in 331us (1232us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333185.517511:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6829 00000100:00100000:3.0:1763333185.527178:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333185.528248:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613842944 00000100:00100000:2.0:1763333185.528264:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613842944 00000100:00100000:2.0:1763333185.528383:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6830 00000100:00100000:2.0:1763333185.528395:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4960b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:57511:x1848987613842944:12345-192.168.204.28@tcp:101:fsx.0 00010000:00010000:2.0:1763333185.528418:0:28650:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333185.528448:0:28650:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c58639 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a2a4 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763333185.528476:0:28650:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x96:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763333185.528511:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333185.528514:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333185.528527:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c58639 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2a4 expref: 13 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333185.528546:0:28650:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe46ac5400/0xb32e3ef184c58639 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2a4 expref: 13 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333185.528568:0:28650:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5400, rc 0) 00000100:00100000:2.0:1763333185.528652:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4960b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:57511:x1848987613842944:12345-192.168.204.28@tcp:101:fsx.0 Request processed in 258us (1489us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333185.528664:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6830 00000100:00100000:3.0:1763333185.537569:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333185.538645:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613843072 00000100:00100000:2.0:1763333185.538662:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613843072 00002000:00010000:2.0:1763333185.538727:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (0->18446744073709551615) 00002000:00100000:2.0:1763333185.538733:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe46e2c000 with x1848987613843072 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333185.538748:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe46e2c000. 00000100:00100000:0.0:1763333185.540008:0:28429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1675 00000100:00100000:0.0:1763333185.540036:0:28429:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46e2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+11:2421:x1848987613843072:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:0.0:1763333185.540369:0:28429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333185.540373:0:28429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 0 -> 1763333185 00002000:00010000:0.0:1763333185.540376:0:28429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333185.540378:0:28429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 0 -> 1763333185 00002000:00010000:0.0:1763333185.540381:0:28429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333185.541402:0:28429:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46e2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:2421:x1848987613843072:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 1373us (3839us total) trans 21474839019 rc 0/0 00000100:00100000:0.0:1763333185.541417:0:28429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1675 00002000:00010000:0.0:1763333185.541425:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (0->18446744073709551615) 00002000:00100000:0.0:1763333185.541429:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe46e2c000 with x1848987613843072 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333185.541440:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe46e2c000. 00000100:00100000:3.0:1763333185.544471:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333185.544782:0:28429:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613843200 00000100:00100000:0.0:1763333185.544797:0:28429:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613843200 00002000:00010000:0.0:1763333185.544853:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/150 (0->18446744073709551615) 00002000:00100000:0.0:1763333185.544859:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe44e19500 with x1848987613843200 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333185.544874:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe44e19500. 00000100:00100000:0.0:1763333185.544916:0:28429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1676 00000100:00100000:0.0:1763333185.544927:0:28429:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2420:x1848987613843200:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:0.0:1763333185.546091:0:28429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333185.546099:0:28429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime from disk: 0 -> 1763333185 00002000:00010000:0.0:1763333185.546103:0:28429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333185.546105:0:28429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb ctime from disk: 0 -> 1763333185 00002000:00010000:0.0:1763333185.546108:0:28429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333185.546205:0:28429:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2420:x1848987613843200:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 1276us (1744us total) trans 17179871714 rc 0/0 00000100:00100000:0.0:1763333185.546216:0:28429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1676 00002000:00010000:0.0:1763333185.546223:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/150 (0->18446744073709551615) 00002000:00100000:0.0:1763333185.546226:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe44e19500 with x1848987613843200 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333185.546233:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe44e19500. 00000100:00100000:2.0:1763333185.555575:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333185.555984:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613843456 00000100:00100000:0.0:1763333185.555999:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613843456 00000100:00100000:1.0:1763333185.556822:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9648 00000100:00100000:1.0:1763333185.556843:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+35:57511:x1848987613843456:12345-192.168.204.28@tcp:101:fsx.0 00010000:00010000:1.0:1763333185.556870:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333185.556899:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c58640 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a2ab expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333185.557045:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c58647 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.557067:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c58647 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.557080:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c58647 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.557099:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c5864e lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x6:0x0].0xe8098f29 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.557106:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c5864e lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x6:0x0].0xe8098f29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.557112:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c5864e lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x6:0x0].0xe8098f29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00000004:00080000:1.0:1763333185.557551:0:6520:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x96:0x0], index 0: 0 00010000:00010000:1.0:1763333185.557734:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c58655 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x57:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.557744:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c58655 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.557752:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c58655 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.557793:0:6520:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c58647 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.557800:0:6520:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c58647 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.557806:0:6520:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c58647 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.557818:0:6520:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c58647 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.557824:0:6520:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700f400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333185.557829:0:6520:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c58647 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.557837:0:6520:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c58647 lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.557850:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0x0 (ffff92ff42c64400) 00010000:00010000:1.0:1763333185.557853:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333185.557859:0:6520:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c58647 lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.557865:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c58647 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 00000004:00010000:1.0:1763333185.557879:0:6520:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f2f65da9 reply state 000000006f889468 transno 8589935410 ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c5864e lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x6:0x0].0xe8098f29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.557890:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c5864e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0xe8098f29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.557896:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0xe8098f29 (ffff92ff4ad5ec00) 00010000:00010000:1.0:1763333185.557898:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333185.557901:0:6520:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763333185.557931:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c58640 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2ab expref: 38 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333185.557945:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdea00/0xb32e3ef184c58655 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2ab expref: 37 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333185.557958:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x57:0x0].0x0 (ffff92ff4ad5e900) 00010000:00010000:1.0:1763333185.557961:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333185.557963:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdea00, rc 0) 00000100:00100000:1.0:1763333185.558057:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+38:57511:x1848987613843456:12345-192.168.204.28@tcp:101:fsx.0 Request processed in 1221us (2495us total) trans 8589935410 rc 0/0 00000100:00100000:1.0:1763333185.558066:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9648 00000100:00100000:3.0:1763333185.566337:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333185.567549:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613843712 00000100:00100000:0.0:1763333185.567565:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613843712 00000100:00100000:0.0:1763333185.567847:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9649 00000100:00100000:0.0:1763333185.567861:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+248:57511:x1848987613843712:12345-192.168.204.28@tcp:101:fsx.0 00010000:00010000:0.0:1763333185.567889:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333185.567893:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763333185.567928:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58591 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a265 expref: 248 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333185.568160:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff92fe43b44900) 00010000:00010000:0.0:1763333185.568174:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333185.568197:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58663 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a2b2 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333185.569190:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5866a lrc: 3/0,1 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333185.569209:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5866a lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333185.569223:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5866a lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333185.569661:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c58671 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x6:0x0].0x9645bb7c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333185.569675:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c58671 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x6:0x0].0x9645bb7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333185.569683:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c58671 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x6:0x0].0x9645bb7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00000004:00080000:0.0:1763333185.570632:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x25d:0x0], index 0: 0 00010000:00010000:0.0:1763333185.570862:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c58678 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333185.570874:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c58678 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333185.570883:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c58678 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333185.570925:0:12741:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5866a lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333185.570933:0:12741:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5866a lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333185.570941:0:12741:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5866a lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333185.570961:0:12741:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5866a lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333185.570974:0:12741:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333185.570978:0:12741:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5866a lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333185.570987:0:12741:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5866a lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333185.571000:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff92fe43b44800) 00010000:00010000:0.0:1763333185.571003:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333185.571009:0:12741:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5866a lrc: 3/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333185.571015:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c5866a lrc: 0/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000004:00010000:0.0:1763333185.571030:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f7bce2fb reply state 00000000888c3da9 transno 4294972606 ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c58671 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x6:0x0].0x9645bb7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333185.571042:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c58671 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x6:0x0].0x9645bb7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333185.571049:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x9645bb7c (ffff92fe43b44100) 00010000:00010000:0.0:1763333185.571052:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333185.571055:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763333185.571096:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58663 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2b2 expref: 250 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333185.571117:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7e800/0xb32e3ef184c58678 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x1cf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2b2 expref: 249 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333185.571125:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1cf:0x0].0x0 (ffff92fe43b44200) 00010000:00010000:0.0:1763333185.571128:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333185.571131:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e800, rc 0) 00000100:00100000:0.0:1763333185.573260:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:57511:x1848987613843712:12345-192.168.204.28@tcp:101:fsx.0 Request processed in 5386us (6922us total) trans 4294972606 rc 0/0 00000100:00100000:0.0:1763333185.573284:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9649 00000100:00100000:3.0:1763333185.592342:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333185.592483:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613843968 00000100:00100000:0.0:1763333185.592496:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613843968 00000100:00100000:0.0:1763333185.592580:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9650 00000100:00100000:0.0:1763333185.592594:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+38:57511:x1848987613843968:12345-192.168.204.28@tcp:36:fsx.0 00010000:00010000:0.0:1763333185.592906:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58686 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333185.592930:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58686 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333185.592944:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58686 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT0 00000001:00080000:0.0:1763333185.593002:0:12741:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935411 00000004:00010000:0.0:1763333185.593029:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000dc6cb74b reply state 00000000754172d3 transno 8589935412 ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58686 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333185.593043:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58686 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333185.593052:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:0.0:1763333185.593055:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333185.593060:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763333185.593183:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+41:57511:x1848987613843968:12345-192.168.204.28@tcp:36:fsx.0 Request processed in 591us (854us total) trans 8589935412 rc 0/0 00000100:00100000:0.0:1763333185.593191:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9650 00000020:00080000:0.0:1763333185.593199:0:12741:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763333185.600008:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333185.600126:0:28429:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613844096 00000100:00100000:0.0:1763333185.600140:0:28429:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613844096 00002000:00010000:0.0:1763333185.600197:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (0->18446744073709551615) 00002000:00100000:0.0:1763333185.600203:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff77c6c700 with x1848987613844096 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333185.600219:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff77c6c700. 00000100:00100000:0.0:1763333185.600261:0:28429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1677 00000100:00100000:0.0:1763333185.600273:0:28429:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+12:2421:x1848987613844096:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:0.0:1763333185.600546:0:28429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333185.600550:0:28429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763333185 -> 1763333185 00002000:00010000:0.0:1763333185.600553:0:28429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333185.600555:0:28429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763333185 -> 1763333185 00002000:00010000:0.0:1763333185.600558:0:28429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333185.600642:0:28429:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2421:x1848987613844096:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 370us (648us total) trans 21474839020 rc 0/0 00000100:00100000:0.0:1763333185.600652:0:28429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1677 00002000:00010000:0.0:1763333185.600658:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (0->18446744073709551615) 00002000:00100000:0.0:1763333185.600661:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff77c6c700 with x1848987613844096 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333185.600666:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff77c6c700. 00000100:00100000:3.0:1763333185.608497:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333185.608636:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613844224 00000100:00100000:2.0:1763333185.608650:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613844224 00002000:00010000:2.0:1763333185.608707:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/150 (0->18446744073709551615) 00002000:00100000:2.0:1763333185.608713:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe44e18a80 with x1848987613844224 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333185.608729:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe44e18a80. 00000100:00100000:2.0:1763333185.608772:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1678 00000100:00100000:2.0:1763333185.608783:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2420:x1848987613844224:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:2.0:1763333185.608989:0:28427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333185.608994:0:28427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime from disk: 1763333185 -> 1763333185 00002000:00010000:2.0:1763333185.608996:0:28427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333185.608999:0:28427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb ctime from disk: 1763333185 -> 1763333185 00002000:00010000:2.0:1763333185.609001:0:28427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333185.609078:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2420:x1848987613844224:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 297us (597us total) trans 17179871715 rc 0/0 00000100:00100000:2.0:1763333185.609091:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1678 00002000:00010000:2.0:1763333185.609095:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/150 (0->18446744073709551615) 00002000:00100000:2.0:1763333185.609098:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe44e18a80 with x1848987613844224 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333185.609103:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe44e18a80. 00000100:00100000:3.0:1763333185.611654:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333185.611777:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613844480 00000100:00100000:1.0:1763333185.611790:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613844480 00000100:00100000:1.0:1763333185.611859:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9651 00000100:00100000:1.0:1763333185.611869:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+41:57511:x1848987613844480:12345-192.168.204.28@tcp:36:fsx.0 00010000:00010000:1.0:1763333185.612157:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5868d lrc: 3/0,1 mode: --/PW res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.612180:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5868d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.612194:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5868d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00000001:00080000:1.0:1763333185.612245:0:6520:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935413 00000004:00010000:1.0:1763333185.612267:0:6520:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009b4729e6 reply state 000000008624bf3a transno 8589935414 ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5868d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.612292:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5868d lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.612301:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333185.612304:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333185.612309:0:6520:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763333185.612464:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+44:57511:x1848987613844480:12345-192.168.204.28@tcp:36:fsx.0 Request processed in 596us (823us total) trans 8589935414 rc 0/0 00000100:00100000:1.0:1763333185.612472:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9651 00000020:00080000:1.0:1763333185.612477:0:6520:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763333185.616325:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333185.616641:0:28429:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613844608 00000100:00100000:0.0:1763333185.616655:0:28429:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613844608 00002000:00010000:0.0:1763333185.616710:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (100000->18446744073709551615) 00002000:00100000:0.0:1763333185.616716:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe434c5880 with x1848987613844608 ext(100000->18446744073709551615) 00002000:00010000:0.0:1763333185.616733:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe434c5880. 00000100:00100000:0.0:1763333185.616777:0:28429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1679 00000100:00100000:0.0:1763333185.616788:0:28429:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2420:x1848987613844608:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:0.0:1763333185.617085:0:28429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 0 -> 100000 00002000:00010000:0.0:1763333185.617090:0:28429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763333185 -> 1763333185 00002000:00010000:0.0:1763333185.617093:0:28429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333185.617095:0:28429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763333185 -> 1763333185 00002000:00010000:0.0:1763333185.617098:0:28429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333185.617170:0:28429:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2420:x1848987613844608:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 383us (859us total) trans 21474839021 rc 0/0 00000100:00100000:0.0:1763333185.617179:0:28429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1679 00002000:00010000:0.0:1763333185.617183:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (100000->18446744073709551615) 00002000:00100000:0.0:1763333185.617186:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe434c5880 with x1848987613844608 ext(100000->18446744073709551615) 00002000:00010000:0.0:1763333185.617190:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe434c5880. 00000100:00100000:3.0:1763333185.625964:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333185.626070:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613844736 00000100:00100000:0.0:1763333185.626084:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613844736 00000100:00100000:0.0:1763333185.626158:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9652 00000100:00100000:0.0:1763333185.626171:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+44:57511:x1848987613844736:12345-192.168.204.28@tcp:101:fsx.0 00010000:00010000:0.0:1763333185.626204:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333185.626231:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c58694 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a2b9 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333185.631220:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c5869b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333185.631255:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c5869b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333185.631270:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c5869b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT0 00000004:00200000:0.0:1763333185.631389:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x55:0x0]: returning size 100000 00000004:00200000:0.0:1763333185.631395:0:12741:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763333185.631425:0:12741:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c5869b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT0 00010000:00010000:0.0:1763333185.631489:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f200/0xb32e3ef184c58694 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2b9 expref: 46 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333185.631517:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c5869b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2b9 expref: 45 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333185.631528:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:0.0:1763333185.631531:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333185.631536:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe467bf600, rc 0) 00000100:00100000:0.0:1763333185.631642:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+45:57511:x1848987613844736:12345-192.168.204.28@tcp:101:fsx.0 Request processed in 5471us (5690us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333185.631654:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9652 00000100:00100000:3.0:1763333185.639447:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333185.639815:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613844992 00000100:00100000:0.0:1763333185.639832:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613844992 00000100:00100000:0.0:1763333185.639927:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9653 00000100:00100000:0.0:1763333185.639940:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+45:57511:x1848987613844992:12345-192.168.204.28@tcp:36:fsx.0 00010000:00010000:0.0:1763333185.640887:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333185.640932:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c5869b lrc: 0/0,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2b9 expref: 45 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333185.640959:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:0.0:1763333185.640966:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333185.641564:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c586a2 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333185.641587:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c586a2 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333185.641599:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c586a2 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT0 00000001:00080000:1.0:1763333185.641653:0:12741:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935415 00000004:00010000:1.0:1763333185.641680:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d92916ab reply state 0000000090e65f2e transno 8589935416 ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c586a2 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333185.641695:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c586a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333185.641701:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333185.641704:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333185.641708:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763333185.641856:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+47:57511:x1848987613844992:12345-192.168.204.28@tcp:36:fsx.0 Request processed in 1917us (2422us total) trans 8589935416 rc 0/0 00000100:00100000:1.0:1763333185.641867:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9653 00000020:00080000:1.0:1763333185.641875:0:12741:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763333185.647150:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333185.648678:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613845248 00000100:00100000:0.0:1763333185.648695:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613845248 00002000:00010000:2.0:1763333185.648836:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/150 (0->18446744073709551615) 00002000:00100000:2.0:1763333185.648844:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe434c4a80 with x1848987613845248 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333185.648860:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe434c4a80. 00000100:00100000:2.0:1763333185.648907:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1680 00000100:00100000:2.0:1763333185.648918:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2421:x1848987613845248:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:2.0:1763333185.649104:0:28427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333185.649108:0:28427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime from disk: 1763333185 -> 1763333185 00002000:00010000:2.0:1763333185.649111:0:28427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333185.649112:0:28427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb ctime from disk: 1763333185 -> 1763333185 00002000:00010000:2.0:1763333185.649115:0:28427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333185.649212:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2421:x1848987613845248:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 295us (2078us total) trans 17179871716 rc 0/0 00000100:00100000:2.0:1763333185.649220:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1680 00002000:00010000:2.0:1763333185.649225:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/150 (0->18446744073709551615) 00002000:00100000:2.0:1763333185.649227:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe434c4a80 with x1848987613845248 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333185.649232:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe434c4a80. 00000100:00100000:3.0:1763333185.649608:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333185.651943:0:28429:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613845120 00000100:00100000:0.0:1763333185.652065:0:28429:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613845120 00002000:00010000:0.0:1763333185.652134:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (0->18446744073709551615) 00002000:00100000:0.0:1763333185.652139:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe434c5c00 with x1848987613845120 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333185.652154:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe434c5c00. 00000100:00100000:0.0:1763333185.652189:0:28429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1681 00000100:00100000:0.0:1763333185.652200:0:28429:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2421:x1848987613845120:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:0.0:1763333185.652502:0:28429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 100000 -> 0 00002000:00010000:0.0:1763333185.652507:0:28429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763333185 -> 1763333185 00002000:00010000:0.0:1763333185.652510:0:28429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333185.652512:0:28429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763333185 -> 1763333185 00002000:00010000:0.0:1763333185.652516:0:28429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333185.652593:0:28429:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2421:x1848987613845120:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 394us (2985us total) trans 21474839022 rc 0/0 00000100:00100000:0.0:1763333185.652600:0:28429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1681 00002000:00010000:0.0:1763333185.652605:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (0->18446744073709551615) 00002000:00100000:0.0:1763333185.652608:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe434c5c00 with x1848987613845120 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333185.652612:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe434c5c00. 00000100:00100000:3.0:1763333185.657545:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333185.661411:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613845504 00000100:00100000:1.0:1763333185.661436:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613845504 00000100:00100000:1.0:1763333185.661538:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9654 00000100:00100000:1.0:1763333185.661552:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+47:57511:x1848987613845504:12345-192.168.204.28@tcp:101:fsx.0 00010000:00010000:1.0:1763333185.661587:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333185.661593:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763333185.661632:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c5862b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a296 expref: 47 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333185.661657:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333185.661663:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333185.661685:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700ee00/0xb32e3ef184c586a9 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a2c0 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333185.661749:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c586b0 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333185.661767:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c586b0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333185.661779:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c586b0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT0 00000004:00080000:1.0:1763333185.661946:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x97:0x0], index 1: 0 00000004:00080000:1.0:1763333185.661953:0:12741:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x97:0x0], index 0: 0 00010000:00010000:1.0:1763333185.662067:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c586b0 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2c0 expref: 49 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333185.662075:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333185.662078:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763333185.662087:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700ee00/0xb32e3ef184c586a9 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2c0 expref: 49 pid: 12741 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763333185.662100:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c586b0 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x55:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2c0 expref: 48 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333185.662128:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333185.662130:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763333185.662133:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4700fe00, rc 0) 00000100:00100000:1.0:1763333185.662229:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+48:57511:x1848987613845504:12345-192.168.204.28@tcp:101:fsx.0 Request processed in 680us (4700us total) trans 8589935417 rc 0/0 00000100:00100000:1.0:1763333185.662238:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9654 00000100:00100000:3.0:1763333185.667599:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333185.667755:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613845632 00000100:00100000:1.0:1763333185.667770:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613845632 00000100:00100000:1.0:1763333185.667835:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6831 00000100:00100000:1.0:1763333185.667846:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:57511:x1848987613845632:12345-192.168.204.28@tcp:101:fsx.0 00010000:00010000:1.0:1763333185.667871:0:8406:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333185.667900:0:8406:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c586b7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a2c7 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333185.667928:0:8406:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x97:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333185.667957:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333185.667960:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333185.667972:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c586b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2c7 expref: 17 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333185.667989:0:8406:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c586b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2c7 expref: 17 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333185.668003:0:8406:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4700f400, rc 0) 00000100:00100000:1.0:1763333185.668079:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:57511:x1848987613845632:12345-192.168.204.28@tcp:101:fsx.0 Request processed in 234us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333185.668091:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6831 00000100:00100000:1.0:1763333185.673755:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333185.674298:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333185.674828:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613845760 00000100:00100000:2.0:1763333185.674853:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613845760 00000100:00100000:0.0:1763333185.675672:0:28429:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613845888 00000100:00100000:0.0:1763333185.675682:0:28429:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613845888 00000100:00100000:0.0:1763333185.675893:0:28429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1682 00000100:00100000:0.0:1763333185.675909:0:28429:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe43998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2421:x1848987613845760:12345-192.168.204.28@tcp:22:fsx.0 00002000:00010000:0.0:1763333185.676249:0:28429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:0.0:1763333185.676254:0:28429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763333185 -> 1763333185 00002000:00010000:0.0:1763333185.676256:0:28429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333185.676260:0:28429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763333185 -> 1763333185 00002000:00010000:0.0:1763333185.676262:0:28429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 0 -> 2048 00000100:00100000:0.0:1763333185.676386:0:28429:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe43998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2421:x1848987613845760:12345-192.168.204.28@tcp:22:fsx.0 Request processed in 481us (2643us total) trans 21474839023 rc 0/0 00000100:00100000:0.0:1763333185.676395:0:28429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1682 00000100:00100000:0.0:1763333185.676421:0:28429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1683 00000100:00100000:0.0:1763333185.676429:0:28429:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4399a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2421:x1848987613845888:12345-192.168.204.28@tcp:22:fsx.0 00002000:00010000:0.0:1763333185.676628:0:28429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:0.0:1763333185.676632:0:28429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763333185.676635:0:28429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333185.676637:0:28429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763333185.676639:0:28429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 0 -> 6144 00000100:00100000:0.0:1763333185.676666:0:28429:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4399a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2421:x1848987613845888:12345-192.168.204.28@tcp:22:fsx.0 Request processed in 239us (2368us total) trans 17179871717 rc 0/0 00000100:00100000:0.0:1763333185.676674:0:28429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1683 00000100:00100000:3.0:1763333185.681254:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333185.681579:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613846144 00000100:00100000:1.0:1763333185.681593:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613846144 00000100:00100000:1.0:1763333185.681913:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9655 00000100:00100000:1.0:1763333185.681926:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+48:57511:x1848987613846144:12345-192.168.204.28@tcp:36:fsx.0 00010000:00010000:1.0:1763333185.682202:0:6520:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333185.682241:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c586b0 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2c0 expref: 48 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333185.682265:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333185.682270:0:6520:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333185.682705:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c586be lrc: 3/0,1 mode: --/PW res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.682724:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c586be lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.682733:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c586be lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00000001:00080000:1.0:1763333185.682785:0:6520:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935418 00000004:00010000:1.0:1763333185.682806:0:6520:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001fed2200 reply state 000000001a7fc582 transno 8589935419 ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c586be lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.682818:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c586be lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.682825:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333185.682829:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333185.682832:0:6520:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763333185.683675:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+50:57511:x1848987613846144:12345-192.168.204.28@tcp:36:fsx.0 Request processed in 1745us (2434us total) trans 8589935419 rc 0/0 00000100:00100000:1.0:1763333185.683688:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9655 00000020:00080000:1.0:1763333185.683697:0:6520:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763333185.686639:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333185.687001:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613846272 00000100:00100000:2.0:1763333185.687017:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613846272 00000100:00100000:2.0:1763333185.687096:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9656 00000100:00100000:2.0:1763333185.687109:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4399b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+50:57511:x1848987613846272:12345-192.168.204.28@tcp:101:fsx.0 00010000:00010000:2.0:1763333185.687142:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333185.687170:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c586c5 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a2ce expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333185.687244:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c586c5 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2ce expref: 51 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333185.687262:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c586c5 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2ce expref: 51 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333185.687293:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:2.0:1763333185.687296:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333185.687301:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4800, rc 0) 00000100:00100000:2.0:1763333185.687403:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4399b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+51:57511:x1848987613846272:12345-192.168.204.28@tcp:101:fsx.0 Request processed in 296us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333185.687410:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9656 00000100:00100000:3.0:1763333185.690875:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333185.691398:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613846400 00000100:00100000:2.0:1763333185.691413:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613846400 00000100:00100000:2.0:1763333185.691477:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6832 00000100:00100000:2.0:1763333185.691489:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:57511:x1848987613846400:12345-192.168.204.28@tcp:101:fsx.0 00010000:00010000:2.0:1763333185.691513:0:28650:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333185.691541:0:28650:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c586cc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a2d5 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763333185.691570:0:28650:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x97:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763333185.691605:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333185.691609:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333185.691618:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c586cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2d5 expref: 17 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333185.691635:0:28650:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c586cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2d5 expref: 17 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333185.691652:0:28650:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac4000, rc 0) 00000100:00100000:2.0:1763333185.691733:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:57511:x1848987613846400:12345-192.168.204.28@tcp:101:fsx.0 Request processed in 245us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333185.691742:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6832 00000100:00100000:3.0:1763333185.694995:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333185.695260:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613846528 00000100:00100000:2.0:1763333185.695282:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613846528 00002000:00010000:2.0:1763333185.695339:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (0->18446744073709551615) 00002000:00100000:2.0:1763333185.695345:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe434c5500 with x1848987613846528 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333185.696228:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe434c5500. 00000100:00100000:1.0:1763333185.697110:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1684 00000100:00100000:1.0:1763333185.697136:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2420:x1848987613846528:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:1.0:1763333185.697483:0:16635:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 1048576 -> 0 00002000:00010000:1.0:1763333185.697488:0:16635:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763333185 -> 1763333185 00002000:00010000:1.0:1763333185.697490:0:16635:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333185.697493:0:16635:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763333185 -> 1763333185 00002000:00010000:1.0:1763333185.697496:0:16635:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2048 -> 0 00000100:00100000:1.0:1763333185.697590:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2420:x1848987613846528:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 467us (2608us total) trans 21474839024 rc 0/0 00000100:00100000:1.0:1763333185.697599:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1684 00002000:00010000:1.0:1763333185.697605:0:16635:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (0->18446744073709551615) 00002000:00100000:1.0:1763333185.697609:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe434c5500 with x1848987613846528 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333185.697615:0:16635:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe434c5500. 00000100:00100000:3.0:1763333185.699055:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333185.699095:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333185.699127:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333185.699260:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613846656 00000100:00100000:2.0:1763333185.699284:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613846656 00002000:00010000:2.0:1763333185.699334:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/150 (0->18446744073709551615) 00002000:00100000:2.0:1763333185.699339:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe434c5f80 with x1848987613846656 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333185.699387:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe434c5f80. 00000100:00100000:2.0:1763333185.699411:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613846784 00000100:00100000:2.0:1763333185.699414:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613846784 00002000:00010000:2.0:1763333185.699427:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/151 (0->18446744073709551615) 00002000:00100000:2.0:1763333185.699430:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe434c6a00 with x1848987613846784 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333185.699436:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe434c6a00. 00000100:00100000:2.0:1763333185.699447:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613846912 00000100:00100000:2.0:1763333185.699450:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613846912 00002000:00010000:2.0:1763333185.699462:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/151 (0->18446744073709551615) 00002000:00100000:2.0:1763333185.699465:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe434c4000 with x1848987613846912 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333185.699470:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe434c4000. 00000100:00100000:2.0:1763333185.699493:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1685 00000100:00100000:2.0:1763333185.699502:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2420:x1848987613846656:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:2.0:1763333185.699668:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333185.699672:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime from disk: 1763333185 -> 1763333185 00002000:00010000:2.0:1763333185.699675:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333185.699677:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb ctime from disk: 1763333185 -> 1763333185 00002000:00010000:2.0:1763333185.699679:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333185.699735:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2420:x1848987613846656:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 233us (687us total) trans 17179871718 rc 0/0 00000100:00100000:2.0:1763333185.699741:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1685 00002000:00010000:2.0:1763333185.699744:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/150 (0->18446744073709551615) 00002000:00100000:2.0:1763333185.699747:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe434c5f80 with x1848987613846656 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333185.699752:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe434c5f80. 00000100:00100000:2.0:1763333185.699772:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1686 00000100:00100000:2.0:1763333185.699779:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2421:x1848987613846784:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:2.0:1763333185.699952:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 4194304 -> 0 00002000:00010000:2.0:1763333185.699955:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 0 -> 1763333185 00002000:00010000:2.0:1763333185.699957:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333185.699960:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 0 -> 1763333185 00002000:00010000:2.0:1763333185.699962:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 6144 -> 0 00000100:00100000:2.0:1763333185.699985:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2421:x1848987613846784:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 207us (889us total) trans 17179871719 rc 0/0 00000100:00100000:2.0:1763333185.699996:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1686 00002000:00010000:2.0:1763333185.699999:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/151 (0->18446744073709551615) 00002000:00100000:2.0:1763333185.700002:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe434c6a00 with x1848987613846784 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333185.700006:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe434c6a00. 00000100:00100000:2.0:1763333185.700019:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1687 00000100:00100000:2.0:1763333185.700027:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2420:x1848987613846912:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:2.0:1763333185.700156:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333185.700159:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 0 -> 1763333185 00002000:00010000:2.0:1763333185.700161:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333185.700163:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 0 -> 1763333185 00002000:00010000:2.0:1763333185.700165:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333185.700186:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2420:x1848987613846912:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 161us (1059us total) trans 21474839025 rc 0/0 00000100:00100000:2.0:1763333185.700193:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1687 00002000:00010000:2.0:1763333185.700195:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/151 (0->18446744073709551615) 00002000:00100000:2.0:1763333185.700197:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe434c4000 with x1848987613846912 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333185.700202:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe434c4000. 00000100:00100000:3.0:1763333185.712657:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333185.716903:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613847168 00000100:00100000:1.0:1763333185.716927:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613847168 00000100:00100000:1.0:1763333185.717112:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333185.717270:0:28430:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613847040 00000100:00100000:3.0:1763333185.717285:0:28430:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613847040 00000100:00100000:3.0:1763333185.717393:0:28430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1688 00000100:00100000:3.0:1763333185.717406:0:28430:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74035c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2418:x1848987613847040:12345-192.168.204.28@tcp:22:fsx.0 00002000:00010000:3.0:1763333185.717633:0:28430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333185.717638:0:28430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763333185 -> 1763333185 00002000:00010000:3.0:1763333185.717641:0:28430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333185.717643:0:28430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763333185 -> 1763333185 00002000:00010000:3.0:1763333185.717646:0:28430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333185.717838:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1689 00000100:00100000:2.0:1763333185.717847:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5004bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2419:x1848987613847168:12345-192.168.204.28@tcp:22:fsx.0 00002000:00010000:2.0:1763333185.717941:0:16635:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333185.717944:0:16635:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1763333185 -> 1763333185 00002000:00010000:2.0:1763333185.717946:0:16635:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333185.717948:0:16635:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1763333185 -> 1763333185 00002000:00010000:2.0:1763333185.717950:0:16635:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333185.718327:0:28430:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74035c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2418:x1848987613847040:12345-192.168.204.28@tcp:22:fsx.0 Request processed in 921us (1218us total) trans 21474839026 rc 0/0 00000100:00100000:3.0:1763333185.718337:0:28430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1688 00000100:00100000:2.0:1763333185.718987:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5004bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2419:x1848987613847168:12345-192.168.204.28@tcp:22:fsx.0 Request processed in 1136us (6340us total) trans 17179871720 rc 0/0 00000100:00100000:2.0:1763333185.718998:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1689 00000100:00100000:1.0:1763333185.726878:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333185.728486:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613847424 00000100:00100000:2.0:1763333185.728510:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613847424 00000100:00100000:2.0:1763333185.728599:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9657 00000100:00100000:2.0:1763333185.728609:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74037480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+51:57511:x1848987613847424:12345-192.168.204.28@tcp:36:fsx.0 00010000:00010000:2.0:1763333185.728911:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c586d3 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333185.728935:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c586d3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333185.728949:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c586d3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT0 00000001:00080000:2.0:1763333185.728999:0:12741:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935420 00000004:00010000:2.0:1763333185.729022:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000456fbc7f reply state 00000000a6dd0115 transno 8589935421 ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c586d3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333185.729035:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c586d3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333185.729043:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:2.0:1763333185.729046:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333185.729051:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763333185.730192:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74037480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+54:57511:x1848987613847424:12345-192.168.204.28@tcp:36:fsx.0 Request processed in 1571us (3318us total) trans 8589935421 rc 0/0 00000100:00100000:2.0:1763333185.730207:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9657 00000020:00080000:2.0:1763333185.730218:0:12741:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763333185.741433:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333185.741475:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333185.741494:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333185.741527:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333185.741911:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613847936 00000100:00100000:0.0:1763333185.741911:0:28430:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613847680 00000100:00100000:1.0:1763333185.741926:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613847936 00000100:00100000:0.0:1763333185.741926:0:28430:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613847680 00002000:00010000:1.0:1763333185.741991:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/151 (0->18446744073709551615) 00002000:00100000:1.0:1763333185.741998:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe44de0380 with x1848987613847936 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333185.742015:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe44de0380. 00000100:00100000:1.0:1763333185.742052:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613847552 00000100:00100000:1.0:1763333185.742056:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613847552 00000100:00100000:3.0:1763333185.742108:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613847808 00000100:00100000:3.0:1763333185.742113:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613847808 00002000:00010000:0.0:1763333185.742223:0:28430:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/150 (0->18446744073709551615) 00002000:00100000:0.0:1763333185.742228:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff50048700 with x1848987613847680 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333185.742236:0:28430:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff50048700. 00000100:00100000:0.0:1763333185.742257:0:28430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1690 00000100:00100000:0.0:1763333185.742270:0:28430:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2419:x1848987613847936:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:0.0:1763333185.742532:0:28430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333185.742537:0:28430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1763333185 -> 1763333186 00002000:00010000:0.0:1763333185.742540:0:28430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333185.742542:0:28430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1763333185 -> 1763333186 00002000:00010000:0.0:1763333185.742546:0:28430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333185.742620:0:28430:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2419:x1848987613847936:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 352us (1144us total) trans 21474839027 rc 0/0 00000100:00100000:0.0:1763333185.742629:0:28430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1690 00002000:00010000:0.0:1763333185.742634:0:28430:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/151 (0->18446744073709551615) 00002000:00100000:0.0:1763333185.742636:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe44de0380 with x1848987613847936 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333185.742641:0:28430:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe44de0380. 00000100:00100000:0.0:1763333185.742660:0:28430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1691 00000100:00100000:0.0:1763333185.742666:0:28430:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50048700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2419:x1848987613847680:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:0.0:1763333185.742735:0:28430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333185.742738:0:28430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime from disk: 1763333185 -> 1763333186 00002000:00010000:0.0:1763333185.742741:0:28430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333185.742743:0:28430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb ctime from disk: 1763333185 -> 1763333186 00002000:00010000:0.0:1763333185.742746:0:28430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333185.742763:0:28430:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50048700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2419:x1848987613847680:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 98us (1345us total) trans 17179871721 rc 0/0 00000100:00100000:0.0:1763333185.742769:0:28430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1691 00002000:00010000:0.0:1763333185.742771:0:28430:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/150 (0->18446744073709551615) 00002000:00100000:0.0:1763333185.742774:0:28430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff50048700 with x1848987613847680 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333185.742778:0:28430:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff50048700. 00002000:00010000:1.0:1763333185.743558:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (0->18446744073709551615) 00002000:00100000:1.0:1763333185.743566:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe44de3100 with x1848987613847552 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333185.743576:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe44de3100. 00000100:00100000:1.0:1763333185.743601:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1692 00000100:00100000:1.0:1763333185.743616:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2419:x1848987613847552:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:1.0:1763333185.743726:0:28427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333185.743729:0:28427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763333185 -> 1763333186 00002000:00010000:1.0:1763333185.743732:0:28427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333185.743734:0:28427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763333185 -> 1763333186 00002000:00010000:1.0:1763333185.743736:0:28427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333185.743778:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2419:x1848987613847552:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 164us (2277us total) trans 21474839028 rc 0/0 00000100:00100000:1.0:1763333185.743786:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1692 00002000:00010000:1.0:1763333185.743790:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (0->18446744073709551615) 00002000:00100000:1.0:1763333185.743792:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe44de3100 with x1848987613847552 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333185.743796:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe44de3100. 00002000:00010000:3.0:1763333185.750414:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/151 (0->18446744073709551615) 00002000:00100000:3.0:1763333185.750429:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe44de1180 with x1848987613847808 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333185.750447:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe44de1180. 00000100:00100000:3.0:1763333185.750577:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1693 00000100:00100000:3.0:1763333185.750601:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2419:x1848987613847808:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:3.0:1763333185.750819:0:24027:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333185.750824:0:24027:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1763333185 -> 1763333186 00002000:00010000:3.0:1763333185.750826:0:24027:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333185.750829:0:24027:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1763333185 -> 1763333186 00002000:00010000:3.0:1763333185.750831:0:24027:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333185.750915:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2419:x1848987613847808:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 323us (9386us total) trans 17179871722 rc 0/0 00000100:00100000:3.0:1763333185.750923:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1693 00002000:00010000:3.0:1763333185.750928:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/151 (0->18446744073709551615) 00002000:00100000:3.0:1763333185.750931:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe44de1180 with x1848987613847808 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333185.750936:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe44de1180. 00000100:00100000:3.0:1763333185.757529:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333185.758813:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613848064 00000100:00100000:2.0:1763333185.758830:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613848064 00000100:00100000:2.0:1763333185.758933:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1694 00000100:00100000:2.0:1763333185.758944:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2418:x1848987613848064:12345-192.168.204.28@tcp:22:fsx.0 00002000:00010000:2.0:1763333185.759309:0:24027:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:2.0:1763333185.759314:0:24027:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:2.0:1763333185.759317:0:24027:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333185.759319:0:24027:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:2.0:1763333185.759321:0:24027:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 0 -> 2048 00000100:00100000:2.0:1763333185.759434:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2418:x1848987613848064:12345-192.168.204.28@tcp:22:fsx.0 Request processed in 491us (1919us total) trans 21474839029 rc 0/0 00000100:00100000:2.0:1763333185.759444:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1694 00000100:00100000:3.0:1763333185.759613:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333185.759679:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613848192 00000100:00100000:2.0:1763333185.759684:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613848192 00000100:00100000:2.0:1763333185.759724:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1695 00000100:00100000:2.0:1763333185.759731:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2418:x1848987613848192:12345-192.168.204.28@tcp:22:fsx.0 00002000:00010000:2.0:1763333185.759906:0:24027:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1763333185.759910:0:24027:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:2.0:1763333185.759912:0:24027:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333185.759914:0:24027:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:2.0:1763333185.759917:0:24027:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 0 -> 6144 00000100:00100000:2.0:1763333185.761496:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:2418:x1848987613848192:12345-192.168.204.28@tcp:22:fsx.0 Request processed in 1755us (1873us total) trans 17179871723 rc 0/0 00000100:00100000:2.0:1763333185.761748:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1695 00000100:00100000:0.0:1763333185.767300:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333185.768061:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613848448 00000100:00100000:2.0:1763333185.768076:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613848448 00000100:00100000:2.0:1763333185.768155:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9658 00000100:00100000:2.0:1763333185.768167:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+54:57511:x1848987613848448:12345-192.168.204.28@tcp:36:fsx.0 00010000:00010000:2.0:1763333185.768496:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c586da lrc: 3/0,1 mode: --/PW res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333185.768521:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c586da lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333185.768536:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c586da lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT0 00000001:00080000:2.0:1763333185.768595:0:12741:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935422 00000004:00010000:2.0:1763333185.768619:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000099002e33 reply state 0000000001df5568 transno 8589935423 ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c586da lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333185.768633:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c586da lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT0 00010000:00010000:2.0:1763333185.768641:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:2.0:1763333185.768645:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333185.768651:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763333185.768778:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+57:57511:x1848987613848448:12345-192.168.204.28@tcp:36:fsx.0 Request processed in 611us (1502us total) trans 8589935423 rc 0/0 00000100:00100000:2.0:1763333185.768786:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9658 00000020:00080000:2.0:1763333185.768793:0:12741:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763333185.773686:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333185.773734:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333185.773752:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333185.773851:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333185.773955:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613848576 00000100:00100000:0.0:1763333185.773970:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613848576 00002000:00010000:0.0:1763333185.774036:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (0->18446744073709551615) 00002000:00100000:0.0:1763333185.774043:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe438a8e00 with x1848987613848576 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333185.774059:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe438a8e00. 00000100:00100000:0.0:1763333185.774095:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613848704 00000100:00100000:0.0:1763333185.774099:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613848704 00002000:00010000:0.0:1763333185.774115:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/150 (0->18446744073709551615) 00002000:00100000:0.0:1763333185.774118:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe438ab480 with x1848987613848704 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333185.774126:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe438ab480. 00000100:00100000:0.0:1763333185.774141:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613848832 00000100:00100000:0.0:1763333185.774145:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613848832 00002000:00010000:0.0:1763333185.774156:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/151 (0->18446744073709551615) 00002000:00100000:0.0:1763333185.774159:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe438a9880 with x1848987613848832 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333185.774164:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe438a9880. 00000100:00100000:0.0:1763333185.774176:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613848960 00000100:00100000:0.0:1763333185.774179:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613848960 00002000:00010000:0.0:1763333185.774188:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/151 (0->18446744073709551615) 00002000:00100000:0.0:1763333185.774190:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe438aa300 with x1848987613848960 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333185.774196:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe438aa300. 00000100:00100000:0.0:1763333185.774213:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1696 00000100:00100000:0.0:1763333185.774224:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:2419:x1848987613848576:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:0.0:1763333185.774541:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 1048576 -> 0 00002000:00010000:0.0:1763333185.774546:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:0.0:1763333185.774549:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333185.774551:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:0.0:1763333185.774554:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2048 -> 0 00000100:00100000:0.0:1763333185.774621:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:2419:x1848987613848576:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 397us (951us total) trans 21474839030 rc 0/0 00000100:00100000:0.0:1763333185.774629:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1696 00002000:00010000:0.0:1763333185.774633:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (0->18446744073709551615) 00002000:00100000:0.0:1763333185.774635:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe438a8e00 with x1848987613848576 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333185.774640:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe438a8e00. 00000100:00100000:0.0:1763333185.774660:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1697 00000100:00100000:0.0:1763333185.774667:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:2419:x1848987613848704:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:0.0:1763333185.774742:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333185.774744:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:0.0:1763333185.774747:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333185.774749:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:0.0:1763333185.774751:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333185.774773:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+26:2419:x1848987613848704:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 106us (1038us total) trans 17179871724 rc 0/0 00000100:00100000:0.0:1763333185.774779:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1697 00002000:00010000:0.0:1763333185.774782:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/150 (0->18446744073709551615) 00002000:00100000:0.0:1763333185.774784:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe438ab480 with x1848987613848704 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333185.774788:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe438ab480. 00000100:00100000:0.0:1763333185.774800:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1698 00000100:00100000:0.0:1763333185.774807:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:2419:x1848987613848832:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:0.0:1763333185.774898:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 4194304 -> 0 00002000:00010000:0.0:1763333185.774901:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:0.0:1763333185.774903:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333185.774905:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:0.0:1763333185.774908:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 6144 -> 0 00000100:00100000:0.0:1763333185.774930:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+26:2419:x1848987613848832:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 123us (1176us total) trans 17179871725 rc 0/0 00000100:00100000:0.0:1763333185.774936:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1698 00002000:00010000:0.0:1763333185.774939:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/151 (0->18446744073709551615) 00002000:00100000:0.0:1763333185.774942:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe438a9880 with x1848987613848832 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333185.774946:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe438a9880. 00000100:00100000:0.0:1763333185.774959:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1699 00000100:00100000:0.0:1763333185.774966:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe438aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:2419:x1848987613848960:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:0.0:1763333185.775019:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333185.775023:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:0.0:1763333185.775025:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333185.775027:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:0.0:1763333185.775029:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333185.775051:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe438aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:2419:x1848987613848960:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 85us (1199us total) trans 21474839031 rc 0/0 00000100:00100000:0.0:1763333185.775058:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1699 00002000:00010000:0.0:1763333185.775060:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/151 (0->18446744073709551615) 00002000:00100000:0.0:1763333185.775063:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe438aa300 with x1848987613848960 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333185.775068:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe438aa300. 00000100:00100000:3.0:1763333185.778826:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333185.778883:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333185.779056:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613849216 00000100:00100000:2.0:1763333185.779072:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613849216 00000100:00100000:2.0:1763333185.779164:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613849088 00000100:00100000:2.0:1763333185.779168:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613849088 00000100:00100000:2.0:1763333185.779202:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1700 00000100:00100000:2.0:1763333185.779212:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+26:2419:x1848987613849216:12345-192.168.204.28@tcp:22:fsx.0 00002000:00010000:2.0:1763333185.779566:0:24027:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333185.779572:0:24027:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:2.0:1763333185.779575:0:24027:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333185.779577:0:24027:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:2.0:1763333185.779579:0:24027:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 0 -> 6144 00000100:00100000:2.0:1763333185.779652:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+27:2419:x1848987613849216:12345-192.168.204.28@tcp:22:fsx.0 Request processed in 440us (841us total) trans 17179871726 rc 0/0 00000100:00100000:2.0:1763333185.779660:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1700 00000100:00100000:2.0:1763333185.779682:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1701 00000100:00100000:2.0:1763333185.779689:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:2419:x1848987613849088:12345-192.168.204.28@tcp:22:fsx.0 00002000:00010000:2.0:1763333185.779813:0:24027:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333185.779816:0:24027:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:2.0:1763333185.779818:0:24027:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333185.779820:0:24027:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:2.0:1763333185.779823:0:24027:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 0 -> 2048 00000100:00100000:2.0:1763333185.779844:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+26:2419:x1848987613849088:12345-192.168.204.28@tcp:22:fsx.0 Request processed in 155us (960us total) trans 21474839032 rc 0/0 00000100:00100000:2.0:1763333185.779850:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1701 00000100:00100000:0.0:1763333185.783458:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333185.783639:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613849472 00000100:00100000:1.0:1763333185.783654:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613849472 00000100:00100000:1.0:1763333185.783731:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9659 00000100:00100000:1.0:1763333185.783741:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+57:57511:x1848987613849472:12345-192.168.204.28@tcp:36:fsx.0 00010000:00010000:1.0:1763333185.784040:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c586e1 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.784063:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c586e1 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.784075:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c586e1 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00000001:00080000:1.0:1763333185.784126:0:6520:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935424 00000004:00010000:1.0:1763333185.784145:0:6520:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009612f44f reply state 000000004fb34292 transno 8589935425 ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c586e1 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.784158:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c586e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333185.784166:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333185.784169:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333185.784172:0:6520:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763333185.785336:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+60:57511:x1848987613849472:12345-192.168.204.28@tcp:36:fsx.0 Request processed in 1585us (1882us total) trans 8589935425 rc 0/0 00000100:00100000:1.0:1763333185.785363:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9659 00000020:00080000:1.0:1763333185.785373:0:6520:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763333185.789785:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333185.790144:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613849600 00000100:00100000:0.0:1763333185.790160:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613849600 00002000:00010000:0.0:1763333185.790221:0:16635:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (0->18446744073709551615) 00002000:00100000:0.0:1763333185.790227:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff75664700 with x1848987613849600 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333185.790244:0:16635:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff75664700. 00000100:00100000:0.0:1763333185.790299:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1702 00000100:00100000:0.0:1763333185.790311:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+26:2419:x1848987613849600:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:0.0:1763333185.790563:0:16635:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333185.790569:0:16635:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:0.0:1763333185.790573:0:16635:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333185.790575:0:16635:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:0.0:1763333185.790579:0:16635:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1763333185.790659:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+27:2419:x1848987613849600:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 349us (887us total) trans 21474839033 rc 0/0 00000100:00100000:0.0:1763333185.790668:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1702 00002000:00010000:0.0:1763333185.790673:0:16635:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (0->18446744073709551615) 00002000:00100000:0.0:1763333185.790676:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff75664700 with x1848987613849600 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333185.790680:0:16635:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff75664700. 00000100:00100000:1.0:1763333185.791613:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333185.791766:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333185.792183:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613849728 00000100:00100000:3.0:1763333185.792196:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613849728 00002000:00010000:3.0:1763333185.792242:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/150 (0->18446744073709551615) 00002000:00100000:3.0:1763333185.792247:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff75667b80 with x1848987613849728 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333185.792258:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff75667b80. 00000100:00100000:3.0:1763333185.792300:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613849856 00000100:00100000:3.0:1763333185.792304:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613849856 00002000:00010000:3.0:1763333185.792315:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/151 (0->18446744073709551615) 00002000:00100000:3.0:1763333185.792318:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff75667100 with x1848987613849856 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333185.792323:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff75667100. 00000100:00100000:3.0:1763333185.792340:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1703 00000100:00100000:3.0:1763333185.792383:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75667b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+28:2419:x1848987613849728:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:3.0:1763333185.792556:0:28427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333185.792561:0:28427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:3.0:1763333185.792564:0:28427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333185.792566:0:28427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:3.0:1763333185.792569:0:28427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333185.792638:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75667b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:2419:x1848987613849728:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 289us (1032us total) trans 17179871727 rc 0/0 00000100:00100000:3.0:1763333185.792646:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1703 00002000:00010000:3.0:1763333185.792650:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/150 (0->18446744073709551615) 00002000:00100000:3.0:1763333185.792653:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff75667b80 with x1848987613849728 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333185.792658:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff75667b80. 00000100:00100000:3.0:1763333185.792679:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1704 00000100:00100000:3.0:1763333185.792687:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+28:2419:x1848987613849856:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:3.0:1763333185.792744:0:28427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333185.792747:0:28427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:3.0:1763333185.792749:0:28427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333185.792752:0:28427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:3.0:1763333185.792754:0:28427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:3.0:1763333185.792775:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:2419:x1848987613849856:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 89us (1009us total) trans 17179871728 rc 0/0 00000100:00100000:3.0:1763333185.792782:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1704 00002000:00010000:3.0:1763333185.792785:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/151 (0->18446744073709551615) 00002000:00100000:3.0:1763333185.792787:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff75667100 with x1848987613849856 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333185.792791:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff75667100. 00000100:00100000:3.0:1763333185.792844:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333185.792954:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613849984 00000100:00100000:3.0:1763333185.792959:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613849984 00002000:00010000:3.0:1763333185.792974:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/151 (0->18446744073709551615) 00002000:00100000:3.0:1763333185.792977:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe44de2a00 with x1848987613849984 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333185.792984:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe44de2a00. 00000100:00100000:3.0:1763333185.793007:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1705 00000100:00100000:3.0:1763333185.793014:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+27:2419:x1848987613849984:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:3.0:1763333185.793101:0:8412:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333185.793104:0:8412:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:3.0:1763333185.793107:0:8412:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333185.793109:0:8412:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:3.0:1763333185.793111:0:8412:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333185.793135:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+28:2419:x1848987613849984:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 121us (292us total) trans 21474839034 rc 0/0 00000100:00100000:3.0:1763333185.793143:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1705 00002000:00010000:3.0:1763333185.793145:0:8412:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/151 (0->18446744073709551615) 00002000:00100000:3.0:1763333185.793148:0:8412:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe44de2a00 with x1848987613849984 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333185.793152:0:8412:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe44de2a00. 00000100:00100000:3.0:1763333185.798770:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333185.799620:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613850112 00000100:00100000:0.0:1763333185.799637:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613850112 00000100:00100000:0.0:1763333185.799738:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6833 00000100:00100000:0.0:1763333185.799751:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+28:2418:x1848987613850112:12345-192.168.204.28@tcp:101:fsx.0 00010000:00010000:0.0:1763333185.799777:0:8406:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333185.799810:0:8406:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe467be000/0xb32e3ef184c586e8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x25d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a2dc expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763333185.799841:0:8406:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x25d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763333185.799868:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333185.799871:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333185.799883:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe467be000/0xb32e3ef184c586e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2dc expref: 29 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333185.799905:0:8406:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe467be000/0xb32e3ef184c586e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2dc expref: 29 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333185.799921:0:8406:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe467be000, rc 0) 00000100:00100000:0.0:1763333185.800006:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:2418:x1848987613850112:12345-192.168.204.28@tcp:101:fsx.0 Request processed in 258us (1251us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333185.800015:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6833 00000100:00100000:1.0:1763333185.808938:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333185.809066:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613850240 00000100:00100000:2.0:1763333185.809080:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613850240 00000100:00100000:2.0:1763333185.809151:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9660 00000100:00100000:2.0:1763333185.809162:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+60:57511:x1848987613850240:12345-192.168.204.28@tcp:101:fsx.0 00010000:00010000:2.0:1763333185.809191:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333185.809219:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c586ef lrc: 2/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a2e3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333185.809372:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c586f6 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1763333185.809391:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c586f6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1763333185.809404:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c586f6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00000004:00200000:2.0:1763333185.809438:0:6520:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x55:0x0]: returning size 0 00000004:00200000:2.0:1763333185.809443:0:6520:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763333185.809468:0:6520:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c586f6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1763333185.809501:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c586ef lrc: 0/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2e3 expref: 62 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333185.809521:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c586f6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2e3 expref: 61 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333185.809532:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:2.0:1763333185.809535:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333185.809540:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4742f400, rc 0) 00000100:00100000:2.0:1763333185.809619:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+61:57511:x1848987613850240:12345-192.168.204.28@tcp:101:fsx.0 Request processed in 459us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333185.809627:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9660 00000100:00100000:2.0:1763333185.818690:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333185.818789:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613850368 00000100:00100000:0.0:1763333185.818803:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613850368 00000100:00100000:0.0:1763333185.818895:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1706 00000100:00100000:0.0:1763333185.818907:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:2421:x1848987613850368:12345-192.168.204.28@tcp:22:fsx.0 00002000:00010000:0.0:1763333185.819120:0:16635:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 0 -> 106336 00002000:00010000:0.0:1763333185.819125:0:16635:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:0.0:1763333185.819128:0:16635:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333185.819130:0:16635:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:0.0:1763333185.819132:0:16635:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1763333185.823464:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:2421:x1848987613850368:12345-192.168.204.28@tcp:22:fsx.0 Request processed in 4537us (4769us total) trans 21474839035 rc 0/0 00000100:00100000:0.0:1763333185.823486:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1706 00000100:00100000:3.0:1763333185.836547:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333185.836687:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613850496 00000100:00100000:0.0:1763333185.836701:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613850496 00002000:00100000:0.0:1763333185.836768:0:16635:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x95:0x0] (102400->106495) req@ffff92fe44de3800 x1848987613850496/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:496/0 lens 488/0 e 0 to 0 dl 1763333196 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1763333185.836780:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe44de3800 with x1848987613850496 ext(102400->106495) 00002000:00010000:0.0:1763333185.836788:0:16635:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe44de3800 00000100:00100000:0.0:1763333185.836834:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1707 00000100:00100000:0.0:1763333185.836844:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:2419:x1848987613850496:12345-192.168.204.28@tcp:3:kworker.0 00000100:00100000:0.0:1763333185.837165:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:2419:x1848987613850496:12345-192.168.204.28@tcp:3:kworker.0 Request processed in 321us (632us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1763333185.837179:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1707 00002000:00100000:0.0:1763333185.837188:0:16635:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x95:0x0] (102400->106495) req@ffff92fe44de3800 x1848987613850496/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:496/0 lens 488/4536 e 0 to 0 dl 1763333196 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1763333185.837197:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe44de3800 with x1848987613850496 ext(102400->106495) 00002000:00010000:0.0:1763333185.837201:0:16635:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe44de3800 00000100:00100000:1.0:1763333185.845341:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333185.845543:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613850624 00000100:00100000:2.0:1763333185.845558:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613850624 00000100:00100000:2.0:1763333185.845643:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1708 00000100:00100000:2.0:1763333185.845654:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff75666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:2418:x1848987613850624:12345-192.168.204.28@tcp:22:fsx.0 00002000:00010000:2.0:1763333185.845849:0:24027:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 106336 -> 106336 00002000:00010000:2.0:1763333185.845854:0:24027:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:2.0:1763333185.845857:0:24027:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333185.845858:0:24027:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:2.0:1763333185.845861:0:24027:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1763333185.845935:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff75666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+31:2418:x1848987613850624:12345-192.168.204.28@tcp:22:fsx.0 Request processed in 282us (610us total) trans 21474839036 rc 0/0 00000100:00100000:2.0:1763333185.845943:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1708 00000100:00100000:3.0:1763333185.853132:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333185.853259:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613850752 00000100:00100000:0.0:1763333185.853283:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613850752 00000100:00100000:0.0:1763333185.853418:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1709 00000100:00100000:0.0:1763333185.853430:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+31:2419:x1848987613850752:12345-192.168.204.28@tcp:22:fsx.0 00002000:00010000:0.0:1763333185.853643:0:16635:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 106336 -> 106336 00002000:00010000:0.0:1763333185.853648:0:16635:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:0.0:1763333185.853651:0:16635:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333185.853653:0:16635:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:0.0:1763333185.853656:0:16635:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1763333185.853729:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+32:2419:x1848987613850752:12345-192.168.204.28@tcp:22:fsx.0 Request processed in 300us (615us total) trans 21474839037 rc 0/0 00000100:00100000:0.0:1763333185.853737:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1709 00000100:00100000:3.0:1763333185.862945:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333185.863168:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613850880 00000100:00100000:2.0:1763333185.863182:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613850880 00000100:00100000:2.0:1763333185.863284:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1710 00000100:00100000:2.0:1763333185.863296:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+32:2418:x1848987613850880:12345-192.168.204.28@tcp:22:fsx.0 00002000:00010000:2.0:1763333185.863608:0:24027:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 106336 -> 106336 00002000:00010000:2.0:1763333185.863613:0:24027:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:2.0:1763333185.863616:0:24027:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333185.863617:0:24027:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:2.0:1763333185.863620:0:24027:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1763333185.863698:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+33:2418:x1848987613850880:12345-192.168.204.28@tcp:22:fsx.0 Request processed in 405us (770us total) trans 21474839038 rc 0/0 00000100:00100000:2.0:1763333185.863707:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1710 00000100:00100000:1.0:1763333185.873541:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333185.873667:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613851008 00000100:00100000:0.0:1763333185.873681:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613851008 00000100:00100000:0.0:1763333185.873774:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1711 00000100:00100000:0.0:1763333185.873787:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+33:2418:x1848987613851008:12345-192.168.204.28@tcp:22:fsx.0 00002000:00010000:0.0:1763333185.874082:0:16635:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 106336 -> 106336 00002000:00010000:0.0:1763333185.874087:0:16635:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:0.0:1763333185.874089:0:16635:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333185.874093:0:16635:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:0.0:1763333185.874095:0:16635:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1763333185.874185:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+34:2418:x1848987613851008:12345-192.168.204.28@tcp:22:fsx.0 Request processed in 400us (658us total) trans 21474839039 rc 0/0 00000100:00100000:0.0:1763333185.874195:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1711 00000100:00100000:3.0:1763333185.884173:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333185.888054:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613851136 00000100:00100000:2.0:1763333185.888076:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613851136 00002000:00100000:2.0:1763333185.888158:0:24027:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (36864->40959) req@ffff92fe4920d880 x1848987613851136/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:496/0 lens 488/0 e 0 to 0 dl 1763333196 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1763333185.888172:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4920d880 with x1848987613851136 ext(36864->40959) 00002000:00010000:2.0:1763333185.888180:0:24027:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe4920d880 00000100:00100000:2.0:1763333185.888222:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1712 00000100:00100000:2.0:1763333185.888234:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+34:2421:x1848987613851136:12345-192.168.204.28@tcp:3:kworker.0 00000100:00100000:2.0:1763333185.888568:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+34:2421:x1848987613851136:12345-192.168.204.28@tcp:3:kworker.0 Request processed in 334us (4409us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1763333185.888577:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1712 00002000:00100000:2.0:1763333185.888584:0:24027:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (36864->40959) req@ffff92fe4920d880 x1848987613851136/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:496/0 lens 488/4536 e 0 to 0 dl 1763333196 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1763333185.888594:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4920d880 with x1848987613851136 ext(36864->40959) 00002000:00010000:2.0:1763333185.888597:0:24027:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe4920d880 00000100:00100000:1.0:1763333185.892292:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333185.892414:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613851264 00000100:00100000:0.0:1763333185.892427:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613851264 00002000:00100000:0.0:1763333185.892495:0:16635:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x95:0x0] (12288->77823) req@ffff92ff7400ed80 x1848987613851264/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:496/0 lens 504/0 e 0 to 0 dl 1763333196 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1763333185.892508:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7400ed80 with x1848987613851264 ext(12288->77823) 00002000:00010000:0.0:1763333185.892515:0:16635:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7400ed80 00000100:00100000:0.0:1763333185.892554:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1713 00000100:00100000:0.0:1763333185.892564:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+34:2421:x1848987613851264:12345-192.168.204.28@tcp:3:kworker.0 00000100:00100000:0.0:1763333185.901228:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+34:2421:x1848987613851264:12345-192.168.204.28@tcp:3:kworker.0 Request processed in 8646us (8942us total) trans 0 rc 61440/61440 00000100:00100000:0.0:1763333185.901248:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1713 00002000:00100000:0.0:1763333185.901266:0:16635:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x95:0x0] (12288->77823) req@ffff92ff7400ed80 x1848987613851264/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:496/0 lens 504/440 e 0 to 0 dl 1763333196 ref 1 fl Complete:/600/0 rc 61440/61440 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1763333185.901295:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7400ed80 with x1848987613851264 ext(12288->77823) 00002000:00010000:0.0:1763333185.901303:0:16635:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7400ed80 00000100:00100000:3.0:1763333185.910925:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333185.911148:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613851520 00000100:00100000:1.0:1763333185.911164:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613851520 00000100:00100000:2.0:1763333185.911930:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9661 00000100:00100000:2.0:1763333185.911962:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+61:57511:x1848987613851520:12345-192.168.204.28@tcp:36:fsx.0 00010000:00010000:2.0:1763333185.912040:0:6520:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333185.912078:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c586f6 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2e3 expref: 61 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333185.912103:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:2.0:1763333185.912109:0:6520:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333185.913044:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c586fd lrc: 3/0,1 mode: --/PW res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1763333185.913070:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c586fd lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1763333185.913083:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c586fd lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00000001:00080000:2.0:1763333185.913155:0:6520:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935426 00000004:00010000:2.0:1763333185.913189:0:6520:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000dbecf224 reply state 000000003f34398b transno 8589935427 ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c586fd lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1763333185.913205:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c586fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1763333185.913212:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:2.0:1763333185.913215:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333185.913219:0:6520:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763333185.914303:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+63:57511:x1848987613851520:12345-192.168.204.28@tcp:36:fsx.0 Request processed in 2349us (3383us total) trans 8589935427 rc 0/0 00000100:00100000:2.0:1763333185.914317:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9661 00000020:00080000:2.0:1763333185.914325:0:6520:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763333185.917019:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333185.917067:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333185.917103:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333185.917399:0:28429:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613851648 00000100:00100000:3.0:1763333185.917414:0:28429:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613851648 00002000:00010000:3.0:1763333185.917467:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (140080->18446744073709551615) 00002000:00100000:3.0:1763333185.917473:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7400dc00 with x1848987613851648 ext(140080->18446744073709551615) 00002000:00010000:3.0:1763333185.917488:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7400dc00. 00000100:00100000:3.0:1763333185.917512:0:28429:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613851776 00000100:00100000:3.0:1763333185.917515:0:28429:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613851776 00002000:00010000:3.0:1763333185.917528:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/151 (0->18446744073709551615) 00002000:00100000:3.0:1763333185.917530:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7400ca80 with x1848987613851776 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333185.917536:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff7400ca80. 00000100:00100000:3.0:1763333185.917552:0:28429:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613851904 00000100:00100000:3.0:1763333185.917554:0:28429:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613851904 00002000:00010000:3.0:1763333185.917564:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/151 (0->18446744073709551615) 00002000:00100000:3.0:1763333185.917566:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff6bc12d80 with x1848987613851904 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333185.917571:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff6bc12d80. 00000100:00100000:3.0:1763333185.917590:0:28429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1714 00000100:00100000:3.0:1763333185.917600:0:28429:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+35:2419:x1848987613851648:12345-192.168.204.28@tcp:10:fsx.0 00000100:00100000:0.0:1763333185.917728:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1715 00000100:00100000:0.0:1763333185.917743:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7400ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:2418:x1848987613851776:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:0.0:1763333185.917874:0:16635:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333185.917878:0:16635:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:0.0:1763333185.917882:0:16635:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333185.917884:0:16635:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:0.0:1763333185.917886:0:16635:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:3.0:1763333185.917915:0:28429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 106336 -> 140080 00002000:00010000:3.0:1763333185.917918:0:28429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:3.0:1763333185.917920:0:28429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333185.917922:0:28429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:3.0:1763333185.917924:0:28429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2048 -> 280 00000100:00100000:2.0:1763333185.918014:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1716 00000100:00100000:2.0:1763333185.918029:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6bc12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+36:2418:x1848987613851904:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:2.0:1763333185.918086:0:24027:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333185.918089:0:24027:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:2.0:1763333185.918091:0:24027:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333185.918093:0:24027:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:2.0:1763333185.918095:0:24027:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333185.918647:0:28429:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+37:2419:x1848987613851648:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 1043us (1638us total) trans 21474839040 rc 0/0 00000100:00100000:3.0:1763333185.918656:0:28429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1714 00002000:00010000:3.0:1763333185.918662:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (140080->18446744073709551615) 00002000:00100000:3.0:1763333185.918665:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7400dc00 with x1848987613851648 ext(140080->18446744073709551615) 00002000:00010000:3.0:1763333185.918672:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7400dc00. 00000100:00100000:0.0:1763333185.918930:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7400ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:2418:x1848987613851776:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 1192us (1861us total) trans 17179871729 rc 0/0 00000100:00100000:0.0:1763333185.918942:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1715 00002000:00010000:0.0:1763333185.918946:0:16635:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/151 (0->18446744073709551615) 00002000:00100000:0.0:1763333185.918949:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7400ca80 with x1848987613851776 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333185.918955:0:16635:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff7400ca80. 00000100:00100000:2.0:1763333185.919476:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6bc12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+36:2418:x1848987613851904:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 1444us (2366us total) trans 21474839041 rc 0/0 00000100:00100000:2.0:1763333185.919485:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1716 00002000:00010000:2.0:1763333185.919489:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/151 (0->18446744073709551615) 00002000:00100000:2.0:1763333185.919491:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff6bc12d80 with x1848987613851904 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333185.919498:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff6bc12d80. 00000100:00100000:3.0:1763333185.924104:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333185.924224:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613852032 00000100:00100000:2.0:1763333185.924238:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613852032 00000100:00100000:2.0:1763333185.924325:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9662 00000100:00100000:2.0:1763333185.924384:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+63:57511:x1848987613852032:12345-192.168.204.28@tcp:101:fsx.0 00010000:00010000:2.0:1763333185.924415:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333185.924445:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58704 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a2ea expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333185.924562:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742fa00/0xb32e3ef184c5870b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1763333185.924579:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742fa00/0xb32e3ef184c5870b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1763333185.924594:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742fa00/0xb32e3ef184c5870b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00000004:00200000:2.0:1763333185.924625:0:6520:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x55:0x0]: returning size 140080 00000004:00200000:2.0:1763333185.924631:0:6520:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763333185.924654:0:6520:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742fa00/0xb32e3ef184c5870b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1763333185.924684:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58704 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2ea expref: 65 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333185.924703:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742fa00/0xb32e3ef184c5870b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2ea expref: 64 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333185.924712:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:2.0:1763333185.924716:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333185.924720:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4742fa00, rc 0) 00000100:00100000:2.0:1763333185.924790:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+64:57511:x1848987613852032:12345-192.168.204.28@tcp:101:fsx.0 Request processed in 455us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333185.924798:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9662 00000100:00100000:1.0:1763333185.938177:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333185.938312:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613852160 00000100:00100000:2.0:1763333185.938327:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613852160 00000100:00100000:2.0:1763333185.938455:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1717 00000100:00100000:2.0:1763333185.938469:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+36:2420:x1848987613852160:12345-192.168.204.28@tcp:22:fsx.0 00002000:00010000:2.0:1763333185.938822:0:24027:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 140080 -> 140080 00002000:00010000:2.0:1763333185.938827:0:24027:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:2.0:1763333185.938830:0:24027:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333185.938832:0:24027:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:2.0:1763333185.938835:0:24027:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 280 -> 224 00000100:00100000:2.0:1763333185.938926:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+37:2420:x1848987613852160:12345-192.168.204.28@tcp:22:fsx.0 Request processed in 460us (764us total) trans 21474839042 rc 0/0 00000100:00100000:2.0:1763333185.938936:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1717 00000100:00100000:0.0:1763333185.944543:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333185.944702:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613852288 00000100:00100000:2.0:1763333185.944716:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613852288 00000100:00100000:2.0:1763333185.944797:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1718 00000100:00100000:2.0:1763333185.944808:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+37:2420:x1848987613852288:12345-192.168.204.28@tcp:22:fsx.0 00002000:00010000:2.0:1763333185.945031:0:24027:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 140080 -> 140080 00002000:00010000:2.0:1763333185.945036:0:24027:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:2.0:1763333185.945039:0:24027:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333185.945041:0:24027:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:2.0:1763333185.945044:0:24027:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 224 -> 224 00000100:00100000:2.0:1763333185.945126:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+38:2420:x1848987613852288:12345-192.168.204.28@tcp:22:fsx.0 Request processed in 319us (596us total) trans 21474839043 rc 0/0 00000100:00100000:2.0:1763333185.945134:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1718 00000100:00100000:3.0:1763333185.952019:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333185.953316:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613852416 00000100:00100000:0.0:1763333185.953335:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613852416 00002000:00100000:1.0:1763333185.954539:0:16635:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x95:0x0] (135168->143359) req@ffff92fe4920ca80 x1848987613852416/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:496/0 lens 488/0 e 0 to 0 dl 1763333196 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763333185.954555:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4920ca80 with x1848987613852416 ext(135168->143359) 00002000:00010000:1.0:1763333185.954563:0:16635:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe4920ca80 00000100:00100000:1.0:1763333185.954608:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1719 00000100:00100000:1.0:1763333185.954618:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+38:2418:x1848987613852416:12345-192.168.204.28@tcp:3:fsx.0 00000100:00100000:1.0:1763333185.955447:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+38:2418:x1848987613852416:12345-192.168.204.28@tcp:3:fsx.0 Request processed in 824us (3436us total) trans 0 rc 8192/8192 00000100:00100000:1.0:1763333185.955459:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1719 00002000:00100000:1.0:1763333185.955469:0:16635:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x95:0x0] (135168->143359) req@ffff92fe4920ca80 x1848987613852416/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:496/0 lens 488/8632 e 0 to 0 dl 1763333196 ref 1 fl Complete:/600/0 rc 8192/8192 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763333185.955478:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4920ca80 with x1848987613852416 ext(135168->143359) 00002000:00010000:1.0:1763333185.955482:0:16635:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe4920ca80 00000100:00100000:1.0:1763333185.964141:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333185.965424:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613852544 00000100:00100000:2.0:1763333185.965442:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613852544 00000100:00100000:0.0:1763333185.966166:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1720 00000100:00100000:0.0:1763333185.966188:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+38:2418:x1848987613852544:12345-192.168.204.28@tcp:22:fsx.0 00002000:00010000:0.0:1763333185.966506:0:24027:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 140080 -> 227321 00002000:00010000:0.0:1763333185.966510:0:24027:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:0.0:1763333185.966513:0:24027:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333185.966516:0:24027:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:0.0:1763333185.966518:0:24027:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 224 -> 344 00000100:00100000:0.0:1763333185.966608:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+39:2418:x1848987613852544:12345-192.168.204.28@tcp:22:fsx.0 Request processed in 430us (2482us total) trans 21474839044 rc 0/0 00000100:00100000:0.0:1763333185.966618:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1720 00000100:00100000:1.0:1763333185.972409:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333185.972572:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613852672 00000100:00100000:2.0:1763333185.972587:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613852672 00002000:00100000:2.0:1763333185.972652:0:16635:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x95:0x0] (0->229375) req@ffff92ff77b16680 x1848987613852672/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:496/0 lens 536/0 e 0 to 0 dl 1763333196 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763333185.972666:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff77b16680 with x1848987613852672 ext(0->229375) 00002000:00010000:2.0:1763333185.972674:0:16635:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff77b16680 00000100:00100000:2.0:1763333185.972713:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1721 00000100:00100000:2.0:1763333185.972723:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+39:2419:x1848987613852672:12345-192.168.204.28@tcp:3:fsx.0 00000100:00100000:2.0:1763333185.982285:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+39:2419:x1848987613852672:12345-192.168.204.28@tcp:3:fsx.0 Request processed in 9538us (9916us total) trans 0 rc 163840/163840 00000100:00100000:2.0:1763333185.982304:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1721 00002000:00100000:2.0:1763333185.982320:0:16635:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x95:0x0] (0->229375) req@ffff92ff77b16680 x1848987613852672/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:496/0 lens 536/440 e 0 to 0 dl 1763333196 ref 1 fl Complete:/600/0 rc 163840/163840 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763333185.982332:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff77b16680 with x1848987613852672 ext(0->229375) 00002000:00010000:2.0:1763333185.982340:0:16635:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff77b16680 00000100:00100000:1.0:1763333185.992242:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333185.992490:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613852800 00000100:00100000:0.0:1763333185.992507:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613852800 00000100:00100000:0.0:1763333185.992607:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1722 00000100:00100000:0.0:1763333185.992619:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+39:2421:x1848987613852800:12345-192.168.204.28@tcp:22:fsx.0 00002000:00010000:0.0:1763333185.992964:0:16635:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 227321 -> 227321 00002000:00010000:0.0:1763333185.992970:0:16635:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:0.0:1763333185.992973:0:16635:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333185.992975:0:16635:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:0.0:1763333185.992978:0:16635:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 344 -> 344 00000100:00100000:0.0:1763333185.993073:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+40:2421:x1848987613852800:12345-192.168.204.28@tcp:22:fsx.0 Request processed in 455us (847us total) trans 21474839045 rc 0/0 00000100:00100000:0.0:1763333185.993084:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1722 00000100:00100000:1.0:1763333185.999344:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333185.999535:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613852928 00000100:00100000:2.0:1763333185.999549:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613852928 00000100:00100000:2.0:1763333185.999644:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1723 00000100:00100000:2.0:1763333185.999656:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+40:2419:x1848987613852928:12345-192.168.204.28@tcp:22:fsx.0 00002000:00010000:2.0:1763333185.999882:0:24027:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 227321 -> 227321 00002000:00010000:2.0:1763333185.999887:0:24027:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:2.0:1763333185.999890:0:24027:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333185.999892:0:24027:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:2.0:1763333185.999895:0:24027:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 344 -> 344 00000100:00100000:2.0:1763333185.999977:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+41:2419:x1848987613852928:12345-192.168.204.28@tcp:22:fsx.0 Request processed in 322us (647us total) trans 21474839046 rc 0/0 00000100:00100000:2.0:1763333185.999987:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1723 00000100:00100000:3.0:1763333186.013740:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333186.015945:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613853056 00000100:00100000:0.0:1763333186.015966:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613853056 00002000:00100000:1.0:1763333186.016097:0:16635:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x95:0x0] (184320->234538) req@ffff92fe4920df80 x1848987613853056/t0(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/0 e 0 to 0 dl 1763333197 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763333186.016111:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4920df80 with x1848987613853056 ext(184320->234538) 00002000:00010000:1.0:1763333186.016120:0:16635:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe4920df80 00000100:00100000:1.0:1763333186.016254:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1724 00000100:00100000:1.0:1763333186.016265:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+41:2420:x1848987613853056:12345-192.168.204.28@tcp:4:fsx.0 00000100:00100000:2.0:1763333186.033888:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+43:2420:x1848987613853056:12345-192.168.204.28@tcp:4:fsx.0 Request processed in 17604us (20146us total) trans 21474839047 rc 0/0 00000100:00100000:2.0:1763333186.033908:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1724 00002000:00100000:2.0:1763333186.033925:0:16635:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x95:0x0] (184320->234538) req@ffff92fe4920df80 x1848987613853056/t21474839047(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/448 e 0 to 0 dl 1763333197 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763333186.033938:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4920df80 with x1848987613853056 ext(184320->234538) 00002000:00010000:2.0:1763333186.033946:0:16635:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe4920df80 00000100:00100000:2.0:1763333186.036316:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333186.036596:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613853184 00000100:00100000:1.0:1763333186.036609:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613853184 00000100:00100000:1.0:1763333186.036875:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1725 00000100:00100000:1.0:1763333186.036889:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+43:2421:x1848987613853184:12345-192.168.204.28@tcp:22:fsx.0 00002000:00010000:1.0:1763333186.037764:0:16635:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 227321 -> 234539 00002000:00010000:1.0:1763333186.037771:0:16635:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:1.0:1763333186.037773:0:16635:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 0 -> 1763333186 00002000:00010000:1.0:1763333186.037776:0:16635:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:1.0:1763333186.037779:0:16635:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 344 -> 304 00000100:00100000:1.0:1763333186.037874:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+44:2421:x1848987613853184:12345-192.168.204.28@tcp:22:fsx.0 Request processed in 986us (1567us total) trans 21474839048 rc 0/0 00000100:00100000:1.0:1763333186.037885:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1725 00000100:00100000:1.0:1763333186.049861:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333186.049990:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613853312 00000100:00100000:2.0:1763333186.050006:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613853312 00002000:00100000:2.0:1763333186.050073:0:16635:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x95:0x0] (53248->57343) req@ffff92ff77b14700 x1848987613853312/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/0 e 0 to 0 dl 1763333197 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763333186.050087:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff77b14700 with x1848987613853312 ext(53248->57343) 00002000:00010000:2.0:1763333186.050095:0:16635:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff77b14700 00000100:00100000:2.0:1763333186.050420:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1726 00000100:00100000:2.0:1763333186.050433:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+44:2421:x1848987613853312:12345-192.168.204.28@tcp:3:fsx.0 00000100:00100000:2.0:1763333186.050696:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+44:2421:x1848987613853312:12345-192.168.204.28@tcp:3:fsx.0 Request processed in 264us (849us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1763333186.050705:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1726 00002000:00100000:2.0:1763333186.050712:0:16635:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x95:0x0] (53248->57343) req@ffff92ff77b14700 x1848987613853312/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/4536 e 0 to 0 dl 1763333197 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763333186.050720:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff77b14700 with x1848987613853312 ext(53248->57343) 00002000:00010000:2.0:1763333186.050725:0:16635:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff77b14700 00000100:00100000:2.0:1763333186.056664:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333186.056927:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613853440 00000100:00100000:1.0:1763333186.056943:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613853440 00002000:00100000:1.0:1763333186.057018:0:16635:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x95:0x0] (0->57343) req@ffff92ff77c6ea00 x1848987613853440/t0(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/0 e 0 to 0 dl 1763333197 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763333186.057031:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff77c6ea00 with x1848987613853440 ext(0->57343) 00002000:00010000:1.0:1763333186.057039:0:16635:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff77c6ea00 00000100:00100000:1.0:1763333186.057973:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1727 00000100:00100000:1.0:1763333186.057998:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+44:2421:x1848987613853440:12345-192.168.204.28@tcp:4:fsx.0 00000100:00100000:1.0:1763333186.065145:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+46:2421:x1848987613853440:12345-192.168.204.28@tcp:4:fsx.0 Request processed in 7143us (8482us total) trans 21474839049 rc 0/0 00000100:00100000:1.0:1763333186.065172:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1727 00002000:00100000:1.0:1763333186.065187:0:16635:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x95:0x0] (0->57343) req@ffff92ff77c6ea00 x1848987613853440/t21474839049(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/448 e 0 to 0 dl 1763333197 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763333186.065206:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff77c6ea00 with x1848987613853440 ext(0->57343) 00002000:00010000:1.0:1763333186.065215:0:16635:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff77c6ea00 00000100:00100000:1.0:1763333186.071432:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333186.072539:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613853568 00000100:00100000:0.0:1763333186.072561:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613853568 00000100:00100000:0.0:1763333186.072780:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6834 00000100:00100000:0.0:1763333186.073172:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+46:2420:x1848987613853568:12345-192.168.204.28@tcp:16:fsx.0 00000001:00080000:1.0:1763333186.081952:0:24714:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839049 is committed 00000001:00080000:1.0:1763333186.082050:0:24714:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839018 is committed 00000100:00100000:0.0:1763333186.084368:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2420:x1848987613853568:12345-192.168.204.28@tcp:16:fsx.0 Request processed in 11167us (12915us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333186.084386:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6834 00000100:00100000:2.0:1763333186.098767:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333186.098893:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613853696 00000100:00100000:1.0:1763333186.098909:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613853696 00002000:00100000:1.0:1763333186.098981:0:16635:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x95:0x0] (57344->204799) req@ffff92ff77c6d180 x1848987613853696/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 504/0 e 0 to 0 dl 1763333197 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763333186.098994:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff77c6d180 with x1848987613853696 ext(57344->204799) 00002000:00010000:1.0:1763333186.099003:0:16635:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff77c6d180 00000100:00100000:0.0:1763333186.099435:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1728 00000100:00100000:0.0:1763333186.099456:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2420:x1848987613853696:12345-192.168.204.28@tcp:3:fsx.0 00000100:00100000:0.0:1763333186.106460:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2420:x1848987613853696:12345-192.168.204.28@tcp:3:fsx.0 Request processed in 6995us (7695us total) trans 0 rc 77824/77824 00000100:00100000:0.0:1763333186.106478:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1728 00002000:00100000:0.0:1763333186.106495:0:24027:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (57344->204799) req@ffff92ff77c6d180 x1848987613853696/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 504/440 e 0 to 0 dl 1763333197 ref 1 fl Complete:/600/0 rc 77824/77824 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763333186.106514:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff77c6d180 with x1848987613853696 ext(57344->204799) 00002000:00010000:0.0:1763333186.106522:0:24027:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff77c6d180 00000100:00100000:2.0:1763333186.119420:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333186.119566:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613853952 00000100:00100000:1.0:1763333186.119582:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613853952 00000100:00100000:1.0:1763333186.119674:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9663 00000100:00100000:1.0:1763333186.119687:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+64:57511:x1848987613853952:12345-192.168.204.28@tcp:36:fsx.0 00010000:00010000:1.0:1763333186.120542:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333186.120580:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742fa00/0xb32e3ef184c5870b lrc: 0/0,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2ea expref: 64 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333186.120606:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333186.120612:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333186.120855:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c58712 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333186.120878:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c58712 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333186.120889:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c58712 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT0 00000001:00080000:1.0:1763333186.120945:0:12741:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935428 00000004:00010000:1.0:1763333186.120972:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000008b3cfc6a reply state 0000000086865169 transno 8589935429 ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c58712 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333186.120985:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c58712 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333186.120990:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333186.120993:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333186.120996:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763333186.123157:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+66:57511:x1848987613853952:12345-192.168.204.28@tcp:36:fsx.0 Request processed in 3458us (3882us total) trans 8589935429 rc 0/0 00000100:00100000:1.0:1763333186.123173:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9663 00000020:00080000:1.0:1763333186.123183:0:12741:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1763333186.128534:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763333186.130968:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333186.134043:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333186.136025:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333186.136504:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613854208 00000100:00100000:0.0:1763333186.136518:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613854208 00002000:00010000:0.0:1763333186.136577:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/151 (0->18446744073709551615) 00002000:00100000:0.0:1763333186.136582:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4684ce00 with x1848987613854208 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333186.136599:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe4684ce00. 00000100:00100000:0.0:1763333186.136625:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613854080 00000100:00100000:0.0:1763333186.136628:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613854080 00002000:00010000:0.0:1763333186.136641:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (51450->18446744073709551615) 00002000:00100000:0.0:1763333186.136644:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4684c000 with x1848987613854080 ext(51450->18446744073709551615) 00002000:00010000:0.0:1763333186.136650:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe4684c000. 00000100:00100000:0.0:1763333186.136669:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1729 00000100:00100000:0.0:1763333186.136679:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:2421:x1848987613854208:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:0.0:1763333186.136858:0:24027:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333186.136862:0:24027:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:0.0:1763333186.136865:0:24027:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333186.136868:0:24027:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:0.0:1763333186.136870:0:24027:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:0.0:1763333186.136945:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+31:2421:x1848987613854208:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 267us (5991us total) trans 17179871730 rc 0/0 00000100:00100000:0.0:1763333186.136952:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1729 00002000:00010000:0.0:1763333186.136957:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/151 (0->18446744073709551615) 00002000:00100000:0.0:1763333186.136960:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4684ce00 with x1848987613854208 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333186.136964:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe4684ce00. 00000100:00100000:0.0:1763333186.136986:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1730 00000100:00100000:0.0:1763333186.136992:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2420:x1848987613854080:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:0.0:1763333186.137585:0:24027:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 234539 -> 51450 00002000:00010000:0.0:1763333186.137589:0:24027:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:0.0:1763333186.137592:0:24027:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1763333186 -> 1763333186 00002000:00010000:0.0:1763333186.137595:0:24027:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:0.0:1763333186.137597:0:24027:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 304 -> 112 00000100:00100000:0.0:1763333186.137623:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2420:x1848987613854080:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 630us (3598us total) trans 21474839050 rc 0/0 00000100:00100000:0.0:1763333186.137630:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1730 00002000:00010000:0.0:1763333186.137633:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (51450->18446744073709551615) 00002000:00100000:0.0:1763333186.137636:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4684c000 with x1848987613854080 ext(51450->18446744073709551615) 00002000:00010000:0.0:1763333186.137640:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe4684c000. 00000100:00100000:3.0:1763333186.144567:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613854336 00000100:00100000:3.0:1763333186.144590:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613854336 00002000:00010000:3.0:1763333186.144658:0:16635:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/151 (0->18446744073709551615) 00002000:00100000:3.0:1763333186.144664:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4684fb80 with x1848987613854336 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333186.144683:0:16635:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe4684fb80. 00000100:00100000:3.0:1763333186.144747:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1731 00000100:00100000:3.0:1763333186.144759:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2420:x1848987613854336:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:3.0:1763333186.144963:0:16635:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333186.144967:0:16635:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:3.0:1763333186.144970:0:16635:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333186.144972:0:16635:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:3.0:1763333186.144974:0:16635:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333186.145071:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2420:x1848987613854336:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 314us (9056us total) trans 21474839051 rc 0/0 00000100:00100000:3.0:1763333186.145079:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1731 00002000:00010000:3.0:1763333186.145083:0:16635:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/151 (0->18446744073709551615) 00002000:00100000:3.0:1763333186.145087:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4684fb80 with x1848987613854336 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333186.145092:0:16635:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe4684fb80. 00000100:00100000:0.0:1763333186.151163:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333186.151239:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613854464 00000100:00100000:1.0:1763333186.151254:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613854464 00000100:00100000:1.0:1763333186.151445:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9664 00000100:00100000:1.0:1763333186.151458:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+66:57511:x1848987613854464:12345-192.168.204.28@tcp:101:fsx.0 00010000:00010000:1.0:1763333186.151493:0:12741:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333186.151522:0:12741:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a000/0xb32e3ef184c58719 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a2f1 expref: -99 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333186.151653:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a600/0xb32e3ef184c58720 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333186.151672:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a600/0xb32e3ef184c58720 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333186.151686:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a600/0xb32e3ef184c58720 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT0 00000004:00200000:1.0:1763333186.151722:0:12741:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x55:0x0]: returning size 51450 00000004:00200000:1.0:1763333186.151728:0:12741:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763333186.151758:0:12741:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a600/0xb32e3ef184c58720 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333186.151791:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a000/0xb32e3ef184c58719 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2f1 expref: 68 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333186.151813:0:12741:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a600/0xb32e3ef184c58720 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2f1 expref: 67 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333186.151824:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333186.151827:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333186.151832:0:12741:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff4139a600, rc 0) 00000100:00100000:1.0:1763333186.151927:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+67:57511:x1848987613854464:12345-192.168.204.28@tcp:101:fsx.0 Request processed in 471us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333186.151936:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9664 00000100:00100000:2.0:1763333186.159486:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333186.160947:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613854720 00000100:00100000:1.0:1763333186.160968:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613854720 00000100:00100000:1.0:1763333186.161113:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9665 00000100:00100000:1.0:1763333186.161127:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+67:57511:x1848987613854720:12345-192.168.204.28@tcp:36:fsx.0 00010000:00010000:1.0:1763333186.161213:0:6520:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333186.161254:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a600/0xb32e3ef184c58720 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2f1 expref: 67 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333186.161400:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333186.161407:0:6520:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333186.161661:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a000/0xb32e3ef184c58727 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333186.161683:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a000/0xb32e3ef184c58727 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333186.161695:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a000/0xb32e3ef184c58727 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00000001:00080000:1.0:1763333186.161751:0:6520:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935430 00000004:00010000:1.0:1763333186.161779:0:6520:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000bf9a29d7 reply state 0000000063561a28 transno 8589935431 ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a000/0xb32e3ef184c58727 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333186.161792:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a000/0xb32e3ef184c58727 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333186.161799:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333186.161803:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333186.161806:0:6520:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763333186.163245:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+69:57511:x1848987613854720:12345-192.168.204.28@tcp:36:fsx.0 Request processed in 2105us (3760us total) trans 8589935431 rc 0/0 00000100:00100000:1.0:1763333186.163263:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9665 00000020:00080000:1.0:1763333186.163860:0:6520:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763333186.167576:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333186.167630:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333186.167685:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333186.167922:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613854848 00000100:00100000:1.0:1763333186.167935:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613854848 00002000:00010000:1.0:1763333186.168000:0:16635:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (260110->18446744073709551615) 00002000:00100000:1.0:1763333186.168007:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4920c000 with x1848987613854848 ext(260110->18446744073709551615) 00002000:00010000:1.0:1763333186.168024:0:16635:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe4920c000. 00000100:00100000:1.0:1763333186.168065:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613855104 00000100:00100000:1.0:1763333186.168069:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613855104 00002000:00010000:1.0:1763333186.168081:0:16635:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/151 (0->18446744073709551615) 00002000:00100000:1.0:1763333186.168084:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4920e680 with x1848987613855104 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333186.168090:0:16635:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe4920e680. 00000100:00100000:1.0:1763333186.168103:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613854976 00000100:00100000:1.0:1763333186.168105:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613854976 00002000:00010000:1.0:1763333186.168118:0:16635:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/151 (0->18446744073709551615) 00002000:00100000:1.0:1763333186.168121:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45af3480 with x1848987613854976 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333186.168129:0:16635:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe45af3480. 00000100:00100000:1.0:1763333186.168159:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1732 00000100:00100000:1.0:1763333186.168171:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2419:x1848987613854848:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:1.0:1763333186.168506:0:28427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 51450 -> 260110 00002000:00010000:1.0:1763333186.168510:0:28427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:1.0:1763333186.168513:0:28427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1763333186 -> 1763333186 00002000:00010000:1.0:1763333186.168516:0:28427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:1.0:1763333186.168519:0:28427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 112 -> 112 00000100:00100000:0.0:1763333186.168916:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1733 00000100:00100000:0.0:1763333186.168932:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4920e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2419:x1848987613855104:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:0.0:1763333186.169017:0:8412:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333186.169020:0:8412:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:0.0:1763333186.169022:0:8412:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333186.169024:0:8412:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:0.0:1763333186.169026:0:8412:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333186.169109:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2419:x1848987613855104:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 183us (1476us total) trans 21474839053 rc 0/0 00000100:00100000:0.0:1763333186.169118:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1733 00002000:00010000:0.0:1763333186.169123:0:8412:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/151 (0->18446744073709551615) 00002000:00100000:0.0:1763333186.169127:0:8412:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4920e680 with x1848987613855104 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333186.169133:0:8412:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe4920e680. 00000100:00100000:0.0:1763333186.169159:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1734 00000100:00100000:0.0:1763333186.169168:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45af3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+31:2419:x1848987613854976:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:0.0:1763333186.170155:0:8412:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333186.170163:0:8412:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:0.0:1763333186.170166:0:8412:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333186.170168:0:8412:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:0.0:1763333186.170171:0:8412:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:0.0:1763333186.170235:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45af3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+32:2419:x1848987613854976:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 1064us (2545us total) trans 17179871731 rc 0/0 00000100:00100000:0.0:1763333186.170244:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1734 00002000:00010000:0.0:1763333186.170249:0:8412:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/151 (0->18446744073709551615) 00002000:00100000:0.0:1763333186.170252:0:8412:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45af3480 with x1848987613854976 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333186.170259:0:8412:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe45af3480. 00000100:00100000:1.0:1763333186.170892:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4920c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2419:x1848987613854848:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 2718us (3331us total) trans 21474839052 rc 0/0 00000100:00100000:1.0:1763333186.170904:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1732 00002000:00010000:1.0:1763333186.170908:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (260110->18446744073709551615) 00002000:00100000:1.0:1763333186.170911:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4920c000 with x1848987613854848 ext(260110->18446744073709551615) 00002000:00010000:1.0:1763333186.170919:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe4920c000. 00000100:00100000:2.0:1763333186.175637:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333186.175743:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613855232 00000100:00100000:1.0:1763333186.175757:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613855232 00002000:00100000:1.0:1763333186.175817:0:28427:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000401:0x95:0x0] (200704->262143) req@ffff92fe4684ed80 x1848987613855232/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 504/0 e 0 to 0 dl 1763333197 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763333186.175837:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4684ed80 with x1848987613855232 ext(200704->262143) 00002000:00010000:1.0:1763333186.175844:0:28427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe4684ed80 00000100:00100000:1.0:1763333186.175882:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1735 00000100:00100000:1.0:1763333186.175892:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2418:x1848987613855232:12345-192.168.204.28@tcp:3:fsx.0 00000100:00100000:1.0:1763333186.184379:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2418:x1848987613855232:12345-192.168.204.28@tcp:3:fsx.0 Request processed in 8440us (8711us total) trans 0 rc 28672/28672 00000100:00100000:1.0:1763333186.184400:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1735 00002000:00100000:1.0:1763333186.184418:0:28427:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000401:0x95:0x0] (200704->262143) req@ffff92fe4684ed80 x1848987613855232/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 504/440 e 0 to 0 dl 1763333197 ref 1 fl Complete:/600/0 rc 28672/28672 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763333186.184430:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4684ed80 with x1848987613855232 ext(200704->262143) 00002000:00010000:1.0:1763333186.184439:0:28427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe4684ed80 00000100:00100000:2.0:1763333186.188872:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333186.189063:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613855360 00000100:00100000:1.0:1763333186.189078:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613855360 00002000:00100000:1.0:1763333186.189145:0:28427:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000401:0x95:0x0] (204800->208895) req@ffff92fe4684ca80 x1848987613855360/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/0 e 0 to 0 dl 1763333197 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763333186.189159:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4684ca80 with x1848987613855360 ext(204800->208895) 00002000:00010000:1.0:1763333186.189167:0:28427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe4684ca80 00000100:00100000:3.0:1763333186.189788:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1736 00000100:00100000:3.0:1763333186.189806:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2418:x1848987613855360:12345-192.168.204.28@tcp:3:fsx.0 00000100:00100000:3.0:1763333186.190133:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2418:x1848987613855360:12345-192.168.204.28@tcp:3:fsx.0 Request processed in 331us (1275us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1763333186.190144:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1736 00002000:00100000:3.0:1763333186.190155:0:24027:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (204800->208895) req@ffff92fe4684ca80 x1848987613855360/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/4536 e 0 to 0 dl 1763333197 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763333186.190166:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4684ca80 with x1848987613855360 ext(204800->208895) 00002000:00010000:3.0:1763333186.190171:0:24027:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe4684ca80 00000100:00100000:2.0:1763333186.196977:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333186.197168:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613855488 00000100:00100000:1.0:1763333186.197182:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613855488 00002000:00100000:1.0:1763333186.197255:0:28427:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000401:0x95:0x0] (208896->212991) req@ffff92fe4684ea00 x1848987613855488/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/0 e 0 to 0 dl 1763333197 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763333186.197281:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4684ea00 with x1848987613855488 ext(208896->212991) 00002000:00010000:1.0:1763333186.197289:0:28427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe4684ea00 00000100:00100000:1.0:1763333186.197331:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1737 00000100:00100000:1.0:1763333186.197342:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2419:x1848987613855488:12345-192.168.204.28@tcp:3:fsx.0 00000100:00100000:1.0:1763333186.197933:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2419:x1848987613855488:12345-192.168.204.28@tcp:3:fsx.0 Request processed in 589us (968us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1763333186.197942:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1737 00002000:00100000:1.0:1763333186.197951:0:28427:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000401:0x95:0x0] (208896->212991) req@ffff92fe4684ea00 x1848987613855488/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/4536 e 0 to 0 dl 1763333197 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763333186.197961:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4684ea00 with x1848987613855488 ext(208896->212991) 00002000:00010000:1.0:1763333186.197966:0:28427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe4684ea00 00000100:00100000:2.0:1763333186.202553:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333186.202936:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613855616 00000100:00100000:1.0:1763333186.202953:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613855616 00002000:00100000:1.0:1763333186.203104:0:28427:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000401:0x95:0x0] (212992->217087) req@ffff92fe4684d500 x1848987613855616/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/0 e 0 to 0 dl 1763333197 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763333186.203118:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4684d500 with x1848987613855616 ext(212992->217087) 00002000:00010000:1.0:1763333186.203126:0:28427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe4684d500 00000100:00100000:1.0:1763333186.203212:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1738 00000100:00100000:1.0:1763333186.203233:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2419:x1848987613855616:12345-192.168.204.28@tcp:3:fsx.0 00000100:00100000:1.0:1763333186.204165:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2419:x1848987613855616:12345-192.168.204.28@tcp:3:fsx.0 Request processed in 935us (1624us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1763333186.204178:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1738 00002000:00100000:1.0:1763333186.204188:0:28427:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000401:0x95:0x0] (212992->217087) req@ffff92fe4684d500 x1848987613855616/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/4536 e 0 to 0 dl 1763333197 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763333186.204200:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4684d500 with x1848987613855616 ext(212992->217087) 00002000:00010000:1.0:1763333186.204206:0:28427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe4684d500 00000100:00100000:2.0:1763333186.209648:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333186.209939:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613855744 00000100:00100000:1.0:1763333186.209955:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613855744 00002000:00100000:1.0:1763333186.210023:0:28427:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000401:0x95:0x0] (217088->221183) req@ffff92fe4684dc00 x1848987613855744/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/0 e 0 to 0 dl 1763333197 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763333186.210036:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4684dc00 with x1848987613855744 ext(217088->221183) 00002000:00010000:1.0:1763333186.210044:0:28427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe4684dc00 00000100:00100000:1.0:1763333186.210301:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1739 00000100:00100000:1.0:1763333186.210312:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2418:x1848987613855744:12345-192.168.204.28@tcp:3:fsx.0 00000100:00100000:1.0:1763333186.210834:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2418:x1848987613855744:12345-192.168.204.28@tcp:3:fsx.0 Request processed in 519us (1198us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1763333186.210846:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1739 00002000:00100000:1.0:1763333186.210857:0:28427:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000401:0x95:0x0] (217088->221183) req@ffff92fe4684dc00 x1848987613855744/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/4536 e 0 to 0 dl 1763333197 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763333186.210868:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4684dc00 with x1848987613855744 ext(217088->221183) 00002000:00010000:1.0:1763333186.210872:0:28427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe4684dc00 00000100:00100000:2.0:1763333186.215039:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333186.215521:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613855872 00000100:00100000:1.0:1763333186.215540:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613855872 00002000:00100000:1.0:1763333186.215620:0:28427:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000401:0x95:0x0] (221184->225279) req@ffff92fe4684f800 x1848987613855872/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/0 e 0 to 0 dl 1763333197 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763333186.215633:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4684f800 with x1848987613855872 ext(221184->225279) 00002000:00010000:1.0:1763333186.215642:0:28427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe4684f800 00000100:00100000:1.0:1763333186.215682:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1740 00000100:00100000:1.0:1763333186.215693:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2418:x1848987613855872:12345-192.168.204.28@tcp:3:fsx.0 00000100:00100000:1.0:1763333186.216007:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2418:x1848987613855872:12345-192.168.204.28@tcp:3:fsx.0 Request processed in 314us (986us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1763333186.216016:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1740 00002000:00100000:1.0:1763333186.216023:0:28427:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000401:0x95:0x0] (221184->225279) req@ffff92fe4684f800 x1848987613855872/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/4536 e 0 to 0 dl 1763333197 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763333186.216031:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4684f800 with x1848987613855872 ext(221184->225279) 00002000:00010000:1.0:1763333186.216034:0:28427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe4684f800 00000100:00100000:2.0:1763333186.221535:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333186.221692:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613856000 00000100:00100000:3.0:1763333186.221706:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613856000 00002000:00100000:3.0:1763333186.221772:0:24027:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (225280->229375) req@ffff92fe4684df80 x1848987613856000/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/0 e 0 to 0 dl 1763333197 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763333186.221786:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4684df80 with x1848987613856000 ext(225280->229375) 00002000:00010000:3.0:1763333186.221795:0:24027:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe4684df80 00000100:00100000:3.0:1763333186.221834:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1741 00000100:00100000:3.0:1763333186.221845:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2418:x1848987613856000:12345-192.168.204.28@tcp:3:fsx.0 00000100:00100000:3.0:1763333186.222127:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2418:x1848987613856000:12345-192.168.204.28@tcp:3:fsx.0 Request processed in 283us (610us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1763333186.222136:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1741 00002000:00100000:3.0:1763333186.222144:0:24027:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (225280->229375) req@ffff92fe4684df80 x1848987613856000/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/4536 e 0 to 0 dl 1763333197 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763333186.222152:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4684df80 with x1848987613856000 ext(225280->229375) 00002000:00010000:3.0:1763333186.222156:0:24027:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe4684df80 00000100:00100000:2.0:1763333186.226240:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333186.226427:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613856128 00000100:00100000:1.0:1763333186.226442:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613856128 00002000:00100000:1.0:1763333186.226519:0:28427:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000401:0x95:0x0] (229376->233471) req@ffff92fe4684e300 x1848987613856128/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/0 e 0 to 0 dl 1763333197 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763333186.226534:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4684e300 with x1848987613856128 ext(229376->233471) 00002000:00010000:1.0:1763333186.226542:0:28427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe4684e300 00000100:00100000:1.0:1763333186.226588:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1742 00000100:00100000:1.0:1763333186.226600:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4684e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2419:x1848987613856128:12345-192.168.204.28@tcp:3:fsx.0 00000100:00100000:1.0:1763333186.226905:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4684e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2419:x1848987613856128:12345-192.168.204.28@tcp:3:fsx.0 Request processed in 306us (681us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1763333186.226915:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1742 00002000:00100000:1.0:1763333186.226923:0:28427:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000401:0x95:0x0] (229376->233471) req@ffff92fe4684e300 x1848987613856128/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/4536 e 0 to 0 dl 1763333197 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763333186.226933:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe4684e300 with x1848987613856128 ext(229376->233471) 00002000:00010000:1.0:1763333186.226937:0:28427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe4684e300 00000100:00100000:2.0:1763333186.232435:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333186.232598:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613856256 00000100:00100000:3.0:1763333186.232612:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613856256 00002000:00100000:3.0:1763333186.232684:0:24027:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (233472->237567) req@ffff92fe450d9f80 x1848987613856256/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/0 e 0 to 0 dl 1763333197 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763333186.232704:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe450d9f80 with x1848987613856256 ext(233472->237567) 00002000:00010000:3.0:1763333186.232711:0:24027:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe450d9f80 00000100:00100000:3.0:1763333186.232758:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1743 00000100:00100000:3.0:1763333186.232771:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe450d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2418:x1848987613856256:12345-192.168.204.28@tcp:3:fsx.0 00000100:00100000:3.0:1763333186.233088:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe450d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2418:x1848987613856256:12345-192.168.204.28@tcp:3:fsx.0 Request processed in 318us (670us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1763333186.233096:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1743 00002000:00100000:3.0:1763333186.233103:0:24027:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (233472->237567) req@ffff92fe450d9f80 x1848987613856256/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/4536 e 0 to 0 dl 1763333197 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763333186.233111:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe450d9f80 with x1848987613856256 ext(233472->237567) 00002000:00010000:3.0:1763333186.233115:0:24027:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe450d9f80 00000100:00100000:0.0:1763333186.258757:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333186.258863:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613856384 00000100:00100000:1.0:1763333186.258879:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613856384 00002000:00100000:1.0:1763333186.258952:0:28427:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000401:0x95:0x0] (200704->260109) req@ffff92ff77a3d500 x1848987613856384/t0(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/0 e 0 to 0 dl 1763333197 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763333186.258967:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff77a3d500 with x1848987613856384 ext(200704->260109) 00002000:00010000:1.0:1763333186.258975:0:28427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff77a3d500 00000100:00100000:3.0:1763333186.259611:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1744 00000100:00100000:3.0:1763333186.259631:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2419:x1848987613856384:12345-192.168.204.28@tcp:4:fsx.0 00000100:00100000:3.0:1763333186.277916:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2419:x1848987613856384:12345-192.168.204.28@tcp:4:fsx.0 Request processed in 18275us (19156us total) trans 21474839054 rc 0/0 00000100:00100000:3.0:1763333186.277934:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1744 00002000:00100000:3.0:1763333186.277950:0:24027:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (200704->260109) req@ffff92ff77a3d500 x1848987613856384/t21474839054(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/448 e 0 to 0 dl 1763333197 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763333186.277961:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff77a3d500 with x1848987613856384 ext(200704->260109) 00002000:00010000:3.0:1763333186.277970:0:24027:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff77a3d500 00000100:00100000:2.0:1763333186.291129:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333186.291272:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613856512 00000100:00100000:0.0:1763333186.291287:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613856512 00000100:00100000:0.0:1763333186.291397:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6835 00000100:00100000:0.0:1763333186.291412:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe450d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2420:x1848987613856512:12345-192.168.204.28@tcp:16:fsx.0 00000001:00080000:1.0:1763333186.300065:0:24714:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839054 is committed 00000100:00100000:0.0:1763333186.306783:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe450d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2420:x1848987613856512:12345-192.168.204.28@tcp:16:fsx.0 Request processed in 15356us (15651us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333186.306801:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6835 00000100:00100000:1.0:1763333186.310118:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333186.310281:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613856640 00000100:00100000:2.0:1763333186.310296:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613856640 00000100:00100000:2.0:1763333186.310422:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9666 00000100:00100000:2.0:1763333186.310437:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+69:57511:x1848987613856640:12345-192.168.204.28@tcp:101:fsx.0 00010000:00010000:2.0:1763333186.310481:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333186.310516:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e42600/0xb32e3ef184c5872e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a2f8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333186.310657:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e43c00/0xb32e3ef184c58735 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1763333186.310681:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e43c00/0xb32e3ef184c58735 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1763333186.310695:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e43c00/0xb32e3ef184c58735 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00000004:00200000:2.0:1763333186.310731:0:6520:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x55:0x0]: returning size 260110 00000004:00200000:2.0:1763333186.310736:0:6520:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763333186.310759:0:6520:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e43c00/0xb32e3ef184c58735 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1763333186.310793:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e42600/0xb32e3ef184c5872e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2f8 expref: 71 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333186.310814:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e43c00/0xb32e3ef184c58735 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2f8 expref: 70 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333186.310825:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:2.0:1763333186.310828:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333186.310833:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46e43c00, rc 0) 00000100:00100000:2.0:1763333186.310916:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+70:57511:x1848987613856640:12345-192.168.204.28@tcp:101:fsx.0 Request processed in 483us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333186.310924:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9666 00000100:00100000:1.0:1763333186.324641:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333186.324747:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613856768 00000100:00100000:3.0:1763333186.324760:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613856768 00000100:00100000:3.0:1763333186.324852:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1745 00000100:00100000:3.0:1763333186.324864:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2420:x1848987613856768:12345-192.168.204.28@tcp:22:fsx.0 00002000:00010000:3.0:1763333186.331647:0:24027:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 260110 -> 260110 00002000:00010000:3.0:1763333186.331665:0:24027:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:3.0:1763333186.331668:0:24027:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1763333186 -> 1763333186 00002000:00010000:3.0:1763333186.331670:0:24027:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:3.0:1763333186.331673:0:24027:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 112 -> 296 00000100:00100000:3.0:1763333186.331806:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2420:x1848987613856768:12345-192.168.204.28@tcp:22:fsx.0 Request processed in 6931us (7168us total) trans 21474839055 rc 0/0 00000100:00100000:3.0:1763333186.331820:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1745 00000100:00100000:0.0:1763333186.344413:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333186.344706:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613856896 00000100:00100000:3.0:1763333186.344721:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613856896 00002000:00100000:3.0:1763333186.344793:0:24027:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (77824->81919) req@ffff92ff77a3c700 x1848987613856896/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/0 e 0 to 0 dl 1763333197 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763333186.344806:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff77a3c700 with x1848987613856896 ext(77824->81919) 00002000:00010000:3.0:1763333186.344814:0:24027:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff77a3c700 00000100:00100000:3.0:1763333186.344856:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1746 00000100:00100000:3.0:1763333186.344867:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2421:x1848987613856896:12345-192.168.204.28@tcp:3:fsx.0 00000100:00100000:3.0:1763333186.346386:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2421:x1848987613856896:12345-192.168.204.28@tcp:3:fsx.0 Request processed in 1476us (2005us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1763333186.346402:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1746 00002000:00100000:3.0:1763333186.346416:0:24027:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (77824->81919) req@ffff92ff77a3c700 x1848987613856896/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/4536 e 0 to 0 dl 1763333197 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763333186.346427:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff77a3c700 with x1848987613856896 ext(77824->81919) 00002000:00010000:3.0:1763333186.346434:0:24027:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff77a3c700 00000100:00100000:1.0:1763333186.356678:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333186.358001:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613857024 00000100:00100000:3.0:1763333186.358024:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613857024 00002000:00100000:3.0:1763333186.358106:0:24027:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (90112->94207) req@ffff92ff7e00e680 x1848987613857024/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/0 e 0 to 0 dl 1763333197 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763333186.358119:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7e00e680 with x1848987613857024 ext(90112->94207) 00002000:00010000:3.0:1763333186.358127:0:24027:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7e00e680 00000100:00100000:3.0:1763333186.358166:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1747 00000100:00100000:3.0:1763333186.358175:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2419:x1848987613857024:12345-192.168.204.28@tcp:3:fsx.0 00000100:00100000:3.0:1763333186.358515:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2419:x1848987613857024:12345-192.168.204.28@tcp:3:fsx.0 Request processed in 339us (1855us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1763333186.358523:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1747 00002000:00100000:3.0:1763333186.358530:0:24027:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (90112->94207) req@ffff92ff7e00e680 x1848987613857024/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/4536 e 0 to 0 dl 1763333197 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763333186.358539:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7e00e680 with x1848987613857024 ext(90112->94207) 00002000:00010000:3.0:1763333186.358542:0:24027:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7e00e680 00000100:00100000:1.0:1763333186.372204:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333186.373978:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613857152 00000100:00100000:2.0:1763333186.374004:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613857152 00002000:00100000:2.0:1763333186.374097:0:28427:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000401:0x95:0x0] (45056->200703) req@ffff92ff7e00f800 x1848987613857152/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 504/0 e 0 to 0 dl 1763333197 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763333186.374111:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7e00f800 with x1848987613857152 ext(45056->200703) 00002000:00010000:2.0:1763333186.374121:0:28427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7e00f800 00000100:00100000:2.0:1763333186.374178:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1748 00000100:00100000:2.0:1763333186.374190:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2418:x1848987613857152:12345-192.168.204.28@tcp:3:fsx.0 00000100:00100000:2.0:1763333186.385946:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2418:x1848987613857152:12345-192.168.204.28@tcp:3:fsx.0 Request processed in 11735us (13736us total) trans 0 rc 139264/139264 00000100:00100000:2.0:1763333186.385967:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1748 00002000:00100000:2.0:1763333186.385986:0:28427:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000401:0x95:0x0] (45056->200703) req@ffff92ff7e00f800 x1848987613857152/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 504/440 e 0 to 0 dl 1763333197 ref 1 fl Complete:/600/0 rc 139264/139264 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763333186.386000:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7e00f800 with x1848987613857152 ext(45056->200703) 00002000:00010000:2.0:1763333186.386009:0:28427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7e00f800 00000100:00100000:0.0:1763333186.401566:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333186.401705:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613857280 00000100:00100000:2.0:1763333186.401721:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613857280 00000100:00100000:2.0:1763333186.401821:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1749 00000100:00100000:2.0:1763333186.401834:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50067480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2418:x1848987613857280:12345-192.168.204.28@tcp:22:fsx.0 00002000:00010000:2.0:1763333186.402550:0:28427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 260110 -> 260110 00002000:00010000:2.0:1763333186.402558:0:28427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:2.0:1763333186.402560:0:28427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1763333186 -> 1763333186 00002000:00010000:2.0:1763333186.402563:0:28427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:2.0:1763333186.402565:0:28427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 296 -> 304 00000100:00100000:2.0:1763333186.402656:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50067480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2418:x1848987613857280:12345-192.168.204.28@tcp:22:fsx.0 Request processed in 823us (1107us total) trans 21474839056 rc 0/0 00000100:00100000:2.0:1763333186.402665:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1749 00000100:00100000:1.0:1763333186.411593:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333186.411686:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613857408 00000100:00100000:3.0:1763333186.411701:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613857408 00000100:00100000:3.0:1763333186.411784:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1750 00000100:00100000:3.0:1763333186.411795:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2419:x1848987613857408:12345-192.168.204.28@tcp:22:fsx.0 00002000:00010000:0.0:1763333186.414460:0:24027:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 260110 -> 260110 00002000:00010000:0.0:1763333186.414472:0:24027:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:0.0:1763333186.414475:0:24027:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1763333186 -> 1763333186 00002000:00010000:0.0:1763333186.414478:0:24027:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:0.0:1763333186.414481:0:24027:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 304 -> 288 00000100:00100000:0.0:1763333186.414591:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2419:x1848987613857408:12345-192.168.204.28@tcp:22:fsx.0 Request processed in 2788us (3003us total) trans 21474839057 rc 0/0 00000100:00100000:0.0:1763333186.414603:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1750 00000100:00100000:0.0:1763333186.424714:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333186.424805:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613857664 00000100:00100000:1.0:1763333186.424819:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613857664 00000100:00100000:1.0:1763333186.424898:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9667 00000100:00100000:1.0:1763333186.424909:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50067b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+70:57511:x1848987613857664:12345-192.168.204.28@tcp:36:fsx.0 00010000:00010000:1.0:1763333186.425009:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333186.425045:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e43c00/0xb32e3ef184c58735 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2f8 expref: 70 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333186.425071:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333186.425077:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333186.425640:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b06600/0xb32e3ef184c5873c lrc: 3/0,1 mode: --/PW res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333186.425664:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b06600/0xb32e3ef184c5873c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333186.425675:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b06600/0xb32e3ef184c5873c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT0 00000001:00080000:1.0:1763333186.425737:0:12741:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935432 00000004:00010000:1.0:1763333186.425766:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f2cc5f6f reply state 00000000d5d4765b transno 8589935433 ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b06600/0xb32e3ef184c5873c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333186.425779:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b06600/0xb32e3ef184c5873c lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333186.425784:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333186.425787:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333186.425790:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763333186.426620:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50067b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+72:57511:x1848987613857664:12345-192.168.204.28@tcp:36:fsx.0 Request processed in 1703us (1910us total) trans 8589935433 rc 0/0 00000100:00100000:1.0:1763333186.426631:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9667 00000020:00080000:1.0:1763333186.426640:0:12741:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763333186.434538:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333186.434574:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333186.434618:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333186.434704:0:28429:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613857920 00000100:00100000:3.0:1763333186.434719:0:28429:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613857920 00002000:00010000:3.0:1763333186.434780:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/151 (0->18446744073709551615) 00002000:00100000:3.0:1763333186.434786:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe450da300 with x1848987613857920 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333186.434804:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe450da300. 00000100:00100000:3.0:1763333186.434843:0:28429:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613857792 00000100:00100000:3.0:1763333186.434847:0:28429:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613857792 00002000:00010000:3.0:1763333186.434862:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (167895->18446744073709551615) 00002000:00100000:3.0:1763333186.434866:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe450db800 with x1848987613857792 ext(167895->18446744073709551615) 00002000:00010000:3.0:1763333186.434873:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe450db800. 00000100:00100000:3.0:1763333186.434883:0:28429:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613858048 00000100:00100000:3.0:1763333186.434886:0:28429:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613858048 00002000:00010000:3.0:1763333186.434894:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/151 (0->18446744073709551615) 00002000:00100000:3.0:1763333186.434897:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe450d9c00 with x1848987613858048 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333186.434902:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe450d9c00. 00000100:00100000:3.0:1763333186.434922:0:28429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1751 00000100:00100000:3.0:1763333186.434932:0:28429:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe450da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+32:2421:x1848987613857920:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:3.0:1763333186.435141:0:28429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333186.435145:0:28429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:3.0:1763333186.435148:0:28429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333186.435150:0:28429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:3.0:1763333186.435153:0:28429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:3.0:1763333186.435231:0:28429:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe450da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+33:2421:x1848987613857920:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 299us (709us total) trans 17179871732 rc 0/0 00000100:00100000:3.0:1763333186.435238:0:28429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1751 00002000:00010000:3.0:1763333186.435242:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/151 (0->18446744073709551615) 00002000:00100000:3.0:1763333186.435245:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe450da300 with x1848987613857920 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333186.435249:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe450da300. 00000100:00100000:3.0:1763333186.435277:0:28429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1752 00000100:00100000:3.0:1763333186.435285:0:28429:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe450db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2421:x1848987613857792:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:3.0:1763333186.435655:0:28429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 260110 -> 167895 00002000:00010000:3.0:1763333186.435659:0:28429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:3.0:1763333186.435661:0:28429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1763333186 -> 1763333186 00002000:00010000:3.0:1763333186.435663:0:28429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:3.0:1763333186.435666:0:28429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 288 -> 184 00000100:00100000:3.0:1763333186.435689:0:28429:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe450db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2421:x1848987613857792:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 405us (1114us total) trans 21474839058 rc 0/0 00000100:00100000:3.0:1763333186.435696:0:28429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1752 00002000:00010000:3.0:1763333186.435699:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (167895->18446744073709551615) 00002000:00100000:3.0:1763333186.435702:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe450db800 with x1848987613857792 ext(167895->18446744073709551615) 00002000:00010000:3.0:1763333186.435706:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe450db800. 00000100:00100000:3.0:1763333186.435720:0:28429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1753 00000100:00100000:3.0:1763333186.435727:0:28429:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe450d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2421:x1848987613858048:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:3.0:1763333186.435778:0:28429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333186.435781:0:28429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:3.0:1763333186.435783:0:28429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763333186.435786:0:28429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:3.0:1763333186.435788:0:28429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333186.435808:0:28429:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe450d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2421:x1848987613858048:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 82us (1190us total) trans 21474839059 rc 0/0 00000100:00100000:3.0:1763333186.435815:0:28429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1753 00002000:00010000:3.0:1763333186.435817:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/151 (0->18446744073709551615) 00002000:00100000:3.0:1763333186.435820:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe450d9c00 with x1848987613858048 ext(0->18446744073709551615) 00002000:00010000:3.0:1763333186.435824:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe450d9c00. 00000100:00100000:0.0:1763333186.441722:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333186.441846:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613858176 00000100:00100000:1.0:1763333186.441860:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613858176 00000100:00100000:2.0:1763333186.444580:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9668 00000100:00100000:2.0:1763333186.444619:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+72:57511:x1848987613858176:12345-192.168.204.28@tcp:101:fsx.0 00010000:00010000:2.0:1763333186.444659:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333186.444691:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e43c00/0xb32e3ef184c58743 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a2ff expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333186.444827:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e42600/0xb32e3ef184c5874a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1763333186.444848:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e42600/0xb32e3ef184c5874a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1763333186.444863:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e42600/0xb32e3ef184c5874a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00000004:00200000:2.0:1763333186.444898:0:6520:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x55:0x0]: returning size 167895 00000004:00200000:2.0:1763333186.444904:0:6520:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763333186.444929:0:6520:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e42600/0xb32e3ef184c5874a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1763333186.444959:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e43c00/0xb32e3ef184c58743 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2ff expref: 74 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333186.444984:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e42600/0xb32e3ef184c5874a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2ff expref: 73 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333186.444993:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:2.0:1763333186.444997:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333186.445002:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46e42600, rc 0) 00000100:00100000:2.0:1763333186.445097:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+73:57511:x1848987613858176:12345-192.168.204.28@tcp:101:fsx.0 Request processed in 499us (3390us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333186.445106:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9668 00000100:00100000:3.0:1763333186.454804:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333186.454956:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613858432 00000100:00100000:1.0:1763333186.454971:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613858432 00000100:00100000:1.0:1763333186.455067:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9669 00000100:00100000:1.0:1763333186.455081:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45af1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+73:57511:x1848987613858432:12345-192.168.204.28@tcp:36:fsx.0 00010000:00010000:1.0:1763333186.455167:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333186.455213:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e42600/0xb32e3ef184c5874a lrc: 0/0,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 17 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2ff expref: 73 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333186.455239:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333186.455246:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333186.455589:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b06200/0xb32e3ef184c58751 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333186.455617:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b06200/0xb32e3ef184c58751 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333186.455629:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b06200/0xb32e3ef184c58751 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT0 00000001:00080000:1.0:1763333186.455682:0:12741:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935434 00000004:00010000:1.0:1763333186.455710:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000016f0aca4 reply state 000000009c4e7524 transno 8589935435 ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b06200/0xb32e3ef184c58751 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333186.455723:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b06200/0xb32e3ef184c58751 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333186.455730:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333186.455734:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333186.455737:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763333186.455855:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45af1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+75:57511:x1848987613858432:12345-192.168.204.28@tcp:36:fsx.0 Request processed in 776us (1068us total) trans 8589935435 rc 0/0 00000100:00100000:1.0:1763333186.455863:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9669 00000020:00080000:1.0:1763333186.455870:0:12741:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763333186.460748:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333186.462235:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613858560 00000100:00100000:1.0:1763333186.462254:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613858560 00002000:00010000:1.0:1763333186.462321:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (49756->18446744073709551615) 00002000:00100000:1.0:1763333186.462326:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe46a6d180 with x1848987613858560 ext(49756->18446744073709551615) 00002000:00010000:1.0:1763333186.462342:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe46a6d180. 00000100:00100000:3.0:1763333186.463445:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333186.464967:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333186.465166:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613858688 00000100:00100000:1.0:1763333186.465180:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613858688 00002000:00010000:1.0:1763333186.465235:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/151 (0->18446744073709551615) 00002000:00100000:1.0:1763333186.465241:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45af2d80 with x1848987613858688 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333186.465268:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe45af2d80. 00000100:00100000:2.0:1763333186.465596:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1754 00000100:00100000:2.0:1763333186.465614:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe46a6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2421:x1848987613858560:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:2.0:1763333186.466078:0:8412:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 167895 -> 49756 00002000:00010000:2.0:1763333186.466083:0:8412:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:2.0:1763333186.466086:0:8412:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1763333186 -> 1763333186 00002000:00010000:2.0:1763333186.466089:0:8412:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:2.0:1763333186.466091:0:8412:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 184 -> 112 00000100:00100000:2.0:1763333186.466188:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe46a6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2421:x1848987613858560:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 579us (5457us total) trans 21474839060 rc 0/0 00000100:00100000:2.0:1763333186.466198:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1754 00002000:00010000:2.0:1763333186.466203:0:8412:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (49756->18446744073709551615) 00002000:00100000:2.0:1763333186.466206:0:8412:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe46a6d180 with x1848987613858560 ext(49756->18446744073709551615) 00002000:00010000:2.0:1763333186.466213:0:8412:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe46a6d180. 00000100:00100000:2.0:1763333186.466243:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1755 00000100:00100000:2.0:1763333186.466252:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45af2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+33:2421:x1848987613858688:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:2.0:1763333186.466373:0:8412:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333186.466377:0:8412:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:2.0:1763333186.466379:0:8412:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333186.466381:0:8412:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:2.0:1763333186.466383:0:8412:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:2.0:1763333186.466406:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45af2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+34:2421:x1848987613858688:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 155us (2971us total) trans 17179871733 rc 0/0 00000100:00100000:2.0:1763333186.466412:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1755 00002000:00010000:2.0:1763333186.466416:0:8412:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/151 (0->18446744073709551615) 00002000:00100000:2.0:1763333186.466418:0:8412:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45af2d80 with x1848987613858688 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333186.466424:0:8412:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe45af2d80. 00000100:00100000:1.0:1763333186.469102:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613858816 00000100:00100000:1.0:1763333186.469124:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613858816 00002000:00010000:1.0:1763333186.469186:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/151 (0->18446744073709551615) 00002000:00100000:1.0:1763333186.469193:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45af2a00 with x1848987613858816 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333186.469210:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe45af2a00. 00000100:00100000:1.0:1763333186.469835:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1756 00000100:00100000:1.0:1763333186.469849:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45af2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2421:x1848987613858816:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:1.0:1763333186.470052:0:28427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333186.470057:0:28427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:1.0:1763333186.470059:0:28427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333186.470062:0:28427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:1.0:1763333186.470065:0:28427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333186.470146:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45af2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2421:x1848987613858816:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 300us (5189us total) trans 21474839061 rc 0/0 00000100:00100000:1.0:1763333186.470155:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1756 00002000:00010000:1.0:1763333186.470160:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/151 (0->18446744073709551615) 00002000:00100000:1.0:1763333186.470163:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45af2a00 with x1848987613858816 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333186.470169:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe45af2a00. 00000100:00100000:0.0:1763333186.475074:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333186.475216:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613858944 00000100:00100000:2.0:1763333186.475233:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613858944 00000100:00100000:2.0:1763333186.475325:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9670 00000100:00100000:2.0:1763333186.475337:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+75:57511:x1848987613858944:12345-192.168.204.28@tcp:101:fsx.0 00010000:00010000:2.0:1763333186.475409:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333186.475439:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e43c00/0xb32e3ef184c58758 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a306 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333186.475569:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e42600/0xb32e3ef184c5875f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 18 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1763333186.475590:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e42600/0xb32e3ef184c5875f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 18 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1763333186.475604:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e42600/0xb32e3ef184c5875f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 18 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00000004:00200000:2.0:1763333186.475637:0:6520:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x55:0x0]: returning size 49756 00000004:00200000:2.0:1763333186.475642:0:6520:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763333186.475669:0:6520:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e42600/0xb32e3ef184c5875f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 18 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1763333186.475701:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e43c00/0xb32e3ef184c58758 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a306 expref: 77 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333186.475721:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e42600/0xb32e3ef184c5875f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 17 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a306 expref: 76 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333186.475731:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:2.0:1763333186.475734:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333186.475739:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46e42600, rc 0) 00000100:00100000:2.0:1763333186.475818:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+76:57511:x1848987613858944:12345-192.168.204.28@tcp:101:fsx.0 Request processed in 482us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333186.475826:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9670 00000100:00100000:2.0:1763333186.480720:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333186.481390:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613859200 00000100:00100000:1.0:1763333186.481408:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613859200 00000100:00100000:1.0:1763333186.481496:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9671 00000100:00100000:1.0:1763333186.481509:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe450d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+76:57511:x1848987613859200:12345-192.168.204.28@tcp:36:fsx.0 00010000:00010000:1.0:1763333186.481602:0:12741:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333186.481648:0:12741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e42600/0xb32e3ef184c5875f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 18 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a306 expref: 76 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333186.481682:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333186.481689:0:12741:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333186.481971:0:12741:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b07a00/0xb32e3ef184c58766 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT flags: 0x40000000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333186.481995:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b07a00/0xb32e3ef184c58766 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333186.482007:0:12741:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b07a00/0xb32e3ef184c58766 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT0 00000001:00080000:1.0:1763333186.482063:0:12741:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935436 00000004:00010000:1.0:1763333186.482093:0:12741:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ec3a8d9d reply state 00000000644611ba transno 8589935437 ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b07a00/0xb32e3ef184c58766 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333186.482109:0:12741:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b07a00/0xb32e3ef184c58766 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333186.482115:0:12741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333186.482118:0:12741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333186.482121:0:12741:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763333186.482249:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe450d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+78:57511:x1848987613859200:12345-192.168.204.28@tcp:36:fsx.0 Request processed in 742us (1547us total) trans 8589935437 rc 0/0 00000100:00100000:1.0:1763333186.482266:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9671 00000020:00080000:1.0:1763333186.482273:0:12741:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763333186.485553:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333186.485671:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613859328 00000100:00100000:2.0:1763333186.485685:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613859328 00002000:00010000:2.0:1763333186.485737:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (243389->18446744073709551615) 00002000:00100000:2.0:1763333186.485743:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45af0700 with x1848987613859328 ext(243389->18446744073709551615) 00002000:00010000:2.0:1763333186.485758:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe45af0700. 00000100:00100000:2.0:1763333186.485801:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1757 00000100:00100000:2.0:1763333186.485812:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45af0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2420:x1848987613859328:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:2.0:1763333186.486087:0:24027:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 49756 -> 243389 00002000:00010000:2.0:1763333186.486092:0:24027:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:2.0:1763333186.486094:0:24027:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1763333186 -> 1763333186 00002000:00010000:2.0:1763333186.486097:0:24027:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:2.0:1763333186.486100:0:24027:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 112 -> 112 00000100:00100000:2.0:1763333186.486183:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45af0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2420:x1848987613859328:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 372us (643us total) trans 21474839062 rc 0/0 00000100:00100000:2.0:1763333186.486192:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1757 00002000:00010000:2.0:1763333186.486196:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (243389->18446744073709551615) 00002000:00100000:2.0:1763333186.486199:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45af0700 with x1848987613859328 ext(243389->18446744073709551615) 00002000:00010000:2.0:1763333186.486203:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe45af0700. 00000100:00100000:3.0:1763333186.488494:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333186.489613:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613859456 00000100:00100000:2.0:1763333186.489633:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613859456 00000100:00100000:3.0:1763333186.489776:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00002000:00010000:2.0:1763333186.490629:0:8412:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/151 (0->18446744073709551615) 00002000:00100000:2.0:1763333186.490640:0:8412:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45af0e00 with x1848987613859456 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333186.490663:0:8412:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe45af0e00. 00000100:00100000:0.0:1763333186.490818:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613859584 00000100:00100000:0.0:1763333186.490828:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613859584 00002000:00010000:0.0:1763333186.490866:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/151 (0->18446744073709551615) 00002000:00100000:0.0:1763333186.490870:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45af0a80 with x1848987613859584 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333186.490878:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe45af0a80. 00000100:00100000:0.0:1763333186.490925:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1758 00000100:00100000:0.0:1763333186.490937:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45af0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+34:2421:x1848987613859456:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:0.0:1763333186.491199:0:24027:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333186.491204:0:24027:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:0.0:1763333186.491207:0:24027:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333186.491209:0:24027:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:0.0:1763333186.491212:0:24027:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:0.0:1763333186.491304:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45af0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+35:2421:x1848987613859456:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 367us (2822us total) trans 17179871734 rc 0/0 00000100:00100000:0.0:1763333186.491316:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1758 00002000:00010000:0.0:1763333186.491322:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/151 (0->18446744073709551615) 00002000:00100000:0.0:1763333186.491324:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45af0e00 with x1848987613859456 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333186.491329:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe45af0e00. 00000100:00100000:0.0:1763333186.491381:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1759 00000100:00100000:0.0:1763333186.491390:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45af0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2421:x1848987613859584:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:0.0:1763333186.491477:0:24027:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333186.491480:0:24027:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:0.0:1763333186.491482:0:24027:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333186.491485:0:24027:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:0.0:1763333186.491487:0:24027:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763333186.491509:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45af0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2421:x1848987613859584:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 121us (1738us total) trans 21474839063 rc 0/0 00000100:00100000:0.0:1763333186.491516:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1759 00002000:00010000:0.0:1763333186.491519:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/151 (0->18446744073709551615) 00002000:00100000:0.0:1763333186.491522:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45af0a80 with x1848987613859584 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333186.491526:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe45af0a80. 00000100:00100000:0.0:1763333186.496664:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333186.496768:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613859712 00000100:00100000:1.0:1763333186.496782:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613859712 00002000:00100000:1.0:1763333186.496841:0:28427:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000401:0x95:0x0] (217088->221183) req@ffff92fe469a0380 x1848987613859712/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/0 e 0 to 0 dl 1763333197 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763333186.496855:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe469a0380 with x1848987613859712 ext(217088->221183) 00002000:00010000:1.0:1763333186.496863:0:28427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe469a0380 00000100:00100000:1.0:1763333186.497482:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1760 00000100:00100000:1.0:1763333186.497497:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2421:x1848987613859712:12345-192.168.204.28@tcp:3:fsx.0 00000100:00100000:1.0:1763333186.497816:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2421:x1848987613859712:12345-192.168.204.28@tcp:3:fsx.0 Request processed in 321us (1164us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1763333186.497825:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1760 00002000:00100000:1.0:1763333186.497835:0:28427:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000401:0x95:0x0] (217088->221183) req@ffff92fe469a0380 x1848987613859712/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/4536 e 0 to 0 dl 1763333197 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763333186.497845:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe469a0380 with x1848987613859712 ext(217088->221183) 00002000:00010000:1.0:1763333186.497850:0:28427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe469a0380 00000100:00100000:3.0:1763333186.502497:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333186.505121:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613859840 00000100:00100000:2.0:1763333186.505146:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613859840 00002000:00100000:2.0:1763333186.505234:0:8412:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (221184->225279) req@ffff92fe45af3b80 x1848987613859840/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/0 e 0 to 0 dl 1763333197 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763333186.505248:0:8412:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45af3b80 with x1848987613859840 ext(221184->225279) 00002000:00010000:2.0:1763333186.505268:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe45af3b80 00000100:00100000:2.0:1763333186.505319:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1761 00000100:00100000:2.0:1763333186.505331:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45af3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2420:x1848987613859840:12345-192.168.204.28@tcp:3:fsx.0 00000100:00100000:2.0:1763333186.507787:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45af3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2420:x1848987613859840:12345-192.168.204.28@tcp:3:fsx.0 Request processed in 2446us (5295us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1763333186.507802:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1761 00002000:00100000:2.0:1763333186.507813:0:8412:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (221184->225279) req@ffff92fe45af3b80 x1848987613859840/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/4536 e 0 to 0 dl 1763333197 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763333186.507825:0:8412:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45af3b80 with x1848987613859840 ext(221184->225279) 00002000:00010000:2.0:1763333186.507832:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe45af3b80 00000100:00100000:3.0:1763333186.517772:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333186.517918:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613859968 00000100:00100000:2.0:1763333186.517941:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613859968 00002000:00100000:2.0:1763333186.518016:0:8412:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (225280->229375) req@ffff92fe45af2680 x1848987613859968/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/0 e 0 to 0 dl 1763333197 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763333186.518030:0:8412:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45af2680 with x1848987613859968 ext(225280->229375) 00002000:00010000:2.0:1763333186.518037:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe45af2680 00000100:00100000:2.0:1763333186.518082:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1762 00000100:00100000:2.0:1763333186.518092:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45af2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2418:x1848987613859968:12345-192.168.204.28@tcp:3:fsx.0 00000100:00100000:2.0:1763333186.518381:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45af2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2418:x1848987613859968:12345-192.168.204.28@tcp:3:fsx.0 Request processed in 256us (593us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1763333186.518390:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1762 00002000:00100000:2.0:1763333186.518398:0:8412:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (225280->229375) req@ffff92fe45af2680 x1848987613859968/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/4536 e 0 to 0 dl 1763333197 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763333186.518406:0:8412:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45af2680 with x1848987613859968 ext(225280->229375) 00002000:00010000:2.0:1763333186.518410:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe45af2680 00000100:00100000:0.0:1763333186.526674:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333186.526771:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613860096 00000100:00100000:1.0:1763333186.526788:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613860096 00002000:00100000:1.0:1763333186.526851:0:28427:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000401:0x95:0x0] (229376->233471) req@ffff92fe469a2a00 x1848987613860096/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/0 e 0 to 0 dl 1763333197 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763333186.526863:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe469a2a00 with x1848987613860096 ext(229376->233471) 00002000:00010000:1.0:1763333186.526869:0:28427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe469a2a00 00000100:00100000:1.0:1763333186.526911:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1763 00000100:00100000:1.0:1763333186.526921:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2421:x1848987613860096:12345-192.168.204.28@tcp:3:fsx.0 00000100:00100000:1.0:1763333186.527140:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2421:x1848987613860096:12345-192.168.204.28@tcp:3:fsx.0 Request processed in 220us (479us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1763333186.527147:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1763 00002000:00100000:1.0:1763333186.527154:0:28427:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000401:0x95:0x0] (229376->233471) req@ffff92fe469a2a00 x1848987613860096/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/4536 e 0 to 0 dl 1763333197 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763333186.527162:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe469a2a00 with x1848987613860096 ext(229376->233471) 00002000:00010000:1.0:1763333186.527167:0:28427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe469a2a00 00000100:00100000:0.0:1763333186.530860:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333186.532104:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613860224 00000100:00100000:2.0:1763333186.532121:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613860224 00002000:00100000:2.0:1763333186.532206:0:8412:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (233472->237567) req@ffff92fe469a0700 x1848987613860224/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/0 e 0 to 0 dl 1763333197 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763333186.532221:0:8412:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe469a0700 with x1848987613860224 ext(233472->237567) 00002000:00010000:2.0:1763333186.532229:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe469a0700 00000100:00100000:2.0:1763333186.532281:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1764 00000100:00100000:2.0:1763333186.532292:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2420:x1848987613860224:12345-192.168.204.28@tcp:3:fsx.0 00000100:00100000:2.0:1763333186.532761:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2420:x1848987613860224:12345-192.168.204.28@tcp:3:fsx.0 Request processed in 469us (1915us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1763333186.532770:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1764 00002000:00100000:2.0:1763333186.532779:0:8412:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (233472->237567) req@ffff92fe469a0700 x1848987613860224/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/4536 e 0 to 0 dl 1763333197 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763333186.532787:0:8412:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe469a0700 with x1848987613860224 ext(233472->237567) 00002000:00010000:2.0:1763333186.532792:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe469a0700 00000100:00100000:3.0:1763333186.541151:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333186.541940:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613860352 00000100:00100000:2.0:1763333186.541957:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613860352 00002000:00100000:2.0:1763333186.542027:0:8412:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (237568->241663) req@ffff92fe45af1180 x1848987613860352/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/0 e 0 to 0 dl 1763333197 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763333186.542041:0:8412:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45af1180 with x1848987613860352 ext(237568->241663) 00002000:00010000:2.0:1763333186.542047:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe45af1180 00000100:00100000:2.0:1763333186.543344:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1765 00000100:00100000:2.0:1763333186.543375:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45af1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2421:x1848987613860352:12345-192.168.204.28@tcp:3:fsx.0 00000100:00100000:2.0:1763333186.543651:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45af1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2421:x1848987613860352:12345-192.168.204.28@tcp:3:fsx.0 Request processed in 285us (2515us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1763333186.543659:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1765 00002000:00100000:2.0:1763333186.543670:0:8412:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (237568->241663) req@ffff92fe45af1180 x1848987613860352/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/4536 e 0 to 0 dl 1763333197 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763333186.543680:0:8412:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45af1180 with x1848987613860352 ext(237568->241663) 00002000:00010000:2.0:1763333186.543686:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe45af1180 00000100:00100000:1.0:1763333186.547832:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333186.548054:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613860480 00000100:00100000:2.0:1763333186.548069:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613860480 00002000:00100000:2.0:1763333186.548132:0:8412:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (241664->245759) req@ffff92ff7e00fb80 x1848987613860480/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/0 e 0 to 0 dl 1763333197 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763333186.548144:0:8412:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7e00fb80 with x1848987613860480 ext(241664->245759) 00002000:00010000:2.0:1763333186.548150:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7e00fb80 00000100:00100000:2.0:1763333186.548185:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1766 00000100:00100000:2.0:1763333186.548195:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2420:x1848987613860480:12345-192.168.204.28@tcp:3:fsx.0 00000100:00100000:2.0:1763333186.548471:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2420:x1848987613860480:12345-192.168.204.28@tcp:3:fsx.0 Request processed in 277us (654us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1763333186.548483:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1766 00002000:00100000:2.0:1763333186.548490:0:8412:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (241664->245759) req@ffff92ff7e00fb80 x1848987613860480/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/4536 e 0 to 0 dl 1763333197 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763333186.548499:0:8412:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7e00fb80 with x1848987613860480 ext(241664->245759) 00002000:00010000:2.0:1763333186.548502:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7e00fb80 00000100:00100000:0.0:1763333186.552307:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333186.552619:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613860608 00000100:00100000:1.0:1763333186.552633:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613860608 00002000:00100000:1.0:1763333186.552697:0:28427:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000401:0x95:0x0] (217088->243388) req@ffff92fe469a3480 x1848987613860608/t0(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/0 e 0 to 0 dl 1763333197 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763333186.552710:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe469a3480 with x1848987613860608 ext(217088->243388) 00002000:00010000:1.0:1763333186.552717:0:28427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe469a3480 00000100:00100000:1.0:1763333186.552745:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1767 00000100:00100000:1.0:1763333186.552754:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2418:x1848987613860608:12345-192.168.204.28@tcp:4:fsx.0 00000100:00100000:1.0:1763333186.561589:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:2418:x1848987613860608:12345-192.168.204.28@tcp:4:fsx.0 Request processed in 8816us (9280us total) trans 21474839064 rc 0/0 00000100:00100000:1.0:1763333186.561607:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1767 00002000:00100000:1.0:1763333186.561625:0:28427:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000401:0x95:0x0] (217088->243388) req@ffff92fe469a3480 x1848987613860608/t21474839064(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/448 e 0 to 0 dl 1763333197 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763333186.561638:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe469a3480 with x1848987613860608 ext(217088->243388) 00002000:00010000:1.0:1763333186.561648:0:28427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe469a3480 00000100:00100000:0.0:1763333186.570961:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333186.571122:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613860736 00000100:00100000:1.0:1763333186.571136:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613860736 00000100:00100000:1.0:1763333186.571964:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6836 00000100:00100000:1.0:1763333186.571979:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:2420:x1848987613860736:12345-192.168.204.28@tcp:16:fsx.0 00000001:00080000:2.0:1763333186.575542:0:24714:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839064 is committed 00000100:00100000:1.0:1763333186.575948:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2420:x1848987613860736:12345-192.168.204.28@tcp:16:fsx.0 Request processed in 3967us (4991us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333186.575960:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6836 00000100:00100000:0.0:1763333186.589593:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333186.589726:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613860864 00000100:00100000:2.0:1763333186.589736:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613860864 00000100:00100000:2.0:1763333186.589837:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9672 00000100:00100000:2.0:1763333186.589848:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+78:57511:x1848987613860864:12345-192.168.204.28@tcp:101:fsx.0 00010000:00010000:2.0:1763333186.589871:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333186.589894:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e43c00/0xb32e3ef184c5876d lrc: 2/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 18 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a30d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333186.589996:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e42600/0xb32e3ef184c58774 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 19 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1763333186.590013:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e42600/0xb32e3ef184c58774 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 19 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1763333186.590025:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e42600/0xb32e3ef184c58774 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 19 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00000004:00200000:2.0:1763333186.590059:0:6520:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x55:0x0]: returning size 243389 00000004:00200000:2.0:1763333186.590064:0:6520:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763333186.590085:0:6520:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e42600/0xb32e3ef184c58774 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 19 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1763333186.590115:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e43c00/0xb32e3ef184c5876d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a30d expref: 80 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333186.590135:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e42600/0xb32e3ef184c58774 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 18 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a30d expref: 79 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333186.590145:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:2.0:1763333186.590148:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333186.590152:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46e42600, rc 0) 00000100:00100000:2.0:1763333186.593735:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+79:57511:x1848987613860864:12345-192.168.204.28@tcp:101:fsx.0 Request processed in 3875us (4142us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333186.593748:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9672 00000100:00100000:0.0:1763333186.600170:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333186.600276:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613860992 00000100:00100000:1.0:1763333186.600287:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613860992 00000100:00100000:1.0:1763333186.600406:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1768 00000100:00100000:1.0:1763333186.600419:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2418:x1848987613860992:12345-192.168.204.28@tcp:22:fsx.0 00002000:00010000:1.0:1763333186.600765:0:28427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 243389 -> 243389 00002000:00010000:1.0:1763333186.600770:0:28427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:1.0:1763333186.600772:0:28427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1763333186 -> 1763333186 00002000:00010000:1.0:1763333186.600774:0:28427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:1.0:1763333186.600776:0:28427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 112 -> 264 00000100:00100000:1.0:1763333186.600830:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2418:x1848987613860992:12345-192.168.204.28@tcp:22:fsx.0 Request processed in 413us (671us total) trans 21474839065 rc 0/0 00000100:00100000:1.0:1763333186.600838:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1768 00000100:00100000:0.0:1763333186.604541:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333186.604935:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613861248 00000100:00100000:2.0:1763333186.604946:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613861248 00000100:00100000:2.0:1763333186.605009:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9673 00000100:00100000:2.0:1763333186.605019:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+79:57511:x1848987613861248:12345-192.168.204.28@tcp:36:fsx.0 00010000:00010000:2.0:1763333186.605085:0:6520:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333186.605113:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e42600/0xb32e3ef184c58774 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 19 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a30d expref: 79 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333186.605132:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:2.0:1763333186.605137:0:6520:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333186.605322:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e43c00/0xb32e3ef184c5877b lrc: 3/0,1 mode: --/PW res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 18 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1763333186.605339:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e43c00/0xb32e3ef184c5877b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1763333186.605377:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e43c00/0xb32e3ef184c5877b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00000001:00080000:2.0:1763333186.605432:0:6520:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935438 00000004:00010000:2.0:1763333186.605454:0:6520:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000772be9fc reply state 00000000285d893c transno 8589935439 ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e43c00/0xb32e3ef184c5877b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1763333186.605467:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e43c00/0xb32e3ef184c5877b lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1763333186.605473:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:2.0:1763333186.605476:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333186.605479:0:6520:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763333186.606092:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+81:57511:x1848987613861248:12345-192.168.204.28@tcp:36:fsx.0 Request processed in 1069us (1556us total) trans 8589935439 rc 0/0 00000100:00100000:2.0:1763333186.606100:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9673 00000020:00080000:2.0:1763333186.606107:0:6520:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763333186.615065:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333186.615107:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333186.615160:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333186.615243:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613861504 00000100:00100000:1.0:1763333186.615254:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613861504 00002000:00010000:1.0:1763333186.615305:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/151 (0->18446744073709551615) 00002000:00100000:1.0:1763333186.615310:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe469a0a80 with x1848987613861504 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333186.615322:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe469a0a80. 00000100:00100000:1.0:1763333186.615370:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613861376 00000100:00100000:1.0:1763333186.615374:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613861376 00002000:00010000:1.0:1763333186.615386:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (49239->18446744073709551615) 00002000:00100000:1.0:1763333186.615390:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe42f0d180 with x1848987613861376 ext(49239->18446744073709551615) 00002000:00010000:1.0:1763333186.615396:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe42f0d180. 00000100:00100000:1.0:1763333186.615406:0:28427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613861632 00000100:00100000:1.0:1763333186.615409:0:28427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613861632 00002000:00010000:1.0:1763333186.615417:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/151 (0->18446744073709551615) 00002000:00100000:1.0:1763333186.615420:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45c4dc00 with x1848987613861632 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333186.615425:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe45c4dc00. 00000100:00100000:1.0:1763333186.615439:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1769 00000100:00100000:1.0:1763333186.615449:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+35:2421:x1848987613861504:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:1.0:1763333186.615594:0:28427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333186.615598:0:28427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:1.0:1763333186.615600:0:28427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333186.615603:0:28427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:1.0:1763333186.615605:0:28427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:1.0:1763333186.615659:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+36:2421:x1848987613861504:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 210us (604us total) trans 17179871735 rc 0/0 00000100:00100000:1.0:1763333186.615666:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1769 00002000:00010000:1.0:1763333186.615670:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/151 (0->18446744073709551615) 00002000:00100000:1.0:1763333186.615673:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe469a0a80 with x1848987613861504 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333186.615677:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe469a0a80. 00000100:00100000:1.0:1763333186.615694:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1770 00000100:00100000:1.0:1763333186.615701:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42f0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2421:x1848987613861376:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:1.0:1763333186.615918:0:28427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 243389 -> 49239 00002000:00010000:1.0:1763333186.615922:0:28427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:1.0:1763333186.615924:0:28427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1763333186 -> 1763333186 00002000:00010000:1.0:1763333186.615927:0:28427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:1.0:1763333186.615929:0:28427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 264 -> 104 00000100:00100000:1.0:1763333186.615952:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42f0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2421:x1848987613861376:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 251us (844us total) trans 21474839066 rc 0/0 00000100:00100000:1.0:1763333186.615958:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1770 00002000:00010000:1.0:1763333186.615961:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (49239->18446744073709551615) 00002000:00100000:1.0:1763333186.615964:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe42f0d180 with x1848987613861376 ext(49239->18446744073709551615) 00002000:00010000:1.0:1763333186.615968:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe42f0d180. 00000100:00100000:1.0:1763333186.615981:0:28427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1771 00000100:00100000:1.0:1763333186.615988:0:28427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2421:x1848987613861632:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:1.0:1763333186.616032:0:28427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333186.616035:0:28427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:1.0:1763333186.616038:0:28427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333186.616040:0:28427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:1.0:1763333186.616042:0:28427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333186.616063:0:28427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2421:x1848987613861632:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 75us (902us total) trans 21474839067 rc 0/0 00000100:00100000:1.0:1763333186.616069:0:28427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1771 00002000:00010000:1.0:1763333186.616072:0:28427:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/151 (0->18446744073709551615) 00002000:00100000:1.0:1763333186.616074:0:28427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45c4dc00 with x1848987613861632 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333186.616079:0:28427:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe45c4dc00. 00000100:00100000:0.0:1763333186.622185:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333186.622330:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613861760 00000100:00100000:2.0:1763333186.622343:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613861760 00000100:00100000:2.0:1763333186.622457:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9674 00000100:00100000:2.0:1763333186.622470:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45c4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+81:57511:x1848987613861760:12345-192.168.204.28@tcp:101:fsx.0 00010000:00010000:2.0:1763333186.622498:0:6520:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333186.622523:0:6520:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e42600/0xb32e3ef184c58782 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 19 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a314 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333186.622664:0:6520:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4a1dec00/0xb32e3ef184c58789 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 20 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1763333186.622680:0:6520:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4a1dec00/0xb32e3ef184c58789 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 20 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1763333186.622694:0:6520:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4a1dec00/0xb32e3ef184c58789 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 20 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00000004:00200000:2.0:1763333186.622731:0:6520:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x55:0x0]: returning size 49239 00000004:00200000:2.0:1763333186.622736:0:6520:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763333186.622755:0:6520:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4a1dec00/0xb32e3ef184c58789 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 20 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 00010000:00010000:2.0:1763333186.622784:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e42600/0xb32e3ef184c58782 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a314 expref: 83 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333186.622805:0:6520:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4a1dec00/0xb32e3ef184c58789 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 19 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a314 expref: 82 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333186.622814:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:2.0:1763333186.622818:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333186.622821:0:6520:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4a1dec00, rc 0) 00000100:00100000:2.0:1763333186.622878:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45c4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+82:57511:x1848987613861760:12345-192.168.204.28@tcp:101:fsx.0 Request processed in 412us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333186.622885:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9674 00000100:00100000:0.0:1763333186.635762:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333186.635923:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613861888 00000100:00100000:2.0:1763333186.635937:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613861888 00000100:00100000:2.0:1763333186.636176:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1772 00000100:00100000:2.0:1763333186.636191:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45c4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2421:x1848987613861888:12345-192.168.204.28@tcp:22:fsx.0 00002000:00010000:2.0:1763333186.636683:0:16635:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 49239 -> 132477 00002000:00010000:2.0:1763333186.636690:0:16635:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:2.0:1763333186.636692:0:16635:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1763333186 -> 1763333186 00002000:00010000:2.0:1763333186.636694:0:16635:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:2.0:1763333186.636697:0:16635:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 104 -> 160 00000100:00100000:2.0:1763333186.639091:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45c4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2421:x1848987613861888:12345-192.168.204.28@tcp:22:fsx.0 Request processed in 2883us (3325us total) trans 21474839068 rc 0/0 00000100:00100000:2.0:1763333186.639113:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1772 00000004:00080000:3.0:1763333186.640593:0:9837:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 1290720240693ns, next at 1291720236031ns, rc = 0 00000100:00100000:3.0:1763333186.640652:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763333186.640679:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe45af3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627311872:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1763333186.640763:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333186.640869:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627311872 00000100:00100000:3.0:1763333186.640880:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627311872 00000100:00100000:3.0:1763333186.640938:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 788 00000100:00100000:3.0:1763333186.640947:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45af0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3655:x1848987627311872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1763333186.640985:0:8408:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 484898112 pending 0 free 3916034048 avail 3684511744 00000100:00100000:3.0:1763333186.641036:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45af0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3655:x1848987627311872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333186.641044:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 788 00000100:00100000:3.0:1763333186.641108:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe45af3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627311872:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1763333186.641901:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe45c4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1848987627311744:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1763333186.641950:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333186.642141:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e00f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627312000:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1763333186.643166:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe45c4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627312256:0@lo:400:kworker.0 00000100:00100000:2.0:1763333186.643202:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333186.643224:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627311744 00000100:00100000:1.0:1763333186.643233:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627311744 00000100:00100000:1.0:1763333186.643293:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1428 00000100:00100000:1.0:1763333186.643303:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe450db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1848987627311744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1763333186.643344:0:6525:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445941248 avail 1299701760 00000100:00100000:1.0:1763333186.643408:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe450db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1848987627311744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (1458us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333186.643415:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1428 00000100:00100000:3.0:1763333186.644450:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe45c4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1848987627312384:0@lo:400:kworker.0 00000100:00100000:3.0:1763333186.644507:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333186.644730:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe45c4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1848987627312768:0@lo:400:kworker.0 00000100:00100000:2.0:1763333186.644826:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe45c4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5e37baad-59e1-47e8-a7d1-7559d772e0ab:3652:1848987627312128:0@lo:400:kworker.0 00000100:00100000:2.0:1763333186.644867:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333186.644896:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe45c4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1848987627312640:0@lo:400:kworker.0 00000100:00100000:2.0:1763333186.644933:0:32351:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627312128 00000100:00100000:2.0:1763333186.644942:0:32351:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627312128 00000100:00100000:2.0:1763333186.644999:0:32351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1763333186.645007:0:32351:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dfa5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e37baad-59e1-47e8-a7d1-7559d772e0ab+23:3652:x1848987627312128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763333186.645064:0:32351:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dfa5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e37baad-59e1-47e8-a7d1-7559d772e0ab+23:3652:x1848987627312128:12345-0@lo:400:kworker.0 Request processed in 58us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333186.645072:0:32351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1763333186.645124:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333186.645158:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe45c4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627312512:0@lo:400:kworker.0 00000100:00100000:2.0:1763333186.645187:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333186.645208:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe45c4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1848987627313024:0@lo:400:kworker.0 00000100:00100000:3.0:1763333186.645470:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe45c4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1848987627312896:0@lo:400:kworker.0 00000100:00100000:3.0:1763333186.645495:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333186.645546:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627312256 00000100:00100000:0.0:1763333186.645552:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627312256 00000100:00100000:0.0:1763333186.645587:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627312000 00000100:00100000:0.0:1763333186.645590:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627312000 00000100:00100000:0.0:1763333186.645604:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1429 00000100:00100000:0.0:1763333186.645612:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe450d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3653:x1848987627312256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1763333186.645656:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe450d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3653:x1848987627312256:12345-0@lo:400:kworker.0 Request processed in 46us (2454us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333186.645663:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1429 00000100:00100000:0.0:1763333186.645676:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1430 00000100:00100000:0.0:1763333186.645682:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe450dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3655:x1848987627312000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1763333186.645711:0:6524:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445875712 avail 1299636224 00000100:00100000:0.0:1763333186.645742:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe450dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3655:x1848987627312000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333186.645749:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1430 00000100:00100000:3.0:1763333186.646837:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe45c4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1848987627313408:0@lo:400:kworker.0 00000100:00100000:3.0:1763333186.646879:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333186.646925:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627312512 00000100:00100000:3.0:1763333186.646931:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627312512 00000100:00100000:3.0:1763333186.646971:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627313408 00000100:00100000:3.0:1763333186.646974:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627313408 00000100:00100000:3.0:1763333186.647009:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 911 00000100:00100000:3.0:1763333186.647017:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe450daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3655:x1848987627312512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1763333186.647060:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe450daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3655:x1848987627312512:12345-0@lo:400:kworker.0 Request processed in 45us (1872us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333186.647067:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 911 00000100:00100000:3.0:1763333186.647083:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 912 00000100:00100000:3.0:1763333186.647089:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45af1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3654:x1848987627313408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1763333186.647121:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45af1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3654:x1848987627313408:12345-0@lo:400:kworker.0 Request processed in 32us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333186.647127:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 912 00000100:00080000:3.0:1763333186.647148:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1763333186.647167:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333186.647295:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627312384 00000100:00100000:1.0:1763333186.647301:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627312384 00000100:00100000:1.0:1763333186.647340:0:12741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627312896 00000100:00100000:1.0:1763333186.647343:0:12741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627312896 00000100:00100000:1.0:1763333186.647389:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1506 00000100:00100000:1.0:1763333186.647395:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45af3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1848987627312384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1763333186.647437:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45af3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1848987627312384:12345-0@lo:400:kworker.0 Request processed in 42us (2930us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333186.647443:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1506 00000100:00100000:1.0:1763333186.647457:0:12741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1507 00000100:00100000:1.0:1763333186.647463:0:12741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45af1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1848987627312896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1763333186.647489:0:12741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45af1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1848987627312896:12345-0@lo:400:kworker.0 Request processed in 26us (1993us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333186.647494:0:12741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1507 00000100:00100000:2.0:1763333186.647677:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe45c4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1848987627312384:0@lo:400:kworker.0 00000100:00100000:2.0:1763333186.647690:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe45c4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1848987627312896:0@lo:400:kworker.0 00000100:00100000:2.0:1763333186.647703:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe45c4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1848987627313408:0@lo:400:kworker.0 00000100:00080000:2.0:1763333186.647738:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1763333186.648230:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe45c4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1848987627313152:0@lo:400:kworker.0 00000100:00100000:3.0:1763333186.648390:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333186.648433:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe45c4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5e37baad-59e1-47e8-a7d1-7559d772e0ab:3652:1848987627312128:0@lo:400:kworker.0 00000100:00100000:3.0:1763333186.648464:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333186.648500:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627312640 00000100:00100000:0.0:1763333186.648509:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627312640 00000100:00100000:1.0:1763333186.648594:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1508 00000100:00100000:1.0:1763333186.648606:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45af2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1848987627312640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1763333186.648658:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45af2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1848987627312640:12345-0@lo:400:kworker.0 Request processed in 54us (1490us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333186.648665:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1508 00000100:00100000:1.0:1763333186.648708:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627313152 00000100:00100000:1.0:1763333186.648712:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627313152 00000100:00100000:1.0:1763333186.648743:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1431 00000100:00100000:1.0:1763333186.648750:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45af3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1848987627313152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1763333186.648783:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45af3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1848987627313152:12345-0@lo:400:kworker.0 Request processed in 34us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333186.648790:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1431 00000100:00080000:2.0:1763333186.648887:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1763333186.649421:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627312768 00000100:00100000:1.0:1763333186.649428:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627312768 00000100:00100000:1.0:1763333186.649476:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1509 00000100:00100000:1.0:1763333186.649484:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45af1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1848987627312768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1763333186.649530:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45af1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1848987627312768:12345-0@lo:400:kworker.0 Request processed in 47us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333186.649537:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1509 00000100:00080000:0.0:1763333186.649597:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1763333186.649751:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe45c4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1848987627312768:0@lo:400:kworker.0 00000100:00100000:3.0:1763333186.649766:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe45c4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1848987627313280:0@lo:400:kworker.0 00000100:00100000:3.0:1763333186.649817:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333186.649855:0:3653:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294972605 gen 2 00000004:00080000:3.0:1763333186.649862:0:3653:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294972605 committed transno 4294972605 00000100:00100000:3.0:1763333186.649896:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe45c4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1848987627311744:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1763333186.649922:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe45c4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627312256:0@lo:400:kworker.0 00000100:00100000:3.0:1763333186.649953:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe45c4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1848987627312640:0@lo:400:kworker.0 00000100:00100000:3.0:1763333186.649963:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe45c4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1848987627313152:0@lo:400:kworker.0 00000100:00100000:2.0:1763333186.650041:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333186.650080:0:3655:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe45c4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1848987627313536:0@lo:400:kworker.0 00000100:00100000:2.0:1763333186.650109:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333186.650145:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e00f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627312000:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1763333186.650168:0:3655:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474839018 gen 2 00000004:00080000:2.0:1763333186.650173:0:3655:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe44e05180, transno 21474839018 00000100:00100000:2.0:1763333186.650183:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe45c4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1848987627312512:0@lo:400:kworker.0 00000100:00100000:0.0:1763333186.650435:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627313024 00000100:00100000:0.0:1763333186.650442:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627313024 00000100:00100000:1.0:1763333186.650881:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627313280 00000100:00100000:1.0:1763333186.650886:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627313280 00000100:00100000:1.0:1763333186.650933:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 913 00000100:00100000:1.0:1763333186.650942:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45af0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1848987627313280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1763333186.651003:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45af0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1848987627313280:12345-0@lo:400:kworker.0 Request processed in 61us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333186.651009:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 913 00000100:00080000:2.0:1763333186.651075:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1763333186.651131:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627313536 00000100:00100000:3.0:1763333186.651136:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627313536 00000100:00100000:3.0:1763333186.651172:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1510 00000100:00100000:3.0:1763333186.651178:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe450d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1848987627313536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1763333186.651225:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe450d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1848987627313536:12345-0@lo:400:kworker.0 Request processed in 47us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333186.651230:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1510 00000100:00100000:3.0:1763333186.651274:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe45c4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1848987627313280:0@lo:400:kworker.0 00000100:00100000:0.0:1763333186.651393:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1511 00000100:00100000:0.0:1763333186.651402:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe450d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1848987627313024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1763333186.651439:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe450d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1848987627313024:12345-0@lo:400:kworker.0 Request processed in 39us (1398us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333186.651446:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1511 00000100:00100000:2.0:1763333186.651561:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe45c4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1848987627313024:0@lo:400:kworker.0 00000100:00100000:2.0:1763333186.651572:0:3655:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe45c4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1848987627313536:0@lo:400:kworker.0 00000100:00080000:3.0:1763333186.651660:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1763333186.652468:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333186.652621:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613862144 00000100:00100000:3.0:1763333186.652627:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613862144 00000100:00100000:3.0:1763333186.652669:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9675 00000100:00100000:3.0:1763333186.652677:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45c4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+82:57511:x1848987613862144:12345-192.168.204.28@tcp:36:fsx.0 00010000:00010000:3.0:1763333186.652737:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333186.652770:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4a1dec00/0xb32e3ef184c58789 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 20 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a314 expref: 82 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333186.652792:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:3.0:1763333186.653041:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333186.653294:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a99800/0xb32e3ef184c58790 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 19 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333186.653319:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a99800/0xb32e3ef184c58790 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333186.653330:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a99800/0xb32e3ef184c58790 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 00000001:00080000:3.0:1763333186.653547:0:6521:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935440 00000004:00010000:3.0:1763333186.653578:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ca866ae2 reply state 00000000664a2323 transno 8589935441 ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a99800/0xb32e3ef184c58790 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333186.653591:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a99800/0xb32e3ef184c58790 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333186.653596:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:3.0:1763333186.653599:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763333186.653602:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763333186.653717:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45c4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+84:57511:x1848987613862144:12345-192.168.204.28@tcp:36:fsx.0 Request processed in 1040us (1252us total) trans 8589935441 rc 0/0 00000100:00100000:3.0:1763333186.653725:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9675 00000020:00080000:3.0:1763333186.653730:0:6521:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763333186.663387:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333186.663596:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613862272 00000100:00100000:2.0:1763333186.663613:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613862272 00002000:00010000:2.0:1763333186.663680:0:16635:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (103443->18446744073709551615) 00002000:00100000:2.0:1763333186.663687:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45c4f800 with x1848987613862272 ext(103443->18446744073709551615) 00002000:00010000:2.0:1763333186.663704:0:16635:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe45c4f800. 00000100:00100000:2.0:1763333186.663750:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1773 00000100:00100000:2.0:1763333186.663761:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45c4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2420:x1848987613862272:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:2.0:1763333186.664106:0:16635:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 132477 -> 103443 00002000:00010000:2.0:1763333186.664112:0:16635:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:2.0:1763333186.664114:0:16635:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1763333186 -> 1763333186 00002000:00010000:2.0:1763333186.664116:0:16635:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:2.0:1763333186.664120:0:16635:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 160 -> 104 00000100:00100000:2.0:1763333186.664219:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45c4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2420:x1848987613862272:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 458us (4435us total) trans 21474839069 rc 0/0 00000100:00100000:2.0:1763333186.664229:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1773 00002000:00010000:2.0:1763333186.664234:0:16635:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (103443->18446744073709551615) 00002000:00100000:2.0:1763333186.664238:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45c4f800 with x1848987613862272 ext(103443->18446744073709551615) 00002000:00010000:2.0:1763333186.664243:0:16635:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe45c4f800. 00000100:00100000:3.0:1763333186.665684:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333186.665761:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333186.665853:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613862400 00000100:00100000:0.0:1763333186.665864:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613862400 00002000:00010000:0.0:1763333186.665910:0:8412:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/151 (0->18446744073709551615) 00002000:00100000:0.0:1763333186.665916:0:8412:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7569f480 with x1848987613862400 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333186.665928:0:8412:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff7569f480. 00000100:00100000:0.0:1763333186.665960:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613862528 00000100:00100000:0.0:1763333186.665963:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613862528 00002000:00010000:0.0:1763333186.665977:0:8412:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/151 (0->18446744073709551615) 00002000:00100000:0.0:1763333186.665981:0:8412:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45d21c00 with x1848987613862528 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333186.665986:0:8412:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe45d21c00. 00000100:00100000:0.0:1763333186.666019:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1774 00000100:00100000:0.0:1763333186.666029:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+36:2421:x1848987613862400:12345-192.168.204.28@tcp:10:fsx.0 00000100:00100000:1.0:1763333186.666052:0:28429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1775 00000100:00100000:1.0:1763333186.666063:0:28429:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45d21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2421:x1848987613862528:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:1.0:1763333186.666197:0:28429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333186.666197:0:8412:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333186.666202:0:28429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:0.0:1763333186.666202:0:8412:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:1.0:1763333186.666205:0:28429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333186.666205:0:8412:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333186.666208:0:28429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:0.0:1763333186.666208:0:8412:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:1.0:1763333186.666211:0:28429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1763333186.666211:0:8412:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:1.0:1763333186.666289:0:28429:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45d21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2421:x1848987613862528:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 226us (527us total) trans 21474839070 rc 0/0 00000100:00100000:1.0:1763333186.666296:0:28429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1775 00002000:00010000:1.0:1763333186.666301:0:28429:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/151 (0->18446744073709551615) 00002000:00100000:1.0:1763333186.666304:0:28429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45d21c00 with x1848987613862528 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333186.666309:0:28429:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe45d21c00. 00000100:00100000:0.0:1763333186.666385:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+37:2421:x1848987613862400:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 356us (710us total) trans 17179871736 rc 0/0 00000100:00100000:0.0:1763333186.666391:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1774 00002000:00010000:0.0:1763333186.666394:0:8412:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/151 (0->18446744073709551615) 00002000:00100000:0.0:1763333186.666397:0:8412:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7569f480 with x1848987613862400 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333186.666401:0:8412:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ff7569f480. 00000100:00100000:0.0:1763333186.670670:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333186.670898:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613862656 00000100:00100000:3.0:1763333186.670912:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613862656 00000100:00100000:3.0:1763333186.671778:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9676 00000100:00100000:3.0:1763333186.671796:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45c4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+84:57511:x1848987613862656:12345-192.168.204.28@tcp:101:fsx.0 00010000:00010000:3.0:1763333186.671834:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333186.671863:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a98600/0xb32e3ef184c58797 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 20 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a31b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333186.671995:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a99000/0xb32e3ef184c5879e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 21 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333186.672014:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a99000/0xb32e3ef184c5879e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 21 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333186.672028:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a99000/0xb32e3ef184c5879e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 21 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 00000004:00200000:3.0:1763333186.672062:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x55:0x0]: returning size 103443 00000004:00200000:3.0:1763333186.672068:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763333186.672092:0:6521:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a99000/0xb32e3ef184c5879e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 21 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333186.672120:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a98600/0xb32e3ef184c58797 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 21 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a31b expref: 86 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333186.672143:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a99000/0xb32e3ef184c5879e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 20 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a31b expref: 85 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333186.672152:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:3.0:1763333186.672156:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333186.672160:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff73a99000, rc 0) 00000100:00100000:3.0:1763333186.672249:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45c4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+85:57511:x1848987613862656:12345-192.168.204.28@tcp:101:fsx.0 Request processed in 458us (1592us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333186.672267:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9676 00000100:00100000:1.0:1763333186.677903:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333186.687004:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613862784 00000100:00100000:2.0:1763333186.687028:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613862784 00000100:00100000:0.0:1763333186.687298:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1776 00000100:00100000:0.0:1763333186.687311:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2421:x1848987613862784:12345-192.168.204.28@tcp:22:fsx.0 00002000:00010000:0.0:1763333186.687636:0:16635:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 103443 -> 103443 00002000:00010000:0.0:1763333186.687641:0:16635:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:0.0:1763333186.687643:0:16635:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1763333186 -> 1763333186 00002000:00010000:0.0:1763333186.687646:0:16635:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:0.0:1763333186.687648:0:16635:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 104 -> 104 00000100:00100000:0.0:1763333186.687737:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2421:x1848987613862784:12345-192.168.204.28@tcp:22:fsx.0 Request processed in 428us (9847us total) trans 21474839071 rc 0/0 00000100:00100000:0.0:1763333186.687746:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1776 00000100:00100000:0.0:1763333186.695689:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333186.698875:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613862912 00000100:00100000:2.0:1763333186.698900:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613862912 00000100:00100000:2.0:1763333186.699035:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1777 00000100:00100000:2.0:1763333186.699049:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45c4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2419:x1848987613862912:12345-192.168.204.28@tcp:22:fsx.0 00002000:00010000:2.0:1763333186.699787:0:8412:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 103443 -> 103443 00002000:00010000:2.0:1763333186.699794:0:8412:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:2.0:1763333186.699797:0:8412:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1763333186 -> 1763333186 00002000:00010000:2.0:1763333186.699800:0:8412:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:2.0:1763333186.699803:0:8412:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 104 -> 88 00000100:00100000:2.0:1763333186.699902:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45c4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2419:x1848987613862912:12345-192.168.204.28@tcp:22:fsx.0 Request processed in 854us (4227us total) trans 21474839072 rc 0/0 00000100:00100000:2.0:1763333186.699913:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1777 00000100:00100000:1.0:1763333186.713901:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333186.716627:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613863168 00000100:00100000:2.0:1763333186.716652:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613863168 00000100:00100000:2.0:1763333186.716782:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9677 00000100:00100000:2.0:1763333186.716796:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+85:57511:x1848987613863168:12345-192.168.204.28@tcp:36:fsx.0 00010000:00010000:2.0:1763333186.716897:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333186.716944:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a99000/0xb32e3ef184c5879e lrc: 0/0,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 21 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a31b expref: 85 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333186.716986:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:2.0:1763333186.716996:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333186.717278:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4a1df000/0xb32e3ef184c587a5 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 20 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333186.717304:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4a1df000/0xb32e3ef184c587a5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333186.717318:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4a1df000/0xb32e3ef184c587a5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00000001:00080000:2.0:1763333186.717438:0:6519:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935442 00000004:00010000:2.0:1763333186.717465:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e258051e reply state 00000000e368459d transno 8589935443 ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4a1df000/0xb32e3ef184c587a5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333186.717480:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4a1df000/0xb32e3ef184c587a5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333186.717487:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:2.0:1763333186.717491:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333186.717494:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763333186.717625:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+87:57511:x1848987613863168:12345-192.168.204.28@tcp:36:fsx.0 Request processed in 831us (3739us total) trans 8589935443 rc 0/0 00000100:00100000:2.0:1763333186.717634:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9677 00000020:00080000:2.0:1763333186.717642:0:6519:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763333186.731106:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333186.731157:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333186.731193:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333186.731308:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613863296 00000100:00100000:1.0:1763333186.731321:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613863296 00000100:00100000:2.0:1763333186.731335:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613863424 00000100:00100000:2.0:1763333186.731339:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613863424 00002000:00010000:1.0:1763333186.731414:0:16635:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (121402->18446744073709551615) 00002000:00010000:2.0:1763333186.731415:0:8412:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/151 (0->18446744073709551615) 00002000:00100000:2.0:1763333186.731421:0:8412:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45c4ce00 with x1848987613863424 ext(0->18446744073709551615) 00002000:00100000:1.0:1763333186.731421:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45c4c000 with x1848987613863296 ext(121402->18446744073709551615) 00002000:00010000:2.0:1763333186.731439:0:8412:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe45c4ce00. 00002000:00010000:1.0:1763333186.731439:0:16635:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe45c4c000. 00000100:00100000:1.0:1763333186.731464:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613863552 00000100:00100000:1.0:1763333186.731468:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613863552 00002000:00010000:1.0:1763333186.731479:0:16635:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/151 (0->18446744073709551615) 00002000:00100000:1.0:1763333186.731483:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45c4f100 with x1848987613863552 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333186.731488:0:16635:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe45c4f100. 00000100:00100000:2.0:1763333186.731703:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1778 00000100:00100000:2.0:1763333186.731715:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45c4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2421:x1848987613863296:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:2.0:1763333186.732018:0:8412:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 103443 -> 121402 00002000:00010000:2.0:1763333186.732022:0:8412:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763333186 -> 1763333187 00002000:00010000:2.0:1763333186.732025:0:8412:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1763333186 -> 1763333186 00002000:00010000:2.0:1763333186.732027:0:8412:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763333186 -> 1763333187 00002000:00010000:2.0:1763333186.732030:0:8412:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 88 -> 88 00000100:00100000:2.0:1763333186.732112:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45c4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2421:x1848987613863296:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 399us (1022us total) trans 21474839073 rc 0/0 00000100:00100000:2.0:1763333186.732122:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1778 00002000:00010000:2.0:1763333186.732127:0:8412:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/149 (121402->18446744073709551615) 00002000:00100000:2.0:1763333186.732130:0:8412:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45c4c000 with x1848987613863296 ext(121402->18446744073709551615) 00002000:00010000:2.0:1763333186.732136:0:8412:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe45c4c000. 00000100:00100000:2.0:1763333186.732160:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1779 00000100:00100000:2.0:1763333186.732168:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+37:2421:x1848987613863424:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:2.0:1763333186.732266:0:8412:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333186.732269:0:8412:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1763333186 -> 1763333187 00002000:00010000:2.0:1763333186.732272:0:8412:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333186.732275:0:8412:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1763333186 -> 1763333187 00002000:00010000:2.0:1763333186.732277:0:8412:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:2.0:1763333186.732300:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+38:2421:x1848987613863424:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 133us (1142us total) trans 17179871737 rc 0/0 00000100:00100000:2.0:1763333186.732307:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1779 00002000:00010000:2.0:1763333186.732311:0:8412:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/151 (0->18446744073709551615) 00002000:00100000:2.0:1763333186.732313:0:8412:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45c4ce00 with x1848987613863424 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333186.732318:0:8412:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe45c4ce00. 00000100:00100000:2.0:1763333186.732333:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1780 00000100:00100000:2.0:1763333186.732339:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45c4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+22:2421:x1848987613863552:12345-192.168.204.28@tcp:10:fsx.0 00002000:00010000:2.0:1763333186.732427:0:8412:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333186.732430:0:8412:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1763333186 -> 1763333187 00002000:00010000:2.0:1763333186.732433:0:8412:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333186.732435:0:8412:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1763333186 -> 1763333187 00002000:00010000:2.0:1763333186.732437:0:8412:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333186.732458:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45c4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2421:x1848987613863552:12345-192.168.204.28@tcp:10:fsx.0 Request processed in 119us (1264us total) trans 21474839074 rc 0/0 00000100:00100000:2.0:1763333186.732464:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1780 00002000:00010000:2.0:1763333186.732467:0:8412:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/151 (0->18446744073709551615) 00002000:00100000:2.0:1763333186.732471:0:8412:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45c4f100 with x1848987613863552 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333186.732475:0:8412:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe45c4f100. 00000100:00100000:0.0:1763333186.737135:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333186.737229:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613863680 00000100:00100000:3.0:1763333186.737263:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613863680 00002000:00100000:3.0:1763333186.737326:0:24027:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (65536->69631) req@ffff92fe45c4ca80 x1848987613863680/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/0 e 0 to 0 dl 1763333197 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763333186.737386:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45c4ca80 with x1848987613863680 ext(65536->69631) 00002000:00010000:3.0:1763333186.737395:0:24027:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe45c4ca80 00000100:00100000:3.0:1763333186.737431:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1781 00000100:00100000:3.0:1763333186.737442:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45c4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2418:x1848987613863680:12345-192.168.204.28@tcp:3:fsx.0 00000100:00100000:3.0:1763333186.737699:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45c4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2418:x1848987613863680:12345-192.168.204.28@tcp:3:fsx.0 Request processed in 258us (578us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1763333186.737708:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1781 00002000:00100000:3.0:1763333186.737716:0:24027:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (65536->69631) req@ffff92fe45c4ca80 x1848987613863680/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/4536 e 0 to 0 dl 1763333197 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763333186.737725:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45c4ca80 with x1848987613863680 ext(65536->69631) 00002000:00010000:3.0:1763333186.737729:0:24027:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe45c4ca80 00000100:00100000:2.0:1763333186.741646:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333186.742219:0:24031:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613863808 00000100:00100000:3.0:1763333186.742233:0:24031:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613863808 00002000:00100000:3.0:1763333186.742306:0:24031:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (69632->73727) req@ffff92fe450d8a80 x1848987613863808/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/0 e 0 to 0 dl 1763333197 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763333186.742319:0:24031:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe450d8a80 with x1848987613863808 ext(69632->73727) 00002000:00010000:3.0:1763333186.742327:0:24031:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe450d8a80 00000100:00100000:0.0:1763333186.743169:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1782 00000100:00100000:0.0:1763333186.743198:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe450d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2418:x1848987613863808:12345-192.168.204.28@tcp:3:fsx.0 00000100:00100000:0.0:1763333186.743625:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe450d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2418:x1848987613863808:12345-192.168.204.28@tcp:3:fsx.0 Request processed in 440us (1995us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1763333186.743636:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1782 00002000:00100000:0.0:1763333186.743648:0:24027:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (69632->73727) req@ffff92fe450d8a80 x1848987613863808/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/4536 e 0 to 0 dl 1763333197 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763333186.743657:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe450d8a80 with x1848987613863808 ext(69632->73727) 00002000:00010000:0.0:1763333186.743664:0:24027:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe450d8a80 00000100:00100000:0.0:1763333186.747885:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333186.748166:0:24031:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613863936 00000100:00100000:2.0:1763333186.748182:0:24031:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613863936 00002000:00100000:2.0:1763333186.748284:0:24031:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (73728->77823) req@ffff92fe45c4ea00 x1848987613863936/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/0 e 0 to 0 dl 1763333197 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763333186.748300:0:24031:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45c4ea00 with x1848987613863936 ext(73728->77823) 00002000:00010000:2.0:1763333186.748310:0:24031:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe45c4ea00 00000100:00100000:2.0:1763333186.748496:0:24031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1783 00000100:00100000:2.0:1763333186.748510:0:24031:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45c4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2421:x1848987613863936:12345-192.168.204.28@tcp:3:fsx.0 00000100:00100000:2.0:1763333186.750672:0:24031:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45c4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2421:x1848987613863936:12345-192.168.204.28@tcp:3:fsx.0 Request processed in 2149us (2789us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1763333186.750688:0:24031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1783 00002000:00100000:2.0:1763333186.750705:0:24031:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (73728->77823) req@ffff92fe45c4ea00 x1848987613863936/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/4536 e 0 to 0 dl 1763333197 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763333186.750718:0:24031:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45c4ea00 with x1848987613863936 ext(73728->77823) 00002000:00010000:2.0:1763333186.750726:0:24031:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe45c4ea00 00000100:00100000:3.0:1763333186.755986:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333186.757420:0:24031:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613864064 00000100:00100000:2.0:1763333186.757437:0:24031:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613864064 00002000:00100000:2.0:1763333186.757517:0:24031:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (77824->81919) req@ffff92fe45d20380 x1848987613864064/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/0 e 0 to 0 dl 1763333197 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763333186.757532:0:24031:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45d20380 with x1848987613864064 ext(77824->81919) 00002000:00010000:2.0:1763333186.757540:0:24031:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe45d20380 00000100:00100000:2.0:1763333186.757583:0:24031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1784 00000100:00100000:2.0:1763333186.757594:0:24031:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45d20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2421:x1848987613864064:12345-192.168.204.28@tcp:3:fsx.0 00000100:00100000:2.0:1763333186.757884:0:24031:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45d20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2421:x1848987613864064:12345-192.168.204.28@tcp:3:fsx.0 Request processed in 290us (1913us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1763333186.757894:0:24031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1784 00002000:00100000:2.0:1763333186.757902:0:24031:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (77824->81919) req@ffff92fe45d20380 x1848987613864064/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/4536 e 0 to 0 dl 1763333197 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763333186.757911:0:24031:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45d20380 with x1848987613864064 ext(77824->81919) 00002000:00010000:2.0:1763333186.757915:0:24031:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe45d20380 00000100:00100000:1.0:1763333186.763557:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333186.763622:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613864192 00000100:00100000:0.0:1763333186.763639:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613864192 00002000:00100000:0.0:1763333186.763709:0:24027:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (81920->86015) req@ffff92ff7e00f100 x1848987613864192/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/0 e 0 to 0 dl 1763333197 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763333186.763723:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7e00f100 with x1848987613864192 ext(81920->86015) 00002000:00010000:0.0:1763333186.763730:0:24027:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7e00f100 00000100:00100000:0.0:1763333186.763772:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1785 00000100:00100000:0.0:1763333186.763784:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e00f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2420:x1848987613864192:12345-192.168.204.28@tcp:3:fsx.0 00000100:00100000:0.0:1763333186.764342:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e00f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2420:x1848987613864192:12345-192.168.204.28@tcp:3:fsx.0 Request processed in 556us (990us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1763333186.764381:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1785 00002000:00100000:0.0:1763333186.764390:0:24027:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (81920->86015) req@ffff92ff7e00f100 x1848987613864192/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/4536 e 0 to 0 dl 1763333197 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763333186.764400:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7e00f100 with x1848987613864192 ext(81920->86015) 00002000:00010000:0.0:1763333186.764404:0:24027:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7e00f100 00000100:00100000:1.0:1763333186.769547:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333186.770137:0:24031:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613864320 00000100:00100000:2.0:1763333186.770155:0:24031:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613864320 00002000:00100000:2.0:1763333186.770224:0:24031:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (86016->90111) req@ffff92ff7e121180 x1848987613864320/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/0 e 0 to 0 dl 1763333197 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763333186.770238:0:24031:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7e121180 with x1848987613864320 ext(86016->90111) 00002000:00010000:2.0:1763333186.770246:0:24031:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7e121180 00000100:00100000:2.0:1763333186.770298:0:24031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1786 00000100:00100000:2.0:1763333186.770309:0:24031:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2418:x1848987613864320:12345-192.168.204.28@tcp:3:fsx.0 00000100:00100000:2.0:1763333186.770620:0:24031:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2418:x1848987613864320:12345-192.168.204.28@tcp:3:fsx.0 Request processed in 311us (1086us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1763333186.770628:0:24031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1786 00002000:00100000:2.0:1763333186.770635:0:24031:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (86016->90111) req@ffff92ff7e121180 x1848987613864320/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/4536 e 0 to 0 dl 1763333197 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763333186.770643:0:24031:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7e121180 with x1848987613864320 ext(86016->90111) 00002000:00010000:2.0:1763333186.770646:0:24031:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7e121180 00000100:00100000:3.0:1763333186.774835:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333186.775032:0:24031:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613864448 00000100:00100000:2.0:1763333186.775048:0:24031:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613864448 00002000:00100000:2.0:1763333186.775115:0:24031:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (90112->94207) req@ffff92fe45d23480 x1848987613864448/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/0 e 0 to 0 dl 1763333197 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763333186.775128:0:24031:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45d23480 with x1848987613864448 ext(90112->94207) 00002000:00010000:2.0:1763333186.775136:0:24031:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe45d23480 00000100:00100000:0.0:1763333186.775812:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1787 00000100:00100000:0.0:1763333186.775837:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45d23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2418:x1848987613864448:12345-192.168.204.28@tcp:3:fsx.0 00000100:00100000:0.0:1763333186.776129:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45d23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2418:x1848987613864448:12345-192.168.204.28@tcp:3:fsx.0 Request processed in 302us (1308us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1763333186.776138:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1787 00002000:00100000:0.0:1763333186.776149:0:24027:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (90112->94207) req@ffff92fe45d23480 x1848987613864448/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/4536 e 0 to 0 dl 1763333197 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763333186.776168:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45d23480 with x1848987613864448 ext(90112->94207) 00002000:00010000:0.0:1763333186.776173:0:24027:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe45d23480 00000100:00100000:1.0:1763333186.784831:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333186.785052:0:24031:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613864576 00000100:00100000:2.0:1763333186.785068:0:24031:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613864576 00002000:00100000:2.0:1763333186.785141:0:24031:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (94208->98303) req@ffff92ff7e123b80 x1848987613864576/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/0 e 0 to 0 dl 1763333197 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763333186.785155:0:24031:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7e123b80 with x1848987613864576 ext(94208->98303) 00002000:00010000:2.0:1763333186.785166:0:24031:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7e123b80 00000100:00100000:2.0:1763333186.785995:0:24031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1788 00000100:00100000:2.0:1763333186.786016:0:24031:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2418:x1848987613864576:12345-192.168.204.28@tcp:3:fsx.0 00000100:00100000:2.0:1763333186.786306:0:24031:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2418:x1848987613864576:12345-192.168.204.28@tcp:3:fsx.0 Request processed in 298us (1493us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1763333186.786314:0:24031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1788 00002000:00100000:2.0:1763333186.786324:0:24031:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (94208->98303) req@ffff92ff7e123b80 x1848987613864576/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/4536 e 0 to 0 dl 1763333197 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763333186.786333:0:24031:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7e123b80 with x1848987613864576 ext(94208->98303) 00002000:00010000:2.0:1763333186.786339:0:24031:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7e123b80 00000100:00100000:1.0:1763333186.790975:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333186.791085:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613864704 00000100:00100000:3.0:1763333186.791101:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613864704 00002000:00100000:3.0:1763333186.791169:0:24027:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (98304->102399) req@ffff92ff7e121500 x1848987613864704/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/0 e 0 to 0 dl 1763333197 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763333186.791182:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7e121500 with x1848987613864704 ext(98304->102399) 00002000:00010000:3.0:1763333186.791191:0:24027:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7e121500 00000100:00100000:3.0:1763333186.791235:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1789 00000100:00100000:3.0:1763333186.791247:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2418:x1848987613864704:12345-192.168.204.28@tcp:3:fsx.0 00000100:00100000:3.0:1763333186.792117:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2418:x1848987613864704:12345-192.168.204.28@tcp:3:fsx.0 Request processed in 864us (1152us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1763333186.792130:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1789 00002000:00100000:3.0:1763333186.792140:0:24027:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (98304->102399) req@ffff92ff7e121500 x1848987613864704/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/4536 e 0 to 0 dl 1763333197 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763333186.792151:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7e121500 with x1848987613864704 ext(98304->102399) 00002000:00010000:3.0:1763333186.792156:0:24027:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7e121500 00000100:00100000:0.0:1763333186.796939:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333186.797722:0:24031:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613864832 00000100:00100000:2.0:1763333186.797739:0:24031:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613864832 00002000:00100000:2.0:1763333186.797809:0:24031:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (102400->106495) req@ffff92fe45c4d500 x1848987613864832/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/0 e 0 to 0 dl 1763333197 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763333186.797823:0:24031:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45c4d500 with x1848987613864832 ext(102400->106495) 00002000:00010000:2.0:1763333186.797831:0:24031:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe45c4d500 00000100:00100000:2.0:1763333186.797873:0:24031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1790 00000100:00100000:2.0:1763333186.797884:0:24031:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45c4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2418:x1848987613864832:12345-192.168.204.28@tcp:3:fsx.0 00000100:00100000:2.0:1763333186.798127:0:24031:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45c4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2418:x1848987613864832:12345-192.168.204.28@tcp:3:fsx.0 Request processed in 244us (1204us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1763333186.798136:0:24031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1790 00002000:00100000:2.0:1763333186.798143:0:24031:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (102400->106495) req@ffff92fe45c4d500 x1848987613864832/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/4536 e 0 to 0 dl 1763333197 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763333186.798153:0:24031:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45c4d500 with x1848987613864832 ext(102400->106495) 00002000:00010000:2.0:1763333186.798158:0:24031:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe45c4d500 00000100:00100000:1.0:1763333186.802241:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333186.802419:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613864960 00000100:00100000:3.0:1763333186.802434:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613864960 00002000:00100000:3.0:1763333186.802505:0:24027:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (106496->110591) req@ffff92ff7e121880 x1848987613864960/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/0 e 0 to 0 dl 1763333197 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763333186.802520:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7e121880 with x1848987613864960 ext(106496->110591) 00002000:00010000:3.0:1763333186.802527:0:24027:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7e121880 00000100:00100000:3.0:1763333186.802568:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1791 00000100:00100000:3.0:1763333186.802580:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2418:x1848987613864960:12345-192.168.204.28@tcp:3:fsx.0 00000100:00100000:3.0:1763333186.802959:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2418:x1848987613864960:12345-192.168.204.28@tcp:3:fsx.0 Request processed in 379us (731us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1763333186.802969:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1791 00002000:00100000:3.0:1763333186.802977:0:24027:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (106496->110591) req@ffff92ff7e121880 x1848987613864960/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/4536 e 0 to 0 dl 1763333197 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763333186.802985:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7e121880 with x1848987613864960 ext(106496->110591) 00002000:00010000:3.0:1763333186.802990:0:24027:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7e121880 00000100:00100000:1.0:1763333186.811693:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333186.811821:0:24031:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613865088 00000100:00100000:2.0:1763333186.811836:0:24031:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613865088 00002000:00100000:2.0:1763333186.811902:0:24031:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (110592->114687) req@ffff92ff7e120000 x1848987613865088/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/0 e 0 to 0 dl 1763333197 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763333186.811915:0:24031:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7e120000 with x1848987613865088 ext(110592->114687) 00002000:00010000:2.0:1763333186.811922:0:24031:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7e120000 00000100:00100000:2.0:1763333186.811963:0:24031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1792 00000100:00100000:2.0:1763333186.811974:0:24031:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2418:x1848987613865088:12345-192.168.204.28@tcp:3:fsx.0 00000100:00100000:2.0:1763333186.812276:0:24031:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2418:x1848987613865088:12345-192.168.204.28@tcp:3:fsx.0 Request processed in 302us (597us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1763333186.812285:0:24031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1792 00002000:00100000:2.0:1763333186.812293:0:24031:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (110592->114687) req@ffff92ff7e120000 x1848987613865088/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/4536 e 0 to 0 dl 1763333197 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763333186.812302:0:24031:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7e120000 with x1848987613865088 ext(110592->114687) 00002000:00010000:2.0:1763333186.812306:0:24031:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7e120000 00000100:00100000:0.0:1763333186.816273:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333186.816489:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613865216 00000100:00100000:3.0:1763333186.816504:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613865216 00002000:00100000:3.0:1763333186.816571:0:24027:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (114688->118783) req@ffff92fe45c4fb80 x1848987613865216/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/0 e 0 to 0 dl 1763333197 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763333186.816584:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45c4fb80 with x1848987613865216 ext(114688->118783) 00002000:00010000:3.0:1763333186.816590:0:24027:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe45c4fb80 00000100:00100000:3.0:1763333186.816631:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1793 00000100:00100000:3.0:1763333186.816642:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2418:x1848987613865216:12345-192.168.204.28@tcp:3:fsx.0 00000100:00100000:3.0:1763333186.816933:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2418:x1848987613865216:12345-192.168.204.28@tcp:3:fsx.0 Request processed in 291us (686us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1763333186.816942:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1793 00002000:00100000:3.0:1763333186.816949:0:24027:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (114688->118783) req@ffff92fe45c4fb80 x1848987613865216/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/4536 e 0 to 0 dl 1763333197 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763333186.816957:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45c4fb80 with x1848987613865216 ext(114688->118783) 00002000:00010000:3.0:1763333186.816960:0:24027:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe45c4fb80 00000100:00100000:1.0:1763333186.822272:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333186.822414:0:24031:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613865344 00000100:00100000:2.0:1763333186.822428:0:24031:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613865344 00002000:00100000:2.0:1763333186.822499:0:24031:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (118784->122879) req@ffff92ff7e122d80 x1848987613865344/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/0 e 0 to 0 dl 1763333197 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763333186.822512:0:24031:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7e122d80 with x1848987613865344 ext(118784->122879) 00002000:00010000:2.0:1763333186.822520:0:24031:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7e122d80 00000100:00100000:2.0:1763333186.822564:0:24031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1794 00000100:00100000:2.0:1763333186.822575:0:24031:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2419:x1848987613865344:12345-192.168.204.28@tcp:3:fsx.0 00000100:00100000:2.0:1763333186.822843:0:24031:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2419:x1848987613865344:12345-192.168.204.28@tcp:3:fsx.0 Request processed in 269us (598us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1763333186.822852:0:24031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1794 00002000:00100000:2.0:1763333186.822859:0:24031:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (118784->122879) req@ffff92ff7e122d80 x1848987613865344/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/4536 e 0 to 0 dl 1763333197 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763333186.822868:0:24031:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7e122d80 with x1848987613865344 ext(118784->122879) 00002000:00010000:2.0:1763333186.822871:0:24031:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7e122d80 00000100:00100000:1.0:1763333186.827561:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333186.827670:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613865472 00000100:00100000:3.0:1763333186.827685:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613865472 00002000:00100000:3.0:1763333186.827750:0:24027:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (65536->121401) req@ffff92ff7e123480 x1848987613865472/t0(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/0 e 0 to 0 dl 1763333197 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763333186.827764:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7e123480 with x1848987613865472 ext(65536->121401) 00002000:00010000:3.0:1763333186.827772:0:24027:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7e123480 00000100:00100000:3.0:1763333186.827816:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1795 00000100:00100000:3.0:1763333186.827826:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+23:2418:x1848987613865472:12345-192.168.204.28@tcp:4:fsx.0 00000100:00100000:2.0:1763333186.836140:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:2418:x1848987613865472:12345-192.168.204.28@tcp:4:fsx.0 Request processed in 8294us (8576us total) trans 21474839075 rc 0/0 00000100:00100000:2.0:1763333186.836162:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1795 00002000:00100000:2.0:1763333186.836179:0:24027:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (65536->121401) req@ffff92ff7e123480 x1848987613865472/t21474839075(0) o4->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:497/0 lens 488/448 e 0 to 0 dl 1763333197 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763333186.836191:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7e123480 with x1848987613865472 ext(65536->121401) 00002000:00010000:2.0:1763333186.836199:0:24027:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7e123480 00000100:00100000:0.0:1763333186.845050:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333186.845159:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613865600 00000100:00100000:3.0:1763333186.845176:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613865600 00000100:00100000:3.0:1763333186.845935:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6837 00000100:00100000:3.0:1763333186.845953:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45c4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:2419:x1848987613865600:12345-192.168.204.28@tcp:16:fsx.0 00000001:00080000:2.0:1763333186.847490:0:24714:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839075 is committed 00000100:00100000:3.0:1763333186.847980:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45c4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2419:x1848987613865600:12345-192.168.204.28@tcp:16:fsx.0 Request processed in 2029us (2942us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333186.847994:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6837 00000100:00100000:1.0:1763333186.852009:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333186.852126:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613865728 00000100:00100000:2.0:1763333186.852144:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613865728 00000100:00100000:2.0:1763333186.852620:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9678 00000100:00100000:2.0:1763333186.852632:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+87:57511:x1848987613865728:12345-192.168.204.28@tcp:101:fsx.0 00010000:00010000:2.0:1763333186.852666:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333186.852694:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4a1dea00/0xb32e3ef184c587ac lrc: 2/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 21 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a322 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333186.852819:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4a1de000/0xb32e3ef184c587b3 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 22 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333186.852844:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4a1de000/0xb32e3ef184c587b3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 22 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333186.852857:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4a1de000/0xb32e3ef184c587b3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 22 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00000004:00200000:2.0:1763333186.852891:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x55:0x0]: returning size 121402 00000004:00200000:2.0:1763333186.852897:0:6519:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763333186.852922:0:6519:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4a1de000/0xb32e3ef184c587b3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 22 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333186.852956:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4a1dea00/0xb32e3ef184c587ac lrc: 0/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 22 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a322 expref: 89 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333186.852977:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4a1de000/0xb32e3ef184c587b3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 21 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a322 expref: 88 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333186.852986:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:2.0:1763333186.852990:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333186.852994:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4a1de000, rc 0) 00000100:00100000:2.0:1763333186.853065:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+88:57511:x1848987613865728:12345-192.168.204.28@tcp:101:fsx.0 Request processed in 435us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333186.853073:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9678 00000100:00100000:1.0:1763333186.861407:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333186.861863:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613865856 00000100:00100000:2.0:1763333186.861878:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613865856 00000100:00100000:2.0:1763333186.862022:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1796 00000100:00100000:2.0:1763333186.862036:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2418:x1848987613865856:12345-192.168.204.28@tcp:22:fsx.0 00002000:00010000:2.0:1763333186.863056:0:24027:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 121402 -> 121402 00002000:00010000:2.0:1763333186.863441:0:24027:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763333187 -> 1763333187 00002000:00010000:2.0:1763333186.863446:0:24027:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1763333186 -> 1763333186 00002000:00010000:2.0:1763333186.863448:0:24027:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763333187 -> 1763333187 00002000:00010000:2.0:1763333186.863451:0:24027:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 88 -> 224 00000100:00100000:2.0:1763333186.863632:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2418:x1848987613865856:12345-192.168.204.28@tcp:22:fsx.0 Request processed in 1593us (2278us total) trans 21474839076 rc 0/0 00000100:00100000:2.0:1763333186.863647:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1796 00000100:00100000:0.0:1763333186.869774:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333186.869888:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613866112 00000100:00100000:3.0:1763333186.869901:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613866112 00000100:00100000:3.0:1763333186.869975:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3296 00000100:00100000:3.0:1763333186.869986:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45c4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+88:57511:x1848987613866112:12345-192.168.204.28@tcp:35:fsx.0 00000100:00100000:3.0:1763333186.870426:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45c4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+89:57511:x1848987613866112:12345-192.168.204.28@tcp:35:fsx.0 Request processed in 440us (666us total) trans 8589935444 rc 0/0 00000100:00100000:3.0:1763333186.870437:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3296 00000100:00100000:1.0:1763333186.893559:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333186.895078:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613866368 00000100:00100000:3.0:1763333186.895099:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613866368 00000100:00100000:3.0:1763333186.895211:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9679 00000100:00100000:3.0:1763333186.895225:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+89:57512:x1848987613866368:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333186.895268:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333186.895304:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a98600/0xb32e3ef184c587ba lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a329 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333186.895453:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a98c00/0xb32e3ef184c587c1 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333186.895474:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a98c00/0xb32e3ef184c587c1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333186.895490:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a98c00/0xb32e3ef184c587c1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333186.895505:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a99000/0xb32e3ef184c587c8 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333186.895514:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a99000/0xb32e3ef184c587c8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333186.895520:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a99000/0xb32e3ef184c587c8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333186.895717:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a600/0xb32e3ef184c587cf lrc: 3/1,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 22 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333186.895730:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a600/0xb32e3ef184c587cf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 22 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333186.895738:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a600/0xb32e3ef184c587cf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 22 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00000004:00200000:3.0:1763333186.895752:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x55:0x0]: returning size 121402 00010000:00010000:3.0:1763333186.895882:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a98c00/0xb32e3ef184c587c1 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333186.895890:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a98c00/0xb32e3ef184c587c1 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333186.895897:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a98c00/0xb32e3ef184c587c1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333186.895906:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a98c00/0xb32e3ef184c587c1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333186.895912:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff73a98c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333186.895918:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a98c00/0xb32e3ef184c587c1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333186.895927:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a98c00/0xb32e3ef184c587c1 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333186.895941:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0x0 (ffff92ff42c64400) 00010000:00010000:3.0:1763333186.895944:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333186.897802:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a98c00/0xb32e3ef184c587c1 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333186.897826:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a98c00/0xb32e3ef184c587c1 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333186.897858:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a99000/0xb32e3ef184c587c8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333186.897866:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a99000/0xb32e3ef184c587c8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333186.897872:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a99000/0xb32e3ef184c587c8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333186.897877:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff73a99000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333186.897881:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a99000/0xb32e3ef184c587c8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333186.897887:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a99000/0xb32e3ef184c587c8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333186.897905:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0xdd396665 (ffff92fe43b44b00) 00010000:00010000:3.0:1763333186.897909:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763333186.897913:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a99000/0xb32e3ef184c587c8 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333186.897924:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a99000/0xb32e3ef184c587c8 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333186.898002:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a98600/0xb32e3ef184c587ba lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a329 expref: 92 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333186.898075:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a600/0xb32e3ef184c587cf lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 22 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a329 expref: 91 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333186.898084:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:3.0:1763333186.898087:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333186.898089:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff4139a600, rc 0) 00000100:00100000:3.0:1763333186.898235:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+91:57512:x1848987613866368:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 3011us (4689us total) trans 8589935445 rc 0/0 00000100:00100000:3.0:1763333186.898247:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9679 00000100:00100000:1.0:1763333186.905160:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333186.905244:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613866624 00000100:00100000:3.0:1763333186.905267:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613866624 00000100:00100000:1.0:1763333186.905275:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333186.905935:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9680 00000100:00100000:3.0:1763333186.905960:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+91:57512:x1848987613866624:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333186.905995:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333186.906028:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a98600/0xb32e3ef184c587dd lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a330 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333186.906749:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613866752 00000100:00100000:0.0:1763333186.906757:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613866752 00000100:00100000:0.0:1763333186.906827:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 414 00000100:00100000:0.0:1763333186.906835:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e120e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+93:2420:x1848987613866752:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333186.906847:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333186.906874:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a600/0xb32e3ef184c587cf lrc: 0/0,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 23 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a329 expref: 93 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333186.906897:0:28428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:0.0:1763333186.906902:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333186.906985:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e120e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+92:2420:x1848987613866752:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 150us (1709us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333186.906994:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 414 00010000:00010000:3.0:1763333186.907387:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a99000/0xb32e3ef184c587e4 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x58:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333186.907404:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a99000/0xb32e3ef184c587e4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333186.907420:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a99000/0xb32e3ef184c587e4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00000004:00200000:3.0:1763333186.907432:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x58:0x0]: returning size 0 00010000:00010000:3.0:1763333186.907490:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a98600/0xb32e3ef184c587dd lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a330 expref: 93 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333186.907507:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a99000/0xb32e3ef184c587e4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a330 expref: 92 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333186.907516:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x58:0x0].0x0 (ffff92ff42c64a00) 00010000:00010000:3.0:1763333186.907519:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763333186.907521:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff73a99000, rc 0) 00000100:00100000:3.0:1763333186.907555:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+92:57512:x1848987613866624:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1609us (2412us total) trans 8589935446 rc 0/0 00000100:00100000:3.0:1763333186.907563:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9680 00000100:00100000:0.0:1763333186.914063:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333186.914179:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613867008 00000100:00100000:3.0:1763333186.914196:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613867008 00000100:00100000:3.0:1763333186.914543:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9681 00000100:00100000:3.0:1763333186.914556:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45c4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+92:57512:x1848987613867008:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333186.914590:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333186.914618:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a98600/0xb32e3ef184c587f2 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a337 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333186.914772:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a98c00/0xb32e3ef184c587f9 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x58:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333186.914790:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a99000/0xb32e3ef184c587e4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a330 expref: 93 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333186.914801:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a98c00/0xb32e3ef184c587f9 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x58:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333186.914848:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a99000/0xb32e3ef184c587e4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a330 expref: 93 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333186.914864:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a99000/0xb32e3ef184c587e4 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a330 expref: 93 pid: 6519 timeout: 1390 lvb_type: 0 00000100:00100000:3.0:1763333186.914880:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe45d21500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1848987627313664:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333186.916133:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff801ea9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763333186.919015:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe45d21500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1848987627313664:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333186.919062:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a98c00/0xb32e3ef184c587f9 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x58:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00000100:00100000:0.0:1763333186.919680:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333186.920131:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613867136 00000100:00100000:1.0:1763333186.920147:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613867136 00010000:00010000:1.0:1763333186.920216:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a99000/0xb32e3ef184c587e4 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a330 expref: 94 pid: 6519 timeout: 1390 lvb_type: 0 00000100:00100000:1.0:1763333186.920281:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3177 00000100:00100000:1.0:1763333186.920293:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff800db850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+94:2421:x1848987613867136:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333186.920315:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333186.920323:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a99000/0xb32e3ef184c587e4 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a330 expref: 94 pid: 6519 timeout: 1390 lvb_type: 0 00010000:00010000:1.0:1763333186.920338:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a99000/0xb32e3ef184c587e4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a330 expref: 94 pid: 6519 timeout: 1390 lvb_type: 0 00010000:00010000:1.0:1763333186.920410:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a99000/0xb32e3ef184c587e4 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a330 expref: 94 pid: 6519 timeout: 1390 lvb_type: 0 00010000:00010000:1.0:1763333186.920431:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x58:0x0].0x0 (ffff92ff42c64a00) 00010000:00010000:1.0:1763333186.920436:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a98c00/0xb32e3ef184c587f9 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x58:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333186.920448:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a98c00/0xb32e3ef184c587f9 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x58:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333186.920456:0:6504:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a98c00/0xb32e3ef184c587f9 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x58:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333186.920487:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333186.920562:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff800db850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+93:2421:x1848987613867136:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 271us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333186.920571:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3177 00010000:00010000:3.0:1763333186.920756:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a98c00/0xb32e3ef184c587f9 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x58:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333186.920769:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a98c00/0xb32e3ef184c587f9 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x58:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00000004:00200000:3.0:1763333186.920801:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x58:0x0]: returning size 0 00000004:00080000:3.0:1763333186.921416:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x98:0x0], index 0: 0 00000004:00080000:3.0:1763333186.921424:0:6519:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x98:0x0], index 1: 0 00010000:00010000:3.0:1763333186.921583:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a98c00/0xb32e3ef184c587f9 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x58:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333186.921594:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a98c00/0xb32e3ef184c587f9 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x58:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333186.921607:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a98c00/0xb32e3ef184c587f9 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x58:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333186.921615:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff73a98c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333186.921621:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a98c00/0xb32e3ef184c587f9 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x58:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333186.921630:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a98c00/0xb32e3ef184c587f9 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x58:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333186.921644:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x58:0x0].0x0 (ffff92ff42c64a00) 00010000:00010000:3.0:1763333186.921648:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763333186.921654:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a98c00/0xb32e3ef184c587f9 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x58:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333186.921660:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a98c00/0xb32e3ef184c587f9 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x58:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333186.921742:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a98600/0xb32e3ef184c587f2 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x58:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a337 expref: 93 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333186.921753:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x58:0x0].0x0 (ffff92ff42c64a00) 00010000:00010000:3.0:1763333186.921756:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763333186.921760:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a98600/0xb32e3ef184c587f2 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x58:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a337 expref: 93 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333186.921780:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff73a98600, rc 0) 00000100:00100000:3.0:1763333186.921857:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45c4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+92:57512:x1848987613867008:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 7303us (7813us total) trans 8589935447 rc 301/301 00000100:00100000:3.0:1763333186.921868:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9681 00000100:00100000:0.0:1763333186.930636:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333186.931167:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613867392 00000100:00100000:2.0:1763333186.931183:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613867392 00000100:00100000:2.0:1763333186.931312:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3297 00000100:00100000:2.0:1763333186.931324:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45c4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+92:57512:x1848987613867392:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333186.931760:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45c4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+93:57512:x1848987613867392:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 437us (1138us total) trans 8589935448 rc 0/0 00000100:00100000:2.0:1763333186.931769:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3297 00000100:00100000:2.0:1763333186.936403:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333186.937580:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613867520 00000100:00100000:3.0:1763333186.937599:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613867520 00000100:00100000:3.0:1763333186.937687:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9682 00000100:00100000:3.0:1763333186.937697:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe450dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+93:57512:x1848987613867520:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333186.937731:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333186.937764:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a98600/0xb32e3ef184c58807 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x58:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a33e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333186.937862:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a98c00/0xb32e3ef184c5880e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333186.937880:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a98c00/0xb32e3ef184c5880e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x58:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333186.937899:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a98c00/0xb32e3ef184c5880e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x58:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00000004:00200000:3.0:1763333186.937962:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x58:0x0]: returning size 0 00000004:00200000:3.0:1763333186.937968:0:6519:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763333186.938005:0:6519:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a98c00/0xb32e3ef184c5880e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x58:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00010000:00010000:3.0:1763333186.938036:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a98600/0xb32e3ef184c58807 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a33e expref: 95 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333186.938055:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a98c00/0xb32e3ef184c5880e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x58:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a33e expref: 94 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333186.938065:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x58:0x0].0x0 (ffff92ff42c64a00) 00010000:00010000:3.0:1763333186.938069:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1763333186.938073:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff73a98c00, rc 0) 00000100:00100000:3.0:1763333186.938149:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe450dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+94:57512:x1848987613867520:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 453us (1803us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333186.938160:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9682 00000100:00100000:1.0:1763333186.945731:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333186.945787:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333186.945811:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613867648 00000100:00100000:3.0:1763333186.945824:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613867648 00000100:00100000:2.0:1763333186.945991:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613867776 00000100:00100000:2.0:1763333186.945996:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613867776 00000100:00100000:3.0:1763333186.946000:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6838 00000100:00100000:3.0:1763333186.946011:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2421:x1848987613867648:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333186.946036:0:8611:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1763333186.946039:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6839 00000100:00100000:2.0:1763333186.946045:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+38:2421:x1848987613867776:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333186.946053:0:8406:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333186.946065:0:8611:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff73a99000/0xb32e3ef184c58815 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a345 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333186.946066:0:8406:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4a1dea00/0xb32e3ef184c5881c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a34c expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333186.946096:0:8611:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x98:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:2.0:1763333186.946096:0:8406:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x98:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763333186.946122:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333186.946122:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333186.946125:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333186.946125:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333186.946137:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff73a99000/0xb32e3ef184c58815 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a345 expref: 15 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333186.946137:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4a1dea00/0xb32e3ef184c5881c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a34c expref: 39 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333186.946159:0:8611:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92ff73a99000/0xb32e3ef184c58815 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a345 expref: 15 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333186.946159:0:8406:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe4a1dea00/0xb32e3ef184c5881c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a34c expref: 39 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333186.946175:0:8406:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4a1dea00, rc 0) 00010000:00010000:3.0:1763333186.946176:0:8611:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff73a99000, rc 0) 00000100:00100000:3.0:1763333186.947153:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2421:x1848987613867648:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1135us (1431us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333186.947153:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+39:2421:x1848987613867776:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1100us (1357us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333186.947164:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6838 00000100:00100000:2.0:1763333186.947167:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6839 00000100:00100000:0.0:1763333186.954790:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333186.955405:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613868032 00000100:00100000:3.0:1763333186.955423:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613868032 00000100:00100000:3.0:1763333186.955515:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9683 00000100:00100000:3.0:1763333186.955529:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44e05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+94:57512:x1848987613868032:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333186.955562:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333186.955594:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a98600/0xb32e3ef184c58823 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 22 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a353 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333186.955784:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c5882a lrc: 3/0,1 mode: --/PW res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 23 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333186.955809:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c5882a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x4/0x0 rrc: 23 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333186.955821:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c5882a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x4/0x0 rrc: 23 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 00000004:00200000:3.0:1763333186.955837:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x55:0x0]: returning size 121402 00010000:00010000:3.0:1763333186.955980:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a98600/0xb32e3ef184c58823 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x1/0x0 rrc: 23 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a353 expref: 97 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333186.956004:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c5882a lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x4/0x0 rrc: 22 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a353 expref: 96 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333186.956015:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:3.0:1763333186.956019:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763333186.956023:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96000, rc 0) 00000100:00100000:3.0:1763333186.956106:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44e05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+96:57512:x1848987613868032:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 580us (1333us total) trans 8589935449 rc 0/0 00000100:00100000:3.0:1763333186.956115:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9683 00000100:00100000:1.0:1763333186.965018:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333186.965578:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333186.966017:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333186.966341:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613868160 00000100:00100000:2.0:1763333186.966376:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613868160 00000100:00100000:1.0:1763333186.966699:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613868288 00000100:00100000:1.0:1763333186.966705:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613868288 00000100:00100000:1.0:1763333186.966723:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613868416 00000100:00100000:1.0:1763333186.966726:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613868416 00000100:00100000:1.0:1763333186.966747:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6840 00000100:00100000:1.0:1763333186.966759:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2419:x1848987613868160:12345-192.168.204.28@tcp:1:lfs.0 00010000:00010000:1.0:1763333186.966824:0:8406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58838 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333186.966848:0:8406:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c58632 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a29d expref: 16 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333186.966859:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333186.966861:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333186.966868:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58838 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333186.966913:0:8406:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c58632 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a29d expref: 16 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333186.966929:0:8406:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c58632 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a29d expref: 16 pid: 28650 timeout: 1391 lvb_type: 0 00000100:00100000:1.0:1763333186.966946:0:8406:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7569e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8406:1848987627313792:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333186.967051:0:8406:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7dcc73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763333186.967075:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6841 00000100:00100000:1.0:1763333186.967082:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+39:2419:x1848987613868288:12345-192.168.204.28@tcp:1:lfs.0 00010000:00010000:1.0:1763333186.967105:0:28650:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c5883f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333186.967118:0:28650:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c586b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2c7 expref: 39 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333186.967124:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333186.967126:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333186.967129:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c5883f lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333186.967151:0:28650:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c586b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2c7 expref: 39 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333186.967158:0:28650:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c586b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2c7 expref: 39 pid: 8406 timeout: 1391 lvb_type: 0 00000100:00100000:1.0:1763333186.967169:0:28650:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff77c6ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28650:1848987627313920:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333186.967192:0:28650:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7dcc7540 going to sleep for 11 seconds 00000100:00100000:3.0:1763333186.967332:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6842 00000100:00100000:3.0:1763333186.967344:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2419:x1848987613868416:12345-192.168.204.28@tcp:1:lfs.0 00010000:00010000:3.0:1763333186.967396:0:8407:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97000/0xb32e3ef184c58846 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333186.967409:0:8407:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c586cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2d5 expref: 16 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333186.967417:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333186.967419:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333186.967422:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97000/0xb32e3ef184c58846 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333186.967461:0:8407:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c586cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2d5 expref: 16 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333186.967472:0:8407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c586cc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2d5 expref: 16 pid: 28650 timeout: 1391 lvb_type: 0 00000100:00100000:1.0:1763333186.967485:0:8407:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8407:1848987627314048:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333186.967873:0:8407:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7412b000 going to sleep for 11 seconds 00000100:00100000:0.0:1763333186.972663:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333186.973069:0:8406:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7569e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8406:1848987627313792:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333186.973111:0:8406:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58838 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333186.973929:0:28650:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff77c6ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28650:1848987627313920:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333186.973967:0:28650:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c5883f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333186.974074:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333186.974210:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613868672 00000100:00100000:1.0:1763333186.974221:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613868672 00010000:00010000:1.0:1763333186.974278:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c58632 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a29d expref: 17 pid: 28650 timeout: 1391 lvb_type: 0 00000100:00100000:1.0:1763333186.974738:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613868544 00000100:00100000:1.0:1763333186.974743:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613868544 00010000:00010000:1.0:1763333186.974764:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c586b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2c7 expref: 40 pid: 8406 timeout: 1391 lvb_type: 0 00000100:00100000:2.0:1763333186.974905:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3178 00000100:00100000:2.0:1763333186.974918:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45d27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2421:x1848987613868672:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333186.974942:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333186.974981:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c58632 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a29d expref: 17 pid: 28650 timeout: 1391 lvb_type: 0 00010000:00010000:2.0:1763333186.974996:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c58632 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a29d expref: 17 pid: 28650 timeout: 1391 lvb_type: 0 00010000:00010000:2.0:1763333186.975025:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c58632 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a29d expref: 17 pid: 28650 timeout: 1391 lvb_type: 0 00010000:00010000:2.0:1763333186.975051:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333186.975054:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333186.975059:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58838 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333186.975069:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58838 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333186.975113:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333186.975188:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45d27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2421:x1848987613868672:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 273us (2539us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333186.975197:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3178 00000100:00100000:2.0:1763333186.975219:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3179 00000100:00100000:2.0:1763333186.975227:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45d25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+40:2421:x1848987613868544:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333186.975236:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333186.975261:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c586b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2c7 expref: 40 pid: 8406 timeout: 1391 lvb_type: 0 00010000:00010000:2.0:1763333186.975271:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c586b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2c7 expref: 40 pid: 8406 timeout: 1391 lvb_type: 0 00010000:00010000:2.0:1763333186.975285:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4700f400/0xb32e3ef184c586b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2c7 expref: 40 pid: 8406 timeout: 1391 lvb_type: 0 00010000:00010000:2.0:1763333186.975295:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333186.975297:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333186.975300:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c5883f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333186.975306:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c5883f lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333186.975324:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333186.975343:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45d25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+39:2421:x1848987613868544:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 118us (1271us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333186.975380:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3179 00010000:00010000:0.0:1763333186.978566:0:8406:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58838 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333186.978591:0:8406:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58838 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333186.978634:0:8406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58838 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333186.978644:0:8406:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58838 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333186.978654:0:8406:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58838 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333186.978662:0:8406:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4742f400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333186.978666:0:8406:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58838 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333186.978676:0:8406:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58838 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333186.978701:0:8406:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58838 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333186.978708:0:8406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58838 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333186.978849:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2419:x1848987613868160:12345-192.168.204.28@tcp:1:lfs.0 Request processed in 12084us (13841us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333186.978860:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6840 00010000:00010000:1.0:1763333186.979109:0:28650:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c5883f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333186.979120:0:28650:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c5883f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333186.979142:0:28650:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c5883f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333186.979150:0:28650:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c5883f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333186.979157:0:28650:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c5883f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333186.979163:0:28650:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4742fa00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333186.979166:0:28650:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c5883f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333186.979173:0:28650:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c5883f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333186.979185:0:28650:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c5883f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333186.979191:0:28650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c5883f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333186.979240:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+38:2419:x1848987613868288:12345-192.168.204.28@tcp:1:lfs.0 Request processed in 12158us (13665us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333186.979248:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6841 00000100:00100000:1.0:1763333186.979460:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333186.979488:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613868800 00000100:00100000:1.0:1763333186.979498:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613868800 00010000:00010000:1.0:1763333186.979539:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c586cc lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2d5 expref: 15 pid: 28650 timeout: 1391 lvb_type: 0 00000100:00100000:1.0:1763333186.979568:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3180 00000100:00100000:1.0:1763333186.979579:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2421:x1848987613868800:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333186.979597:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333186.979615:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c586cc lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2d5 expref: 15 pid: 28650 timeout: 1391 lvb_type: 0 00010000:00010000:1.0:1763333186.979627:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c586cc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2d5 expref: 15 pid: 28650 timeout: 1391 lvb_type: 0 00010000:00010000:1.0:1763333186.979649:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333186.979652:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333186.979658:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97000/0xb32e3ef184c58846 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333186.979669:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97000/0xb32e3ef184c58846 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333186.979692:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333186.979711:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2421:x1848987613868800:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 134us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333186.979718:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3180 00010000:00010000:0.0:1763333186.981173:0:8407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46ac4000/0xb32e3ef184c586cc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2d5 expref: 14 pid: 28650 timeout: 1391 lvb_type: 0 00000100:00100000:0.0:1763333186.981198:0:8407:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8407:1848987627314048:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333186.981231:0:8407:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97000/0xb32e3ef184c58846 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333186.981243:0:8407:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97000/0xb32e3ef184c58846 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333186.981259:0:8407:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97000/0xb32e3ef184c58846 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333186.981293:0:8407:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97000/0xb32e3ef184c58846 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333186.981301:0:8407:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97000/0xb32e3ef184c58846 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333186.981308:0:8407:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97000/0xb32e3ef184c58846 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333186.981320:0:8407:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333186.981325:0:8407:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97000/0xb32e3ef184c58846 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333186.981333:0:8407:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97000/0xb32e3ef184c58846 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333186.981729:0:8407:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97000/0xb32e3ef184c58846 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333186.981740:0:8407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97000/0xb32e3ef184c58846 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333186.982190:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2419:x1848987613868416:12345-192.168.204.28@tcp:1:lfs.0 Request processed in 14846us (16171us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333186.982202:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6842 00000100:00100000:1.0:1763333186.985506:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333186.985557:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333186.985598:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333186.985678:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613869056 00000100:00100000:3.0:1763333186.985691:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613869056 00000100:00100000:3.0:1763333186.985763:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613868928 00000100:00100000:3.0:1763333186.985767:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613868928 00000100:00100000:3.0:1763333186.985791:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613869184 00000100:00100000:3.0:1763333186.985794:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613869184 00000100:00100000:3.0:1763333186.985822:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6843 00000100:00100000:2.0:1763333186.986007:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6844 00000100:00100000:3.0:1763333186.986013:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+38:2418:x1848987613869056:12345-192.168.204.28@tcp:101:lfs.0 00000100:00100000:2.0:1763333186.986023:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2418:x1848987613868928:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333186.986038:0:8406:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333186.986039:0:28650:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333186.986071:0:8406:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c58854 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a361 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333186.986071:0:28650:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4a1dec00/0xb32e3ef184c5884d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a35a expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763333186.986112:0:8406:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x97:0x0] initial LVB size: 0, mtime: 0x691a5443, atime: 0x0, ctime: 0x691a5443, blocks: 0x1800 00002000:00010000:2.0:1763333186.986112:0:28650:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x95:0x0] initial LVB size: 121402, mtime: 0x691a5443, atime: 0x691a5442, ctime: 0x691a5443, blocks: 0xe0 00010000:00010000:3.0:1763333186.986144:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333186.986144:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333186.986147:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333186.986148:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333186.986162:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c58854 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a361 expref: 39 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333186.986162:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4a1dec00/0xb32e3ef184c5884d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a35a expref: 15 pid: 28650 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333186.986194:0:28650:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe4a1dec00/0xb32e3ef184c5884d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a35a expref: 15 pid: 28650 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333186.986195:0:8406:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c58854 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a361 expref: 39 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333186.986213:0:28650:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4a1dec00, rc 0) 00010000:00010000:3.0:1763333186.986223:0:8406:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96e00, rc 0) 00000100:00100000:1.0:1763333186.986234:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6845 00000100:00100000:1.0:1763333186.986245:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2418:x1848987613869184:12345-192.168.204.28@tcp:101:lfs.0 00000100:00100000:3.0:1763333186.986291:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+39:2418:x1848987613869056:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 286us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333186.986298:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6843 00010000:00010000:1.0:1763333186.986342:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333186.986376:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5885b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a368 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333186.986444:0:8404:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x97:0x0] initial LVB size: 0, mtime: 0x691a5443, atime: 0x0, ctime: 0x691a5443, blocks: 0x0 00010000:00010000:1.0:1763333186.986462:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333186.986464:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333186.986469:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5885b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a368 expref: 16 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333186.986486:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5885b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a368 expref: 16 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333186.986495:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe42feaa00, rc 0) 00000100:00100000:2.0:1763333186.986518:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2418:x1848987613868928:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 499us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333186.986523:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2418:x1848987613869184:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 280us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333186.986531:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6844 00000100:00100000:1.0:1763333186.986542:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6845 00000100:00100000:2.0:1763333187.033944:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333187.034153:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613869312 00000100:00100000:3.0:1763333187.034167:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613869312 00000100:00100000:3.0:1763333187.034276:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6846 00000100:00100000:3.0:1763333187.034289:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe450da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2420:x1848987613869312:12345-192.168.204.28@tcp:23:lfs.0 00000100:00100000:3.0:1763333187.034491:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe450da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2420:x1848987613869312:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 205us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333187.034500:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6846 00000100:00080000:2.0:1763333187.034569:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1763333187.041015:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333187.041098:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613869440 00000100:00100000:0.0:1763333187.041111:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613869440 00000100:00080000:2.0:1763333187.041790:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1763333187.042757:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9684 00000100:00100000:1.0:1763333187.042779:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+96:57512:x1848987613869440:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333187.042815:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333187.042847:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c58862 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a36f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.042894:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58869 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x58:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333187.042910:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58869 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x58:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333187.042923:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58869 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x58:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333187.043479:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c58862 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x58:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a36f expref: 98 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.043506:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58869 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x58:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a36f expref: 97 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.043518:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x58:0x0].0x0 (ffff92ff42c64a00) 00010000:00010000:1.0:1763333187.043522:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763333187.043526:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4742f400, rc 0) 00000100:00100000:1.0:1763333187.043620:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+97:57512:x1848987613869440:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 849us (2619us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333187.043629:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9684 00000100:00100000:1.0:1763333187.051702:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333187.051904:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613869696 00000100:00100000:3.0:1763333187.051919:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613869696 00000100:00100000:3.0:1763333187.052006:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9685 00000100:00100000:3.0:1763333187.052017:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+97:57512:x1848987613869696:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:3.0:1763333187.052090:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333187.052128:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a98c00/0xb32e3ef184c5880e lrc: 0/0,0 mode: --/PR res: [0x200000405:0x58:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a33e expref: 97 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.052153:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x58:0x0].0x0 (ffff92ff42c64a00) 00010000:00010000:3.0:1763333187.052159:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333187.052434:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c58870 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333187.052452:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c58870 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333187.052463:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c58870 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 00000001:00080000:3.0:1763333187.052521:0:6521:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935450 00000004:00010000:3.0:1763333187.052547:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001a763a71 reply state 00000000e1e5dfcf transno 8589935451 ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c58870 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333187.052560:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c58870 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x58:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333187.052567:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x58:0x0].0x0 (ffff92ff42c64a00) 00010000:00010000:3.0:1763333187.052570:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763333187.052574:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763333187.054610:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+99:57512:x1848987613869696:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 2579us (2911us total) trans 8589935451 rc 0/0 00000100:00100000:3.0:1763333187.054625:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9685 00000020:00080000:3.0:1763333187.054637:0:6521:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763333187.059695:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333187.059981:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613869824 00000100:00100000:3.0:1763333187.059995:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613869824 00000100:00100000:3.0:1763333187.060062:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9686 00000100:00100000:3.0:1763333187.060072:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe450d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+99:57512:x1848987613869824:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333187.060509:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333187.060543:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c58877 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x58:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a376 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.060627:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c58877 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x58:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a376 expref: 100 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.060644:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c58877 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x58:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a376 expref: 100 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.060767:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x58:0x0].0x0 (ffff92ff42c64a00) 00010000:00010000:2.0:1763333187.060771:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333187.060776:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46ac5e00, rc 0) 00000100:00100000:2.0:1763333187.060858:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe450d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+100:57512:x1848987613869824:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 786us (1176us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333187.060868:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9686 00000100:00100000:2.0:1763333187.065483:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333187.065595:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613869952 00000100:00100000:0.0:1763333187.066167:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613869952 00000100:00100000:0.0:1763333187.066271:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6847 00000100:00100000:0.0:1763333187.066284:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe450db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:57512:x1848987613869952:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333187.066311:0:28651:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333187.066338:0:28651:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf200/0xb32e3ef184c5887e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a37d expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.066755:0:28651:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff73a99000/0xb32e3ef184c58815 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a345 expref: 16 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333187.066764:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333187.066766:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333187.066771:0:28651:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf200/0xb32e3ef184c5887e lrc: 4/0,0 mode: --/PW res: [0x280000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a37d expref: 16 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.066821:0:28651:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92ff73a99000/0xb32e3ef184c58815 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a345 expref: 16 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333187.066837:0:28651:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92ff73a99000/0xb32e3ef184c58815 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a345 expref: 16 pid: 8611 timeout: 1391 lvb_type: 1 00000100:00100000:0.0:1763333187.066852:0:28651:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe45d26d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28651:1848987627314176:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333187.068293:0:28651:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff49dd4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1763333187.074711:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333187.074862:0:28651:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe45d26d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28651:1848987627314176:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333187.074914:0:28651:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf200/0xb32e3ef184c5887e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a37d expref: 16 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.074940:0:28651:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe467bf200, rc 0) 00000100:00100000:3.0:1763333187.075064:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613870080 00000100:00100000:3.0:1763333187.075073:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613870080 00010000:00010000:3.0:1763333187.075116:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92ff73a99000/0xb32e3ef184c58815 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a345 expref: 17 pid: 8611 timeout: 1391 lvb_type: 1 00000100:00100000:3.0:1763333187.075166:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3181 00000100:00100000:3.0:1763333187.075174:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2421:x1848987613870080:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333187.075195:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333187.075200:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92ff73a99000/0xb32e3ef184c58815 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a345 expref: 17 pid: 8611 timeout: 1391 lvb_type: 1 00010000:00010000:3.0:1763333187.075214:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92ff73a99000/0xb32e3ef184c58815 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a345 expref: 17 pid: 8611 timeout: 1391 lvb_type: 1 00010000:00010000:3.0:1763333187.075240:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff73a99000/0xb32e3ef184c58815 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a345 expref: 17 pid: 8611 timeout: 1391 lvb_type: 1 00010000:00010000:3.0:1763333187.075266:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333187.075268:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333187.075276:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf200/0xb32e3ef184c5887e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a37d expref: 16 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.075286:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf200/0xb32e3ef184c5887e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a37d expref: 16 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.075326:0:8423:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf200/0xb32e3ef184c5887e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a37d expref: 16 pid: 28651 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333187.075340:0:8423:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe45d21500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8423:1848987627314304:192.168.204.28@tcp:105: 00000100:00100000:3.0:1763333187.075537:0:8423:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7dfd8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1763333187.075617:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe450db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:57512:x1848987613869952:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 9336us (10150us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333187.075626:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6847 00000100:00100000:2.0:1763333187.083618:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333187.084180:0:8423:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe45d21500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8423:1848987627314304:192.168.204.28@tcp:105: 00010000:00010000:3.0:1763333187.084216:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333187.084314:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2421:x1848987613870080:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 9137us (9616us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333187.084330:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3181 00000100:00100000:1.0:1763333187.084641:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613870208 00000100:00100000:1.0:1763333187.084652:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613870208 00000100:00100000:1.0:1763333187.084733:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6848 00000100:00100000:1.0:1763333187.084744:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe450d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+39:57512:x1848987613870208:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333187.084793:0:28651:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333187.084822:0:28651:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c58885 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a384 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.084864:0:28651:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4a1dea00/0xb32e3ef184c5881c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a34c expref: 40 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333187.084874:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333187.084877:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333187.084881:0:28651:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c58885 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a384 expref: 40 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.084927:0:28651:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe4a1dea00/0xb32e3ef184c5881c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a34c expref: 40 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333187.084947:0:28651:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe4a1dea00/0xb32e3ef184c5881c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a34c expref: 40 pid: 8406 timeout: 1391 lvb_type: 1 00000100:00100000:1.0:1763333187.084964:0:28651:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42ef9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28651:1848987627314432:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333187.085043:0:28651:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff5c737540 going to sleep for 11 seconds 00000100:00080000:2.0:1763333187.085321:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1763333187.088777:0:28651:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42ef9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28651:1848987627314432:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333187.088826:0:28651:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c58885 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a384 expref: 40 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.088853:0:28651:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4742fa00, rc 0) 00000100:00100000:1.0:1763333187.088932:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe450d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+40:57512:x1848987613870208:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 4188us (5330us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333187.088942:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6848 00000100:00100000:1.0:1763333187.093520:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333187.093729:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613870336 00000100:00100000:3.0:1763333187.093744:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613870336 00010000:00010000:3.0:1763333187.093796:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4a1dea00/0xb32e3ef184c5881c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a34c expref: 40 pid: 8406 timeout: 1391 lvb_type: 1 00000100:00100000:3.0:1763333187.093846:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3182 00000100:00100000:3.0:1763333187.093858:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+40:2420:x1848987613870336:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333187.093881:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333187.093887:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe4a1dea00/0xb32e3ef184c5881c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a34c expref: 40 pid: 8406 timeout: 1391 lvb_type: 1 00010000:00010000:3.0:1763333187.093903:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe4a1dea00/0xb32e3ef184c5881c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a34c expref: 40 pid: 8406 timeout: 1391 lvb_type: 1 00010000:00010000:3.0:1763333187.093934:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4a1dea00/0xb32e3ef184c5881c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a34c expref: 40 pid: 8406 timeout: 1391 lvb_type: 1 00010000:00010000:3.0:1763333187.093956:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333187.093959:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333187.093967:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c58885 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a384 expref: 39 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.093978:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c58885 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a384 expref: 39 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.094038:0:8423:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff92fe4742fa00/0xb32e3ef184c58885 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a384 expref: 39 pid: 28651 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333187.094057:0:8423:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe45d21500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8423:1848987627314560:192.168.204.28@tcp:105: 00000100:00100000:3.0:1763333187.095825:0:8423:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7dfd8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1763333187.100935:0:8423:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe45d21500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8423:1848987627314560:192.168.204.28@tcp:105: 00010000:00010000:3.0:1763333187.100975:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333187.101061:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+39:2420:x1848987613870336:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 7203us (7552us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333187.101074:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3182 00000100:00100000:2.0:1763333187.104541:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333187.104630:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333187.104797:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613870464 00000100:00100000:0.0:1763333187.104811:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613870464 00002000:00010000:0.0:1763333187.104870:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/152 (0->18446744073709551615) 00002000:00100000:0.0:1763333187.104876:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7569e300 with x1848987613870464 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333187.104892:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7569e300. 00000100:00100000:0.0:1763333187.104930:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613870592 00000100:00100000:0.0:1763333187.104934:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613870592 00002000:00010000:0.0:1763333187.104948:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/152 (0->18446744073709551615) 00002000:00100000:0.0:1763333187.104951:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe452bed80 with x1848987613870592 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333187.104959:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe452bed80. 00000100:00100000:0.0:1763333187.104987:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1797 00000100:00100000:0.0:1763333187.104998:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7569e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2420:x1848987613870464:12345-192.168.204.28@tcp:10:lfs.0 00002000:00010000:0.0:1763333187.105278:0:24027:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763333187.105283:0:24027:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 0 -> 1763333187 00002000:00010000:0.0:1763333187.105286:0:24027:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763333187.105288:0:24027:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 0 -> 1763333187 00002000:00010000:0.0:1763333187.105291:0:24027:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333187.105739:0:24031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1798 00000100:00100000:1.0:1763333187.105753:0:24031:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe452bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+39:2420:x1848987613870592:12345-192.168.204.28@tcp:10:lfs.0 00002000:00010000:1.0:1763333187.105892:0:24031:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333187.105895:0:24031:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime from disk: 0 -> 1763333187 00002000:00010000:1.0:1763333187.105898:0:24031:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333187.105900:0:24031:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb ctime from disk: 0 -> 1763333187 00002000:00010000:1.0:1763333187.105903:0:24031:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333187.105946:0:24031:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe452bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1370b1d7-8612-4b90-ab37-e53288bbf9fd+40:2420:x1848987613870592:12345-192.168.204.28@tcp:10:lfs.0 Request processed in 196us (1314us total) trans 17179871738 rc 0/0 00000100:00100000:1.0:1763333187.105959:0:24031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1798 00002000:00010000:1.0:1763333187.105965:0:24031:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/152 (0->18446744073709551615) 00002000:00100000:1.0:1763333187.105968:0:24031:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe452bed80 with x1848987613870592 ext(0->18446744073709551615) 00002000:00010000:1.0:1763333187.105973:0:24031:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe452bed80. 00000100:00100000:0.0:1763333187.108700:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7569e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2420:x1848987613870464:12345-192.168.204.28@tcp:10:lfs.0 Request processed in 3685us (4157us total) trans 21474839077 rc 0/0 00000100:00100000:0.0:1763333187.108718:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1797 00002000:00010000:0.0:1763333187.108728:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/152 (0->18446744073709551615) 00002000:00100000:0.0:1763333187.108734:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92ff7569e300 with x1848987613870464 ext(0->18446744073709551615) 00002000:00010000:0.0:1763333187.108748:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92ff7569e300. 00000100:00100000:2.0:1763333187.112741:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333187.112867:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613870720 00000100:00100000:1.0:1763333187.112881:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613870720 00000100:00100000:1.0:1763333187.112954:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6849 00000100:00100000:1.0:1763333187.112965:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe452bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2421:x1848987613870720:12345-192.168.204.28@tcp:23:lfs.0 00000100:00100000:1.0:1763333187.113341:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe452bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2421:x1848987613870720:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 376us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333187.113400:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6849 00000100:00100000:1.0:1763333187.117392:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333187.117488:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613870848 00000100:00100000:0.0:1763333187.117502:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613870848 00000100:00100000:0.0:1763333187.117583:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6850 00000100:00100000:0.0:1763333187.117595:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e0f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2421:x1848987613870848:12345-192.168.204.28@tcp:23:lfs.0 00000100:00100000:0.0:1763333187.117758:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e0f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2421:x1848987613870848:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 165us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333187.117767:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6850 00000100:00100000:3.0:1763333187.125891:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333187.125988:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613870976 00000100:00100000:0.0:1763333187.126002:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613870976 00000100:00100000:0.0:1763333187.126105:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1799 00000100:00100000:0.0:1763333187.126118:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45d21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2419:x1848987613870976:12345-192.168.204.28@tcp:3:lfs.0 00010000:00010000:0.0:1763333187.126205:0:24027:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c5888c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.126225:0:24027:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333187.126227:0:24027:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333187.126235:0:24027:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c5888c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.126260:0:24027:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c5888c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.126451:0:24027:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c5888c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.126461:0:24027:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c5888c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.126469:0:24027:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c5888c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.126477:0:24027:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe467bf600 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333187.126482:0:24027:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c5888c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.126492:0:24027:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c5888c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.126513:0:24027:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c5888c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.126521:0:24027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c5888c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333187.126610:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45d21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2419:x1848987613870976:12345-192.168.204.28@tcp:3:lfs.0 Request processed in 493us (734us total) trans 0 rc 16384/16384 00000100:00100000:0.0:1763333187.126618:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1799 00000100:00100000:3.0:1763333187.130033:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333187.130140:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613871104 00000100:00100000:1.0:1763333187.130156:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613871104 00000100:00100000:1.0:1763333187.130260:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1800 00000100:00100000:1.0:1763333187.130273:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45d22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2418:x1848987613871104:12345-192.168.204.28@tcp:4:lfs.0 00010000:00010000:1.0:1763333187.130327:0:16635:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c58893 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.130395:0:16635:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf200/0xb32e3ef184c5887e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a37d expref: 16 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.130406:0:16635:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333187.130408:0:16635:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333187.130413:0:16635:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c58893 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.130466:0:16635:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf200/0xb32e3ef184c5887e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a37d expref: 16 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.130483:0:16635:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf200/0xb32e3ef184c5887e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a37d expref: 16 pid: 28651 timeout: 1391 lvb_type: 0 00000100:00100000:1.0:1763333187.130501:0:16635:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42efad80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:16635:1848987627314688:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333187.130606:0:16635:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff5c737540 going to sleep for 11 seconds 00000100:00100000:1.0:1763333187.134829:0:16635:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42efad80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:16635:1848987627314688:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333187.134877:0:16635:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c58893 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333187.136229:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333187.136923:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613871232 00000100:00100000:2.0:1763333187.136939:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613871232 00010000:00010000:2.0:1763333187.137058:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf200/0xb32e3ef184c5887e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a37d expref: 17 pid: 28651 timeout: 1391 lvb_type: 0 00000100:00100000:2.0:1763333187.137113:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3183 00000100:00100000:2.0:1763333187.137124:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45d22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2420:x1848987613871232:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333187.137146:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333187.137174:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf200/0xb32e3ef184c5887e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a37d expref: 17 pid: 28651 timeout: 1391 lvb_type: 0 00010000:00010000:2.0:1763333187.137190:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf200/0xb32e3ef184c5887e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a37d expref: 17 pid: 28651 timeout: 1391 lvb_type: 0 00010000:00010000:2.0:1763333187.137222:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf200/0xb32e3ef184c5887e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a37d expref: 17 pid: 28651 timeout: 1391 lvb_type: 0 00010000:00010000:2.0:1763333187.137242:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333187.137244:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333187.137261:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c58893 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.137273:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c58893 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.137312:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763333187.137502:0:16635:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c58893 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.137513:0:16635:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c58893 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333187.139357:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45d22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2420:x1848987613871232:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 2215us (3118us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333187.139375:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3183 00000001:00080000:2.0:1763333187.143041:0:24714:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839078 is committed 00002000:00010000:3.0:1763333187.143293:0:16635:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 0 -> 16384 00002000:00010000:3.0:1763333187.143300:0:16635:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 0 -> 32 00010000:00010000:3.0:1763333187.143319:0:16635:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c58893 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.143332:0:16635:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c58893 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.143343:0:16635:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c58893 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.143385:0:16635:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea200 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333187.143391:0:16635:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c58893 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.143402:0:16635:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c58893 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.143429:0:16635:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c58893 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.143437:0:16635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe42fea200/0xb32e3ef184c58893 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333187.143579:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45d22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2418:x1848987613871104:12345-192.168.204.28@tcp:4:lfs.0 Request processed in 13301us (13553us total) trans 21474839078 rc 0/0 00000100:00100000:3.0:1763333187.143592:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1800 00000100:00100000:3.0:1763333187.147486:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333187.148171:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613871360 00000100:00100000:1.0:1763333187.148189:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613871360 00000100:00100000:1.0:1763333187.148289:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6851 00000100:00100000:1.0:1763333187.148301:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45d20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2419:x1848987613871360:12345-192.168.204.28@tcp:23:lfs.0 00000100:00100000:1.0:1763333187.148527:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45d20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2419:x1848987613871360:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 228us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333187.148536:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6851 00000004:00080000:0.0:1763333187.152900:0:8605:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 1291232547816ns, next at 1292232543387ns, rc = 0 00000100:00100000:3.0:1763333187.153226:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe452bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1848987627314816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1763333187.153329:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333187.153415:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763333187.153422:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe45d26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627314944:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1763333187.153446:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333187.153487:0:10996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627314816 00000100:00100000:3.0:1763333187.153497:0:10996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627314816 00000100:00100000:3.0:1763333187.153564:0:10996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627314944 00000100:00100000:3.0:1763333187.153567:0:10996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627314944 00000100:00100000:3.0:1763333187.153606:0:10996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 789 00000100:00100000:3.0:1763333187.153614:0:10996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45d20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1848987627314816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1763333187.153640:0:10996:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 484898112 pending 0 free 3920060416 avail 3688116224 00000100:00100000:3.0:1763333187.153688:0:10996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45d20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1848987627314816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333187.153697:0:10996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 789 00000100:00100000:3.0:1763333187.153717:0:10996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 790 00000100:00100000:3.0:1763333187.153723:0:10996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45d23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1848987627314944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1763333187.153732:0:10996:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 484898112 pending 0 free 3920060416 avail 3688116224 00000100:00100000:3.0:1763333187.153754:0:10996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45d23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1848987627314944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 31us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333187.153760:0:10996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 790 00000100:00080000:3.0:1763333187.153789:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1763333187.153831:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe45d26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1848987627314944:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1763333187.153845:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe452bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1848987627314816:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1763333187.154115:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763333187.154173:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333187.154261:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe45d20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1848987627315072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1763333187.154300:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333187.154436:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613871488 00000100:00100000:0.0:1763333187.154441:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613871488 00000100:00100000:0.0:1763333187.154482:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6852 00000100:00100000:0.0:1763333187.154492:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2419:x1848987613871488:12345-192.168.204.28@tcp:23:lfs.0 00000100:00100000:0.0:1763333187.154613:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2419:x1848987613871488:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 122us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333187.154620:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6852 00000100:00100000:1.0:1763333187.154844:0:8409:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627315072 00000100:00100000:1.0:1763333187.154850:0:8409:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627315072 00000100:00100000:1.0:1763333187.154881:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 791 00000100:00100000:1.0:1763333187.154889:0:8409:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe452bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1848987627315072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1763333187.154905:0:8409:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 484898112 pending 0 free 3916034048 avail 3684511744 00000100:00100000:1.0:1763333187.154946:0:8409:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe452bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1848987627315072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333187.154952:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 791 00000100:00100000:1.0:1763333187.154994:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe45d20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1848987627315072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1763333187.159737:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333187.159912:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613871616 00000100:00100000:1.0:1763333187.159930:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613871616 00000100:00100000:1.0:1763333187.160034:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1801 00000100:00100000:1.0:1763333187.160049:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45d22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2418:x1848987613871616:12345-192.168.204.28@tcp:3:lfs.0 00010000:00010000:1.0:1763333187.160131:0:16635:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe4700ee00/0xb32e3ef184c5889a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.160153:0:16635:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333187.160156:0:16635:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333187.160164:0:16635:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4700ee00/0xb32e3ef184c5889a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [32768->49151] (req 32768->49151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.160181:0:16635:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4700ee00/0xb32e3ef184c5889a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [32768->49151] (req 32768->49151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.160851:0:16635:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe4700ee00/0xb32e3ef184c5889a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [32768->49151] (req 32768->49151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.160865:0:16635:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4700ee00/0xb32e3ef184c5889a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [32768->49151] (req 32768->49151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.160874:0:16635:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe4700ee00/0xb32e3ef184c5889a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [32768->49151] (req 32768->49151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.160888:0:16635:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700ee00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333187.160893:0:16635:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4700ee00/0xb32e3ef184c5889a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [32768->49151] (req 32768->49151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.160901:0:16635:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4700ee00/0xb32e3ef184c5889a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [32768->49151] (req 32768->49151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.160921:0:16635:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe4700ee00/0xb32e3ef184c5889a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [32768->49151] (req 32768->49151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.160928:0:16635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4700ee00/0xb32e3ef184c5889a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [32768->49151] (req 32768->49151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333187.161084:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45d22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2418:x1848987613871616:12345-192.168.204.28@tcp:3:lfs.0 Request processed in 1035us (1367us total) trans 0 rc 16384/16384 00000100:00100000:1.0:1763333187.161095:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1801 00000100:00100000:0.0:1763333187.165766:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333187.166183:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613871744 00000100:00100000:1.0:1763333187.166199:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613871744 00000100:00100000:1.0:1763333187.166301:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1802 00000100:00100000:1.0:1763333187.166314:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45d26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2420:x1848987613871744:12345-192.168.204.28@tcp:4:lfs.0 00002000:00010000:1.0:1763333187.166429:0:16635:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x98:0x0] initial LVB size: 16384, mtime: 0x691a5443, atime: 0x0, ctime: 0x691a5443, blocks: 0x20 00010000:00010000:1.0:1763333187.166441:0:16635:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c588a1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.166460:0:16635:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333187.166462:0:16635:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333187.166470:0:16635:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c588a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [32768->49151] (req 32768->49151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.166487:0:16635:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c588a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [32768->49151] (req 32768->49151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1763333187.168723:0:24714:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839079 is committed 00002000:00010000:1.0:1763333187.168863:0:16635:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 16384 -> 49152 00002000:00010000:1.0:1763333187.168870:0:16635:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 32 -> 64 00010000:00010000:1.0:1763333187.168888:0:16635:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c588a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [32768->49151] (req 32768->49151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.168901:0:16635:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c588a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [32768->49151] (req 32768->49151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.168911:0:16635:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c588a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [32768->49151] (req 32768->49151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.168918:0:16635:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700f400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333187.168923:0:16635:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c588a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [32768->49151] (req 32768->49151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.168933:0:16635:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c588a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [32768->49151] (req 32768->49151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.168956:0:16635:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c588a1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [32768->49151] (req 32768->49151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.168964:0:16635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c588a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [32768->49151] (req 32768->49151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333187.169826:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45d26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2420:x1848987613871744:12345-192.168.204.28@tcp:4:lfs.0 Request processed in 3501us (4060us total) trans 21474839079 rc 0/0 00000100:00100000:1.0:1763333187.169842:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1802 00000100:00100000:3.0:1763333187.173791:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333187.175077:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613871872 00000100:00100000:0.0:1763333187.175095:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613871872 00000100:00100000:0.0:1763333187.175188:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6853 00000100:00100000:0.0:1763333187.175202:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2419:x1848987613871872:12345-192.168.204.28@tcp:23:lfs.0 00000100:00100000:0.0:1763333187.175417:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2419:x1848987613871872:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 218us (1641us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333187.175427:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6853 00000100:00100000:2.0:1763333187.179590:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333187.179685:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613872000 00000100:00100000:0.0:1763333187.179699:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613872000 00000100:00100000:0.0:1763333187.179776:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6854 00000100:00100000:0.0:1763333187.179787:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe452bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2419:x1848987613872000:12345-192.168.204.28@tcp:23:lfs.0 00000100:00100000:0.0:1763333187.179940:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe452bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2419:x1848987613872000:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 154us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333187.179948:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6854 00000100:00100000:3.0:1763333187.183972:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333187.184679:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613872128 00000100:00100000:1.0:1763333187.184697:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613872128 00000100:00100000:1.0:1763333187.184801:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1803 00000100:00100000:1.0:1763333187.184814:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45d23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2418:x1848987613872128:12345-192.168.204.28@tcp:3:lfs.0 00010000:00010000:1.0:1763333187.184867:0:16635:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c588a8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.184886:0:16635:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333187.184889:0:16635:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333187.184897:0:16635:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c588a8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [65536->122879] (req 65536->122879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.184913:0:16635:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c588a8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [65536->122879] (req 65536->122879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.190135:0:16635:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c588a8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [65536->122879] (req 65536->122879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.190159:0:16635:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c588a8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [65536->122879] (req 65536->122879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.190169:0:16635:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c588a8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [65536->122879] (req 65536->122879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.190183:0:16635:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700f400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333187.190188:0:16635:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c588a8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [65536->122879] (req 65536->122879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.190197:0:16635:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c588a8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [65536->122879] (req 65536->122879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.190222:0:16635:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c588a8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [65536->122879] (req 65536->122879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.190230:0:16635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c588a8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [65536->122879] (req 65536->122879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333187.191272:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45d23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2418:x1848987613872128:12345-192.168.204.28@tcp:3:lfs.0 Request processed in 6437us (7297us total) trans 0 rc 55866/55866 00000100:00100000:1.0:1763333187.191289:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1803 00000100:00100000:2.0:1763333187.194807:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333187.195179:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613872256 00000100:00100000:1.0:1763333187.195195:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613872256 00000100:00100000:1.0:1763333187.195512:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1804 00000100:00100000:1.0:1763333187.195524:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe452bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2420:x1848987613872256:12345-192.168.204.28@tcp:4:lfs.0 00002000:00010000:1.0:1763333187.195591:0:16635:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x98:0x0] initial LVB size: 49152, mtime: 0x691a5443, atime: 0x0, ctime: 0x691a5443, blocks: 0x40 00010000:00010000:1.0:1763333187.195603:0:16635:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe4700ee00/0xb32e3ef184c588af lrc: 3/0,1 mode: --/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.195620:0:16635:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333187.195622:0:16635:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333187.195630:0:16635:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4700ee00/0xb32e3ef184c588af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [65536->122879] (req 65536->122879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.195645:0:16635:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4700ee00/0xb32e3ef184c588af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [65536->122879] (req 65536->122879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1763333187.208044:0:24714:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839080 is committed 00002000:00010000:3.0:1763333187.209784:0:16635:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 49152 -> 121402 00002000:00010000:3.0:1763333187.209795:0:16635:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 64 -> 176 00010000:00010000:3.0:1763333187.209814:0:16635:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe4700ee00/0xb32e3ef184c588af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [65536->122879] (req 65536->122879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.209828:0:16635:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4700ee00/0xb32e3ef184c588af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [65536->122879] (req 65536->122879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.209840:0:16635:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe4700ee00/0xb32e3ef184c588af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [65536->122879] (req 65536->122879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.209848:0:16635:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700ee00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333187.209854:0:16635:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4700ee00/0xb32e3ef184c588af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [65536->122879] (req 65536->122879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.209862:0:16635:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4700ee00/0xb32e3ef184c588af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [65536->122879] (req 65536->122879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.209888:0:16635:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe4700ee00/0xb32e3ef184c588af lrc: 2/0,0 mode: --/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [65536->122879] (req 65536->122879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.209896:0:16635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4700ee00/0xb32e3ef184c588af lrc: 0/0,0 mode: --/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [65536->122879] (req 65536->122879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333187.210047:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe452bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2420:x1848987613872256:12345-192.168.204.28@tcp:4:lfs.0 Request processed in 14518us (15252us total) trans 21474839080 rc 0/0 00000100:00100000:3.0:1763333187.210062:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1804 00000100:00100000:2.0:1763333187.220465:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333187.220806:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613872384 00000100:00100000:0.0:1763333187.220821:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613872384 00000100:00100000:0.0:1763333187.220906:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9687 00000100:00100000:0.0:1763333187.220918:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe452be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+100:57512:x1848987613872384:12345-192.168.204.28@tcp:44:lfs.0 00000001:00080000:0.0:1763333187.233999:0:32345:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935451 is committed 00000020:00080000:0.0:1763333187.234134:0:32345:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff92ff801ea240 refcount 2 committed 0 result 0 batchid 4294969303 00000020:00080000:0.0:1763333187.234143:0:32345:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff92ff77ca5200 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff92ff801ea9c0 00000020:00080000:0.0:1763333187.234147:0:32345:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000405:0x2:0x0].5 00000020:00080000:0.0:1763333187.234151:0:32345:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff92ff77ca5e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff92fe45ede400 00000020:00080000:0.0:1763333187.234154:0:32345:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000bd0:0x2:0x0].8 00000100:00100000:3.0:1763333187.234571:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe452be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+50:57512:x1848987613872384:12345-192.168.204.28@tcp:44:lfs.0 Request processed in 13634us (14100us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333187.234585:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9687 00010000:00010000:1.0:1763333187.235212:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c5852f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235229:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c5852f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235238:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c5852f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235253:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333187.235259:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c5852f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235269:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c5852f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235288:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x85409d3b (ffff92ff42c64900) 00010000:00010000:1.0:1763333187.235292:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333187.235297:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c5852f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235304:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42fea800/0xb32e3ef184c5852f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235335:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c58536 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235345:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c58536 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235400:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c58536 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235405:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42feb400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333187.235408:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c58536 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235413:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c58536 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235421:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff92ff42c64000) 00010000:00010000:1.0:1763333187.235423:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333187.235426:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c58536 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235431:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42feb400/0xb32e3ef184c58536 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235442:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c5853d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235447:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c5853d lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235453:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c5853d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235458:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe42fea000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333187.235461:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c5853d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235470:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c5853d lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235476:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0x0 (ffff92ff42c64400) 00010000:00010000:1.0:1763333187.235478:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333187.235482:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c5853d lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235486:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe42fea000/0xb32e3ef184c5853d lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235505:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c585c9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235511:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c585c9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235516:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c585c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235521:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333187.235524:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c585c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235529:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c585c9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235535:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0xdd396665 (ffff92fe43b44b00) 00010000:00010000:1.0:1763333187.235538:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333187.235540:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c585c9 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235546:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c585c9 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235562:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c58624 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.235568:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c58624 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.235574:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c58624 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.235579:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333187.235581:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c58624 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.235587:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c58624 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.235594:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333187.235597:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333187.235600:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c58624 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.235605:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c58624 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.235617:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c5864e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0xe8098f29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235623:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c5864e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0xe8098f29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235628:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c5864e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0xe8098f29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235637:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700f000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333187.235640:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c5864e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0xe8098f29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235645:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c5864e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0xe8098f29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235651:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0xe8098f29 (ffff92ff4ad5ec00) 00010000:00010000:1.0:1763333187.235653:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333187.235656:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c5864e lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x6:0x0].0xe8098f29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235662:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c5864e lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x6:0x0].0xe8098f29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235676:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58686 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.235687:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58686 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.235692:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58686 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.235696:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7ec00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333187.235700:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58686 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.235704:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58686 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.235711:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333187.235714:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333187.235717:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58686 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.235721:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58686 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.235731:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5868d lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235736:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5868d lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235742:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5868d lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235746:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333187.235749:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5868d lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235753:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5868d lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235760:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333187.235762:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333187.235764:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5868d lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235769:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c5868d lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235779:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c586a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.235784:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c586a2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.235790:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c586a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.235795:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdfe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333187.235798:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c586a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.235804:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c586a2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.235812:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333187.235814:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333187.235817:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c586a2 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.235822:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c586a2 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.235832:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c586be lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235838:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c586be lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235843:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c586be lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235847:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700e000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333187.235850:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c586be lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235855:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c586be lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235865:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333187.235867:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333187.235869:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c586be lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235873:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c586be lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235883:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c586d3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.235887:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c586d3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.235893:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c586d3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.235897:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46ac4a00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333187.235900:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c586d3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.235904:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c586d3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.235911:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333187.235913:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333187.235915:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c586d3 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.235920:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac4a00/0xb32e3ef184c586d3 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.235931:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c586da lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.235938:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c586da lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.235943:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c586da lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.235948:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4742e000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333187.235952:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c586da lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.235957:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c586da lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.235965:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333187.235967:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333187.235970:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c586da lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.235976:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c586da lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.235987:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c586e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235992:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c586e1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.235997:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c586e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.236001:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700fe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333187.236004:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c586e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.236013:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c586e1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.236020:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333187.236022:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333187.236024:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c586e1 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.236029:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c586e1 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.236037:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c586fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.236042:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c586fd lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.236047:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c586fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.236051:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4742fc00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333187.236054:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c586fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.236058:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c586fd lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.236065:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333187.236066:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333187.236069:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c586fd lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.236073:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c586fd lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.236082:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c58712 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.236087:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c58712 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.236092:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c58712 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.236096:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff4139a800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333187.236099:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c58712 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.236104:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c58712 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.236110:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333187.236112:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333187.236114:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c58712 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.236119:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c58712 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.236129:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a000/0xb32e3ef184c58727 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.236134:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a000/0xb32e3ef184c58727 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.236139:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a000/0xb32e3ef184c58727 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.236143:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff4139a000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333187.236146:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a000/0xb32e3ef184c58727 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.236151:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a000/0xb32e3ef184c58727 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.236157:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333187.236159:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333187.236161:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a000/0xb32e3ef184c58727 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.236166:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a000/0xb32e3ef184c58727 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.236173:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b06600/0xb32e3ef184c5873c lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.236178:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b06600/0xb32e3ef184c5873c lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.236182:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b06600/0xb32e3ef184c5873c lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.236186:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46b06600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333187.236188:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b06600/0xb32e3ef184c5873c lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.236193:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b06600/0xb32e3ef184c5873c lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.236199:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333187.236201:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333187.236203:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b06600/0xb32e3ef184c5873c lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.236211:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b06600/0xb32e3ef184c5873c lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.236221:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b06200/0xb32e3ef184c58751 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.236227:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b06200/0xb32e3ef184c58751 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.236232:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b06200/0xb32e3ef184c58751 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.236236:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46b06200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333187.236239:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b06200/0xb32e3ef184c58751 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.236243:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b06200/0xb32e3ef184c58751 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.236262:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333187.236264:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333187.236267:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b06200/0xb32e3ef184c58751 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.236273:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b06200/0xb32e3ef184c58751 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.236284:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b07a00/0xb32e3ef184c58766 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.236290:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b07a00/0xb32e3ef184c58766 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.236295:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b07a00/0xb32e3ef184c58766 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.236301:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46b07a00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333187.236303:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b07a00/0xb32e3ef184c58766 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.236310:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b07a00/0xb32e3ef184c58766 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.236317:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333187.236319:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333187.236321:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b07a00/0xb32e3ef184c58766 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.236326:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b07a00/0xb32e3ef184c58766 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT0 00010000:00010000:1.0:1763333187.236336:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e43c00/0xb32e3ef184c5877b lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.236341:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e43c00/0xb32e3ef184c5877b lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.236346:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e43c00/0xb32e3ef184c5877b lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.236382:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe46e43c00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333187.236385:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e43c00/0xb32e3ef184c5877b lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.236390:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e43c00/0xb32e3ef184c5877b lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.236397:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333187.236399:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333187.236402:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e43c00/0xb32e3ef184c5877b lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.236407:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46e43c00/0xb32e3ef184c5877b lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 00010000:00010000:1.0:1763333187.236419:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a99800/0xb32e3ef184c58790 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333187.236425:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a99800/0xb32e3ef184c58790 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333187.236429:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a99800/0xb32e3ef184c58790 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333187.236433:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff73a99800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333187.236436:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a99800/0xb32e3ef184c58790 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333187.236441:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a99800/0xb32e3ef184c58790 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333187.236447:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333187.236449:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333187.236452:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a99800/0xb32e3ef184c58790 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333187.236457:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff73a99800/0xb32e3ef184c58790 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333187.236465:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4a1df000/0xb32e3ef184c587a5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333187.236471:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4a1df000/0xb32e3ef184c587a5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333187.236480:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4a1df000/0xb32e3ef184c587a5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333187.236484:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4a1df000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333187.236487:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4a1df000/0xb32e3ef184c587a5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333187.236492:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4a1df000/0xb32e3ef184c587a5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333187.236498:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333187.236501:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333187.236503:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4a1df000/0xb32e3ef184c587a5 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333187.236508:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4a1df000/0xb32e3ef184c587a5 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333187.236519:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c58870 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333187.236524:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c58870 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333187.236529:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c58870 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333187.236534:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333187.236536:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c58870 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333187.236541:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c58870 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333187.236551:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x58:0x0].0x0 (ffff92ff42c64a00) 00010000:00010000:1.0:1763333187.236553:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333187.236556:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c58870 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333187.236561:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c58870 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 00000020:00080000:2.0:1763333187.237279:0:32374:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969303 committed batchid 4294969302 00000020:00080000:2.0:1763333187.237427:0:32374:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969302 00000100:00100000:2.0:1763333187.240933:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333187.241274:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333187.241899:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613872640 00000100:00100000:0.0:1763333187.241914:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613872640 00000100:00100000:0.0:1763333187.241989:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613872512 00000100:00100000:0.0:1763333187.241993:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613872512 00000100:00100000:0.0:1763333187.242025:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6855 00000100:00100000:0.0:1763333187.242037:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe452bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+40:2420:x1848987613872640:12345-192.168.204.28@tcp:16:lfs.0 00000100:00100000:0.0:1763333187.242134:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6856 00000100:00100000:0.0:1763333187.242141:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe452bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2420:x1848987613872512:12345-192.168.204.28@tcp:16:lfs.0 00000100:00100000:0.0:1763333187.242268:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe452bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2420:x1848987613872512:12345-192.168.204.28@tcp:16:lfs.0 Request processed in 125us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333187.242275:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6856 00000001:00080000:2.0:1763333187.247618:0:26035:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871738 is committed 00000001:00080000:2.0:1763333187.247702:0:26035:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871713 is committed 00000100:00100000:0.0:1763333187.253313:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe452bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2420:x1848987613872640:12345-192.168.204.28@tcp:16:lfs.0 Request processed in 11254us (12373us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333187.253334:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6855 00000100:00100000:2.0:1763333187.275630:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333187.275674:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333187.275710:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333187.275812:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613872768 00000100:00100000:3.0:1763333187.275826:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613872768 00000100:00100000:3.0:1763333187.275900:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6857 00000100:00100000:3.0:1763333187.275911:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe452bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2421:x1848987613872768:12345-192.168.204.28@tcp:1:lfs.0 00010000:00010000:3.0:1763333187.275975:0:28651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96c00/0xb32e3ef184c588b6 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.276005:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333187.276007:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333187.276014:0:28651:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96c00/0xb32e3ef184c588b6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.276030:0:28651:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96c00/0xb32e3ef184c588b6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.276062:0:28651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96c00/0xb32e3ef184c588b6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.276070:0:28651:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96c00/0xb32e3ef184c588b6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.276078:0:28651:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96c00/0xb32e3ef184c588b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.276086:0:28651:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96c00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333187.276090:0:28651:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96c00/0xb32e3ef184c588b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.276099:0:28651:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96c00/0xb32e3ef184c588b6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.276117:0:28651:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96c00/0xb32e3ef184c588b6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.276126:0:28651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96c00/0xb32e3ef184c588b6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333187.276214:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe452bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2421:x1848987613872768:12345-192.168.204.28@tcp:1:lfs.0 Request processed in 305us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333187.276221:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6857 00000100:00100000:3.0:1763333187.276241:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613873024 00000100:00100000:3.0:1763333187.276255:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613873024 00000100:00100000:3.0:1763333187.276272:0:28651:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613872896 00000100:00100000:3.0:1763333187.276275:0:28651:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613872896 00000100:00100000:3.0:1763333187.276303:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6858 00000100:00100000:3.0:1763333187.276309:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe452bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2421:x1848987613873024:12345-192.168.204.28@tcp:1:lfs.0 00010000:00010000:3.0:1763333187.276326:0:28651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c588bd lrc: 3/1,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.276334:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333187.276335:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333187.276339:0:28651:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c588bd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.276396:0:28651:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c588bd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.276410:0:28651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c588bd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.276416:0:28651:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c588bd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.276424:0:28651:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c588bd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.276429:0:28651:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333187.276431:0:28651:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c588bd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.276437:0:28651:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c588bd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.276445:0:28651:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c588bd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.276451:0:28651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c588bd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333187.276477:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe452bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2421:x1848987613873024:12345-192.168.204.28@tcp:1:lfs.0 Request processed in 168us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333187.276483:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6858 00000100:00100000:3.0:1763333187.276495:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6859 00000100:00100000:3.0:1763333187.276500:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe452bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2421:x1848987613872896:12345-192.168.204.28@tcp:1:lfs.0 00010000:00010000:3.0:1763333187.276520:0:28651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c588c4 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.276528:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333187.276530:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333187.276533:0:28651:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c588c4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.276542:0:28651:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c588c4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.276558:0:28651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c588c4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.276564:0:28651:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c588c4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.276570:0:28651:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c588c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.276576:0:28651:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97200 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333187.276579:0:28651:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c588c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.276585:0:28651:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c588c4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.276593:0:28651:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c588c4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.276599:0:28651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a97200/0xb32e3ef184c588c4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333187.276636:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe452bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2421:x1848987613872896:12345-192.168.204.28@tcp:1:lfs.0 Request processed in 135us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333187.276642:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6859 00000100:00100000:3.0:1763333187.288438:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333187.288540:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613873280 00000100:00100000:0.0:1763333187.288551:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613873280 00000100:00100000:0.0:1763333187.288616:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9688 00000100:00100000:0.0:1763333187.288627:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45d20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:57512:x1848987613873280:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:0.0:1763333187.288719:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a000/0xb32e3ef184c588cb lrc: 3/0,1 mode: --/PW res: [0x200000405:0x58:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333187.288737:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a000/0xb32e3ef184c588cb lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333187.288750:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a000/0xb32e3ef184c588cb lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 00000004:00010000:0.0:1763333187.288893:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009abc4588 reply state 00000000a618fc21 transno 8589935452 ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a000/0xb32e3ef184c588cb lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333187.288907:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a000/0xb32e3ef184c588cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x58:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333187.288915:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x58:0x0].0x0 (ffff92ff42c64a00) 00010000:00010000:0.0:1763333187.288919:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333187.288924:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763333187.289031:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45d20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+31:57512:x1848987613873280:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 405us (604us total) trans 8589935452 rc 0/0 00000100:00100000:0.0:1763333187.289040:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9688 00000100:00100000:0.0:1763333187.298836:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333187.298879:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333187.298958:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613873408 00000100:00100000:1.0:1763333187.298976:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613873408 00000100:00100000:1.0:1763333187.299069:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613873536 00000100:00100000:1.0:1763333187.299073:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613873536 00000100:00100000:1.0:1763333187.299128:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6860 00000100:00100000:1.0:1763333187.299146:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45d24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+13:2420:x1848987613873408:12345-192.168.204.28@tcp:2:lfs.0 00000100:00100000:3.0:1763333187.299213:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6861 00000100:00100000:3.0:1763333187.299233:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2420:x1848987613873536:12345-192.168.204.28@tcp:2:lfs.0 00002000:00010000:3.0:1763333187.299487:0:8404:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333187.299492:0:8404:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime from disk: 1763333187 -> 1763333187 00002000:00010000:3.0:1763333187.299494:0:8404:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime from disk: 0 -> 1763333187 00002000:00010000:3.0:1763333187.299496:0:8404:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb ctime from disk: 1763333187 -> 1763333187 00002000:00010000:3.0:1763333187.299499:0:8404:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333187.299528:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45d24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2420:x1848987613873408:12345-192.168.204.28@tcp:2:lfs.0 Request processed in 386us (697us total) trans 21474839081 rc 0/0 00000100:00100000:1.0:1763333187.299539:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6860 00000100:00100000:3.0:1763333187.299554:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2420:x1848987613873536:12345-192.168.204.28@tcp:2:lfs.0 Request processed in 327us (670us total) trans 17179871739 rc 0/0 00000100:00100000:3.0:1763333187.299564:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6861 00000100:00100000:2.0:1763333187.307239:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333187.307380:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613873792 00000100:00100000:0.0:1763333187.307391:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613873792 00000100:00100000:0.0:1763333187.307454:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9689 00000100:00100000:0.0:1763333187.307465:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe452be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+31:57512:x1848987613873792:12345-192.168.204.28@tcp:55:lfs.0 00010000:00010000:0.0:1763333187.307533:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c588d2 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x58:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333187.307549:0:6521:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58869 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x58:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a36f expref: 31 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.307558:0:6521:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c588d2 lrc: 4/0,1 mode: --/PW res: [0x200000405:0x58:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333187.307589:0:6521:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58869 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x58:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a36f expref: 31 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.307602:0:6521:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58869 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x58:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a36f expref: 31 pid: 6519 timeout: 1391 lvb_type: 0 00000100:00100000:0.0:1763333187.307615:0:6521:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe45d24a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1848987627315200:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333187.307692:0:6521:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff49dd4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1763333187.312900:0:6521:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe45d24a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1848987627315200:192.168.204.28@tcp:104: 00010000:00010000:0.0:1763333187.312933:0:6521:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c588d2 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x58:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 00000100:00100000:2.0:1763333187.318746:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333187.318959:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613873920 00000100:00100000:3.0:1763333187.318970:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613873920 00010000:00010000:3.0:1763333187.319015:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58869 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x58:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a36f expref: 32 pid: 6519 timeout: 1391 lvb_type: 0 00000100:00100000:3.0:1763333187.319059:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3184 00000100:00100000:3.0:1763333187.319069:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff800d8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+32:2419:x1848987613873920:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333187.319084:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333187.319091:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58869 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x58:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a36f expref: 32 pid: 6519 timeout: 1391 lvb_type: 0 00010000:00010000:3.0:1763333187.319111:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58869 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x58:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a36f expref: 32 pid: 6519 timeout: 1391 lvb_type: 0 00010000:00010000:3.0:1763333187.319134:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58869 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x58:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a36f expref: 32 pid: 6519 timeout: 1391 lvb_type: 0 00010000:00010000:3.0:1763333187.319150:0:8423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x58:0x0].0x0 (ffff92ff42c64a00) 00010000:00010000:3.0:1763333187.319155:0:8423:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c588d2 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x58:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333187.319165:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c588d2 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x58:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333187.319172:0:8423:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c588d2 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x58:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333187.319206:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333187.319279:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff800d8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+31:2419:x1848987613873920:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 211us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333187.319287:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3184 00010000:00010000:0.0:1763333187.319575:0:6521:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c588d2 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x58:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333187.319584:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c588d2 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x58:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333187.319626:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c588d2 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x58:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333187.319632:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c588d2 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x58:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333187.319639:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c588d2 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x58:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333187.319644:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff4139a800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333187.319648:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c588d2 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x58:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333187.319655:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c588d2 lrc: 4/0,0 mode: PW/PW res: [0x200000405:0x58:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333187.319665:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x58:0x0].0x0 (ffff92ff42c64a00) 00010000:00010000:0.0:1763333187.319668:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1763333187.319671:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c588d2 lrc: 2/0,0 mode: --/PW res: [0x200000405:0x58:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333187.319677:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c588d2 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x58:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 00000100:00100000:0.0:1763333187.319731:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe452be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:57512:x1848987613873792:12345-192.168.204.28@tcp:55:lfs.0 Request processed in 12268us (12501us total) trans 0 rc -22/-22 00000100:00100000:0.0:1763333187.319740:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9689 00000100:00100000:2.0:1763333187.329879:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333187.329982:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613874176 00000100:00100000:0.0:1763333187.329997:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613874176 00000100:00100000:0.0:1763333187.330073:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9690 00000100:00100000:0.0:1763333187.330083:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe452bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:57512:x1848987613874176:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:0.0:1763333187.330141:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333187.330170:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4a1de000/0xb32e3ef184c587b3 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a322 expref: 30 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.330190:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:0.0:1763333187.330196:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333187.330263:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c588d9 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333187.330278:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c588d9 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333187.330288:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c588d9 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 00000004:00010000:0.0:1763333187.330461:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006d0eab59 reply state 000000003dea2b32 transno 8589935453 ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c588d9 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333187.330474:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c588d9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333187.330480:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:0.0:1763333187.330483:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763333187.330486:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763333187.330580:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe452bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+31:57512:x1848987613874176:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 498us (714us total) trans 8589935453 rc 0/0 00000100:00100000:0.0:1763333187.330588:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9690 00000100:00100000:1.0:1763333187.338670:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333187.338788:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613874304 00000100:00100000:0.0:1763333187.338799:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613874304 00000100:00100000:0.0:1763333187.338862:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6862 00000100:00100000:0.0:1763333187.338872:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+14:2420:x1848987613874304:12345-192.168.204.28@tcp:2:lfs.0 00002000:00010000:0.0:1763333187.339026:0:28650:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 121402 -> 121402 00002000:00010000:0.0:1763333187.339031:0:28650:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763333187 -> 1763333187 00002000:00010000:0.0:1763333187.339033:0:28650:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1763333186 -> 1763333187 00002000:00010000:0.0:1763333187.339035:0:28650:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763333187 -> 1763333187 00002000:00010000:0.0:1763333187.339037:0:28650:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 224 -> 224 00000100:00100000:0.0:1763333187.339089:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2420:x1848987613874304:12345-192.168.204.28@tcp:2:lfs.0 Request processed in 219us (429us total) trans 21474839082 rc 0/0 00000100:00100000:0.0:1763333187.339097:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6862 00000100:00100000:2.0:1763333187.346500:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333187.346570:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333187.346724:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613874432 00000100:00100000:1.0:1763333187.346735:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613874432 00000100:00100000:1.0:1763333187.346786:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613874560 00000100:00100000:1.0:1763333187.346789:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613874560 00000100:00100000:1.0:1763333187.346821:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6863 00000100:00100000:1.0:1763333187.346832:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe452bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2421:x1848987613874432:12345-192.168.204.28@tcp:2:lfs.0 00002000:00010000:1.0:1763333187.346982:0:28650:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333187.346986:0:28650:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1763333187 -> 1763333187 00002000:00010000:1.0:1763333187.346988:0:28650:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 0 -> 1763333187 00002000:00010000:1.0:1763333187.346991:0:28650:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1763333187 -> 1763333187 00002000:00010000:1.0:1763333187.346994:0:28650:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:1.0:1763333187.347067:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe452bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2421:x1848987613874432:12345-192.168.204.28@tcp:2:lfs.0 Request processed in 236us (578us total) trans 17179871740 rc 0/0 00000100:00100000:1.0:1763333187.347076:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6863 00000100:00100000:1.0:1763333187.347094:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6864 00000100:00100000:1.0:1763333187.347100:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe452bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2421:x1848987613874560:12345-192.168.204.28@tcp:2:lfs.0 00002000:00010000:1.0:1763333187.347166:0:28650:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333187.347169:0:28650:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1763333187 -> 1763333187 00002000:00010000:1.0:1763333187.347172:0:28650:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 1763333187 00002000:00010000:1.0:1763333187.347174:0:28650:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1763333187 -> 1763333187 00002000:00010000:1.0:1763333187.347176:0:28650:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333187.347196:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe452bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2421:x1848987613874560:12345-192.168.204.28@tcp:2:lfs.0 Request processed in 96us (627us total) trans 21474839083 rc 0/0 00000100:00100000:1.0:1763333187.347202:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6864 00000100:00100000:1.0:1763333187.349827:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333187.350562:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613874816 00000100:00100000:2.0:1763333187.350572:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613874816 00000100:00100000:2.0:1763333187.350627:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3298 00000100:00100000:2.0:1763333187.350636:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6b3ed050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+31:57512:x1848987613874816:12345-192.168.204.28@tcp:35:lfs.0 00000004:00010000:2.0:1763333187.350713:0:19668:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x55:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c5882a lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a353 expref: 31 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.350756:0:19668:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465eec00/0xb32e3ef184c588e0 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19668 initiator: MDT0 00010000:00010000:2.0:1763333187.350769:0:19668:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5861d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a28f expref: 31 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.350776:0:19668:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c586c5 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2ce expref: 31 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.350783:0:19668:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465eec00/0xb32e3ef184c588e0 lrc: 5/0,1 mode: --/EX res: [0x200000405:0x55:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19668 initiator: MDT0 00010000:00010000:2.0:1763333187.350815:0:19668:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c586c5 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2ce expref: 31 pid: 6520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.350827:0:19668:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c586c5 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2ce expref: 31 pid: 6520 timeout: 1391 lvb_type: 0 00000100:00100000:2.0:1763333187.350841:0:19668:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe452bf480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:19668:1848987627315328:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333187.351299:0:19668:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5861d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a28f expref: 31 pid: 12741 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.351308:0:19668:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5861d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a28f expref: 31 pid: 12741 timeout: 1391 lvb_type: 0 00000100:00100000:2.0:1763333187.351316:0:19668:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe452bd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:19668:1848987627315456:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333187.352294:0:19668:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe45198180 going to sleep for 11 seconds 00000100:00100000:2.0:1763333187.362518:0:19668:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe452bf480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:19668:1848987627315328:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333187.363887:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333187.364824:0:19668:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe452bd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:19668:1848987627315456:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333187.364859:0:19668:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465eec00/0xb32e3ef184c588e0 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x55:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19668 initiator: MDT0 00000100:00100000:1.0:1763333187.365020:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333187.365105:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613874944 00000100:00100000:3.0:1763333187.365113:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613874944 00010000:00010000:3.0:1763333187.365147:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c586c5 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2ce expref: 32 pid: 6520 timeout: 1391 lvb_type: 0 00000100:00100000:3.0:1763333187.365180:0:28428:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613875072 00000100:00100000:3.0:1763333187.365183:0:28428:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613875072 00010000:00010000:3.0:1763333187.365195:0:28428:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5861d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a28f expref: 33 pid: 12741 timeout: 1391 lvb_type: 0 00000100:00100000:3.0:1763333187.365227:0:28428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3185 00000100:00100000:3.0:1763333187.365236:0:28428:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+33:2421:x1848987613874944:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333187.365259:0:28428:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333187.365266:0:28428:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c586c5 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2ce expref: 33 pid: 6520 timeout: 1391 lvb_type: 0 00010000:00010000:3.0:1763333187.365278:0:28428:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c586c5 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2ce expref: 33 pid: 6520 timeout: 1391 lvb_type: 0 00010000:00010000:3.0:1763333187.365300:0:28428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac4800/0xb32e3ef184c586c5 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2ce expref: 33 pid: 6520 timeout: 1391 lvb_type: 0 00010000:00010000:3.0:1763333187.365315:0:28428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:3.0:1763333187.365320:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465eec00/0xb32e3ef184c588e0 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x55:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19668 initiator: MDT0 00010000:00010000:3.0:1763333187.365329:0:28428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465eec00/0xb32e3ef184c588e0 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x55:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19668 initiator: MDT0 00010000:00010000:3.0:1763333187.365346:0:28428:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333187.365432:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3186 00000100:00100000:3.0:1763333187.365438:0:28428:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+32:2421:x1848987613874944:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 201us (1554us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333187.365445:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+32:2421:x1848987613875072:12345-192.168.204.28@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1763333187.365451:0:28428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3185 00010000:00010000:2.0:1763333187.365457:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333187.365466:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5861d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a28f expref: 31 pid: 12741 timeout: 1391 lvb_type: 0 00010000:00010000:2.0:1763333187.365479:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5861d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a28f expref: 31 pid: 12741 timeout: 1391 lvb_type: 0 00010000:00010000:2.0:1763333187.365494:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c5861d lrc: 0/0,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a28f expref: 31 pid: 12741 timeout: 1391 lvb_type: 0 00010000:00010000:2.0:1763333187.365506:0:8423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:2.0:1763333187.365510:0:8423:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465eec00/0xb32e3ef184c588e0 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x55:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19668 initiator: MDT0 00010000:00010000:2.0:1763333187.365517:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465eec00/0xb32e3ef184c588e0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19668 initiator: MDT0 00010000:00010000:2.0:1763333187.365524:0:8423:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465eec00/0xb32e3ef184c588e0 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19668 initiator: MDT0 00010000:00010000:2.0:1763333187.365553:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333187.365576:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:2421:x1848987613875072:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 136us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333187.365583:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3186 00010000:00010000:3.0:1763333187.365637:0:19668:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465eec00/0xb32e3ef184c588e0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19668 initiator: MDT0 00010000:00010000:3.0:1763333187.365645:0:19668:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465eec00/0xb32e3ef184c588e0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19668 initiator: MDT0 00010000:00010000:3.0:1763333187.365671:0:19668:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c588e7 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x58:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19668 initiator: MDT0 00010000:00010000:3.0:1763333187.365682:0:19668:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c58877 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x58:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a376 expref: 29 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.365691:0:19668:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c588e7 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x58:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19668 initiator: MDT0 00010000:00010000:3.0:1763333187.365719:0:19668:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c58877 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x58:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a376 expref: 29 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.365731:0:19668:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c58877 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x58:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a376 expref: 29 pid: 6521 timeout: 1391 lvb_type: 0 00000100:00100000:3.0:1763333187.365745:0:19668:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe45d22a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:19668:1848987627315584:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333187.365805:0:19668:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7ad029c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763333187.378526:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333187.379630:0:19668:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe45d22a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:19668:1848987627315584:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333187.379679:0:19668:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c588e7 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x58:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19668 initiator: MDT0 00000100:00100000:2.0:1763333187.380455:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613875200 00000100:00100000:2.0:1763333187.380469:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613875200 00010000:00010000:0.0:1763333187.380610:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c58877 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x58:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a376 expref: 30 pid: 6521 timeout: 1391 lvb_type: 0 00000100:00100000:0.0:1763333187.380670:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3187 00000100:00100000:0.0:1763333187.380682:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:2421:x1848987613875200:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333187.380701:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333187.380707:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c58877 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x58:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a376 expref: 30 pid: 6521 timeout: 1391 lvb_type: 0 00010000:00010000:0.0:1763333187.380720:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c58877 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x58:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a376 expref: 30 pid: 6521 timeout: 1391 lvb_type: 0 00010000:00010000:0.0:1763333187.380743:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46ac5e00/0xb32e3ef184c58877 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x58:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a376 expref: 30 pid: 6521 timeout: 1391 lvb_type: 0 00010000:00010000:0.0:1763333187.380765:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x58:0x0].0x0 (ffff92ff42c64a00) 00010000:00010000:0.0:1763333187.380770:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c588e7 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x58:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19668 initiator: MDT0 00010000:00010000:0.0:1763333187.380779:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c588e7 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x58:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19668 initiator: MDT0 00010000:00010000:0.0:1763333187.380785:0:6504:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c588e7 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x58:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19668 initiator: MDT0 00010000:00010000:0.0:1763333187.380811:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333187.380881:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:2421:x1848987613875200:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 202us (2371us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333187.380888:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3187 00010000:00010000:3.0:1763333187.381336:0:19668:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c588e7 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x58:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19668 initiator: MDT0 00010000:00010000:3.0:1763333187.381385:0:19668:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c588e7 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x58:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19668 initiator: MDT0 00000100:00100000:1.0:1763333187.381996:0:19668:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff74039500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:19668:1848987627315712:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1763333187.382455:0:19668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333187.383132:0:19668:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff74009840 going to sleep for 11 seconds 00000100:00100000:0.0:1763333187.383466:0:7798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627315712 00000100:00100000:0.0:1763333187.383475:0:7798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627315712 00000100:00100000:0.0:1763333187.383524:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1432 00000100:00100000:0.0:1763333187.383531:0:7798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7403b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:19668:x1848987627315712:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1763333187.383622:0:7798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7403b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:19668:x1848987627315712:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 91us (1172us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333187.383629:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1432 00000100:00100000:2.0:1763333187.383718:0:19668:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff74039500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:19668:1848987627315712:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1763333187.383788:0:19668:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe452bd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:19668:1848987627315840:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1763333187.383820:0:19668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333187.383842:0:19668:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe451980c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763333187.383886:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627315840 00000100:00100000:1.0:1763333187.383890:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627315840 00000100:00100000:1.0:1763333187.383920:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1433 00000100:00100000:1.0:1763333187.383925:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe452bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:19668:x1848987627315840:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1763333187.383985:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe452bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:19668:x1848987627315840:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 60us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333187.383992:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1433 00000100:00100000:2.0:1763333187.384209:0:19668:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe452bd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:19668:1848987627315840:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1763333187.384254:0:19668:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe452bd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:19668:1848987627315968:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1763333187.384276:0:19668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333187.384292:0:19668:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff74009300 going to sleep for 11 seconds 00000100:00100000:3.0:1763333187.384309:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627315968 00000100:00100000:3.0:1763333187.384323:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627315968 00000100:00100000:0.0:1763333187.384430:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1434 00000100:00100000:0.0:1763333187.384441:0:7798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe452bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:19668:x1848987627315968:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1763333187.384503:0:7798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe452bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:19668:x1848987627315968:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 66us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333187.384510:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1434 00000100:00100000:2.0:1763333187.384604:0:19668:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe452bd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:19668:1848987627315968:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1763333187.384633:0:19668:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe452bd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:19668:1848987627316096:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1763333187.384651:0:19668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333187.384672:0:19668:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff74009840 going to sleep for 11 seconds 00000100:00100000:0.0:1763333187.384905:0:7798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627316096 00000100:00100000:0.0:1763333187.384911:0:7798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627316096 00000100:00100000:0.0:1763333187.384952:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1435 00000100:00100000:0.0:1763333187.384959:0:7798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe452bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:19668:x1848987627316096:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1763333187.385015:0:7798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe452bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:19668:x1848987627316096:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 57us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333187.385022:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1435 00000100:00100000:2.0:1763333187.385270:0:19668:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe452bd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:19668:1848987627316096:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1763333187.385310:0:19668:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe452bd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:19668:1848987627316224:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1763333187.385336:0:19668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333187.385384:0:19668:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff74009300 going to sleep for 11 seconds 00000100:00100000:1.0:1763333187.385454:0:7798:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627316224 00000100:00100000:1.0:1763333187.385459:0:7798:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627316224 00000100:00100000:1.0:1763333187.385493:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1436 00000100:00100000:1.0:1763333187.385499:0:7798:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77b14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:19668:x1848987627316224:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1763333187.385550:0:7798:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77b14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:19668:x1848987627316224:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 51us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333187.385556:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1436 00000100:00100000:2.0:1763333187.386168:0:19668:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe452bd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:19668:1848987627316224:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1763333187.386219:0:19668:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe452bd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:19668:1848987627316352:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1763333187.386260:0:19668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333187.386288:0:19668:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff74009840 going to sleep for 11 seconds 00000100:00100000:1.0:1763333187.390854:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627316352 00000100:00100000:1.0:1763333187.390874:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627316352 00000100:00100000:1.0:1763333187.390938:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1437 00000100:00100000:1.0:1763333187.390949:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:19668:x1848987627316352:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1763333187.391106:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:19668:x1848987627316352:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 159us (4844us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333187.391114:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1437 00000100:00100000:2.0:1763333187.391260:0:19668:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe452bd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:19668:1848987627316352:0@lo:1000:mdt_rdpg00_002.0 00000040:00080000:2.0:1763333187.391644:0:19668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd0:0x2:0x0].9, 640 off43224 00000001:00080000:2.0:1763333187.391658:0:19668:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935454 00000100:00100000:2.0:1763333187.391728:0:19668:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7e121c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:19668:1848987627316480:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1763333187.391762:0:19668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333187.391942:0:19668:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff5c737540 going to sleep for 11 seconds 00000100:00100000:3.0:1763333187.391985:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627316480 00000100:00100000:3.0:1763333187.391990:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627316480 00000100:00100000:3.0:1763333187.392028:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1438 00000100:00100000:3.0:1763333187.392037:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe452bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:19668:x1848987627316480:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1763333187.392152:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe452bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:19668:x1848987627316480:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 117us (389us total) trans 17179871741 rc 0/0 00000100:00100000:3.0:1763333187.392158:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1438 00000100:00100000:2.0:1763333187.392271:0:19668:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7e121c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:19668:1848987627316480:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1763333187.392294:0:19668:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe45c4ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:19668:1848987627316608:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1763333187.392320:0:19668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333187.392428:0:19668:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff74009300 going to sleep for 11 seconds 00000100:00100000:1.0:1763333187.392456:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627316608 00000100:00100000:1.0:1763333187.392460:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627316608 00000100:00100000:1.0:1763333187.392487:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1439 00000100:00100000:1.0:1763333187.392493:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45af1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:19668:x1848987627316608:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1763333187.392591:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45af1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:19668:x1848987627316608:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 97us (269us total) trans 21474839084 rc 0/0 00000100:00100000:1.0:1763333187.392597:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1439 00000100:00100000:2.0:1763333187.392677:0:19668:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe45c4ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:19668:1848987627316608:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1763333187.392727:0:19668:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935455 00010000:00010000:2.0:1763333187.392751:0:19668:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c588e7 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x58:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19668 initiator: MDT0 00010000:00010000:2.0:1763333187.392762:0:19668:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c588e7 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x58:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19668 initiator: MDT0 00010000:00010000:2.0:1763333187.392769:0:19668:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c588e7 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x58:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19668 initiator: MDT0 00010000:00010000:2.0:1763333187.392774:0:19668:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a97200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333187.392778:0:19668:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c588e7 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x58:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19668 initiator: MDT0 00010000:00010000:2.0:1763333187.392784:0:19668:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c588e7 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x58:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19668 initiator: MDT0 00010000:00010000:2.0:1763333187.392798:0:19668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x58:0x0].0x0 (ffff92ff42c64a00) 00010000:00010000:2.0:1763333187.392802:0:19668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1763333187.392808:0:19668:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c588e7 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x58:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19668 initiator: MDT0 00010000:00010000:2.0:1763333187.392814:0:19668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c588e7 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x58:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19668 initiator: MDT0 00010000:00010000:2.0:1763333187.392827:0:19668:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465eec00/0xb32e3ef184c588e0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19668 initiator: MDT0 00010000:00010000:2.0:1763333187.392833:0:19668:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465eec00/0xb32e3ef184c588e0 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19668 initiator: MDT0 00010000:00010000:2.0:1763333187.392838:0:19668:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465eec00/0xb32e3ef184c588e0 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19668 initiator: MDT0 00010000:00010000:2.0:1763333187.392843:0:19668:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe465eec00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333187.392845:0:19668:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465eec00/0xb32e3ef184c588e0 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19668 initiator: MDT0 00010000:00010000:2.0:1763333187.392851:0:19668:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465eec00/0xb32e3ef184c588e0 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19668 initiator: MDT0 00010000:00010000:2.0:1763333187.392858:0:19668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:2.0:1763333187.392861:0:19668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1763333187.392863:0:19668:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465eec00/0xb32e3ef184c588e0 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x55:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19668 initiator: MDT0 00010000:00010000:2.0:1763333187.392868:0:19668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465eec00/0xb32e3ef184c588e0 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x55:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19668 initiator: MDT0 00010000:00010000:2.0:1763333187.392880:0:19668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:2.0:1763333187.392882:0:19668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763333187.392888:0:19668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a96000/0xb32e3ef184c5882a lrc: 0/0,0 mode: --/PW res: [0x200000405:0x55:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a353 expref: 31 pid: 6521 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333187.392984:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6b3ed050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:57512:x1848987613874816:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 42349us (43165us total) trans 8589935456 rc 0/0 00000100:00100000:2.0:1763333187.392992:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3298 00000020:00080000:2.0:1763333187.392996:0:19668:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1763333187.407152:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333187.407262:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613875328 00000100:00100000:3.0:1763333187.407273:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613875328 00000100:00100000:3.0:1763333187.407345:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9691 00000100:00100000:2.0:1763333187.407734:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff74039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:57512:x1848987613875328:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333187.407761:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333187.407783:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465eec00/0xb32e3ef184c588ee lrc: 2/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a38b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.407841:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465eec00/0xb32e3ef184c588ee lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a38b expref: 31 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.407856:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465eec00/0xb32e3ef184c588ee lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a38b expref: 31 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.407875:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:2.0:1763333187.407878:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333187.407882:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe465eec00, rc 0) 00000100:00100000:2.0:1763333187.407947:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff74039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+31:57512:x1848987613875328:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 453us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333187.407954:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9691 00000100:00100000:0.0:1763333187.417315:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333187.417433:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613875584 00000100:00100000:2.0:1763333187.417443:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613875584 00000100:00100000:2.0:1763333187.417499:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3299 00000100:00100000:2.0:1763333187.417509:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45d24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+31:57512:x1848987613875584:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333187.417711:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45d24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+32:57512:x1848987613875584:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 203us (405us total) trans 8589935457 rc 0/0 00000100:00100000:2.0:1763333187.417719:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3299 00000100:00100000:1.0:1763333187.422619:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333187.422707:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613875840 00000100:00100000:3.0:1763333187.422719:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613875840 00000100:00100000:3.0:1763333187.422804:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3300 00000100:00100000:3.0:1763333187.422815:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe44de2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+32:57512:x1848987613875840:12345-192.168.204.28@tcp:35:lfs.0 00000004:00080000:3.0:1763333187.423028:0:6523:0:(mdd_object.c:3993:mdd_close()) Object [0x200000405:0x58:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:3.0:1763333187.423124:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c588f5 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763333187.423139:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c588f5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763333187.423149:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c588f5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763333187.423158:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c588f5 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763333187.423164:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c588f5 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763333187.423170:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c588f5 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763333187.424323:0:8421:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333187.424333:0:8421:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c588f5 lrc: 4/0,0 mode: PW/PW res: [0x200000405:0x58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763333187.424342:0:8421:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333187.424346:0:8421:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c588f5 lrc: 4/0,0 mode: PW/PW res: [0x200000405:0x58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763333187.424406:0:6523:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1763333187.424519:0:8421:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c588f5 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763333187.424533:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x58:0x0].0x0 (ffff92ff42c64a00) 00010000:00010000:0.0:1763333187.424536:0:8421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763333187.424541:0:8421:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c588f5 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763333187.424546:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c588f5 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763333187.424559:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333187.424561:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333187.424562:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763333187.424899:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe44de2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+33:57512:x1848987613875840:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 2082us (2287us total) trans 8589935458 rc 0/0 00000100:00100000:2.0:1763333187.424908:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3300 00000100:00100000:1.0:1763333187.443082:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333187.443208:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613875968 00000100:00100000:2.0:1763333187.443219:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613875968 00000100:00100000:2.0:1763333187.443284:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9692 00000100:00100000:2.0:1763333187.443293:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+33:57513:x1848987613875968:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333187.443318:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333187.443340:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465ef600/0xb32e3ef184c588fc lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a392 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.443446:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465ee200/0xb32e3ef184c58903 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333187.443459:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465ee200/0xb32e3ef184c58903 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333187.443471:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465ee200/0xb32e3ef184c58903 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333187.443484:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465efc00/0xb32e3ef184c5890a lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333187.443490:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465efc00/0xb32e3ef184c5890a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333187.443496:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465efc00/0xb32e3ef184c5890a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333187.443575:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700c200/0xb32e3ef184c58911 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333187.443582:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700c200/0xb32e3ef184c58911 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333187.443588:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700c200/0xb32e3ef184c58911 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00000004:00200000:2.0:1763333187.443625:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x55:0x0]: returning size 121402 00000004:00200000:2.0:1763333187.443629:0:6519:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763333187.443647:0:6519:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700c200/0xb32e3ef184c58911 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333187.443657:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700c200/0xb32e3ef184c58911 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333187.443666:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465ee200/0xb32e3ef184c58903 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333187.443672:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465ee200/0xb32e3ef184c58903 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333187.443678:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465ee200/0xb32e3ef184c58903 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333187.443683:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465ee200/0xb32e3ef184c58903 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333187.443689:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe465ee200 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333187.443692:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465ee200/0xb32e3ef184c58903 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333187.443698:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465ee200/0xb32e3ef184c58903 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333187.443708:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0x0 (ffff92fe43a31b00) 00010000:00010000:2.0:1763333187.443711:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333187.443715:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465ee200/0xb32e3ef184c58903 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333187.443720:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465ee200/0xb32e3ef184c58903 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333187.443731:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465efc00/0xb32e3ef184c5890a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333187.443736:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465efc00/0xb32e3ef184c5890a lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333187.443740:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465efc00/0xb32e3ef184c5890a lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333187.443744:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe465efc00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333187.443747:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465efc00/0xb32e3ef184c5890a lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333187.443751:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465efc00/0xb32e3ef184c5890a lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333187.443758:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0xdd396665 (ffff92fe43a31100) 00010000:00010000:2.0:1763333187.443760:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763333187.443763:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465efc00/0xb32e3ef184c5890a lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333187.443767:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465efc00/0xb32e3ef184c5890a lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 00010000:00010000:2.0:1763333187.443795:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465ef600/0xb32e3ef184c588fc lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a392 expref: 35 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.443811:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700c200/0xb32e3ef184c58911 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a392 expref: 34 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.443819:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:2.0:1763333187.443821:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333187.443823:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4700c200, rc 0) 00000100:00100000:2.0:1763333187.443876:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+34:57513:x1848987613875968:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 584us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333187.443883:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9692 00000100:00100000:0.0:1763333187.451194:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333187.451422:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613876224 00000100:00100000:2.0:1763333187.451435:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613876224 00000100:00100000:2.0:1763333187.451501:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9693 00000100:00100000:2.0:1763333187.451512:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45d27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+34:57513:x1848987613876224:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333187.451533:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333187.451561:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700de00/0xb32e3ef184c58918 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a399 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.451710:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700ce00/0xb32e3ef184c5891f lrc: 3/1,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333187.451728:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700ce00/0xb32e3ef184c5891f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x55:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333187.451740:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700ce00/0xb32e3ef184c5891f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x55:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 00000004:00200000:2.0:1763333187.451751:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x55:0x0]: returning size 121402 00010000:00010000:2.0:1763333187.451877:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700de00/0xb32e3ef184c58918 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a399 expref: 37 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.451896:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700ce00/0xb32e3ef184c5891f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x55:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a399 expref: 36 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.451904:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:2.0:1763333187.451908:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1763333187.451911:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4700ce00, rc 0) 00000100:00100000:2.0:1763333187.451985:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45d27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+36:57513:x1848987613876224:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 473us (801us total) trans 8589935459 rc 0/0 00000100:00100000:2.0:1763333187.451993:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9693 00000100:00100000:1.0:1763333187.455744:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333187.456249:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613876480 00000100:00100000:2.0:1763333187.456259:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613876480 00000100:00100000:2.0:1763333187.456323:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9694 00000100:00100000:2.0:1763333187.456332:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe434c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+36:57513:x1848987613876480:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333187.456374:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333187.456396:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700c600/0xb32e3ef184c5892d lrc: 2/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a3a0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.456546:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465ef600/0xb32e3ef184c58934 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333187.456562:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465ef600/0xb32e3ef184c58934 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333187.456572:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465ef600/0xb32e3ef184c58934 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 00000004:00200000:2.0:1763333187.456584:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x55:0x0]: returning size 121402 00010000:00010000:2.0:1763333187.456681:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700c600/0xb32e3ef184c5892d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3a0 expref: 39 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.456698:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465ef600/0xb32e3ef184c58934 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3a0 expref: 38 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.456707:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:2.0:1763333187.456710:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763333187.456713:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe465ef600, rc 0) 00000100:00100000:2.0:1763333187.456772:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe434c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+38:57513:x1848987613876480:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 441us (1039us total) trans 8589935460 rc 0/0 00000100:00100000:2.0:1763333187.456779:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9694 00000100:00100000:1.0:1763333187.501064:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333187.501328:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613876608 00000100:00100000:3.0:1763333187.501339:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613876608 00000100:00100000:0.0:1763333187.503094:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1805 00000100:00100000:0.0:1763333187.503114:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49608700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2420:x1848987613876608:12345-192.168.204.28@tcp:3:lfs.0 00010000:00010000:0.0:1763333187.503154:0:24027:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf200/0xb32e3ef184c58942 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.503179:0:24027:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333187.503181:0:24027:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333187.503187:0:24027:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf200/0xb32e3ef184c58942 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.503200:0:24027:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf200/0xb32e3ef184c58942 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333187.516174:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:1.0:1763333187.516889:0:24027:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf200/0xb32e3ef184c58942 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.516904:0:24027:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf200/0xb32e3ef184c58942 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.516913:0:24027:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf200/0xb32e3ef184c58942 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333187.517189:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333187.517654:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613876864 00000100:00100000:3.0:1763333187.517663:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613876864 00000100:00100000:3.0:1763333187.517737:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1512 00000100:00100000:3.0:1763333187.517746:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45d26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:2421:x1848987613876864:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1763333187.517842:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45d26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:2421:x1848987613876864:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 97us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333187.517851:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1512 00010000:00010000:1.0:1763333187.518077:0:24027:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe467bf200 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333187.518082:0:24027:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf200/0xb32e3ef184c58942 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.518092:0:24027:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf200/0xb32e3ef184c58942 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.518112:0:24027:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf200/0xb32e3ef184c58942 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.518119:0:24027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe467bf200/0xb32e3ef184c58942 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333187.518163:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49608700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2420:x1848987613876608:12345-192.168.204.28@tcp:3:lfs.0 Request processed in 15058us (17108us total) trans 0 rc 121402/121402 00000100:00100000:1.0:1763333187.518171:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1805 00000100:00080000:0.0:1763333187.518474:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1763333187.518543:0:32350:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613876736 00000100:00100000:2.0:1763333187.518548:0:32350:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613876736 00000100:00100000:2.0:1763333187.518577:0:32350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 159 00000100:00100000:2.0:1763333187.518584:0:32350:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dfa6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae3ba77-d588-4a44-b5f9-fbec4e33064f+9:2421:x1848987613876736:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1763333187.518613:0:32350:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dfa6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae3ba77-d588-4a44-b5f9-fbec4e33064f+9:2421:x1848987613876736:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 30us (2449us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333187.518619:0:32350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 159 00000100:00100000:1.0:1763333187.530645:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333187.530758:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613876992 00000100:00100000:2.0:1763333187.530770:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613876992 00000100:00100000:2.0:1763333187.530846:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1806 00000100:00100000:2.0:1763333187.530855:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe49608a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2418:x1848987613876992:12345-192.168.204.28@tcp:3:lfs.0 00002000:00010000:2.0:1763333187.530905:0:24027:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x98:0x0] initial LVB size: 121402, mtime: 0x691a5443, atime: 0x691a5443, ctime: 0x691a5443, blocks: 0xb0 00010000:00010000:2.0:1763333187.530915:0:24027:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe465efc00/0xb32e3ef184c58949 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.530929:0:24027:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333187.530932:0:24027:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333187.530938:0:24027:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe465efc00/0xb32e3ef184c58949 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.530951:0:24027:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe465efc00/0xb32e3ef184c58949 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.535952:0:24027:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe465efc00/0xb32e3ef184c58949 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.535975:0:24027:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe465efc00/0xb32e3ef184c58949 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.535984:0:24027:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe465efc00/0xb32e3ef184c58949 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.535992:0:24027:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe465efc00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333187.535997:0:24027:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe465efc00/0xb32e3ef184c58949 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.536006:0:24027:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe465efc00/0xb32e3ef184c58949 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.536027:0:24027:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe465efc00/0xb32e3ef184c58949 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.536035:0:24027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe465efc00/0xb32e3ef184c58949 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24027 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333187.540286:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe49608a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2418:x1848987613876992:12345-192.168.204.28@tcp:3:lfs.0 Request processed in 9420us (9638us total) trans 0 rc 121402/121402 00000100:00100000:2.0:1763333187.540301:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1806 00000100:00100000:3.0:1763333187.551883:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333187.553656:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613877120 00000100:00100000:2.0:1763333187.553669:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613877120 00000100:00100000:1.0:1763333187.554969:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 415 00000100:00100000:1.0:1763333187.554987:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45d22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+38:57513:x1848987613877120:12345-192.168.204.28@tcp:103:lfs.0 00010000:00010000:1.0:1763333187.555007:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333187.555033:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465ef600/0xb32e3ef184c58934 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3a0 expref: 38 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.555055:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333187.555061:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333187.555129:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45d22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+37:57513:x1848987613877120:12345-192.168.204.28@tcp:103:lfs.0 Request processed in 149us (3257us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333187.555137:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 415 00000100:00100000:1.0:1763333187.563975:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333187.564108:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613877376 00000100:00100000:2.0:1763333187.564119:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613877376 00000100:00100000:2.0:1763333187.564184:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3301 00000100:00100000:2.0:1763333187.564192:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe4960b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+37:57513:x1848987613877376:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333187.564829:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe4960b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+38:57513:x1848987613877376:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 635us (862us total) trans 8589935461 rc 0/0 00000100:00100000:2.0:1763333187.564838:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3301 00000100:00100000:3.0:1763333187.575119:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333187.575410:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613877632 00000100:00100000:1.0:1763333187.575420:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613877632 00000100:00100000:1.0:1763333187.575481:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9695 00000100:00100000:1.0:1763333187.575491:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45d21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+38:57511:x1848987613877632:12345-192.168.204.28@tcp:101:fsx.0 00010000:00010000:1.0:1763333187.575516:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333187.575536:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c58950 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a3a7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.575646:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58957 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333187.575662:0:6521:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700c200/0xb32e3ef184c58911 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a392 expref: 39 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.575671:0:6521:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58957 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333187.575707:0:6521:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700c200/0xb32e3ef184c58911 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a392 expref: 39 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.575725:0:6521:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700c200/0xb32e3ef184c58911 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a392 expref: 39 pid: 6519 timeout: 1391 lvb_type: 0 00000100:00100000:1.0:1763333187.575740:0:6521:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe45181c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1848987627316736:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333187.575830:0:6521:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4869d300 going to sleep for 11 seconds 00000100:00100000:1.0:1763333187.579682:0:6521:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe45181c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1848987627316736:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333187.579724:0:6521:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58957 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 00000100:00100000:3.0:1763333187.586811:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333187.588392:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613877760 00000100:00100000:0.0:1763333187.588407:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613877760 00010000:00010000:0.0:1763333187.588458:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700c200/0xb32e3ef184c58911 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a392 expref: 40 pid: 6519 timeout: 1391 lvb_type: 0 00000100:00100000:0.0:1763333187.588505:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3188 00000100:00100000:0.0:1763333187.588515:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45d21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+40:2421:x1848987613877760:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333187.588534:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333187.588541:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700c200/0xb32e3ef184c58911 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a392 expref: 40 pid: 6519 timeout: 1391 lvb_type: 0 00010000:00010000:0.0:1763333187.588556:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700c200/0xb32e3ef184c58911 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a392 expref: 40 pid: 6519 timeout: 1391 lvb_type: 0 00010000:00010000:0.0:1763333187.588579:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700c200/0xb32e3ef184c58911 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a392 expref: 40 pid: 6519 timeout: 1391 lvb_type: 0 00010000:00010000:0.0:1763333187.588597:0:8423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:0.0:1763333187.588603:0:8423:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58957 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333187.588614:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58957 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333187.588621:0:8423:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58957 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333187.588654:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333187.588727:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45d21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+39:2421:x1848987613877760:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 213us (1927us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333187.588735:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3188 00010000:00010000:2.0:1763333187.589207:0:6521:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58957 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x55:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333187.589217:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58957 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x55:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 00000004:00200000:2.0:1763333187.589259:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x55:0x0]: returning size 121402 00010000:00010000:2.0:1763333187.592743:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c58950 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3a7 expref: 40 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.592778:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58957 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x55:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3a7 expref: 39 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.592788:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:2.0:1763333187.592791:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1763333187.592794:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4700f000, rc 0) 00000100:00100000:2.0:1763333187.592884:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45d21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+39:57511:x1848987613877632:12345-192.168.204.28@tcp:101:fsx.0 Request processed in 17393us (17773us total) trans 8589935462 rc 0/0 00000100:00100000:2.0:1763333187.592899:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9695 00000100:00100000:3.0:1763333187.596529:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333187.596667:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613877888 00000100:00100000:2.0:1763333187.596680:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613877888 00000100:00100000:1.0:1763333187.598266:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9696 00000100:00100000:1.0:1763333187.598283:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45d22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+39:57511:x1848987613877888:12345-192.168.204.28@tcp:101:fsx.0 00010000:00010000:1.0:1763333187.598311:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333187.598335:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c58965 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a3ae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.598448:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c5896c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333187.598465:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58957 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3a7 expref: 40 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.598474:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c5896c lrc: 4/1,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333187.598508:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58957 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3a7 expref: 40 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.598521:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58957 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3a7 expref: 40 pid: 6521 timeout: 1391 lvb_type: 0 00000100:00100000:1.0:1763333187.598533:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe45181c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1848987627316864:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333187.598611:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4869d300 going to sleep for 11 seconds 00000100:00100000:3.0:1763333187.603007:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333187.603404:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613878016 00000100:00100000:0.0:1763333187.603415:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613878016 00010000:00010000:0.0:1763333187.603459:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58957 lrc: 5/0,0 mode: CW/CW res: [0x200000405:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3a7 expref: 41 pid: 6521 timeout: 1391 lvb_type: 0 00000100:00100000:0.0:1763333187.603505:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3189 00000100:00100000:0.0:1763333187.603516:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45d23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+41:2421:x1848987613878016:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333187.603532:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333187.603539:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58957 lrc: 5/0,0 mode: CW/CW res: [0x200000405:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3a7 expref: 41 pid: 6521 timeout: 1391 lvb_type: 0 00010000:00010000:0.0:1763333187.603552:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58957 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3a7 expref: 41 pid: 6521 timeout: 1391 lvb_type: 0 00010000:00010000:0.0:1763333187.603581:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:0.0:1763333187.603587:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c5896c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333187.603597:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c5896c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333187.603605:0:6504:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c5896c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333187.603625:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333187.603695:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45d23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+41:2421:x1848987613878016:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 180us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333187.603703:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3189 00010000:00010000:1.0:1763333187.603956:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58957 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3a7 expref: 40 pid: 6521 timeout: 1391 lvb_type: 0 00000100:00100000:1.0:1763333187.603974:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe45181c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1848987627316864:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333187.603994:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c5896c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333187.604003:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c5896c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333187.604009:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c5896c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00000004:00200000:1.0:1763333187.604069:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x55:0x0]: returning size 121402 00000004:00200000:1.0:1763333187.604074:0:6519:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763333187.604096:0:6519:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c5896c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333187.604125:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c58965 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3ae expref: 40 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.604141:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c5896c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3ae expref: 39 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.604148:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333187.604151:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333187.604154:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4700fe00, rc 0) 00000100:00100000:1.0:1763333187.604196:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45d22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+39:57511:x1848987613877888:12345-192.168.204.28@tcp:101:fsx.0 Request processed in 5919us (7675us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333187.604203:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9696 00000100:00100000:3.0:1763333187.608109:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333187.608158:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333187.608229:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613878272 00000100:00100000:1.0:1763333187.608248:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613878272 00000100:00100000:1.0:1763333187.608300:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613878144 00000100:00100000:1.0:1763333187.608304:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613878144 00000100:00100000:1.0:1763333187.608339:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6865 00000100:00100000:1.0:1763333187.608367:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2420:x1848987613878272:12345-192.168.204.28@tcp:101:fsx.0 00010000:00010000:1.0:1763333187.608388:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333187.608408:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58973 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a3bc expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333187.608472:0:8404:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe45181c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8404:1848987627316992:192.168.204.28@tcp:106: 00000100:00100000:1.0:1763333187.608557:0:8404:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4869d300 going to sleep for 11 seconds 00000100:00100000:2.0:1763333187.608778:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6866 00000100:00100000:2.0:1763333187.608788:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2420:x1848987613878144:12345-192.168.204.28@tcp:101:fsx.0 00010000:00010000:2.0:1763333187.608797:0:8611:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333187.608811:0:8611:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe465ee200/0xb32e3ef184c5897a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a3b5 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763333187.608833:0:8611:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x98:0x0] initial LVB size: 121402, mtime: 0x691a5443, atime: 0x691a5443, ctime: 0x691a5443, blocks: 0xb0 00010000:00010000:2.0:1763333187.608844:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333187.608846:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333187.608853:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe465ee200/0xb32e3ef184c5897a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3b5 expref: 17 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333187.608869:0:8611:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe465ee200/0xb32e3ef184c5897a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3b5 expref: 17 pid: 8611 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333187.608884:0:8611:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe465ee200, rc 0) 00000100:00100000:2.0:1763333187.608933:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2420:x1848987613878144:12345-192.168.204.28@tcp:101:fsx.0 Request processed in 147us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333187.608941:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6866 00000100:00100000:1.0:1763333187.612708:0:8404:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe45181c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8404:1848987627316992:192.168.204.28@tcp:106: 00010000:00010000:1.0:1763333187.612746:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58973 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3bc expref: 18 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333187.612768:0:8404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58973 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3bc expref: 18 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333187.612780:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4700ee00, rc 0) 00000100:00100000:1.0:1763333187.613265:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2420:x1848987613878272:12345-192.168.204.28@tcp:101:fsx.0 Request processed in 4915us (5162us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333187.613274:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6865 00000100:00100000:1.0:1763333187.617165:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333187.617307:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613878400 00000100:00100000:2.0:1763333187.617317:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613878400 00002000:00100000:2.0:1763333187.617399:0:24027:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x98:0x0] (45056->102399) req@ffff92fe45181c00 x1848987613878400/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:498/0 lens 488/0 e 0 to 0 dl 1763333198 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763333187.617419:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45181c00 with x1848987613878400 ext(45056->102399) 00002000:00010000:2.0:1763333187.617426:0:24027:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe45181c00 00000100:00100000:2.0:1763333187.617457:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1807 00000100:00100000:2.0:1763333187.617468:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2421:x1848987613878400:12345-192.168.204.28@tcp:3:fsx.0 00000100:00100000:1.0:1763333187.619869:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2421:x1848987613878400:12345-192.168.204.28@tcp:3:fsx.0 Request processed in 2392us (2702us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1763333187.619882:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1807 00002000:00100000:1.0:1763333187.619894:0:24027:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x98:0x0] (45056->102399) req@ffff92fe45181c00 x1848987613878400/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:498/0 lens 488/440 e 0 to 0 dl 1763333198 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763333187.619904:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45181c00 with x1848987613878400 ext(45056->102399) 00002000:00010000:1.0:1763333187.619909:0:24027:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe45181c00 00000100:00100000:3.0:1763333187.623926:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333187.624208:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613878528 00000100:00100000:1.0:1763333187.624218:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613878528 00000100:00100000:1.0:1763333187.624284:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6867 00000100:00100000:1.0:1763333187.624294:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff77c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2420:x1848987613878528:12345-192.168.204.28@tcp:101:fsx.0 00010000:00010000:1.0:1763333187.624312:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333187.624330:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe46b06600/0xb32e3ef184c58981 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a3c3 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333187.624429:0:8404:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe45182a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8404:1848987627317120:192.168.204.28@tcp:106: 00000100:00100000:1.0:1763333187.624978:0:8404:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4869d300 going to sleep for 11 seconds 00000100:00100000:1.0:1763333187.627100:0:8404:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe45182a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8404:1848987627317120:192.168.204.28@tcp:106: 00010000:00010000:1.0:1763333187.627141:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe46b06600/0xb32e3ef184c58981 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3c3 expref: 18 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333187.627165:0:8404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe46b06600/0xb32e3ef184c58981 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3c3 expref: 18 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333187.627186:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46b06600, rc 0) 00000100:00100000:1.0:1763333187.627256:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff77c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2420:x1848987613878528:12345-192.168.204.28@tcp:101:fsx.0 Request processed in 2962us (3339us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333187.627264:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6867 00000100:00100000:2.0:1763333187.630655:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333187.631007:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613878656 00000100:00100000:1.0:1763333187.631017:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613878656 00000100:00100000:1.0:1763333187.631081:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6868 00000100:00100000:1.0:1763333187.631091:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45af0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2421:x1848987613878656:12345-192.168.204.28@tcp:101:fsx.0 00010000:00010000:1.0:1763333187.631109:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333187.631132:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe46b06200/0xb32e3ef184c58988 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a3ca expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333187.631192:0:8404:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe45182a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8404:1848987627317248:192.168.204.28@tcp:106: 00000100:00100000:1.0:1763333187.631285:0:8404:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4869d300 going to sleep for 11 seconds 00000100:00100000:1.0:1763333187.633722:0:8404:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe45182a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8404:1848987627317248:192.168.204.28@tcp:106: 00010000:00010000:1.0:1763333187.633756:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe46b06200/0xb32e3ef184c58988 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3ca expref: 18 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333187.633778:0:8404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe46b06200/0xb32e3ef184c58988 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3ca expref: 18 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333187.633790:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46b06200, rc 0) 00000100:00100000:1.0:1763333187.634037:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45af0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2421:x1848987613878656:12345-192.168.204.28@tcp:101:fsx.0 Request processed in 2946us (3391us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333187.634049:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6868 00000100:00100000:2.0:1763333187.637232:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333187.637423:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613878784 00000100:00100000:1.0:1763333187.637432:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613878784 00000100:00100000:1.0:1763333187.637481:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6869 00000100:00100000:1.0:1763333187.637490:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45c4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2419:x1848987613878784:12345-192.168.204.28@tcp:101:fsx.0 00010000:00010000:1.0:1763333187.637508:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333187.637527:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe46b06600/0xb32e3ef184c5898f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a3d1 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333187.637582:0:8404:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe45182a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8404:1848987627317376:192.168.204.28@tcp:106: 00000100:00100000:1.0:1763333187.638307:0:8404:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4869d300 going to sleep for 11 seconds 00000100:00100000:1.0:1763333187.642149:0:8404:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe45182a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8404:1848987627317376:192.168.204.28@tcp:106: 00010000:00010000:1.0:1763333187.642192:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe46b06600/0xb32e3ef184c5898f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3d1 expref: 18 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333187.642217:0:8404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe46b06600/0xb32e3ef184c5898f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3d1 expref: 18 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333187.642230:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46b06600, rc 0) 00000100:00100000:1.0:1763333187.642297:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45c4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2419:x1848987613878784:12345-192.168.204.28@tcp:101:fsx.0 Request processed in 4808us (5072us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333187.642307:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6869 00000100:00100000:2.0:1763333187.645518:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333187.646050:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613879040 00000100:00100000:1.0:1763333187.646062:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613879040 00000100:00100000:1.0:1763333187.646121:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3302 00000100:00100000:1.0:1763333187.646131:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45c4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+39:57511:x1848987613879040:12345-192.168.204.28@tcp:35:fsx.0 00000100:00100000:1.0:1763333187.646468:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45c4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+40:57511:x1848987613879040:12345-192.168.204.28@tcp:35:fsx.0 Request processed in 337us (960us total) trans 8589935463 rc 0/0 00000100:00100000:1.0:1763333187.646477:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3302 00000100:00100000:2.0:1763333187.653919:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333187.654171:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613879296 00000100:00100000:1.0:1763333187.654185:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613879296 00000100:00100000:3.0:1763333187.654761:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9697 00000100:00100000:0.0:1763333187.654832:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe469a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+40:57511:x1848987613879296:12345-192.168.204.28@tcp:101:fsx.0 00010000:00010000:0.0:1763333187.654862:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333187.654866:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 1 00010000:00010000:0.0:1763333187.654903:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c5896c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3ae expref: 40 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.654925:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700ce00/0xb32e3ef184c5891f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a399 expref: 39 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.654938:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465eec00/0xb32e3ef184c588ee lrc: 0/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a38b expref: 38 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.655031:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:0.0:1763333187.655038:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763333187.655055:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe467bf200/0xb32e3ef184c58996 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a3d8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.655101:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c5899d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333187.655114:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c5899d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333187.655122:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c5899d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 00000040:00080000:0.0:1763333187.655402:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].47, 88 off11944 00000004:00080000:0.0:1763333187.655411:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1291735061568ns, next at 1217460659873ns, rc = 0 00000040:00080000:0.0:1763333187.655448:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].49, 88 off12144 00000004:00080000:0.0:1763333187.655453:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1291735104078ns, next at 1217460685386ns, rc = 0 00000040:00080000:0.0:1763333187.655475:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].50, 88 off12232 00000004:00080000:0.0:1763333187.655478:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1291735129596ns, next at 1217460685386ns, rc = 0 00000040:00080000:0.0:1763333187.655486:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].48, 88 off12032 00000004:00080000:0.0:1763333187.655489:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1291735140478ns, next at 1217460659873ns, rc = 0 00000040:00080000:0.0:1763333187.655496:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].49, 88 off12120 00000004:00080000:0.0:1763333187.655498:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1291735149554ns, next at 1217460659873ns, rc = 0 00000040:00080000:0.0:1763333187.655508:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].51, 88 off12320 00000004:00080000:0.0:1763333187.655511:0:6521:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1291735161769ns, next at 1217460685386ns, rc = 0 00000001:00080000:2.0:1763333187.657329:0:32345:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935464 is committed 00010000:00010000:0.0:1763333187.657390:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a000/0xb32e3ef184c588cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x58:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333187.657404:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a000/0xb32e3ef184c588cb lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x58:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333187.657413:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a000/0xb32e3ef184c588cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x58:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333187.657420:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff4139a000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333187.657425:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a000/0xb32e3ef184c588cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x58:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 00000004:00080000:2.0:1763333187.657426:0:32345:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 51 committed 00010000:00010000:0.0:1763333187.657434:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a000/0xb32e3ef184c588cb lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x58:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 00000004:00080000:2.0:1763333187.657442:0:32345:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 48 committed 00010000:00010000:0.0:1763333187.657452:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x58:0x0].0x0 (ffff92ff42c64a00) 00010000:00010000:0.0:1763333187.657456:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333187.657461:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a000/0xb32e3ef184c588cb lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x58:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333187.657466:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a000/0xb32e3ef184c588cb lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x58:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333187.657494:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c588d9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333187.657500:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c588d9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333187.657505:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c588d9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333187.657509:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff4139a800 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333187.657512:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c588d9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333187.657518:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c588d9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333187.657525:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:0.0:1763333187.657527:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333187.657530:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c588d9 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333187.657535:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff4139a800/0xb32e3ef184c588d9 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 00000004:00080000:2.0:1763333187.657641:0:32345:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 47 committed 00000100:00100000:3.0:1763333187.657783:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763333187.657805:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe450d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1848987627317504:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763333187.657884:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333187.657915:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627317504 00000004:00080000:2.0:1763333187.657918:0:32345:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 50 committed 00000004:00080000:2.0:1763333187.657920:0:32345:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 49 committed 00000100:00100000:1.0:1763333187.657922:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627317504 00000004:00080000:2.0:1763333187.657925:0:32345:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 46 committed 00000020:00080000:2.0:1763333187.657955:0:32345:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff92fe45198540 refcount 2 committed 0 result 0 batchid 4294969304 00000020:00080000:2.0:1763333187.657959:0:32345:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff92ff7dd6c800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff92fe45198600 00000020:00080000:2.0:1763333187.657962:0:32345:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff92ff7dd6c900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff92fe45198180 00000020:00080000:2.0:1763333187.657965:0:32345:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff92ff7dd6c600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff92fe45b51a00 00000020:00080000:2.0:1763333187.657968:0:32345:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000bd0:0x2:0x0].9 00000100:00100000:1.0:1763333187.657971:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6870 00000100:00100000:1.0:1763333187.657980:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe450db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3654:x1848987627317504:12345-0@lo:2:osp-syn-1-0.0 00000020:00080000:2.0:1763333187.657983:0:32345:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969303 batchid updated 00000020:00080000:2.0:1763333187.658000:0:32374:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969304 committed batchid 4294969303 00000004:00080000:2.0:1763333187.658115:0:32374:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff92ff7dcc7540 with version 16 00000020:00080000:2.0:1763333187.658128:0:32374:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 4294969303 cancel update log [0x240000405:0x2:0x0].5: rc = 0 00000020:00080000:2.0:1763333187.658165:0:32374:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 4294969303 cancel update log [0x200000bd0:0x2:0x0].8: rc = 0 00000020:00080000:2.0:1763333187.658175:0:32374:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969303 00000004:00080000:2.0:1763333187.658183:0:32360:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff92ff499ad300 version 16 rpc_version 16 00002000:00010000:1.0:1763333187.658189:0:8404:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763333187.658192:0:8404:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime from disk: 1763333186 -> 1763333186 00002000:00010000:1.0:1763333187.658194:0:8404:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763333187.658196:0:8404:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb ctime from disk: 1763333186 -> 1763333186 00002000:00010000:1.0:1763333187.658198:0:8404:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333187.658266:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe450db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3654:x1848987627317504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 287us (381us total) trans 17179871742 rc 0/0 00000100:00100000:1.0:1763333187.658274:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6870 00000004:00080000:3.0:1763333187.658286:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe450d9880/2, rc 0, transno 17179871742 00000100:00100000:3.0:1763333187.658291:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe450d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1848987627317504:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763333187.658302:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe45182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1848987627317888:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763333187.658328:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333187.658375:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763333187.658382:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe45181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1848987627318016:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763333187.658414:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333187.658444:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe450daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1848987627317632:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1763333187.658447:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c5899d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x55:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3d8 expref: 25 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.658456:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:0.0:1763333187.658459:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:3.0:1763333187.658465:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1763333187.658474:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe467bf200/0xb32e3ef184c58996 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3d8 expref: 25 pid: 6521 timeout: 0 lvb_type: 3 00000100:00100000:3.0:1763333187.658479:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe472f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1848987627318144:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1763333187.658490:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c5899d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x55:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3d8 expref: 24 pid: 6521 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333187.658496:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333187.658513:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763333187.658518:0:3652:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe450da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1848987627317760:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1763333187.658522:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:0.0:1763333187.658525:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763333187.658528:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe467bf600, rc 0) 00000100:00100000:3.0:1763333187.658539:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00100000:2.0:1763333187.658583:0:32360:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1763333187.658592:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627317888 00000100:00100000:2.0:1763333187.658594:0:32360:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff92fe480a8700 x1848987627318400/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1763333187.658596:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627317888 00000100:00100000:2.0:1763333187.658612:0:32360:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe480a8700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:32360:1848987627318400:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1763333187.658621:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627318016 00000100:00100000:1.0:1763333187.658623:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627318016 00000100:00100000:1.0:1763333187.658638:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627317632 00000100:00100000:1.0:1763333187.658751:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627317632 00000100:00100000:1.0:1763333187.658779:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627318144 00000100:00100000:1.0:1763333187.658781:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627318144 00000100:00100000:1.0:1763333187.658793:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627317760 00000100:00100000:1.0:1763333187.658795:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627317760 00000100:00100000:1.0:1763333187.658806:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6871 00000100:00100000:1.0:1763333187.658812:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe450d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3654:x1848987627317888:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1763333187.658885:0:8407:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 121402 -> 121402 00002000:00010000:1.0:1763333187.658889:0:8407:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763333187 -> 1763333187 00002000:00010000:1.0:1763333187.658891:0:8407:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1763333187 -> 1763333187 00002000:00010000:1.0:1763333187.658893:0:8407:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763333187 -> 1763333187 00002000:00010000:1.0:1763333187.658895:0:8407:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 224 -> 224 00000100:00100000:0.0:1763333187.659098:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe469a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:57511:x1848987613879296:12345-192.168.204.28@tcp:101:fsx.0 Request processed in 4316us (5188us total) trans 8589935464 rc 0/0 00000100:00100000:3.0:1763333187.659106:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6872 00000100:00100000:0.0:1763333187.659106:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9697 00000100:00100000:3.0:1763333187.659113:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe480ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3654:x1848987627318016:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763333187.659174:0:28650:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333187.659177:0:28650:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1763333187 -> 1763333187 00002000:00010000:3.0:1763333187.659179:0:28650:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1763333187 -> 1763333187 00002000:00010000:3.0:1763333187.659180:0:28650:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1763333187 -> 1763333187 00002000:00010000:3.0:1763333187.659182:0:28650:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333187.659213:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe480ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3654:x1848987627318016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 101us (799us total) trans 21474839086 rc 0/0 00000100:00100000:3.0:1763333187.659219:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6872 00000100:00100000:3.0:1763333187.659231:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6873 00000100:00100000:3.0:1763333187.659248:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe480ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3652:x1848987627317632:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1763333187.659300:0:28650:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333187.659303:0:28650:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1763333187 -> 1763333187 00002000:00010000:3.0:1763333187.659305:0:28650:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 1763333187 -> 1763333187 00002000:00010000:3.0:1763333187.659308:0:28650:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1763333187 -> 1763333187 00002000:00010000:3.0:1763333187.659310:0:28650:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:2.0:1763333187.659562:0:32360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333187.659565:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe450d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3654:x1848987627317888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 753us (1236us total) trans 21474839085 rc 0/0 00000100:00100000:1.0:1763333187.659571:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6871 00000100:00100000:2.0:1763333187.659584:0:32360:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff61840000 going to sleep for 11 seconds 00000100:00100000:1.0:1763333187.659585:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6874 00000100:00100000:1.0:1763333187.659591:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe480aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3652:x1848987627318144:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763333187.659600:0:29010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6875 00000100:00100000:2.0:1763333187.659606:0:29010:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe480afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3652:x1848987627317760:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1763333187.659639:0:8407:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 121402 -> 121402 00002000:00010000:1.0:1763333187.659642:0:8407:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1763333187 -> 1763333187 00002000:00010000:1.0:1763333187.659645:0:8407:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 1763333187 -> 1763333187 00002000:00010000:1.0:1763333187.659647:0:8407:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1763333187 -> 1763333187 00002000:00010000:1.0:1763333187.659650:0:8407:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 176 -> 176 00002000:00010000:2.0:1763333187.659661:0:29010:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333187.659664:0:29010:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime from disk: 1763333187 -> 1763333187 00002000:00010000:2.0:1763333187.659666:0:29010:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime from disk: 1763333187 -> 1763333187 00002000:00010000:2.0:1763333187.659668:0:29010:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb ctime from disk: 1763333187 -> 1763333187 00002000:00010000:2.0:1763333187.659670:0:29010:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763333187.659673:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe480aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3652:x1848987627318144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (1177us total) trans 21474839087 rc 0/0 00000100:00100000:1.0:1763333187.659679:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6874 00000100:00100000:2.0:1763333187.659690:0:29010:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe480afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3652:x1848987627317760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (1150us total) trans 17179871744 rc 0/0 00000100:00100000:2.0:1763333187.659696:0:29010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6875 00000100:00100000:2.0:1763333187.659712:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627318400 00000100:00100000:2.0:1763333187.659716:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627318400 00000100:00100000:2.0:1763333187.659750:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1440 00000100:00100000:2.0:1763333187.659756:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe480a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:32360:x1848987627318400:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1763333187.659881:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe480a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:32360:x1848987627318400:12345-0@lo:1000:osp_up1-0.0 Request processed in 124us (318us total) trans 4294972607 rc 0/0 00000100:00100000:2.0:1763333187.659887:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1440 00000004:00080000:0.0:1763333187.659909:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe450da680/2, rc 0, transno 17179871744 00000100:00100000:0.0:1763333187.659914:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe450da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1848987627317760:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763333187.659923:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe450daa00/2, rc 0, transno 17179871743 00000100:00100000:0.0:1763333187.659926:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe450daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1848987627317632:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763333187.659933:0:3652:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe472f6a00/2, rc 0, transno 21474839087 00000100:00100000:0.0:1763333187.659936:0:3652:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe472f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1848987627318144:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763333187.659998:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe480ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3652:x1848987627317632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 761us (1531us total) trans 17179871743 rc 0/0 00000100:00100000:3.0:1763333187.660004:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6873 00000004:00080000:3.0:1763333187.660058:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe45181500/2, rc 0, transno 21474839086 00000100:00100000:3.0:1763333187.660063:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe45181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1848987627318016:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763333187.660071:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92fe45182a00/2, rc 0, transno 21474839085 00000100:00100000:3.0:1763333187.660074:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe45182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1848987627317888:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763333187.660626:0:32360:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe480a8700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:32360:1848987627318400:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1763333187.665778:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333187.669126:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613879424 00000100:00100000:2.0:1763333187.669143:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613879424 00000100:00100000:2.0:1763333187.669211:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6876 00000100:00100000:2.0:1763333187.669220:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe480ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:57511:x1848987613879424:12345-192.168.204.28@tcp:101:fsx.0 00010000:00010000:2.0:1763333187.669248:0:8611:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333187.669268:0:8611:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe465ef600/0xb32e3ef184c589a4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a3df expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.669298:0:8611:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe4a1dec00/0xb32e3ef184c5884d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a35a expref: 18 pid: 28650 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333187.669305:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333187.669308:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333187.669312:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe465ef600/0xb32e3ef184c589a4 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [49152->81919] (req 49152->81919) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3df expref: 18 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.669395:0:8611:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe4a1dec00/0xb32e3ef184c5884d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a35a expref: 18 pid: 28650 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333187.669409:0:8611:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe4a1dec00/0xb32e3ef184c5884d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a35a expref: 18 pid: 28650 timeout: 1391 lvb_type: 1 00000100:00100000:2.0:1763333187.669425:0:8611:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe480a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8611:1848987627318528:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333187.669510:0:8611:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe45ffe600 going to sleep for 11 seconds 00000100:00100000:3.0:1763333187.671797:0:8611:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe480a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8611:1848987627318528:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333187.671831:0:8611:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe465ef600/0xb32e3ef184c589a4 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [49152->81919] (req 49152->81919) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3df expref: 18 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.671848:0:8611:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe465ef600, rc 0) 00000100:00100000:3.0:1763333187.671901:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe480ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:57511:x1848987613879424:12345-192.168.204.28@tcp:101:fsx.0 Request processed in 2682us (6136us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333187.671910:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6876 00000100:00100000:0.0:1763333187.673889:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333187.674088:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613879552 00000100:00100000:3.0:1763333187.674100:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613879552 00010000:00010000:3.0:1763333187.674139:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4a1dec00/0xb32e3ef184c5884d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a35a expref: 18 pid: 28650 timeout: 1391 lvb_type: 1 00000100:00100000:3.0:1763333187.674298:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3190 00000100:00100000:3.0:1763333187.674309:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff800db450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2421:x1848987613879552:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333187.674327:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333187.674475:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe4a1dec00/0xb32e3ef184c5884d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a35a expref: 18 pid: 28650 timeout: 1391 lvb_type: 1 00010000:00010000:3.0:1763333187.674489:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe4a1dec00/0xb32e3ef184c5884d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a35a expref: 18 pid: 28650 timeout: 1391 lvb_type: 1 00010000:00010000:3.0:1763333187.674513:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4a1dec00/0xb32e3ef184c5884d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a35a expref: 18 pid: 28650 timeout: 1391 lvb_type: 1 00010000:00010000:3.0:1763333187.674528:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333187.674530:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333187.674536:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe465ef600/0xb32e3ef184c589a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 49152->81919) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3df expref: 17 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.674545:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe465ef600/0xb32e3ef184c589a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 49152->81919) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3df expref: 17 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.674585:0:8423:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff92fe465ef600/0xb32e3ef184c589a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 49152->81919) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3df expref: 17 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333187.674598:0:8423:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe480ad180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8423:1848987627318656:192.168.204.28@tcp:105: 00000100:00100000:3.0:1763333187.674689:0:8423:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7ad02180 going to sleep for 11 seconds 00000100:00100000:2.0:1763333187.679824:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333187.681005:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613879680 00000100:00100000:1.0:1763333187.681019:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613879680 00000100:00100000:1.0:1763333187.681100:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1808 00000100:00100000:1.0:1763333187.681111:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe480abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2420:x1848987613879680:12345-192.168.204.28@tcp:22:fsx.0 00002000:00010000:1.0:1763333187.681600:0:24027:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 121402 -> 121402 00002000:00010000:1.0:1763333187.681604:0:24027:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763333187 -> 1763333187 00002000:00010000:1.0:1763333187.681607:0:24027:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1763333187 -> 1763333187 00002000:00010000:1.0:1763333187.681608:0:24027:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763333187 -> 1763333187 00002000:00010000:1.0:1763333187.681611:0:24027:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 224 -> 248 00000100:00100000:1.0:1763333187.681670:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe480abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2420:x1848987613879680:12345-192.168.204.28@tcp:22:fsx.0 Request processed in 561us (1857us total) trans 21474839088 rc 0/0 00000100:00100000:1.0:1763333187.681678:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1808 00000100:00100000:3.0:1763333187.682593:0:8423:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe480ad180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8423:1848987627318656:192.168.204.28@tcp:105: 00010000:00010000:3.0:1763333187.682618:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333187.682658:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff800db450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2421:x1848987613879552:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 8350us (8777us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333187.682670:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3190 00000100:00100000:0.0:1763333187.686280:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333187.686634:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613879808 00000100:00100000:2.0:1763333187.686645:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613879808 00000100:00100000:2.0:1763333187.686704:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9698 00000100:00100000:2.0:1763333187.686713:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45d25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+24:57511:x1848987613879808:12345-192.168.204.28@tcp:101:fsx.0 00010000:00010000:2.0:1763333187.686736:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333187.686756:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465eec00/0xb32e3ef184c589ab lrc: 2/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a3e6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.686868:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465efc00/0xb32e3ef184c589b2 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333187.686881:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465efc00/0xb32e3ef184c589b2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333187.686891:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465efc00/0xb32e3ef184c589b2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 00000004:00200000:2.0:1763333187.686912:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x55:0x0]: returning size 121402 00000004:00200000:2.0:1763333187.686916:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763333187.686931:0:6521:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465efc00/0xb32e3ef184c589b2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333187.686954:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465eec00/0xb32e3ef184c589ab lrc: 0/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3e6 expref: 26 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.686967:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465efc00/0xb32e3ef184c589b2 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3e6 expref: 25 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.686975:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:2.0:1763333187.686978:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763333187.686982:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe465efc00, rc 0) 00000100:00100000:2.0:1763333187.687030:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45d25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:57511:x1848987613879808:12345-192.168.204.28@tcp:101:fsx.0 Request processed in 318us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333187.687036:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9698 00000100:00100000:2.0:1763333187.692508:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333187.693128:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613879936 00000100:00100000:1.0:1763333187.693140:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613879936 00000100:00100000:1.0:1763333187.693661:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1809 00000100:00100000:1.0:1763333187.693674:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe480aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2419:x1848987613879936:12345-192.168.204.28@tcp:22:fsx.0 00002000:00010000:1.0:1763333187.694055:0:16635:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 121402 -> 121402 00002000:00010000:1.0:1763333187.694059:0:16635:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763333187 -> 1763333187 00002000:00010000:1.0:1763333187.694062:0:16635:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1763333187 -> 1763333187 00002000:00010000:1.0:1763333187.694064:0:16635:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763333187 -> 1763333187 00002000:00010000:1.0:1763333187.694067:0:16635:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 248 -> 248 00000100:00100000:1.0:1763333187.694142:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe480aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2419:x1848987613879936:12345-192.168.204.28@tcp:22:fsx.0 Request processed in 471us (1644us total) trans 21474839089 rc 0/0 00000100:00100000:1.0:1763333187.694151:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1809 00000100:00100000:3.0:1763333187.698781:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333187.698884:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613880064 00000100:00100000:1.0:1763333187.698894:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613880064 00002000:00100000:1.0:1763333187.698942:0:16635:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x95:0x0] (0->122879) req@ffff92fe480ad180 x1848987613880064/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:498/0 lens 488/0 e 0 to 0 dl 1763333198 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763333187.698953:0:16635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe480ad180 with x1848987613880064 ext(0->122879) 00002000:00010000:1.0:1763333187.698959:0:16635:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe480ad180 00000100:00100000:2.0:1763333187.699567:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1810 00000100:00100000:2.0:1763333187.699582:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe480ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2420:x1848987613880064:12345-192.168.204.28@tcp:3:fsx.0 00000100:00100000:2.0:1763333187.703889:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe480ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2420:x1848987613880064:12345-192.168.204.28@tcp:3:fsx.0 Request processed in 4297us (5105us total) trans 0 rc 122880/122880 00000100:00100000:2.0:1763333187.703905:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1810 00002000:00100000:2.0:1763333187.703918:0:24027:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (0->122879) req@ffff92fe480ad180 x1848987613880064/t0(0) o3->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:498/0 lens 488/440 e 0 to 0 dl 1763333198 ref 1 fl Complete:/600/0 rc 122880/122880 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763333187.703929:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe480ad180 with x1848987613880064 ext(0->122879) 00002000:00010000:2.0:1763333187.703935:0:24027:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe480ad180 00000100:00100000:3.0:1763333187.709009:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333187.709181:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613880320 00000100:00100000:0.0:1763333187.709193:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613880320 00000100:00100000:0.0:1763333187.709328:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3303 00000100:00100000:0.0:1763333187.709341:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe480af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+25:57511:x1848987613880320:12345-192.168.204.28@tcp:35:fsx.0 00000100:00100000:0.0:1763333187.709653:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe480af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+26:57511:x1848987613880320:12345-192.168.204.28@tcp:35:fsx.0 Request processed in 314us (656us total) trans 8589935465 rc 0/0 00000100:00100000:0.0:1763333187.709662:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3303 00000100:00100000:3.0:1763333187.725746:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333187.725984:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613880576 00000100:00100000:0.0:1763333187.725995:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613880576 00000100:00100000:0.0:1763333187.726067:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9699 00000100:00100000:0.0:1763333187.726078:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe480ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+26:57514:x1848987613880576:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333187.726102:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333187.726127:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe467bf200/0xb32e3ef184c589b9 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a3ed expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.726205:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c589c0 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333187.726219:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c589c0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333187.726230:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c589c0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333187.726250:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c589c7 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333187.726257:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c589c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333187.726263:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c589c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333187.727476:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c589ce lrc: 3/1,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333187.727495:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c589ce lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333187.727505:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c589ce lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00000004:00200000:0.0:1763333187.727516:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x55:0x0]: returning size 121402 00010000:00010000:0.0:1763333187.727603:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c589c0 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333187.727611:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c589c0 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333187.727617:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c589c0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333187.727624:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c589c0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333187.727629:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f600 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333187.727633:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c589c0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333187.727640:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c589c0 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333187.727654:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0x0 (ffff92fe48355c00) 00010000:00010000:0.0:1763333187.727657:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333187.727663:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c589c0 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333187.727668:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c589c0 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333187.727680:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c589c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333187.727685:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c589c7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333187.727691:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c589c7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333187.727695:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7ec00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333187.727698:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c589c7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333187.727703:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c589c7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333187.727710:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0xdd396665 (ffff92fe48355300) 00010000:00010000:0.0:1763333187.727712:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333187.727715:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c589c7 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333187.727720:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c589c7 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333187.727773:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe467bf200/0xb32e3ef184c589b9 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3ed expref: 29 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.727790:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c589ce lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3ed expref: 28 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.727799:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:0.0:1763333187.727801:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333187.727803:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f000, rc 0) 00000100:00100000:0.0:1763333187.729915:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe480ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+28:57514:x1848987613880576:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 3825us (4164us total) trans 8589935466 rc 0/0 00000100:00100000:0.0:1763333187.729929:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9699 00000100:00100000:2.0:1763333187.737224:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333187.738207:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333187.738300:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613880832 00000100:00100000:0.0:1763333187.738314:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613880832 00000100:00100000:1.0:1763333187.738471:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9700 00000100:00100000:1.0:1763333187.738483:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe480a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+28:57514:x1848987613880832:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333187.738509:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333187.738534:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b06600/0xb32e3ef184c589dc lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a3f4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.739048:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b06200/0xb32e3ef184c589e3 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x59:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333187.739065:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b06200/0xb32e3ef184c589e3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333187.739077:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b06200/0xb32e3ef184c589e3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00000004:00200000:1.0:1763333187.739088:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x59:0x0]: returning size 0 00010000:00010000:1.0:1763333187.739137:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b06600/0xb32e3ef184c589dc lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3f4 expref: 31 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.739160:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b06200/0xb32e3ef184c589e3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3f4 expref: 30 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.739169:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x59:0x0].0x0 (ffff92fe4388ed00) 00010000:00010000:1.0:1763333187.739171:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333187.739175:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46b06200, rc 0) 00000100:00100000:1.0:1763333187.739249:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe480a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:57514:x1848987613880832:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 768us (2038us total) trans 8589935467 rc 0/0 00000100:00100000:1.0:1763333187.739258:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9700 00000100:00100000:3.0:1763333187.739392:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613880960 00000100:00100000:3.0:1763333187.739399:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613880960 00000100:00100000:3.0:1763333187.739437:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 416 00000100:00100000:3.0:1763333187.739444:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe480ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:2420:x1848987613880960:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333187.739454:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333187.739469:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f000/0xb32e3ef184c589ce lrc: 0/0,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3ed expref: 30 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.739479:0:8423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:3.0:1763333187.739483:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333187.739504:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe480ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:2420:x1848987613880960:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 61us (1302us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333187.739512:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 416 00000100:00100000:2.0:1763333187.745480:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333187.745815:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613881216 00000100:00100000:0.0:1763333187.745827:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613881216 00000100:00100000:0.0:1763333187.746282:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9701 00000100:00100000:0.0:1763333187.746293:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe480a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:57514:x1848987613881216:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333187.746317:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333187.746337:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c589f1 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a3fb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.746484:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c589f8 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333187.746499:0:6521:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b06200/0xb32e3ef184c589e3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3f4 expref: 30 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.746508:0:6521:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c589f8 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x59:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333187.746545:0:6521:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b06200/0xb32e3ef184c589e3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3f4 expref: 30 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.746563:0:6521:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b06200/0xb32e3ef184c589e3 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3f4 expref: 30 pid: 6519 timeout: 1391 lvb_type: 0 00000100:00100000:0.0:1763333187.746576:0:6521:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe45d27100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1848987627318784:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333187.746654:0:6521:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff49dd4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1763333187.751028:0:6521:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe45d27100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1848987627318784:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333187.751062:0:6521:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c589f8 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x59:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 00000100:00100000:0.0:1763333187.751129:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333187.751413:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613881344 00000100:00100000:1.0:1763333187.751421:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613881344 00010000:00010000:1.0:1763333187.751457:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b06200/0xb32e3ef184c589e3 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3f4 expref: 31 pid: 6519 timeout: 1391 lvb_type: 0 00000100:00100000:1.0:1763333187.751492:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3191 00000100:00100000:1.0:1763333187.751500:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45d24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+31:2421:x1848987613881344:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333187.751514:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333187.751521:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b06200/0xb32e3ef184c589e3 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3f4 expref: 31 pid: 6519 timeout: 1391 lvb_type: 0 00010000:00010000:1.0:1763333187.751533:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b06200/0xb32e3ef184c589e3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3f4 expref: 31 pid: 6519 timeout: 1391 lvb_type: 0 00010000:00010000:1.0:1763333187.751556:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe46b06200/0xb32e3ef184c589e3 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3f4 expref: 31 pid: 6519 timeout: 1391 lvb_type: 0 00010000:00010000:1.0:1763333187.751571:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x59:0x0].0x0 (ffff92fe4388ed00) 00010000:00010000:1.0:1763333187.751576:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c589f8 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x59:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333187.751585:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c589f8 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x59:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333187.751592:0:6504:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c589f8 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x59:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 00010000:00010000:1.0:1763333187.751617:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333187.751663:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45d24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:2421:x1848987613881344:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 163us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333187.751670:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3191 00010000:00010000:2.0:1763333187.752225:0:6521:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c589f8 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x59:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333187.752244:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c589f8 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x59:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 00000004:00200000:2.0:1763333187.752270:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x59:0x0]: returning size 0 00000004:00080000:2.0:1763333187.752500:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x99:0x0], index 1: 0 00000004:00080000:2.0:1763333187.752508:0:6521:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x99:0x0], index 0: 0 00010000:00010000:2.0:1763333187.752648:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c589f8 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x59:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333187.752661:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c589f8 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x59:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333187.752667:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c589f8 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x59:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333187.752673:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333187.752677:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c589f8 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x59:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333187.752684:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c589f8 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x59:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333187.752696:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x59:0x0].0x0 (ffff92fe4388ed00) 00010000:00010000:2.0:1763333187.752699:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333187.752703:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c589f8 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x59:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333187.752708:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c589f8 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x59:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333187.752756:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c589f1 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x59:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3fb expref: 30 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.752765:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x59:0x0].0x0 (ffff92fe4388ed00) 00010000:00010000:2.0:1763333187.752766:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763333187.752770:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ff77e7f600/0xb32e3ef184c589f1 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x59:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3fb expref: 30 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.752783:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7f600, rc 0) 00000100:00100000:2.0:1763333187.752845:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe480a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:57514:x1848987613881216:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 6554us (7377us total) trans 8589935468 rc 301/301 00000100:00100000:2.0:1763333187.752854:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9701 00000100:00100000:0.0:1763333187.756559:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333187.756713:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613881600 00000100:00100000:2.0:1763333187.756723:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613881600 00000100:00100000:2.0:1763333187.757620:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3304 00000100:00100000:2.0:1763333187.757637:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6b3ed450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:57514:x1848987613881600:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333187.758001:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6b3ed450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:57514:x1848987613881600:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 368us (1450us total) trans 8589935469 rc 0/0 00000100:00100000:2.0:1763333187.758009:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3304 00000100:00100000:0.0:1763333187.760997:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333187.761225:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613881728 00000100:00100000:2.0:1763333187.761247:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613881728 00000100:00100000:2.0:1763333187.761316:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9702 00000100:00100000:2.0:1763333187.761326:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45d25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:57514:x1848987613881728:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333187.761392:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333187.761420:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c58a06 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x59:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a402 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.761495:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58a0d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333187.761509:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58a0d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333187.761521:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58a0d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 00000004:00200000:2.0:1763333187.761567:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x59:0x0]: returning size 0 00000004:00200000:2.0:1763333187.761572:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763333187.761591:0:6521:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58a0d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333187.761619:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c58a06 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a402 expref: 32 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.761638:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58a0d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a402 expref: 31 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.761647:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x59:0x0].0x0 (ffff92fe43a31700) 00010000:00010000:2.0:1763333187.761650:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1763333187.761654:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4700f000, rc 0) 00000100:00100000:2.0:1763333187.761709:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45d25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+31:57514:x1848987613881728:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 385us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333187.761716:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9702 00000100:00100000:0.0:1763333187.764275:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333187.764309:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333187.764391:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613881856 00000100:00100000:1.0:1763333187.764400:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613881856 00000100:00100000:1.0:1763333187.764447:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613881984 00000100:00100000:1.0:1763333187.764450:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613881984 00000100:00100000:1.0:1763333187.764478:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6877 00000100:00100000:1.0:1763333187.764487:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45d25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2421:x1848987613881856:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333187.764503:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333187.764523:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe46b06200/0xb32e3ef184c58a14 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a409 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333187.764546:0:8404:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x99:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333187.764563:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333187.764565:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333187.764573:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46b06200/0xb32e3ef184c58a14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a409 expref: 18 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333187.764588:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe46b06200/0xb32e3ef184c58a14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a409 expref: 18 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333187.764599:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46b06200, rc 0) 00000100:00100000:1.0:1763333187.764645:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45d25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2421:x1848987613881856:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 159us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333187.764652:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6877 00000100:00100000:1.0:1763333187.764667:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6878 00000100:00100000:1.0:1763333187.764672:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2421:x1848987613881984:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333187.764678:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333187.764688:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe46b06600/0xb32e3ef184c58a1b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a410 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333187.764706:0:8404:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x99:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763333187.764713:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333187.764714:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333187.764719:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46b06600/0xb32e3ef184c58a1b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a410 expref: 20 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333187.764729:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe46b06600/0xb32e3ef184c58a1b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a410 expref: 20 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333187.764737:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe46b06600, rc 0) 00000100:00100000:1.0:1763333187.764751:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2421:x1848987613881984:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 79us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333187.764757:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6878 00000100:00100000:0.0:1763333187.768460:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333187.768566:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613882240 00000100:00100000:1.0:1763333187.768576:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613882240 00000100:00100000:1.0:1763333187.768778:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9703 00000100:00100000:1.0:1763333187.768788:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6b3ce850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+31:57514:x1848987613882240:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333187.768808:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333187.768831:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58a22 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a417 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.769034:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c58a29 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333187.769049:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c58a29 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333187.769059:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c58a29 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00000004:00200000:1.0:1763333187.769072:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x55:0x0]: returning size 121402 00010000:00010000:1.0:1763333187.769168:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58a22 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a417 expref: 34 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.769183:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c58a29 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a417 expref: 33 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.769191:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333187.769194:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763333187.769197:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4742fc00, rc 0) 00000100:00100000:1.0:1763333187.769259:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6b3ce850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+33:57514:x1848987613882240:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 473us (810us total) trans 8589935470 rc 0/0 00000100:00100000:1.0:1763333187.769266:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9703 00000100:00100000:1.0:1763333187.774483:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333187.774512:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333187.774829:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333187.775534:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613882368 00000100:00100000:2.0:1763333187.775544:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613882368 00000100:00100000:2.0:1763333187.775595:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613882496 00000100:00100000:2.0:1763333187.775597:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613882496 00000100:00100000:2.0:1763333187.775617:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613882624 00000100:00100000:2.0:1763333187.775618:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613882624 00000100:00100000:2.0:1763333187.775636:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6879 00000100:00100000:2.0:1763333187.775644:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2419:x1848987613882368:12345-192.168.204.28@tcp:1:lfs.0 00010000:00010000:2.0:1763333187.775687:0:28600:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c58a37 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.775705:0:28600:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe465ef600/0xb32e3ef184c589a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 49152->81919) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3df expref: 21 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.775713:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333187.775716:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333187.775720:0:28600:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c58a37 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.775755:0:28600:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe465ef600/0xb32e3ef184c589a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 49152->81919) gid 0 flags: 0x50000000020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3df expref: 21 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.775768:0:28600:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe465ef600/0xb32e3ef184c589a4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 49152->81919) gid 0 flags: 0x70000400020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3df expref: 21 pid: 8611 timeout: 1391 lvb_type: 0 00000100:00100000:2.0:1763333187.775782:0:28600:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe480a9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28600:1848987627318912:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333187.775872:0:28600:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe49ad03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763333187.775921:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6880 00000100:00100000:0.0:1763333187.775933:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2419:x1848987613882496:12345-192.168.204.28@tcp:1:lfs.0 00010000:00010000:0.0:1763333187.775954:0:28651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c58a3e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.775963:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333187.775965:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333187.775971:0:28651:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c58a3e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.775984:0:28651:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c58a3e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.776009:0:28651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c58a3e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.776020:0:28651:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c58a3e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.776028:0:28651:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c58a3e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.776035:0:28651:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7f200 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333187.776039:0:28651:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c58a3e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.776048:0:28651:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c58a3e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.776061:0:28651:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c58a3e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.776069:0:28651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7f200/0xb32e3ef184c58a3e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333187.776113:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2419:x1848987613882496:12345-192.168.204.28@tcp:1:lfs.0 Request processed in 184us (1600us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333187.776122:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6880 00000100:00100000:0.0:1763333187.776141:0:28651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6881 00000100:00100000:0.0:1763333187.776148:0:28651:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2419:x1848987613882624:12345-192.168.204.28@tcp:1:lfs.0 00010000:00010000:0.0:1763333187.776166:0:28651:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58a45 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.776174:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333187.776175:0:28651:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333187.776178:0:28651:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58a45 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.776186:0:28651:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58a45 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.776199:0:28651:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58a45 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.776206:0:28651:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58a45 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.776212:0:28651:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58a45 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.776217:0:28651:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7ec00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333187.776220:0:28651:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58a45 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.776226:0:28651:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58a45 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.776247:0:28651:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58a45 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.776259:0:28651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58a45 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28651 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333187.776291:0:28651:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2419:x1848987613882624:12345-192.168.204.28@tcp:1:lfs.0 Request processed in 143us (1462us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333187.776297:0:28651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6881 00000100:00100000:2.0:1763333187.780318:0:28600:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe480a9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28600:1848987627318912:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333187.780373:0:28600:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c58a37 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333187.782108:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333187.782616:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613882752 00000100:00100000:3.0:1763333187.782626:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613882752 00010000:00010000:3.0:1763333187.782667:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe465ef600/0xb32e3ef184c589a4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 49152->81919) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3df expref: 21 pid: 8611 timeout: 1391 lvb_type: 0 00000100:00100000:3.0:1763333187.782700:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3192 00000100:00100000:3.0:1763333187.782709:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5004b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2421:x1848987613882752:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333187.782726:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333187.782747:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe465ef600/0xb32e3ef184c589a4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 49152->81919) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3df expref: 21 pid: 8611 timeout: 1391 lvb_type: 0 00010000:00010000:3.0:1763333187.782762:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe465ef600/0xb32e3ef184c589a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 49152->81919) gid 0 flags: 0x50000400020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3df expref: 21 pid: 8611 timeout: 1391 lvb_type: 0 00010000:00010000:3.0:1763333187.782787:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe465ef600/0xb32e3ef184c589a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 49152->81919) gid 0 flags: 0x44801400020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3df expref: 21 pid: 8611 timeout: 1391 lvb_type: 0 00010000:00010000:3.0:1763333187.782806:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333187.782808:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333187.782815:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c58a37 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.782826:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c58a37 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.782859:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333187.782932:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5004b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2421:x1848987613882752:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 224us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333187.782940:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3192 00010000:00010000:2.0:1763333187.783212:0:28600:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c58a37 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.783222:0:28600:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c58a37 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.783257:0:28600:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c58a37 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.783266:0:28600:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c58a37 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.783279:0:28600:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c58a37 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.783287:0:28600:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700e000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333187.783292:0:28600:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c58a37 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.783300:0:28600:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c58a37 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.783313:0:28600:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c58a37 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.783321:0:28600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c58a37 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333187.783392:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2419:x1848987613882368:12345-192.168.204.28@tcp:1:lfs.0 Request processed in 7748us (8917us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333187.783401:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6879 00000100:00100000:0.0:1763333187.787457:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333187.787556:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613882880 00000100:00100000:2.0:1763333187.787567:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613882880 00000100:00100000:2.0:1763333187.787697:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6882 00000100:00100000:2.0:1763333187.787707:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45d27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2419:x1848987613882880:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333187.787725:0:28600:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333187.787747:0:28600:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c58a4c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a41e expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763333187.787777:0:28600:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x95:0x0] initial LVB size: 121402, mtime: 0x691a5443, atime: 0x691a5443, ctime: 0x691a5443, blocks: 0xf8 00010000:00010000:2.0:1763333187.787796:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333187.787798:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333187.787807:0:28600:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c58a4c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a41e expref: 20 pid: 28600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333187.787821:0:28600:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c58a4c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a41e expref: 20 pid: 28600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333187.787834:0:28600:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4700f400, rc 0) 00000100:00100000:2.0:1763333187.787884:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45d27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2419:x1848987613882880:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 179us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333187.787891:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6882 00000100:00100000:1.0:1763333187.821384:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333187.822919:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613883008 00000100:00100000:2.0:1763333187.822936:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613883008 00000100:00100000:2.0:1763333187.823578:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6883 00000100:00100000:2.0:1763333187.823594:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50048000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2418:x1848987613883008:12345-192.168.204.28@tcp:23:lfs.0 00000100:00100000:2.0:1763333187.823796:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50048000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2418:x1848987613883008:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 206us (2422us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333187.823804:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6883 00000100:00100000:0.0:1763333187.827030:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333187.827132:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613883136 00000100:00100000:1.0:1763333187.827144:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613883136 00000100:00100000:1.0:1763333187.827212:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9704 00000100:00100000:1.0:1763333187.827222:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45d25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+33:57514:x1848987613883136:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333187.827256:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333187.827280:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58a53 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a425 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.827315:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c58a5a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333187.827329:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c58a5a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x59:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333187.827340:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c58a5a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x59:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333187.827496:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58a53 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x59:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a425 expref: 35 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.827515:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c58a5a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x59:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a425 expref: 34 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.827524:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x59:0x0].0x0 (ffff92fe43a31700) 00010000:00010000:1.0:1763333187.827528:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763333187.827531:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4742e000, rc 0) 00000100:00100000:1.0:1763333187.827599:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45d25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+34:57514:x1848987613883136:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 378us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333187.827606:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9704 00000100:00100000:0.0:1763333187.829905:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333187.830246:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613883392 00000100:00100000:1.0:1763333187.830256:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613883392 00000100:00100000:1.0:1763333187.830316:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9705 00000100:00100000:1.0:1763333187.830326:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45d24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+34:57514:x1848987613883392:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:1.0:1763333187.830406:0:6519:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333187.830437:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58a0d lrc: 0/0,0 mode: --/PR res: [0x200000405:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a402 expref: 34 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.830455:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x59:0x0].0x0 (ffff92fe43a31700) 00010000:00010000:1.0:1763333187.830460:0:6519:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763333187.830616:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c58a61 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333187.830629:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c58a61 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333187.830637:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c58a61 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00000001:00080000:1.0:1763333187.830683:0:6519:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935471 00000004:00010000:1.0:1763333187.830703:0:6519:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000008fa8ff0e reply state 00000000d5d4765b transno 8589935472 ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c58a61 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333187.830715:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c58a61 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x59:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333187.830722:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x59:0x0].0x0 (ffff92fe43a31700) 00010000:00010000:1.0:1763333187.830725:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763333187.830727:0:6519:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763333187.830803:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45d24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+36:57514:x1848987613883392:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 478us (908us total) trans 8589935472 rc 0/0 00000100:00100000:1.0:1763333187.830811:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9705 00000020:00080000:1.0:1763333187.830816:0:6519:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763333187.834055:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333187.834114:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613883520 00000100:00100000:2.0:1763333187.834125:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613883520 00000100:00100000:2.0:1763333187.834195:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9706 00000100:00100000:2.0:1763333187.834207:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45d27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+36:57514:x1848987613883520:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333187.834231:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333187.834267:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c58a68 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a42c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.834323:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c58a68 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x59:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a42c expref: 37 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.834339:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c58a68 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x59:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a42c expref: 37 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.834382:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x59:0x0].0x0 (ffff92fe43a31700) 00010000:00010000:2.0:1763333187.834386:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333187.834390:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4700e000, rc 0) 00000100:00100000:2.0:1763333187.834448:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45d27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+37:57514:x1848987613883520:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 243us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333187.835775:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9706 00000100:00100000:0.0:1763333187.838249:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333187.838443:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613883648 00000100:00100000:2.0:1763333187.838454:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613883648 00000100:00100000:2.0:1763333187.838513:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6884 00000100:00100000:2.0:1763333187.838523:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:57514:x1848987613883648:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333187.838544:0:28600:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333187.838563:0:28600:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58a6f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a433 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.838596:0:28600:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe46b06200/0xb32e3ef184c58a14 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a409 expref: 19 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333187.838604:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333187.838607:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333187.838612:0:28600:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58a6f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a433 expref: 19 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.838646:0:28600:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe46b06200/0xb32e3ef184c58a14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a409 expref: 19 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333187.838660:0:28600:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe46b06200/0xb32e3ef184c58a14 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a409 expref: 19 pid: 8404 timeout: 1391 lvb_type: 1 00000100:00100000:2.0:1763333187.838672:0:28600:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe480a9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28600:1848987627319040:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333187.838900:0:28600:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe49ad03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763333187.849578:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333187.849792:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613883776 00000100:00100000:1.0:1763333187.849804:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613883776 00010000:00010000:1.0:1763333187.849847:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe46b06200/0xb32e3ef184c58a14 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a409 expref: 20 pid: 8404 timeout: 1391 lvb_type: 1 00000100:00100000:1.0:1763333187.849890:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3193 00000100:00100000:1.0:1763333187.849901:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45d25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2420:x1848987613883776:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333187.849917:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333187.849922:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe46b06200/0xb32e3ef184c58a14 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a409 expref: 20 pid: 8404 timeout: 1391 lvb_type: 1 00010000:00010000:1.0:1763333187.849935:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe46b06200/0xb32e3ef184c58a14 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a409 expref: 20 pid: 8404 timeout: 1391 lvb_type: 1 00010000:00010000:1.0:1763333187.850052:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333187.850055:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333187.850061:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58a6f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a433 expref: 20 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.850071:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58a6f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a433 expref: 20 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.850111:0:6504:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58a6f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a433 expref: 20 pid: 28600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333187.850125:0:6504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff5004a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6504:1848987627319168:192.168.204.28@tcp:105: 00000100:00100000:1.0:1763333187.850215:0:6504:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4869d6c0 going to sleep for 11 seconds 00010000:00010000:2.0:1763333187.850882:0:28600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe46b06200/0xb32e3ef184c58a14 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a409 expref: 20 pid: 8404 timeout: 1391 lvb_type: 1 00000100:00100000:2.0:1763333187.850899:0:28600:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe480a9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28600:1848987627319040:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333187.850926:0:28600:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58a6f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a433 expref: 19 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.850948:0:28600:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4700ee00, rc 0) 00000100:00100000:2.0:1763333187.851001:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:57514:x1848987613883648:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 12478us (12772us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333187.851009:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6884 00000100:00100000:1.0:1763333187.854289:0:6504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff5004a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6504:1848987627319168:192.168.204.28@tcp:105: 00010000:00010000:1.0:1763333187.854325:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333187.854546:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45d25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2420:x1848987613883776:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 4645us (4976us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333187.854559:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3193 00000100:00100000:0.0:1763333187.854644:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333187.857537:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613883904 00000100:00100000:3.0:1763333187.857564:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613883904 00000100:00100000:3.0:1763333187.857657:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6885 00000100:00100000:3.0:1763333187.857670:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:57514:x1848987613883904:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333187.857694:0:28600:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333187.857720:0:28600:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97000/0xb32e3ef184c58a76 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a43a expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.857761:0:28600:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe46b06600/0xb32e3ef184c58a1b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a410 expref: 21 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333187.857771:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333187.857774:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333187.857780:0:28600:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97000/0xb32e3ef184c58a76 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a43a expref: 21 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.857829:0:28600:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe46b06600/0xb32e3ef184c58a1b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a410 expref: 21 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333187.857843:0:28600:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe46b06600/0xb32e3ef184c58a1b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a410 expref: 21 pid: 8404 timeout: 1391 lvb_type: 1 00000100:00100000:3.0:1763333187.857859:0:28600:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe480adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28600:1848987627319296:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333187.857956:0:28600:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7ad02300 going to sleep for 11 seconds 00000100:00100000:2.0:1763333187.865392:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333187.866073:0:28600:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe480adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28600:1848987627319296:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333187.866120:0:28600:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97000/0xb32e3ef184c58a76 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a43a expref: 21 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333187.866146:0:28600:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a97000, rc 0) 00000100:00100000:3.0:1763333187.866212:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:57514:x1848987613883904:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 8544us (11569us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333187.866222:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6885 00000100:00100000:1.0:1763333187.867727:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613884032 00000100:00100000:1.0:1763333187.867739:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613884032 00010000:00010000:1.0:1763333187.867780:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe46b06600/0xb32e3ef184c58a1b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a410 expref: 21 pid: 8404 timeout: 1391 lvb_type: 1 00000100:00100000:1.0:1763333187.867831:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3194 00000100:00100000:1.0:1763333187.867842:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe480a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2421:x1848987613884032:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333187.867857:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333187.867863:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe46b06600/0xb32e3ef184c58a1b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a410 expref: 21 pid: 8404 timeout: 1391 lvb_type: 1 00010000:00010000:1.0:1763333187.867876:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe46b06600/0xb32e3ef184c58a1b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a410 expref: 21 pid: 8404 timeout: 1391 lvb_type: 1 00010000:00010000:1.0:1763333187.867905:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe46b06600/0xb32e3ef184c58a1b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a410 expref: 21 pid: 8404 timeout: 1391 lvb_type: 1 00010000:00010000:1.0:1763333187.867922:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333187.867924:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333187.867931:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97000/0xb32e3ef184c58a76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a43a expref: 20 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.867941:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97000/0xb32e3ef184c58a76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a43a expref: 20 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.867994:0:6504:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97000/0xb32e3ef184c58a76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a43a expref: 20 pid: 28600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333187.868008:0:6504:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff5004a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6504:1848987627319424:192.168.204.28@tcp:105: 00000100:00100000:1.0:1763333187.868093:0:6504:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4869d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763333187.872242:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333187.873316:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333187.873893:0:6504:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff5004a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6504:1848987627319424:192.168.204.28@tcp:105: 00010000:00010000:1.0:1763333187.873919:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333187.873988:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe480a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2421:x1848987613884032:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 6147us (8640us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333187.873997:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3194 00000100:00100000:2.0:1763333187.874280:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613884160 00000100:00100000:2.0:1763333187.874288:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613884160 00002000:00010000:2.0:1763333187.874327:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/153 (0->18446744073709551615) 00002000:00100000:2.0:1763333187.874332:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45d24a80 with x1848987613884160 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333187.874344:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe45d24a80. 00000100:00100000:2.0:1763333187.874397:0:24027:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613884288 00000100:00100000:2.0:1763333187.874401:0:24027:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613884288 00002000:00010000:2.0:1763333187.874414:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/153 (0->18446744073709551615) 00002000:00100000:2.0:1763333187.874416:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45d27100 with x1848987613884288 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333187.874422:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe45d27100. 00000100:00100000:2.0:1763333187.874441:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1811 00000100:00100000:2.0:1763333187.874449:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2421:x1848987613884160:12345-192.168.204.28@tcp:10:lfs.0 00002000:00010000:2.0:1763333187.874631:0:24027:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x99:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333187.874635:0:24027:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x99:0x0] updating lvb mtime from disk: 0 -> 1763333188 00002000:00010000:2.0:1763333187.874637:0:24027:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x99:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333187.874640:0:24027:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x99:0x0] updating lvb ctime from disk: 0 -> 1763333188 00002000:00010000:2.0:1763333187.874642:0:24027:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x99:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333187.874670:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2421:x1848987613884160:12345-192.168.204.28@tcp:10:lfs.0 Request processed in 221us (2449us total) trans 17179871745 rc 0/0 00000100:00100000:2.0:1763333187.874678:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1811 00002000:00010000:2.0:1763333187.874681:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/153 (0->18446744073709551615) 00002000:00100000:2.0:1763333187.874684:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45d24a80 with x1848987613884160 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333187.874688:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92fe45d24a80. 00000100:00100000:2.0:1763333187.874703:0:24027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1812 00000100:00100000:2.0:1763333187.874709:0:24027:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2421:x1848987613884288:12345-192.168.204.28@tcp:10:lfs.0 00002000:00010000:2.0:1763333187.874800:0:24027:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333187.874803:0:24027:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 0 -> 1763333188 00002000:00010000:2.0:1763333187.874806:0:24027:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763333187.874808:0:24027:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 0 -> 1763333188 00002000:00010000:2.0:1763333187.874810:0:24027:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333187.874831:0:24027:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2421:x1848987613884288:12345-192.168.204.28@tcp:10:lfs.0 Request processed in 122us (1521us total) trans 21474839090 rc 0/0 00000100:00100000:2.0:1763333187.874837:0:24027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1812 00002000:00010000:2.0:1763333187.874840:0:24027:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/153 (0->18446744073709551615) 00002000:00100000:2.0:1763333187.874843:0:24027:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92fe45d27100 with x1848987613884288 ext(0->18446744073709551615) 00002000:00010000:2.0:1763333187.874847:0:24027:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92fe45d27100. 00000100:00100000:0.0:1763333187.884854:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333187.886275:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613884416 00000100:00100000:3.0:1763333187.886287:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613884416 00000100:00100000:1.0:1763333187.887071:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6886 00000100:00100000:1.0:1763333187.887087:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45d27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2419:x1848987613884416:12345-192.168.204.28@tcp:23:lfs.0 00000100:00100000:1.0:1763333187.887401:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45d27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2419:x1848987613884416:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 318us (2556us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333187.887411:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6886 00000100:00100000:0.0:1763333187.891748:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333187.891846:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613884544 00000100:00100000:3.0:1763333187.891857:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613884544 00000100:00100000:3.0:1763333187.891950:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6887 00000100:00100000:3.0:1763333187.891960:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45d25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2421:x1848987613884544:12345-192.168.204.28@tcp:23:lfs.0 00000100:00100000:3.0:1763333187.892719:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45d25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2421:x1848987613884544:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 758us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333187.892729:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6887 00000100:00100000:2.0:1763333187.895986:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333187.896573:0:28429:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613884672 00000100:00100000:0.0:1763333187.896584:0:28429:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613884672 00000100:00100000:0.0:1763333187.896654:0:28429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1813 00000100:00100000:0.0:1763333187.896664:0:28429:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe480a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2418:x1848987613884672:12345-192.168.204.28@tcp:3:lfs.0 00010000:00010000:0.0:1763333187.896727:0:28429:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c58a7d lrc: 3/1,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.896744:0:28429:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333187.896746:0:28429:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333187.896752:0:28429:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c58a7d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.896767:0:28429:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c58a7d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.896881:0:28429:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c58a7d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.896891:0:28429:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c58a7d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.896899:0:28429:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c58a7d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.896906:0:28429:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7e000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333187.896910:0:28429:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c58a7d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.896919:0:28429:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c58a7d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.896935:0:28429:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c58a7d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333187.896943:0:28429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c58a7d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333187.897019:0:28429:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe480a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2418:x1848987613884672:12345-192.168.204.28@tcp:3:lfs.0 Request processed in 356us (1043us total) trans 0 rc 16384/16384 00000100:00100000:0.0:1763333187.897031:0:28429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1813 00000100:00100000:0.0:1763333187.901896:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333187.902262:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613884800 00000100:00100000:1.0:1763333187.902274:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613884800 00000100:00100000:1.0:1763333187.902382:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1814 00000100:00100000:1.0:1763333187.902393:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe45d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2421:x1848987613884800:12345-192.168.204.28@tcp:4:lfs.0 00010000:00010000:1.0:1763333187.902434:0:16635:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58a84 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.902454:0:16635:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58a6f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a433 expref: 19 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.902464:0:16635:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333187.902466:0:16635:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763333187.902470:0:16635:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58a84 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.902505:0:16635:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58a6f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a433 expref: 19 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.902520:0:16635:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58a6f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a433 expref: 19 pid: 28600 timeout: 1391 lvb_type: 0 00000100:00100000:1.0:1763333187.902535:0:16635:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff5004a680 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:16635:1848987627319552:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333187.902617:0:16635:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4869d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763333187.906701:0:16635:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff5004a680 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:16635:1848987627319552:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333187.906735:0:16635:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58a84 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333187.906945:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333187.907208:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613884928 00000100:00100000:1.0:1763333187.907216:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613884928 00010000:00010000:1.0:1763333187.907264:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58a6f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a433 expref: 20 pid: 28600 timeout: 1391 lvb_type: 0 00000100:00100000:1.0:1763333187.907305:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3195 00000100:00100000:1.0:1763333187.907315:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:2421:x1848987613884928:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333187.907331:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333187.907391:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58a6f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a433 expref: 20 pid: 28600 timeout: 1391 lvb_type: 0 00010000:00010000:1.0:1763333187.907404:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58a6f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a433 expref: 20 pid: 28600 timeout: 1391 lvb_type: 0 00010000:00010000:1.0:1763333187.907429:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58a6f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a433 expref: 20 pid: 28600 timeout: 1391 lvb_type: 0 00010000:00010000:1.0:1763333187.907445:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333187.907447:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333187.907452:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58a84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.907463:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58a84 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.907499:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333187.907552:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2421:x1848987613884928:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 237us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333187.907560:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3195 00010000:00010000:2.0:1763333187.908029:0:16635:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58a84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.908040:0:16635:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58a84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1763333187.911717:0:26035:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871746 is committed 00000001:00080000:0.0:1763333187.911740:0:26035:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871744 is committed 00002000:00010000:2.0:1763333187.911919:0:16635:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x99:0x0] updating lvb size from disk: 0 -> 16384 00002000:00010000:2.0:1763333187.911924:0:16635:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x99:0x0] updating lvb blocks from disk: 0 -> 32 00010000:00010000:2.0:1763333187.911938:0:16635:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58a84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.911949:0:16635:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58a84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.911958:0:16635:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58a84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.911964:0:16635:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf200 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333187.911969:0:16635:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58a84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.911978:0:16635:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58a84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.911996:0:16635:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58a84 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.912003:0:16635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58a84 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333187.912103:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe45d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2421:x1848987613884800:12345-192.168.204.28@tcp:4:lfs.0 Request processed in 9708us (10212us total) trans 17179871746 rc 0/0 00000100:00100000:2.0:1763333187.912113:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1814 00000100:00100000:0.0:1763333187.920124:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333187.920734:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613885056 00000100:00100000:3.0:1763333187.920747:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613885056 00000100:00100000:1.0:1763333187.921390:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6888 00000100:00100000:1.0:1763333187.921404:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e0f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2420:x1848987613885056:12345-192.168.204.28@tcp:23:lfs.0 00000100:00100000:1.0:1763333187.921563:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e0f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2420:x1848987613885056:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 162us (1449us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333187.921571:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6888 00000100:00100000:0.0:1763333187.925143:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333187.926476:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613885184 00000100:00100000:3.0:1763333187.926488:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613885184 00000100:00100000:3.0:1763333187.926549:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6889 00000100:00100000:3.0:1763333187.926558:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2419:x1848987613885184:12345-192.168.204.28@tcp:23:lfs.0 00000100:00100000:3.0:1763333187.926688:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2419:x1848987613885184:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 130us (1555us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333187.926696:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6889 00000100:00100000:0.0:1763333187.931838:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333187.943579:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613885312 00000100:00100000:2.0:1763333187.943598:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613885312 00000100:00100000:2.0:1763333187.943688:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1815 00000100:00100000:2.0:1763333187.943698:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2420:x1848987613885312:12345-192.168.204.28@tcp:3:lfs.0 00010000:00010000:2.0:1763333187.943767:0:16635:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58a8b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.943784:0:16635:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333187.943787:0:16635:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333187.943792:0:16635:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58a8b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [32768->49151] (req 32768->49151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.943810:0:16635:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58a8b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [32768->49151] (req 32768->49151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.943937:0:16635:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58a8b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [32768->49151] (req 32768->49151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.943946:0:16635:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58a8b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [32768->49151] (req 32768->49151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.943956:0:16635:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58a8b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [32768->49151] (req 32768->49151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.943963:0:16635:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700ee00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333187.943967:0:16635:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58a8b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [32768->49151] (req 32768->49151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.943975:0:16635:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58a8b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [32768->49151] (req 32768->49151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.943991:0:16635:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58a8b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [32768->49151] (req 32768->49151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333187.943998:0:16635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58a8b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [32768->49151] (req 32768->49151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333187.944097:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2420:x1848987613885312:12345-192.168.204.28@tcp:3:lfs.0 Request processed in 399us (12268us total) trans 0 rc 16384/16384 00000100:00100000:2.0:1763333187.944104:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1815 00000100:00100000:0.0:1763333187.955330:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333187.956832:0:28429:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613885440 00000100:00100000:1.0:1763333187.956847:0:28429:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613885440 00000100:00100000:1.0:1763333187.956954:0:28429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1816 00000100:00100000:1.0:1763333187.956965:0:28429:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7e493850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2418:x1848987613885440:12345-192.168.204.28@tcp:4:lfs.0 00002000:00010000:1.0:1763333187.957021:0:28429:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x99:0x0] initial LVB size: 16384, mtime: 0x691a5444, atime: 0x0, ctime: 0x691a5444, blocks: 0x20 00010000:00010000:1.0:1763333187.957033:0:28429:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58a92 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.957054:0:28429:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333187.957056:0:28429:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333187.957062:0:28429:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58a92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [32768->49151] (req 32768->49151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.957079:0:28429:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58a92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [32768->49151] (req 32768->49151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1763333187.963105:0:26035:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871747 is committed 00002000:00010000:1.0:1763333187.963733:0:28429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x99:0x0] updating lvb size from disk: 16384 -> 49152 00002000:00010000:1.0:1763333187.963740:0:28429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x99:0x0] updating lvb blocks from disk: 32 -> 64 00010000:00010000:1.0:1763333187.963753:0:28429:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58a92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [32768->49151] (req 32768->49151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.963764:0:28429:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58a92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [32768->49151] (req 32768->49151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.963772:0:28429:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58a92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [32768->49151] (req 32768->49151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.963779:0:28429:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf200 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333187.963784:0:28429:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58a92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [32768->49151] (req 32768->49151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.963793:0:28429:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58a92 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [32768->49151] (req 32768->49151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.963813:0:28429:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58a92 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [32768->49151] (req 32768->49151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.963826:0:28429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58a92 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [32768->49151] (req 32768->49151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333187.963936:0:28429:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7e493850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2418:x1848987613885440:12345-192.168.204.28@tcp:4:lfs.0 Request processed in 6968us (8616us total) trans 17179871747 rc 0/0 00000100:00100000:1.0:1763333187.963948:0:28429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1816 00000100:00100000:0.0:1763333187.971808:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333187.971887:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613885568 00000100:00100000:3.0:1763333187.971896:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613885568 00000100:00100000:3.0:1763333187.971957:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6890 00000100:00100000:3.0:1763333187.971967:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2421:x1848987613885568:12345-192.168.204.28@tcp:23:lfs.0 00000100:00100000:3.0:1763333187.972096:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2421:x1848987613885568:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 130us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333187.972102:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6890 00000100:00100000:0.0:1763333187.977972:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333187.987110:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613885696 00000100:00100000:1.0:1763333187.987128:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613885696 00000100:00100000:1.0:1763333187.987200:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6891 00000100:00100000:1.0:1763333187.987212:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2420:x1848987613885696:12345-192.168.204.28@tcp:23:lfs.0 00000100:00100000:1.0:1763333187.987374:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2420:x1848987613885696:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 164us (9411us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333187.987382:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6891 00000100:00100000:0.0:1763333187.993267:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333187.995071:0:28429:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613885824 00000100:00100000:1.0:1763333187.995085:0:28429:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613885824 00000100:00100000:1.0:1763333187.995172:0:28429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1817 00000100:00100000:1.0:1763333187.995183:0:28429:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2420:x1848987613885824:12345-192.168.204.28@tcp:3:lfs.0 00010000:00010000:1.0:1763333187.995220:0:28429:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58a99 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.995246:0:28429:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333187.995249:0:28429:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333187.995254:0:28429:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58a99 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [77824->98303] (req 77824->98303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333187.995268:0:28429:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58a99 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [77824->98303] (req 77824->98303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333188.005480:0:28429:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58a99 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [77824->98303] (req 77824->98303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333188.005500:0:28429:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58a99 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [77824->98303] (req 77824->98303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333188.005510:0:28429:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58a99 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [77824->98303] (req 77824->98303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333188.005517:0:28429:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf200 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333188.005521:0:28429:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58a99 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [77824->98303] (req 77824->98303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333188.005531:0:28429:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58a99 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [77824->98303] (req 77824->98303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333188.005550:0:28429:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58a99 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [77824->98303] (req 77824->98303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333188.005557:0:28429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58a99 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [77824->98303] (req 77824->98303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333188.005652:0:28429:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2420:x1848987613885824:12345-192.168.204.28@tcp:3:lfs.0 Request processed in 10467us (12391us total) trans 0 rc 20480/20480 00000100:00100000:1.0:1763333188.005662:0:28429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1817 00000100:00100000:0.0:1763333188.019857:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333188.020460:0:28429:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613885952 00000100:00100000:1.0:1763333188.020472:0:28429:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613885952 00000100:00100000:1.0:1763333188.020558:0:28429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1818 00000100:00100000:1.0:1763333188.020569:0:28429:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2421:x1848987613885952:12345-192.168.204.28@tcp:4:lfs.0 00002000:00010000:1.0:1763333188.020620:0:28429:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x99:0x0] initial LVB size: 49152, mtime: 0x691a5444, atime: 0x0, ctime: 0x691a5444, blocks: 0x40 00010000:00010000:1.0:1763333188.020629:0:28429:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58aa0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333188.020644:0:28429:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333188.020647:0:28429:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333188.020652:0:28429:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58aa0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [77824->98303] (req 77824->98303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333188.020667:0:28429:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58aa0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [77824->98303] (req 77824->98303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1763333188.030613:0:26035:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871748 is committed 00002000:00010000:1.0:1763333188.030789:0:28429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x99:0x0] updating lvb size from disk: 49152 -> 98304 00002000:00010000:1.0:1763333188.030794:0:28429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x99:0x0] updating lvb blocks from disk: 64 -> 104 00010000:00010000:1.0:1763333188.030808:0:28429:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58aa0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [77824->98303] (req 77824->98303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333188.030819:0:28429:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58aa0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [77824->98303] (req 77824->98303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333188.030827:0:28429:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58aa0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [77824->98303] (req 77824->98303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333188.030834:0:28429:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf200 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333188.030838:0:28429:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58aa0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [77824->98303] (req 77824->98303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333188.030850:0:28429:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58aa0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [77824->98303] (req 77824->98303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333188.030868:0:28429:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58aa0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [77824->98303] (req 77824->98303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333188.030875:0:28429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58aa0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [77824->98303] (req 77824->98303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333188.033751:0:28429:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2421:x1848987613885952:12345-192.168.204.28@tcp:4:lfs.0 Request processed in 13169us (13890us total) trans 17179871748 rc 0/0 00000100:00100000:1.0:1763333188.033766:0:28429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1818 00000100:00100000:0.0:1763333188.038204:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333188.038297:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613886080 00000100:00100000:3.0:1763333188.038313:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613886080 00000100:00100000:3.0:1763333188.038416:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6892 00000100:00100000:3.0:1763333188.038426:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2418:x1848987613886080:12345-192.168.204.28@tcp:23:lfs.0 00000100:00100000:2.0:1763333188.041511:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2418:x1848987613886080:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 3075us (3305us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333188.041526:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6892 00000100:00100000:0.0:1763333188.048923:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333188.048981:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613886208 00000100:00100000:2.0:1763333188.048995:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613886208 00000100:00100000:2.0:1763333188.049212:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6893 00000100:00100000:2.0:1763333188.049225:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2421:x1848987613886208:12345-192.168.204.28@tcp:23:lfs.0 00000100:00100000:2.0:1763333188.049389:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2421:x1848987613886208:12345-192.168.204.28@tcp:23:lfs.0 Request processed in 166us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333188.049398:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6893 00000100:00100000:0.0:1763333188.055265:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333188.055332:0:28429:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613886336 00000100:00100000:1.0:1763333188.055343:0:28429:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613886336 00000100:00100000:1.0:1763333188.055484:0:28429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1819 00000100:00100000:1.0:1763333188.055494:0:28429:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2420:x1848987613886336:12345-192.168.204.28@tcp:3:lfs.0 00010000:00010000:1.0:1763333188.055532:0:28429:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58aa7 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333188.055548:0:28429:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333188.055550:0:28429:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333188.055556:0:28429:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58aa7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333188.055569:0:28429:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58aa7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333188.055673:0:28429:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58aa7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333188.055681:0:28429:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58aa7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333188.055690:0:28429:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58aa7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333188.055697:0:28429:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdf200 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333188.055701:0:28429:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58aa7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333188.055709:0:28429:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58aa7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333188.055724:0:28429:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58aa7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333188.055731:0:28429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58aa7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333188.055792:0:28429:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2420:x1848987613886336:12345-192.168.204.28@tcp:3:lfs.0 Request processed in 299us (538us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1763333188.055799:0:28429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1819 00000100:00100000:0.0:1763333188.066014:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333188.066100:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613886464 00000100:00100000:3.0:1763333188.066112:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613886464 00000100:00100000:3.0:1763333188.067556:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1820 00000100:00100000:3.0:1763333188.067581:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2418:x1848987613886464:12345-192.168.204.28@tcp:4:lfs.0 00002000:00010000:3.0:1763333188.067636:0:16635:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x99:0x0] initial LVB size: 98304, mtime: 0x691a5444, atime: 0x0, ctime: 0x691a5444, blocks: 0x68 00010000:00010000:3.0:1763333188.067646:0:16635:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c58aae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333188.067661:0:16635:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333188.067663:0:16635:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333188.067668:0:16635:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c58aae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333188.067681:0:16635:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c58aae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1763333188.082495:0:26035:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871749 is committed 00002000:00010000:3.0:1763333188.085124:0:16635:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x99:0x0] updating lvb size from disk: 98304 -> 122880 00002000:00010000:3.0:1763333188.085135:0:16635:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x99:0x0] updating lvb blocks from disk: 104 -> 112 00010000:00010000:3.0:1763333188.085150:0:16635:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c58aae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333188.085162:0:16635:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c58aae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333188.085171:0:16635:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c58aae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333188.085178:0:16635:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45a96c00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333188.085182:0:16635:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c58aae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333188.085196:0:16635:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c58aae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333188.085217:0:16635:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c58aae lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333188.085226:0:16635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96c00/0xb32e3ef184c58aae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333188.085439:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2418:x1848987613886464:12345-192.168.204.28@tcp:4:lfs.0 Request processed in 17865us (19429us total) trans 17179871749 rc 0/0 00000100:00100000:3.0:1763333188.085450:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1820 00000100:00100000:0.0:1763333188.104998:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333188.105125:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613886592 00000100:00100000:2.0:1763333188.105138:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613886592 00000100:00100000:2.0:1763333188.105209:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9707 00000100:00100000:2.0:1763333188.105220:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+37:57514:x1848987613886592:12345-192.168.204.28@tcp:44:lfs.0 00000001:00080000:0.0:1763333188.112339:0:32345:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935472 is committed 00000020:00080000:0.0:1763333188.112399:0:32345:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969304 batchid updated 00000100:00100000:3.0:1763333188.112685:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:57514:x1848987613886592:12345-192.168.204.28@tcp:44:lfs.0 Request processed in 7459us (7699us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333188.112698:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9707 00000020:00080000:2.0:1763333188.112849:0:32374:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969304 00000020:00080000:2.0:1763333188.112957:0:32374:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 4294969304 cancel update log [0x200000bd0:0x2:0x0].9: rc = 0 00000020:00080000:2.0:1763333188.112968:0:32374:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969304 00010000:00010000:1.0:1763333188.114388:0:3638:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c58a61 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333188.114403:0:3638:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c58a61 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333188.114411:0:3638:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c58a61 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333188.114416:0:3638:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4abdfe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333188.114420:0:3638:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c58a61 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333188.114427:0:3638:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c58a61 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333188.114445:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x59:0x0].0x0 (ffff92fe43a31700) 00010000:00010000:1.0:1763333188.114448:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333188.114452:0:3638:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c58a61 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333188.114457:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c58a61 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 00000100:00100000:0.0:1763333188.128153:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333188.128202:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333188.128305:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613886848 00000100:00100000:1.0:1763333188.128316:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613886848 00000100:00100000:1.0:1763333188.128406:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613886720 00000100:00100000:1.0:1763333188.128410:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613886720 00000100:00100000:1.0:1763333188.128448:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6894 00000100:00100000:3.0:1763333188.128462:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6895 00000100:00100000:1.0:1763333188.128464:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2420:x1848987613886848:12345-192.168.204.28@tcp:16:lfs.0 00000100:00100000:3.0:1763333188.128482:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2421:x1848987613886720:12345-192.168.204.28@tcp:16:lfs.0 00000100:00100000:3.0:1763333188.128579:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2421:x1848987613886720:12345-192.168.204.28@tcp:16:lfs.0 Request processed in 102us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333188.128587:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6895 00000001:00080000:1.0:1763333188.131790:0:24714:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839090 is committed 00000001:00080000:1.0:1763333188.131823:0:24714:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839087 is committed 00000100:00100000:3.0:1763333188.132255:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2420:x1848987613886848:12345-192.168.204.28@tcp:16:lfs.0 Request processed in 3790us (4105us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333188.132267:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6894 00000100:00100000:0.0:1763333188.152873:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333188.155879:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613886976 00000100:00100000:3.0:1763333188.155902:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613886976 00000100:00100000:2.0:1763333188.157041:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333188.157103:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333188.157131:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613887104 00000100:00100000:2.0:1763333188.157138:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613887104 00000100:00100000:2.0:1763333188.157184:0:28600:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613887232 00000100:00100000:2.0:1763333188.157188:0:28600:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613887232 00000100:00100000:2.0:1763333188.157209:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6896 00000100:00100000:2.0:1763333188.157219:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe480aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2418:x1848987613887104:12345-192.168.204.28@tcp:1:lfs.0 00010000:00010000:2.0:1763333188.157283:0:28600:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58ab5 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.157299:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333188.157301:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333188.157306:0:28600:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58ab5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.157319:0:28600:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58ab5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.157344:0:28600:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58ab5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.157368:0:28600:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58ab5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.157377:0:28600:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58ab5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.157383:0:28600:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700ee00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333188.157388:0:28600:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58ab5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.157397:0:28600:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58ab5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.157411:0:28600:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58ab5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.157418:0:28600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4700ee00/0xb32e3ef184c58ab5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333188.157490:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe480aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2418:x1848987613887104:12345-192.168.204.28@tcp:1:lfs.0 Request processed in 272us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333188.157497:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6896 00000100:00100000:2.0:1763333188.157516:0:28600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6897 00000100:00100000:2.0:1763333188.157523:0:28600:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe480ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2418:x1848987613887232:12345-192.168.204.28@tcp:1:lfs.0 00010000:00010000:2.0:1763333188.157542:0:28600:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58abc lrc: 3/1,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.157550:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333188.157552:0:28600:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333188.157555:0:28600:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58abc lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.157564:0:28600:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58abc lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.157579:0:28600:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58abc lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.157585:0:28600:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58abc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.157591:0:28600:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58abc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.157596:0:28600:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700f000 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333188.157599:0:28600:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58abc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.157605:0:28600:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58abc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.157619:0:28600:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58abc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.157640:0:28600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58abc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28600 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333188.157670:0:28600:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe480ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2418:x1848987613887232:12345-192.168.204.28@tcp:1:lfs.0 Request processed in 147us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333188.157676:0:28600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6897 00000100:00100000:2.0:1763333188.159851:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6898 00000100:00100000:2.0:1763333188.159866:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2419:x1848987613886976:12345-192.168.204.28@tcp:1:lfs.0 00010000:00010000:2.0:1763333188.159914:0:8404:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe4700ce00/0xb32e3ef184c58ac3 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.159928:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333188.159930:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333188.159935:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4700ce00/0xb32e3ef184c58ac3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.159947:0:8404:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4700ce00/0xb32e3ef184c58ac3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.159970:0:8404:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe4700ce00/0xb32e3ef184c58ac3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.159977:0:8404:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4700ce00/0xb32e3ef184c58ac3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.159986:0:8404:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe4700ce00/0xb32e3ef184c58ac3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.159992:0:8404:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700ce00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333188.159996:0:8404:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4700ce00/0xb32e3ef184c58ac3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.160003:0:8404:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4700ce00/0xb32e3ef184c58ac3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.160014:0:8404:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe4700ce00/0xb32e3ef184c58ac3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.160020:0:8404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4700ce00/0xb32e3ef184c58ac3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333188.160330:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2419:x1848987613886976:12345-192.168.204.28@tcp:1:lfs.0 Request processed in 465us (7465us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333188.160337:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6898 00000100:00100000:2.0:1763333188.162970:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333188.163255:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613887488 00000100:00100000:3.0:1763333188.163265:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613887488 00000100:00100000:3.0:1763333188.164241:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9708 00000100:00100000:3.0:1763333188.164257:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe480a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+28:57514:x1848987613887488:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:3.0:1763333188.164366:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a96c00/0xb32e3ef184c58aca lrc: 3/0,1 mode: --/PW res: [0x200000405:0x59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333188.164383:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a96c00/0xb32e3ef184c58aca lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333188.164394:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a96c00/0xb32e3ef184c58aca lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 00000004:00010000:3.0:1763333188.164523:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000cfd19744 reply state 00000000ee5257d5 transno 8589935473 ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a96c00/0xb32e3ef184c58aca lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333188.164535:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45a96c00/0xb32e3ef184c58aca lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333188.164542:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x59:0x0].0x0 (ffff92fe43a31700) 00010000:00010000:3.0:1763333188.164545:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763333188.164548:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763333188.165698:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe480a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:57514:x1848987613887488:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 1441us (2731us total) trans 8589935473 rc 0/0 00000100:00100000:3.0:1763333188.165707:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9708 00000100:00100000:3.0:1763333188.171580:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333188.171740:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613887616 00000100:00100000:2.0:1763333188.171752:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613887616 00000100:00100000:2.0:1763333188.171815:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6899 00000100:00100000:2.0:1763333188.171826:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe480adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:57514:x1848987613887616:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333188.171843:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333188.171867:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c58ad1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a441 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763333188.171890:0:8404:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x99:0x0] initial LVB size: 122880, mtime: 0x691a5444, atime: 0x0, ctime: 0x691a5444, blocks: 0x70 00010000:00010000:2.0:1763333188.171911:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333188.171914:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333188.171921:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c58ad1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a441 expref: 16 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.171939:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c58ad1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a441 expref: 16 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.171951:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4700c200, rc 0) 00000100:00100000:2.0:1763333188.172004:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe480adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:57514:x1848987613887616:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 180us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333188.172011:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6899 00000100:00100000:1.0:1763333188.175886:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333188.175935:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333188.176001:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613887872 00000100:00100000:2.0:1763333188.176011:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613887872 00000100:00100000:2.0:1763333188.176067:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613887744 00000100:00100000:2.0:1763333188.176070:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613887744 00000100:00100000:2.0:1763333188.176105:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6900 00000100:00100000:2.0:1763333188.176114:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50048a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+15:2420:x1848987613887872:12345-192.168.204.28@tcp:2:lfs.0 00002000:00010000:2.0:1763333188.176289:0:8404:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333188.176293:0:8404:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1763333188 -> 1763333187 00002000:00010000:2.0:1763333188.176296:0:8404:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 0 -> 1763333188 00002000:00010000:2.0:1763333188.176298:0:8404:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1763333188 -> 1763333188 00002000:00010000:2.0:1763333188.176301:0:8404:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763333188.176391:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50048a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2420:x1848987613887872:12345-192.168.204.28@tcp:2:lfs.0 Request processed in 277us (514us total) trans 21474839091 rc 0/0 00000100:00100000:2.0:1763333188.176399:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6900 00000100:00100000:2.0:1763333188.176418:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6901 00000100:00100000:2.0:1763333188.176425:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50049880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2420:x1848987613887744:12345-192.168.204.28@tcp:2:lfs.0 00002000:00010000:2.0:1763333188.176496:0:8404:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x99:0x0] updating lvb size from disk: 122880 -> 122880 00002000:00010000:2.0:1763333188.176499:0:8404:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x99:0x0] updating lvb mtime from disk: 1763333188 -> 1763333187 00002000:00010000:2.0:1763333188.176501:0:8404:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x99:0x0] updating lvb atime from disk: 0 -> 1763333188 00002000:00010000:2.0:1763333188.176503:0:8404:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x99:0x0] updating lvb ctime from disk: 1763333188 -> 1763333188 00002000:00010000:2.0:1763333188.176505:0:8404:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x99:0x0] updating lvb blocks from disk: 112 -> 112 00000100:00100000:2.0:1763333188.176526:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50049880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2420:x1848987613887744:12345-192.168.204.28@tcp:2:lfs.0 Request processed in 102us (591us total) trans 17179871750 rc 0/0 00000100:00100000:2.0:1763333188.176532:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6901 00010000:00010000:1.0:1763333188.176651:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763333188.185954:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333188.186173:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613888128 00000100:00100000:2.0:1763333188.186185:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613888128 00000100:00100000:2.0:1763333188.186252:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9709 00000100:00100000:2.0:1763333188.186263:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5004a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:57514:x1848987613888128:12345-192.168.204.28@tcp:55:lfs.0 00010000:00010000:2.0:1763333188.186512:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700ce00/0xb32e3ef184c58ad8 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x59:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333188.186530:0:6521:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c58a5a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x59:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a425 expref: 30 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.186540:0:6521:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700ce00/0xb32e3ef184c58ad8 lrc: 4/0,1 mode: --/PW res: [0x200000405:0x59:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333188.186572:0:6521:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c58a5a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x59:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a425 expref: 30 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.186591:0:6521:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c58a5a lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x59:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a425 expref: 30 pid: 6519 timeout: 1392 lvb_type: 0 00000100:00100000:2.0:1763333188.186605:0:6521:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe480a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1848987627319680:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333188.186708:0:6521:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe49ad03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763333188.190425:0:6521:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe480a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1848987627319680:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333188.190462:0:6521:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700ce00/0xb32e3ef184c58ad8 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x59:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 00000100:00100000:1.0:1763333188.191692:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333188.191907:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613888256 00000100:00100000:3.0:1763333188.191916:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613888256 00010000:00010000:3.0:1763333188.192262:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c58a5a lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x59:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a425 expref: 31 pid: 6519 timeout: 1392 lvb_type: 0 00000100:00100000:3.0:1763333188.192380:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3196 00000100:00100000:3.0:1763333188.192392:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff800db050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+31:2421:x1848987613888256:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333188.192409:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333188.192416:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c58a5a lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x59:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a425 expref: 31 pid: 6519 timeout: 1392 lvb_type: 0 00010000:00010000:3.0:1763333188.192429:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c58a5a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x59:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a425 expref: 31 pid: 6519 timeout: 1392 lvb_type: 0 00010000:00010000:3.0:1763333188.192451:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c58a5a lrc: 0/0,0 mode: --/PR res: [0x200000405:0x59:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a425 expref: 31 pid: 6519 timeout: 1392 lvb_type: 0 00010000:00010000:3.0:1763333188.192467:0:8423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x59:0x0].0x0 (ffff92fe43a31700) 00010000:00010000:3.0:1763333188.192471:0:8423:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700ce00/0xb32e3ef184c58ad8 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x59:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333188.192481:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700ce00/0xb32e3ef184c58ad8 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x59:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333188.192488:0:8423:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700ce00/0xb32e3ef184c58ad8 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x59:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333188.192519:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763333188.192581:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff800db050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:2421:x1848987613888256:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 192us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333188.192589:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3196 00010000:00010000:2.0:1763333188.192852:0:6521:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700ce00/0xb32e3ef184c58ad8 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x59:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333188.192860:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700ce00/0xb32e3ef184c58ad8 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x59:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333188.192902:0:6521:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700ce00/0xb32e3ef184c58ad8 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x59:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333188.192909:0:6521:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700ce00/0xb32e3ef184c58ad8 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x59:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333188.192915:0:6521:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700ce00/0xb32e3ef184c58ad8 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x59:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333188.192920:0:6521:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700ce00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:2.0:1763333188.192924:0:6521:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700ce00/0xb32e3ef184c58ad8 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x59:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333188.192931:0:6521:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700ce00/0xb32e3ef184c58ad8 lrc: 4/0,0 mode: PW/PW res: [0x200000405:0x59:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333188.192944:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x59:0x0].0x0 (ffff92fe43a31700) 00010000:00010000:2.0:1763333188.192947:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1763333188.193439:0:6521:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700ce00/0xb32e3ef184c58ad8 lrc: 2/0,0 mode: --/PW res: [0x200000405:0x59:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333188.193446:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700ce00/0xb32e3ef184c58ad8 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x59:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 00000100:00100000:2.0:1763333188.193510:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5004a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:57514:x1848987613888128:12345-192.168.204.28@tcp:55:lfs.0 Request processed in 7247us (7563us total) trans 0 rc -22/-22 00000100:00100000:2.0:1763333188.193519:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9709 00000100:00100000:1.0:1763333188.197166:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333188.197248:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613888512 00000100:00100000:2.0:1763333188.197259:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613888512 00000100:00100000:2.0:1763333188.197315:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9710 00000100:00100000:2.0:1763333188.197324:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50049f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:57514:x1848987613888512:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:2.0:1763333188.197558:0:6521:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1763333188.197588:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe465efc00/0xb32e3ef184c589b2 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3e6 expref: 29 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.197608:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe467bf600/0xb32e3ef184c5899d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a3d8 expref: 28 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.197876:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:2.0:1763333188.197881:0:6521:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763333188.197935:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700c600/0xb32e3ef184c58adf lrc: 3/0,1 mode: --/PW res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333188.197957:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700c600/0xb32e3ef184c58adf lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333188.197970:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700c600/0xb32e3ef184c58adf lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 00000004:00010000:2.0:1763333188.198075:0:6521:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000067a4ebb0 reply state 00000000007e2d96 transno 8589935474 ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700c600/0xb32e3ef184c58adf lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333188.198169:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700c600/0xb32e3ef184c58adf lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333188.198175:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:2.0:1763333188.198177:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763333188.198180:0:6521:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763333188.198342:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50049f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:57514:x1848987613888512:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 1018us (1183us total) trans 8589935474 rc 0/0 00000100:00100000:2.0:1763333188.198486:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9710 00000100:00100000:3.0:1763333188.205395:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333188.205541:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613888640 00000100:00100000:2.0:1763333188.205554:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613888640 00000100:00100000:2.0:1763333188.205629:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9711 00000100:00100000:2.0:1763333188.205639:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe480ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:57514:x1848987613888640:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333188.205667:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333188.205694:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700de00/0xb32e3ef184c58ae6 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a448 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.205759:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700de00/0xb32e3ef184c58ae6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a448 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.205775:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700de00/0xb32e3ef184c58ae6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a448 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.205797:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:2.0:1763333188.205800:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763333188.205804:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4700de00, rc 0) 00000100:00100000:2.0:1763333188.205884:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe480ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:57514:x1848987613888640:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 247us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333188.205892:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9711 00000100:00100000:0.0:1763333188.210269:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333188.210398:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613888768 00000100:00100000:3.0:1763333188.210409:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613888768 00000100:00100000:3.0:1763333188.210457:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6902 00000100:00100000:3.0:1763333188.210466:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:57514:x1848987613888768:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333188.210488:0:8611:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333188.210509:0:8611:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c58aed lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a44f expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333188.210541:0:8611:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c58a4c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a41e expref: 17 pid: 28600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333188.210549:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333188.210552:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333188.210556:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c58aed lrc: 4/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a44f expref: 17 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333188.210591:0:8611:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c58a4c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a41e expref: 17 pid: 28600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333188.210604:0:8611:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c58a4c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a41e expref: 17 pid: 28600 timeout: 1392 lvb_type: 1 00000100:00100000:3.0:1763333188.210617:0:8611:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe480ae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8611:1848987627319808:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333188.210704:0:8611:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7ad02300 going to sleep for 11 seconds 00000100:00100000:2.0:1763333188.212532:0:8611:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe480ae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8611:1848987627319808:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333188.212562:0:8611:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c58aed lrc: 3/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a44f expref: 17 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.212579:0:8611:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96400, rc 0) 00000100:00100000:2.0:1763333188.212619:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:57514:x1848987613888768:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 2153us (2362us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333188.212628:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6902 00000100:00100000:1.0:1763333188.218500:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333188.219201:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613888896 00000100:00100000:3.0:1763333188.219213:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613888896 00010000:00010000:3.0:1763333188.219271:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c58a4c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a41e expref: 17 pid: 28600 timeout: 1392 lvb_type: 1 00000100:00100000:3.0:1763333188.219321:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3197 00000100:00100000:3.0:1763333188.219333:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5004b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2421:x1848987613888896:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333188.220256:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333188.220297:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c58a4c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a41e expref: 17 pid: 28600 timeout: 1392 lvb_type: 1 00010000:00010000:3.0:1763333188.220315:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c58a4c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a41e expref: 17 pid: 28600 timeout: 1392 lvb_type: 1 00010000:00010000:3.0:1763333188.220343:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c58a4c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a41e expref: 17 pid: 28600 timeout: 1392 lvb_type: 1 00010000:00010000:3.0:1763333188.220382:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333188.220385:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333188.220392:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c58aed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a44f expref: 16 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333188.220402:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c58aed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a44f expref: 16 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.223256:0:8423:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c58aed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a44f expref: 16 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333188.223282:0:8423:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe480a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8423:1848987627319936:192.168.204.28@tcp:105: 00000100:00100000:2.0:1763333188.223394:0:8423:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe49ad06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763333188.230033:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333188.230114:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613889024 00000100:00100000:3.0:1763333188.230125:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613889024 00000100:00100000:3.0:1763333188.230186:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6903 00000100:00100000:3.0:1763333188.230195:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:57514:x1848987613889024:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333188.230218:0:8611:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333188.230244:0:8611:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c58af4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a456 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333188.230272:0:8611:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c58854 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a361 expref: 18 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333188.230282:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333188.230284:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333188.230288:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c58af4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a456 expref: 18 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333188.230320:0:8611:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c58854 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a361 expref: 18 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333188.230333:0:8611:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c58854 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a361 expref: 18 pid: 8406 timeout: 1392 lvb_type: 1 00000100:00100000:3.0:1763333188.230374:0:8611:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe480af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8611:1848987627320064:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333188.230456:0:8611:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7ad02300 going to sleep for 11 seconds 00000100:00100000:2.0:1763333188.230751:0:8423:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe480a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8423:1848987627319936:192.168.204.28@tcp:105: 00010000:00010000:2.0:1763333188.230774:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333188.230801:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5004b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:2421:x1848987613888896:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 11470us (12320us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333188.230813:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3197 00000100:00100000:2.0:1763333188.234505:0:8611:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe480af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8611:1848987627320064:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333188.234553:0:8611:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c58af4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a456 expref: 18 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.234579:0:8611:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a96000, rc 0) 00000100:00100000:2.0:1763333188.234646:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:57514:x1848987613889024:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 4449us (4625us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333188.234655:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6903 00000100:00100000:1.0:1763333188.237580:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333188.237723:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613889152 00000100:00100000:2.0:1763333188.237733:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613889152 00010000:00010000:2.0:1763333188.237771:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c58854 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a361 expref: 18 pid: 8406 timeout: 1392 lvb_type: 1 00000100:00100000:2.0:1763333188.238550:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3198 00000100:00100000:2.0:1763333188.238563:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5004bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2421:x1848987613889152:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333188.238581:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333188.238605:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c58854 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a361 expref: 18 pid: 8406 timeout: 1392 lvb_type: 1 00010000:00010000:2.0:1763333188.238619:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c58854 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a361 expref: 18 pid: 8406 timeout: 1392 lvb_type: 1 00010000:00010000:2.0:1763333188.238642:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96e00/0xb32e3ef184c58854 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a361 expref: 18 pid: 8406 timeout: 1392 lvb_type: 1 00010000:00010000:2.0:1763333188.238660:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333188.238663:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333188.238670:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c58af4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a456 expref: 17 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.238681:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c58af4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a456 expref: 17 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.238721:0:8423:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff92fe45a96000/0xb32e3ef184c58af4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a456 expref: 17 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333188.238736:0:8423:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe480a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8423:1848987627320192:192.168.204.28@tcp:105: 00000100:00100000:2.0:1763333188.238825:0:8423:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe49ad06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763333188.245303:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333188.245426:0:8423:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe480a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8423:1848987627320192:192.168.204.28@tcp:105: 00010000:00010000:2.0:1763333188.245452:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333188.245511:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5004bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2421:x1848987613889152:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 6951us (7940us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333188.245522:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3198 00000100:00100000:3.0:1763333188.245694:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613889280 00000100:00100000:3.0:1763333188.245702:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613889280 00000100:00100000:3.0:1763333188.245750:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6904 00000100:00100000:3.0:1763333188.245758:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+16:57514:x1848987613889280:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1763333188.245774:0:8611:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333188.245791:0:8611:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c58afb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a45d expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333188.245818:0:8611:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5885b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a368 expref: 17 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333188.245825:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333188.245828:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333188.245831:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c58afb lrc: 4/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a45d expref: 17 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333188.245861:0:8611:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5885b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a368 expref: 17 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763333188.245873:0:8611:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5885b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a368 expref: 17 pid: 8404 timeout: 1392 lvb_type: 1 00000100:00100000:3.0:1763333188.245884:0:8611:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe480adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8611:1848987627320320:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333188.245932:0:8611:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7ad02300 going to sleep for 11 seconds 00000100:00100000:2.0:1763333188.256172:0:8611:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe480adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8611:1848987627320320:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333188.256221:0:8611:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c58afb lrc: 3/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a45d expref: 17 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.256255:0:8611:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45a97200, rc 0) 00000100:00100000:2.0:1763333188.257321:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:57514:x1848987613889280:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 11555us (12020us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333188.257333:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6904 00000100:00100000:1.0:1763333188.257579:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333188.257994:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613889408 00000100:00100000:2.0:1763333188.258002:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613889408 00010000:00010000:2.0:1763333188.258036:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5885b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a368 expref: 17 pid: 8404 timeout: 1392 lvb_type: 1 00000100:00100000:2.0:1763333188.258075:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3199 00000100:00100000:2.0:1763333188.258083:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50048700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2420:x1848987613889408:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333188.258098:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333188.258118:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5885b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a368 expref: 17 pid: 8404 timeout: 1392 lvb_type: 1 00010000:00010000:2.0:1763333188.258131:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5885b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a368 expref: 17 pid: 8404 timeout: 1392 lvb_type: 1 00010000:00010000:2.0:1763333188.258154:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe42feaa00/0xb32e3ef184c5885b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a368 expref: 17 pid: 8404 timeout: 1392 lvb_type: 1 00010000:00010000:2.0:1763333188.258169:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333188.258171:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333188.258177:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c58afb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a45d expref: 16 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.258187:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c58afb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a45d expref: 16 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.258235:0:8423:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff92fe45a97200/0xb32e3ef184c58afb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a45d expref: 16 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333188.258254:0:8423:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe480a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8423:1848987627320448:192.168.204.28@tcp:105: 00000100:00100000:2.0:1763333188.258331:0:8423:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe49ad06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763333188.261852:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333188.262308:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333188.262792:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333188.262849:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613889664 00000100:00100000:2.0:1763333188.262860:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613889664 00000100:00100000:2.0:1763333188.262914:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613889536 00000100:00100000:2.0:1763333188.262917:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613889536 00000100:00100000:2.0:1763333188.262939:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6905 00000100:00100000:2.0:1763333188.262957:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50048000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2420:x1848987613889664:12345-192.168.204.28@tcp:2:lfs.0 00002000:00010000:2.0:1763333188.263099:0:8611:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763333188.263102:0:8611:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1763333187 -> 1763333187 00002000:00010000:2.0:1763333188.263105:0:8611:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 1763333187 -> 1763333188 00002000:00010000:2.0:1763333188.263107:0:8611:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1763333187 -> 1763333188 00002000:00010000:2.0:1763333188.263109:0:8611:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:2.0:1763333188.263159:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50048000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2420:x1848987613889664:12345-192.168.204.28@tcp:2:lfs.0 Request processed in 212us (1316us total) trans 17179871751 rc 0/0 00000100:00100000:2.0:1763333188.263166:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6905 00000100:00100000:2.0:1763333188.263185:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6906 00000100:00100000:2.0:1763333188.263191:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5004a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2420:x1848987613889536:12345-192.168.204.28@tcp:2:lfs.0 00002000:00010000:2.0:1763333188.263275:0:8611:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 121402 -> 121402 00002000:00010000:2.0:1763333188.263279:0:8611:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1763333187 -> 1763333187 00002000:00010000:2.0:1763333188.263281:0:8611:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1763333187 -> 1763333188 00002000:00010000:2.0:1763333188.263283:0:8611:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1763333187 -> 1763333188 00002000:00010000:2.0:1763333188.263285:0:8611:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 248 -> 248 00000100:00100000:2.0:1763333188.263306:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5004a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2420:x1848987613889536:12345-192.168.204.28@tcp:2:lfs.0 Request processed in 115us (998us total) trans 21474839092 rc 0/0 00000100:00100000:2.0:1763333188.263312:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6906 00000100:00100000:3.0:1763333188.264148:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613889792 00000100:00100000:3.0:1763333188.264156:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613889792 00000100:00100000:3.0:1763333188.264203:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6907 00000100:00100000:3.0:1763333188.264212:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5004b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2420:x1848987613889792:12345-192.168.204.28@tcp:2:lfs.0 00002000:00010000:3.0:1763333188.264295:0:8406:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763333188.264299:0:8406:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1763333187 -> 1763333187 00002000:00010000:3.0:1763333188.264302:0:8406:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1763333187 -> 1763333188 00002000:00010000:3.0:1763333188.264304:0:8406:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1763333187 -> 1763333188 00002000:00010000:3.0:1763333188.264307:0:8406:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763333188.264341:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5004b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2420:x1848987613889792:12345-192.168.204.28@tcp:2:lfs.0 Request processed in 130us (1550us total) trans 21474839093 rc 0/0 00000100:00100000:3.0:1763333188.264369:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6907 00000100:00100000:2.0:1763333188.264820:0:8423:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe480a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8423:1848987627320448:192.168.204.28@tcp:105: 00010000:00010000:2.0:1763333188.264842:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333188.264913:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50048700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2420:x1848987613889408:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 6830us (7333us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333188.264922:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3199 00000100:00100000:1.0:1763333188.267944:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333188.268094:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613890048 00000100:00100000:2.0:1763333188.268103:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613890048 00000100:00100000:2.0:1763333188.268533:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3305 00000100:00100000:2.0:1763333188.268543:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5004aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:57514:x1848987613890048:12345-192.168.204.28@tcp:35:lfs.0 00000004:00010000:2.0:1763333188.268610:0:6523:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x55:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c58a29 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a417 expref: 30 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.268650:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700ce00/0xb32e3ef184c58b02 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763333188.268662:0:6523:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700de00/0xb32e3ef184c58ae6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a448 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.268671:0:6523:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700ce00/0xb32e3ef184c58b02 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x55:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763333188.268706:0:6523:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700de00/0xb32e3ef184c58ae6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a448 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.268718:0:6523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700de00/0xb32e3ef184c58ae6 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a448 expref: 30 pid: 6521 timeout: 1392 lvb_type: 0 00000100:00100000:2.0:1763333188.268738:0:6523:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe480a8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6523:1848987627320576:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333188.268820:0:6523:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe49ad06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763333188.271148:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333188.271307:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613890176 00000100:00100000:0.0:1763333188.271315:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613890176 00010000:00010000:0.0:1763333188.271393:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700de00/0xb32e3ef184c58ae6 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a448 expref: 31 pid: 6521 timeout: 1392 lvb_type: 0 00000100:00100000:0.0:1763333188.271424:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3200 00000100:00100000:0.0:1763333188.271434:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50049180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+31:2421:x1848987613890176:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333188.271450:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333188.271457:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700de00/0xb32e3ef184c58ae6 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a448 expref: 31 pid: 6521 timeout: 1392 lvb_type: 0 00010000:00010000:0.0:1763333188.271469:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700de00/0xb32e3ef184c58ae6 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a448 expref: 31 pid: 6521 timeout: 1392 lvb_type: 0 00010000:00010000:0.0:1763333188.271491:0:8423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:0.0:1763333188.271496:0:8423:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700ce00/0xb32e3ef184c58b02 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x55:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763333188.271505:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700ce00/0xb32e3ef184c58b02 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763333188.271512:0:8423:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700ce00/0xb32e3ef184c58b02 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763333188.271529:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333188.271580:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50049180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+31:2421:x1848987613890176:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 148us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333188.271587:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3200 00010000:00010000:2.0:1763333188.272217:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700de00/0xb32e3ef184c58ae6 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a448 expref: 30 pid: 6521 timeout: 1392 lvb_type: 0 00000100:00100000:2.0:1763333188.272241:0:6523:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe480a8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6523:1848987627320576:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333188.272260:0:6523:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700ce00/0xb32e3ef184c58b02 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763333188.272267:0:6523:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700ce00/0xb32e3ef184c58b02 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763333188.272273:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700ce00/0xb32e3ef184c58b02 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763333188.272291:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c58b09 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763333188.272300:0:6523:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c58a68 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x59:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a42c expref: 29 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.272308:0:6523:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c58b09 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x59:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763333188.272331:0:6523:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c58a68 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x59:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a42c expref: 29 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.272342:0:6523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c58a68 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x59:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a42c expref: 29 pid: 6521 timeout: 1392 lvb_type: 0 00000100:00100000:2.0:1763333188.272403:0:6523:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe480a8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6523:1848987627320704:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333188.272458:0:6523:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe49ad06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763333188.274936:0:6523:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe480a8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6523:1848987627320704:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333188.274972:0:6523:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c58b09 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x59:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000100:00100000:3.0:1763333188.275415:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333188.276241:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613890304 00000100:00100000:1.0:1763333188.276251:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613890304 00010000:00010000:1.0:1763333188.276292:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c58a68 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x59:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a42c expref: 30 pid: 6521 timeout: 1392 lvb_type: 0 00000100:00100000:1.0:1763333188.276330:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3201 00000100:00100000:1.0:1763333188.276338:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe480ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:2420:x1848987613890304:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763333188.276389:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763333188.276396:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c58a68 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x59:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a42c expref: 30 pid: 6521 timeout: 1392 lvb_type: 0 00010000:00010000:1.0:1763333188.276409:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c58a68 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x59:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a42c expref: 30 pid: 6521 timeout: 1392 lvb_type: 0 00010000:00010000:1.0:1763333188.276431:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700e000/0xb32e3ef184c58a68 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x59:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a42c expref: 30 pid: 6521 timeout: 1392 lvb_type: 0 00010000:00010000:1.0:1763333188.276450:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x59:0x0].0x0 (ffff92fe43a31700) 00010000:00010000:1.0:1763333188.276455:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c58b09 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x59:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763333188.276464:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c58b09 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x59:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763333188.276471:0:6504:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c58b09 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x59:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763333188.276491:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763333188.276529:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe480ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+29:2420:x1848987613890304:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 192us (1116us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333188.276535:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3201 00010000:00010000:3.0:1763333188.276807:0:6523:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c58b09 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x59:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763333188.276819:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c58b09 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x59:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000100:00100000:3.0:1763333188.277330:0:6523:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe480af480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1848987627320832:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1763333188.277991:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333188.278169:0:6523:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff74009300 going to sleep for 11 seconds 00000100:00100000:2.0:1763333188.278244:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627320832 00000100:00100000:2.0:1763333188.278251:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627320832 00000100:00080000:0.0:1763333188.278576:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1763333188.278612:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1441 00000100:00100000:2.0:1763333188.278621:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe480ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6523:x1848987627320832:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763333188.278708:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe480ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6523:x1848987627320832:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 88us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333188.278715:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1441 00000100:00100000:3.0:1763333188.278765:0:6523:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474839087 gen 2 00000004:00080000:3.0:1763333188.278771:0:6523:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474839084 committed transno 21474839087 00000004:00080000:3.0:1763333188.278800:0:6523:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe45182a00, transno 21474839085 00000004:00080000:3.0:1763333188.278915:0:6523:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe45181500, transno 21474839086 00000004:00080000:3.0:1763333188.279087:0:6523:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe472f6a00, transno 21474839087 00000100:00100000:3.0:1763333188.279095:0:6523:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe480af480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1848987627320832:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1763333188.279147:0:6523:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe480af480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1848987627320960:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1763333188.279172:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333188.279193:0:6523:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff80206c00 going to sleep for 11 seconds 00000100:00100000:2.0:1763333188.279380:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627320960 00000100:00100000:2.0:1763333188.279385:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627320960 00000100:00100000:2.0:1763333188.279419:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1442 00000100:00100000:2.0:1763333188.279425:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe480aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6523:x1848987627320960:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763333188.279477:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe480aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6523:x1848987627320960:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 53us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333188.279483:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1442 00000100:00080000:0.0:1763333188.279564:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1763333188.279607:0:6523:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179871744 gen 2 00000004:00080000:3.0:1763333188.279610:0:6523:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179871741 committed transno 17179871744 00000004:00080000:3.0:1763333188.279634:0:6523:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe450d9880, transno 17179871742 00000004:00080000:3.0:1763333188.279725:0:6523:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe450daa00, transno 17179871743 00000004:00080000:3.0:1763333188.279801:0:6523:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92fe450da680, transno 17179871744 00000100:00100000:3.0:1763333188.279806:0:6523:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe480af480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1848987627320960:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763333188.279988:0:6523:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe480a8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1848987627321088:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763333188.280016:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763333188.280638:0:6523:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe49ad0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1763333188.280710:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627321088 00000100:00100000:1.0:1763333188.280717:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627321088 00000100:00100000:1.0:1763333188.281190:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1443 00000100:00100000:1.0:1763333188.281200:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe480ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6523:x1848987627321088:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1763333188.281309:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe480ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6523:x1848987627321088:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 111us (1291us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333188.281316:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1443 00000100:00100000:3.0:1763333188.281454:0:6523:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe480a8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1848987627321088:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1763333188.281513:0:6523:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe480aea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1848987627321216:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1763333188.281543:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333188.285208:0:6523:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff80206b40 going to sleep for 11 seconds 00000100:00100000:2.0:1763333188.285532:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627321216 00000100:00100000:2.0:1763333188.285544:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627321216 00000100:00100000:2.0:1763333188.285603:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1444 00000100:00100000:2.0:1763333188.285610:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe480af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6523:x1848987627321216:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763333188.285723:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe480af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6523:x1848987627321216:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 113us (4178us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333188.285730:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1444 00000100:00100000:3.0:1763333188.285806:0:6523:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe480aea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1848987627321216:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1763333188.285890:0:6523:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe480aea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1848987627321344:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1763333188.285920:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333188.285942:0:6523:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff74009300 going to sleep for 11 seconds 00000100:00100000:2.0:1763333188.285995:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627321344 00000100:00100000:2.0:1763333188.285999:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627321344 00000100:00100000:2.0:1763333188.286013:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1445 00000100:00100000:2.0:1763333188.286018:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe480adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6523:x1848987627321344:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763333188.286064:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe480adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6523:x1848987627321344:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 46us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333188.286070:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1445 00000100:00100000:3.0:1763333188.286117:0:6523:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe480aea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1848987627321344:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1763333188.286144:0:6523:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe480aea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1848987627321472:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1763333188.286162:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333188.286187:0:6523:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7ad02300 going to sleep for 11 seconds 00000100:00100000:2.0:1763333188.286468:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627321472 00000100:00100000:2.0:1763333188.286472:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627321472 00000100:00100000:2.0:1763333188.286490:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1446 00000100:00100000:2.0:1763333188.286495:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe480af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6523:x1848987627321472:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763333188.286546:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe480af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6523:x1848987627321472:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 50us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333188.286552:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1446 00000100:00100000:3.0:1763333188.286622:0:6523:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe480aea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1848987627321472:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1763333188.286653:0:6523:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe480aea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1848987627321600:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1763333188.286672:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333188.286681:0:6523:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff44fdf000 going to sleep for 11 seconds 00000100:00100000:2.0:1763333188.286719:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627321600 00000100:00100000:2.0:1763333188.286723:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627321600 00000100:00100000:2.0:1763333188.286739:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1447 00000100:00100000:2.0:1763333188.286744:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe480ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6523:x1848987627321600:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763333188.286799:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe480ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6523:x1848987627321600:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 55us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333188.286805:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1447 00000100:00100000:3.0:1763333188.286858:0:6523:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe480aea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1848987627321600:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1763333188.286888:0:6523:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe480aea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1848987627321728:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1763333188.286907:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333188.286928:0:6523:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff74009300 going to sleep for 11 seconds 00000100:00100000:2.0:1763333188.286971:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627321728 00000100:00100000:2.0:1763333188.286976:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627321728 00000100:00100000:2.0:1763333188.286992:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1448 00000100:00100000:2.0:1763333188.286997:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe480ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6523:x1848987627321728:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763333188.287047:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe480ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6523:x1848987627321728:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 49us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333188.287053:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1448 00000100:00100000:3.0:1763333188.287101:0:6523:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe480aea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1848987627321728:0@lo:1000:mdt_rdpg00_001.0 00000040:00080000:3.0:1763333188.287263:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd0:0x2:0x0].10, 552 off43776 00000001:00080000:3.0:1763333188.287275:0:6523:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935475 00000100:00100000:3.0:1763333188.287322:0:6523:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe480aea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1848987627321856:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1763333188.287341:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333188.287380:0:6523:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7dfd8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1763333188.287426:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627321856 00000100:00100000:2.0:1763333188.287431:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627321856 00000100:00100000:2.0:1763333188.287450:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1449 00000100:00100000:2.0:1763333188.287456:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe480ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6523:x1848987627321856:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763333188.287551:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe480ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6523:x1848987627321856:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 95us (208us total) trans 21474839094 rc 0/0 00000100:00100000:2.0:1763333188.287557:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1449 00000100:00100000:3.0:1763333188.287788:0:6523:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe480aea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1848987627321856:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1763333188.287808:0:6523:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe480aca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1848987627321984:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1763333188.287827:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763333188.287847:0:6523:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff7ad02300 going to sleep for 11 seconds 00000100:00100000:2.0:1763333188.287884:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627321984 00000100:00100000:2.0:1763333188.287887:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627321984 00000100:00100000:2.0:1763333188.287900:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1450 00000100:00100000:2.0:1763333188.287905:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe480afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6523:x1848987627321984:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763333188.287985:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe480afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6523:x1848987627321984:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 80us (156us total) trans 17179871752 rc 0/0 00000100:00100000:2.0:1763333188.287992:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1450 00000100:00100000:3.0:1763333188.288045:0:6523:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe480aca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1848987627321984:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1763333188.288097:0:6523:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935476 00010000:00010000:3.0:1763333188.288122:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c58b09 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x59:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763333188.288132:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c58b09 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x59:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763333188.288138:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c58b09 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x59:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763333188.288144:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c84400 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333188.288148:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c58b09 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x59:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763333188.288155:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c58b09 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x59:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763333188.288170:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x59:0x0].0x0 (ffff92fe43a31700) 00010000:00010000:3.0:1763333188.288173:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1763333188.288177:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c58b09 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x59:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763333188.288182:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45c84400/0xb32e3ef184c58b09 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x59:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763333188.288195:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700ce00/0xb32e3ef184c58b02 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763333188.288203:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700ce00/0xb32e3ef184c58b02 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763333188.288208:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700ce00/0xb32e3ef184c58b02 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763333188.288212:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700ce00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:3.0:1763333188.288214:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700ce00/0xb32e3ef184c58b02 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763333188.288219:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700ce00/0xb32e3ef184c58b02 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763333188.288235:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:3.0:1763333188.288238:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1763333188.288241:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700ce00/0xb32e3ef184c58b02 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x55:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763333188.288246:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700ce00/0xb32e3ef184c58b02 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x55:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763333188.288257:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:3.0:1763333188.288259:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763333188.288267:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c58a29 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x55:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a417 expref: 31 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333188.288473:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5004aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:57514:x1848987613890048:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 19931us (20536us total) trans 8589935477 rc 0/0 00000100:00100000:3.0:1763333188.288481:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3305 00000020:00080000:3.0:1763333188.288485:0:6523:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1763333188.291188:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333188.296562:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613890432 00000100:00100000:1.0:1763333188.296581:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613890432 00000100:00100000:1.0:1763333188.296687:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9712 00000100:00100000:1.0:1763333188.296697:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+30:57514:x1848987613890432:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333188.296724:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333188.296749:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58b10 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a464 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333188.296803:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58b10 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a464 expref: 31 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333188.296819:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58b10 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a464 expref: 31 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333188.296839:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333188.296843:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763333188.296846:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdf200, rc 0) 00000100:00100000:1.0:1763333188.296911:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+31:57514:x1848987613890432:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 214us (5729us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333188.296919:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9712 00000100:00100000:2.0:1763333188.299247:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333188.300972:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613890432 00000100:00100000:3.0:1763333188.300986:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613890432 00000004:00100000:3.0:1763333188.301057:0:6521:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) @@@ lock 0000000035cd5820 cookie 0xd9dc1b5e3696a464 req@ffff92fe480a9500 x1848987613890432/t0(0) o101->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:499/0 lens 376/0 e 0 to 0 dl 1763333199 ref 1 fl New:/602/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000004:00010000:3.0:1763333188.301074:0:6521:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) ### hpreq resend ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58b10 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a464 expref: 31 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333188.301767:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1513 00000100:00100000:1.0:1763333188.301784:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe480a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+31:57514:x1848987613890432:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333188.301803:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333188.301813:0:6519:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue()) @@@ found existing lock cookie 0xb32e3ef184c58b10 req@ffff92fe480a9500 x1848987613890432/t0(0) o101->1370b1d7-8612-4b90-ab37-e53288bbf9fd@192.168.204.28@tcp:499/0 lens 376/0 e 0 to 0 dl 1763333199 ref 1 fl Interpret:H/602/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1763333188.301864:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdf200/0xb32e3ef184c58b10 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a464 expref: 31 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333188.301888:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333188.301891:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763333188.301896:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdf200, rc 0) 00000100:00100000:1.0:1763333188.301969:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe480a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+31:57514:x1848987613890432:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 191us (2730us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333188.301980:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1513 00000100:00100000:0.0:1763333188.307551:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333188.307732:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613890816 00000100:00100000:3.0:1763333188.307742:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613890816 00000100:00100000:3.0:1763333188.307799:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3306 00000100:00100000:3.0:1763333188.307809:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe472f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+31:57514:x1848987613890816:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1763333188.308044:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe472f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+32:57514:x1848987613890816:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 235us (503us total) trans 8589935478 rc 0/0 00000100:00100000:3.0:1763333188.308052:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3306 00000100:00100000:3.0:1763333188.310094:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333188.310433:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613891072 00000100:00100000:2.0:1763333188.310444:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613891072 00000100:00100000:2.0:1763333188.310496:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3307 00000100:00100000:2.0:1763333188.310505:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe480ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+32:57514:x1848987613891072:12345-192.168.204.28@tcp:35:lfs.0 00000004:00080000:2.0:1763333188.310689:0:19668:0:(mdd_object.c:3993:mdd_close()) Object [0x200000405:0x59:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:2.0:1763333188.310764:0:19668:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45c85400/0xb32e3ef184c58b17 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19668 initiator: MDT0 00010000:00010000:2.0:1763333188.310779:0:19668:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45c85400/0xb32e3ef184c58b17 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 19668 initiator: MDT0 00010000:00010000:2.0:1763333188.310791:0:19668:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45c85400/0xb32e3ef184c58b17 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19668 initiator: MDT0 00010000:00010000:2.0:1763333188.310798:0:19668:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45c85400/0xb32e3ef184c58b17 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19668 initiator: MDT0 00010000:00010000:2.0:1763333188.310805:0:19668:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45c85400/0xb32e3ef184c58b17 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19668 initiator: MDT0 00010000:00010000:2.0:1763333188.310810:0:19668:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45c85400/0xb32e3ef184c58b17 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19668 initiator: MDT0 00010000:00010000:2.0:1763333188.311390:0:19668:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763333188.311577:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe480ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+33:57514:x1848987613891072:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 1070us (1488us total) trans 8589935479 rc 0/0 00000100:00100000:2.0:1763333188.311585:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3307 00010000:00010000:1.0:1763333188.311861:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333188.311868:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45c85400/0xb32e3ef184c58b17 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19668 initiator: MDT0 00010000:00010000:1.0:1763333188.311877:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c85400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333188.311881:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45c85400/0xb32e3ef184c58b17 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19668 initiator: MDT0 00010000:00010000:1.0:1763333188.311890:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45c85400/0xb32e3ef184c58b17 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 19668 initiator: MDT0 00010000:00010000:1.0:1763333188.311905:0:8422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x59:0x0].0x0 (ffff92fe43a31700) 00010000:00010000:1.0:1763333188.311908:0:8422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1763333188.311912:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45c85400/0xb32e3ef184c58b17 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19668 initiator: MDT0 00010000:00010000:1.0:1763333188.311918:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45c85400/0xb32e3ef184c58b17 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19668 initiator: MDT0 00010000:00010000:1.0:1763333188.311929:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333188.311932:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333188.311933:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763333188.328505:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333188.329911:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613891200 00000100:00100000:0.0:1763333188.329925:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613891200 00000100:00100000:1.0:1763333188.331288:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9713 00000100:00100000:1.0:1763333188.331308:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe480aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+33:57515:x1848987613891200:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333188.331336:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333188.331390:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c58b1e lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a46b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333188.331471:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c58b25 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333188.331486:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c58b25 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333188.331497:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c58b25 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333188.331510:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c58b2c lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333188.331517:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c58b2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333188.331523:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c58b2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333188.331598:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58b33 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333188.331607:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58b33 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333188.331614:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58b33 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00000004:00200000:1.0:1763333188.331655:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x55:0x0]: returning size 121402 00000004:00200000:1.0:1763333188.331660:0:6519:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763333188.331679:0:6519:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58b33 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333188.331691:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58b33 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333188.331699:0:6519:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c58b25 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333188.331709:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c58b25 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333188.331714:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c58b25 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333188.331721:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c58b25 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333188.331726:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4742fc00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333188.331730:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c58b25 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333188.331737:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c58b25 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333188.331750:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0x0 (ffff92fe4388e400) 00010000:00010000:1.0:1763333188.331753:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333188.331758:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c58b25 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333188.331763:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c58b25 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333188.331776:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c58b2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333188.331782:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c58b2c lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333188.331787:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c58b2c lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333188.331792:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4742e000 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:1.0:1763333188.331796:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c58b2c lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333188.331802:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c58b2c lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333188.331809:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0xdd396665 (ffff92fe4388e500) 00010000:00010000:1.0:1763333188.331812:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763333188.331815:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c58b2c lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333188.331820:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c58b2c lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333188.331852:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c58b1e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a46b expref: 35 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333188.331868:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58b33 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a46b expref: 34 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333188.331874:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333188.331876:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763333188.331878:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4742f400, rc 0) 00000100:00100000:1.0:1763333188.331971:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe480aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+34:57515:x1848987613891200:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 671us (3474us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333188.331978:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9713 00000100:00100000:0.0:1763333188.337060:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333188.337473:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613891456 00000100:00100000:2.0:1763333188.337486:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613891456 00000100:00100000:2.0:1763333188.337966:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9714 00000100:00100000:2.0:1763333188.337979:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+34:57515:x1848987613891456:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333188.338000:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333188.338020:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45c84200/0xb32e3ef184c58b3a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a472 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.338128:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45c84c00/0xb32e3ef184c58b41 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333188.338146:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45c84c00/0xb32e3ef184c58b41 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x55:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333188.338157:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45c84c00/0xb32e3ef184c58b41 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x55:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 00000004:00200000:2.0:1763333188.338169:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x55:0x0]: returning size 121402 00010000:00010000:2.0:1763333188.338284:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45c84200/0xb32e3ef184c58b3a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a472 expref: 37 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.338302:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45c84c00/0xb32e3ef184c58b41 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x55:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a472 expref: 36 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.338311:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:2.0:1763333188.338314:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1763333188.338317:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45c84c00, rc 0) 00000100:00100000:2.0:1763333188.338407:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+36:57515:x1848987613891456:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 431us (1356us total) trans 8589935480 rc 0/0 00000100:00100000:2.0:1763333188.338415:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9714 00000100:00100000:0.0:1763333188.342463:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333188.342569:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613891712 00000100:00100000:2.0:1763333188.342582:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613891712 00000100:00100000:2.0:1763333188.342645:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9715 00000100:00100000:2.0:1763333188.342654:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+36:57515:x1848987613891712:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333188.342680:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333188.342703:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45c85600/0xb32e3ef184c58b4f lrc: 2/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a479 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.342805:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45c85400/0xb32e3ef184c58b56 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333188.342822:0:6521:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45c85400/0xb32e3ef184c58b56 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333188.342833:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45c85400/0xb32e3ef184c58b56 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 00000004:00200000:2.0:1763333188.342846:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x55:0x0]: returning size 121402 00010000:00010000:2.0:1763333188.342968:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45c85600/0xb32e3ef184c58b4f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a479 expref: 39 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.342988:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45c85400/0xb32e3ef184c58b56 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a479 expref: 38 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.342997:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:2.0:1763333188.343000:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763333188.343004:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45c85400, rc 0) 00000100:00100000:2.0:1763333188.343058:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+38:57515:x1848987613891712:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 405us (606us total) trans 8589935481 rc 0/0 00000100:00100000:2.0:1763333188.343066:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9715 00000100:00100000:3.0:1763333188.346962:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333188.347270:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613891840 00000100:00100000:0.0:1763333188.347280:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613891840 00000100:00100000:0.0:1763333188.347714:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6908 00000100:00100000:0.0:1763333188.347725:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe480ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2420:x1848987613891840:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1763333188.347746:0:28650:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333188.347764:0:28650:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58b64 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a480 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333188.347823:0:28650:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7dcfd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28650:1848987627322112:192.168.204.28@tcp:106: 00000100:00100000:0.0:1763333188.347904:0:28650:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff49dd4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1763333188.351325:0:28650:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7dcfd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28650:1848987627322112:192.168.204.28@tcp:106: 00010000:00010000:1.0:1763333188.351406:0:28650:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58b64 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a480 expref: 19 pid: 28650 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333188.351437:0:28650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58b64 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a480 expref: 19 pid: 28650 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333188.351450:0:28650:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7ec00, rc 0) 00000100:00100000:1.0:1763333188.351513:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe480ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2420:x1848987613891840:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 3789us (4559us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333188.351522:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6908 00000100:00100000:2.0:1763333188.394514:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333188.394601:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613891968 00000100:00100000:3.0:1763333188.394612:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613891968 00000100:00100000:3.0:1763333188.395118:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1821 00000100:00100000:3.0:1763333188.395129:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe480aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2418:x1848987613891968:12345-192.168.204.28@tcp:3:lfs.0 00010000:00010000:3.0:1763333188.395164:0:16635:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c58b6b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333188.395183:0:16635:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c58aed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a44f expref: 18 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333188.395191:0:16635:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333188.395194:0:16635:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763333188.395197:0:16635:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c58b6b lrc: 4/1,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333188.395241:0:16635:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c58aed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a44f expref: 18 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333188.395255:0:16635:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c58aed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a44f expref: 18 pid: 8611 timeout: 1392 lvb_type: 0 00000100:00100000:3.0:1763333188.395270:0:16635:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe480ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:16635:1848987627322240:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333188.395617:0:16635:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff44fdf000 going to sleep for 11 seconds 00000100:00100000:3.0:1763333188.399294:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333188.399492:0:16635:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe480ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:16635:1848987627322240:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333188.399526:0:16635:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c58b6b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333188.399643:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613892096 00000100:00100000:0.0:1763333188.399650:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613892096 00010000:00010000:0.0:1763333188.399692:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c58aed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a44f expref: 19 pid: 8611 timeout: 1392 lvb_type: 0 00000100:00100000:0.0:1763333188.400034:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3202 00000100:00100000:0.0:1763333188.400046:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe480af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2420:x1848987613892096:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333188.400063:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333188.400083:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c58aed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a44f expref: 19 pid: 8611 timeout: 1392 lvb_type: 0 00010000:00010000:0.0:1763333188.400102:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c58aed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a44f expref: 19 pid: 8611 timeout: 1392 lvb_type: 0 00010000:00010000:0.0:1763333188.400125:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe45a96400/0xb32e3ef184c58aed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a44f expref: 19 pid: 8611 timeout: 1392 lvb_type: 0 00010000:00010000:0.0:1763333188.400141:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333188.400144:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333188.400149:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c58b6b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333188.400160:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c58b6b lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333188.400193:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333188.400266:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe480af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2420:x1848987613892096:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 222us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333188.400274:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3202 00010000:00010000:2.0:1763333188.400501:0:16635:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c58b6b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.400510:0:16635:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c58b6b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.404286:0:16635:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c58b6b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.404308:0:16635:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c58b6b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.404318:0:16635:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c58b6b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.404326:0:16635:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe4700f400 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333188.404331:0:16635:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c58b6b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.404341:0:16635:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c58b6b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.404479:0:16635:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c58b6b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.404488:0:16635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4700f400/0xb32e3ef184c58b6b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333188.404582:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe480aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2418:x1848987613891968:12345-192.168.204.28@tcp:3:lfs.0 Request processed in 9448us (10071us total) trans 0 rc 121402/121402 00000100:00100000:2.0:1763333188.404593:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1821 00000100:00100000:3.0:1763333188.409904:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333188.411786:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613892224 00000100:00100000:1.0:1763333188.411802:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613892224 00000100:00100000:1.0:1763333188.412138:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6909 00000100:00100000:1.0:1763333188.412150:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe480ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2420:x1848987613892224:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333188.412169:0:28650:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333188.412188:0:28650:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c58b72 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a487 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333188.412253:0:28650:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff50049500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28650:1848987627322368:192.168.204.28@tcp:106: 00000100:00100000:1.0:1763333188.412343:0:28650:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4869d540 going to sleep for 11 seconds 00000100:00100000:2.0:1763333188.412939:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333188.413382:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613892352 00000100:00100000:1.0:1763333188.413389:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613892352 00000100:00100000:1.0:1763333188.413667:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6910 00000100:00100000:1.0:1763333188.413678:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe480a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2420:x1848987613892352:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333188.413693:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333188.413709:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c58b79 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a48e expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333188.413759:0:8404:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff50048380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8404:1848987627322496:192.168.204.28@tcp:106: 00000100:00100000:1.0:1763333188.414832:0:8404:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4869d300 going to sleep for 11 seconds 00000100:00100000:1.0:1763333188.416776:0:28650:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff50049500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28650:1848987627322368:192.168.204.28@tcp:106: 00010000:00010000:1.0:1763333188.416816:0:28650:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c58b72 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a487 expref: 19 pid: 28650 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333188.416842:0:28650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4742e000/0xb32e3ef184c58b72 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a487 expref: 19 pid: 28650 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333188.416856:0:28650:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4742e000, rc 0) 00000100:00100000:1.0:1763333188.416918:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe480ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2420:x1848987613892224:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 4770us (7026us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333188.416929:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6909 00000100:00100000:1.0:1763333188.418640:0:8404:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff50048380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8404:1848987627322496:192.168.204.28@tcp:106: 00010000:00010000:1.0:1763333188.418675:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c58b79 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a48e expref: 18 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333188.418696:0:8404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c58b79 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a48e expref: 18 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333188.418708:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4742fc00, rc 0) 00000100:00100000:1.0:1763333188.419434:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe480a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2420:x1848987613892352:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 5752us (6490us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333188.419447:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6910 00000100:00100000:3.0:1763333188.422082:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333188.422316:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613892480 00000100:00100000:2.0:1763333188.422327:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613892480 00000100:00100000:2.0:1763333188.422429:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1822 00000100:00100000:2.0:1763333188.422440:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2418:x1848987613892480:12345-192.168.204.28@tcp:3:lfs.0 00010000:00010000:2.0:1763333188.422477:0:16635:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c58b80 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.422496:0:16635:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c58ad1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a441 expref: 18 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.422504:0:16635:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333188.422506:0:16635:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763333188.422510:0:16635:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c58b80 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.422543:0:16635:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c58ad1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a441 expref: 18 pid: 8404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.422557:0:16635:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c58ad1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a441 expref: 18 pid: 8404 timeout: 1392 lvb_type: 0 00000100:00100000:2.0:1763333188.422571:0:16635:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe480ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:16635:1848987627322624:192.168.204.28@tcp:104: 00000100:00100000:2.0:1763333188.422641:0:16635:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe49ad0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1763333188.427145:0:16635:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe480ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:16635:1848987627322624:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333188.427180:0:16635:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c58b80 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333188.428842:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333188.428936:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613892608 00000100:00100000:0.0:1763333188.428946:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613892608 00010000:00010000:0.0:1763333188.428997:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c58ad1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a441 expref: 19 pid: 8404 timeout: 1392 lvb_type: 0 00000100:00100000:0.0:1763333188.429659:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3203 00000100:00100000:0.0:1763333188.429672:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff800da450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2421:x1848987613892608:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333188.429689:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333188.429713:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c58ad1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a441 expref: 19 pid: 8404 timeout: 1392 lvb_type: 0 00010000:00010000:0.0:1763333188.429728:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c58ad1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a441 expref: 19 pid: 8404 timeout: 1392 lvb_type: 0 00010000:00010000:0.0:1763333188.429753:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4700c200/0xb32e3ef184c58ad1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a441 expref: 19 pid: 8404 timeout: 1392 lvb_type: 0 00010000:00010000:0.0:1763333188.429771:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333188.429773:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333188.429778:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c58b80 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333188.429788:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c58b80 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333188.429821:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333188.429873:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff800da450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2421:x1848987613892608:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 205us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333188.429880:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3203 00010000:00010000:3.0:1763333188.430143:0:16635:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c58b80 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333188.430153:0:16635:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c58b80 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.433943:0:16635:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c58b80 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.433962:0:16635:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c58b80 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.433977:0:16635:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c58b80 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.433984:0:16635:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c84600 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333188.433988:0:16635:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c58b80 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.433996:0:16635:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c58b80 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.434014:0:16635:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c58b80 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.434021:0:16635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe45c84600/0xb32e3ef184c58b80 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333188.434142:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2418:x1848987613892480:12345-192.168.204.28@tcp:3:lfs.0 Request processed in 11700us (12064us total) trans 0 rc 121402/121402 00000100:00100000:2.0:1763333188.434152:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1822 00000100:00100000:2.0:1763333188.447426:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333188.447560:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613892736 00000100:00100000:0.0:1763333188.447571:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613892736 00000100:00100000:0.0:1763333188.448105:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 417 00000100:00100000:0.0:1763333188.448117:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe480a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+38:57515:x1848987613892736:12345-192.168.204.28@tcp:103:lfs.0 00010000:00010000:0.0:1763333188.448133:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333188.448158:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe45c85400/0xb32e3ef184c58b56 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a479 expref: 38 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333188.448181:0:8423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:0.0:1763333188.448186:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333188.448265:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe480a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+37:57515:x1848987613892736:12345-192.168.204.28@tcp:103:lfs.0 Request processed in 151us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333188.448274:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 417 00000100:00100000:0.0:1763333188.455033:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333188.455415:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613892992 00000100:00100000:2.0:1763333188.455427:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613892992 00000100:00100000:2.0:1763333188.455490:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3308 00000100:00100000:2.0:1763333188.455498:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+37:57515:x1848987613892992:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1763333188.456929:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+38:57515:x1848987613892992:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 1424us (1899us total) trans 8589935482 rc 0/0 00000100:00100000:2.0:1763333188.456944:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3308 00000100:00100000:3.0:1763333188.479494:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333188.479939:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613893248 00000100:00100000:1.0:1763333188.480012:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613893248 00000100:00100000:1.0:1763333188.480075:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9716 00000100:00100000:1.0:1763333188.480085:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+38:57516:x1848987613893248:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333188.480112:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333188.480135:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c58b87 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a495 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333188.480252:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c58b8e lrc: 3/0,1 mode: --/PW res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333188.480269:0:6519:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c58b8e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333188.480280:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c58b8e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00000004:00200000:1.0:1763333188.480293:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x55:0x0]: returning size 121402 00010000:00010000:1.0:1763333188.480439:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742fc00/0xb32e3ef184c58b87 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a495 expref: 41 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333188.480457:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c58b8e lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a495 expref: 40 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333188.480465:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333188.480468:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763333188.480473:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4742e000, rc 0) 00000100:00100000:1.0:1763333188.480542:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+40:57516:x1848987613893248:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 459us (1059us total) trans 8589935483 rc 0/0 00000100:00100000:1.0:1763333188.480551:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9716 00000100:00100000:0.0:1763333188.487266:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333188.487483:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613893376 00000100:00100000:1.0:1763333188.487494:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613893376 00000100:00100000:1.0:1763333188.487542:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6911 00000100:00100000:1.0:1763333188.487551:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2419:x1848987613893376:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333188.487570:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333188.487590:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c58b9c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a49c expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333188.487647:0:8404:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff50048380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8404:1848987627322752:192.168.204.28@tcp:106: 00000100:00100000:1.0:1763333188.487747:0:8404:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4869d540 going to sleep for 11 seconds 00000100:00100000:1.0:1763333188.492602:0:8404:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff50048380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8404:1848987627322752:192.168.204.28@tcp:106: 00010000:00010000:1.0:1763333188.492644:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c58b9c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a49c expref: 18 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333188.492668:0:8404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c58b9c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a49c expref: 18 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333188.492681:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdfe00, rc 0) 00000100:00100000:1.0:1763333188.494820:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2419:x1848987613893376:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 7258us (7553us total) trans 0 rc 301/301 00000100:00100000:1.0:1763333188.494833:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6911 00000100:00100000:3.0:1763333188.498002:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333188.498100:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613893504 00000100:00100000:2.0:1763333188.498110:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613893504 00000100:00100000:2.0:1763333188.498175:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1823 00000100:00100000:2.0:1763333188.498183:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2421:x1848987613893504:12345-192.168.204.28@tcp:3:lfs.0 00010000:00010000:2.0:1763333188.498230:0:16635:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85600/0xb32e3ef184c58ba3 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.498245:0:16635:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333188.498247:0:16635:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333188.498254:0:16635:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85600/0xb32e3ef184c58ba3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.498266:0:16635:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85600/0xb32e3ef184c58ba3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.504292:0:16635:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85600/0xb32e3ef184c58ba3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.504316:0:16635:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85600/0xb32e3ef184c58ba3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.504325:0:16635:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85600/0xb32e3ef184c58ba3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.504331:0:16635:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c85600 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333188.504336:0:16635:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85600/0xb32e3ef184c58ba3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.504381:0:16635:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85600/0xb32e3ef184c58ba3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.504400:0:16635:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85600/0xb32e3ef184c58ba3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.504408:0:16635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85600/0xb32e3ef184c58ba3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333188.504500:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2421:x1848987613893504:12345-192.168.204.28@tcp:3:lfs.0 Request processed in 6313us (6504us total) trans 0 rc 122880/122880 00000100:00100000:2.0:1763333188.504511:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1823 00000100:00100000:0.0:1763333188.543813:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333188.543914:0:8404:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613893632 00000100:00100000:1.0:1763333188.543925:0:8404:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613893632 00000100:00100000:1.0:1763333188.543982:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6912 00000100:00100000:1.0:1763333188.543991:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2419:x1848987613893632:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333188.544009:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333188.544029:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c58baa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a4a3 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333188.544050:0:8404:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x95:0x0] initial LVB size: 121402, mtime: 0x691a5443, atime: 0x691a5444, ctime: 0x691a5444, blocks: 0xf8 00010000:00010000:1.0:1763333188.544067:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333188.544069:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333188.544079:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c58baa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a4a3 expref: 18 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333188.544094:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe4abdfe00/0xb32e3ef184c58baa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a4a3 expref: 18 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333188.544106:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4abdfe00, rc 0) 00000100:00100000:1.0:1763333188.544731:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2419:x1848987613893632:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 738us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333188.544739:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6912 00000100:00100000:3.0:1763333188.546983:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333188.547105:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613893760 00000100:00100000:2.0:1763333188.547117:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613893760 00000100:00100000:2.0:1763333188.547194:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1824 00000100:00100000:2.0:1763333188.547205:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2418:x1848987613893760:12345-192.168.204.28@tcp:3:lfs.0 00010000:00010000:2.0:1763333188.547256:0:16635:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85600/0xb32e3ef184c58bb1 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.547273:0:16635:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333188.547276:0:16635:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333188.547281:0:16635:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85600/0xb32e3ef184c58bb1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.547294:0:16635:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85600/0xb32e3ef184c58bb1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333188.551981:0:16635:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85600/0xb32e3ef184c58bb1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333188.552002:0:16635:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85600/0xb32e3ef184c58bb1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333188.552011:0:16635:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85600/0xb32e3ef184c58bb1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333188.552019:0:16635:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c85600 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:3.0:1763333188.552023:0:16635:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85600/0xb32e3ef184c58bb1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333188.552031:0:16635:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85600/0xb32e3ef184c58bb1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333188.552051:0:16635:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85600/0xb32e3ef184c58bb1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333188.552057:0:16635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85600/0xb32e3ef184c58bb1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333188.552151:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2418:x1848987613893760:12345-192.168.204.28@tcp:3:lfs.0 Request processed in 4942us (5173us total) trans 0 rc 122880/122880 00000100:00100000:3.0:1763333188.552161:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1824 00000100:00100000:0.0:1763333188.555775:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333188.555814:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333188.556070:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613894016 00000100:00100000:2.0:1763333188.556080:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613894016 00000100:00100000:2.0:1763333188.556132:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613893888 00000100:00100000:2.0:1763333188.556134:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613893888 00000100:00100000:2.0:1763333188.556161:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6913 00000100:00100000:2.0:1763333188.556170:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2418:x1848987613894016:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1763333188.556187:0:28650:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333188.556204:0:28650:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85400/0xb32e3ef184c58bb8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a4b1 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333188.556267:0:28650:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe480abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28650:1848987627322880:192.168.204.28@tcp:106: 00000100:00100000:2.0:1763333188.556334:0:28650:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe49ad0840 going to sleep for 11 seconds 00000100:00100000:1.0:1763333188.556522:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6914 00000100:00100000:1.0:1763333188.556532:0:8404:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2418:x1848987613893888:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1763333188.556539:0:8404:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333188.556553:0:8404:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c58bbf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a4aa expref: -99 pid: 8404 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763333188.556571:0:8404:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x99:0x0] initial LVB size: 122880, mtime: 0x691a5443, atime: 0x691a5444, ctime: 0x691a5444, blocks: 0x70 00010000:00010000:1.0:1763333188.556582:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333188.556584:0:8404:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333188.556592:0:8404:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c58bbf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a4aa expref: 18 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333188.556608:0:8404:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff92fe4742fc00/0xb32e3ef184c58bbf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a4aa expref: 18 pid: 8404 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333188.556619:0:8404:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4742fc00, rc 0) 00000100:00100000:1.0:1763333188.556657:0:8404:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2418:x1848987613893888:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 128us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1763333188.556664:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6914 00000100:00100000:2.0:1763333188.560658:0:28650:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe480abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28650:1848987627322880:192.168.204.28@tcp:106: 00010000:00010000:2.0:1763333188.560700:0:28650:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85400/0xb32e3ef184c58bb8 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a4b1 expref: 19 pid: 28650 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333188.560726:0:28650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85400/0xb32e3ef184c58bb8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a4b1 expref: 19 pid: 28650 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763333188.560740:0:28650:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45c85400, rc 0) 00000100:00100000:2.0:1763333188.560804:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2418:x1848987613894016:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 4634us (5038us total) trans 0 rc 301/301 00000100:00100000:2.0:1763333188.560814:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6913 00000100:00100000:2.0:1763333188.565607:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333188.566328:0:16635:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613894144 00000100:00100000:3.0:1763333188.566338:0:16635:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613894144 00000100:00100000:2.0:1763333188.566773:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1825 00000100:00100000:2.0:1763333188.566785:0:16635:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe480abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2420:x1848987613894144:12345-192.168.204.28@tcp:3:lfs.0 00010000:00010000:2.0:1763333188.566823:0:16635:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c58bc6 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.566840:0:16635:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333188.566843:0:16635:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333188.566849:0:16635:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c58bc6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.566862:0:16635:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c58bc6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.575340:0:16635:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c58bc6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.575385:0:16635:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c58bc6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.575397:0:16635:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c58bc6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.575404:0:16635:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe45c85e00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:2.0:1763333188.575409:0:16635:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c58bc6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.575418:0:16635:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c58bc6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.575437:0:16635:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c58bc6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.575444:0:16635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe45c85e00/0xb32e3ef184c58bc6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->122879] (req 0->122879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333188.575537:0:16635:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe480abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2420:x1848987613894144:12345-192.168.204.28@tcp:3:lfs.0 Request processed in 8750us (9939us total) trans 0 rc 122880/122880 00000100:00100000:2.0:1763333188.575548:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1825 00000100:00100000:0.0:1763333188.590589:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333188.590983:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613894272 00000100:00100000:2.0:1763333188.590994:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613894272 00000100:00100000:2.0:1763333188.591067:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 418 00000100:00100000:2.0:1763333188.591077:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+40:57516:x1848987613894272:12345-192.168.204.28@tcp:103:lfs.0 00010000:00010000:2.0:1763333188.591094:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333188.591122:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c58b8e lrc: 0/0,0 mode: --/PW res: [0x200000405:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a495 expref: 40 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.591141:0:8423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:2.0:1763333188.591146:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333188.591209:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+39:57516:x1848987613894272:12345-192.168.204.28@tcp:103:lfs.0 Request processed in 133us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333188.591216:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 418 00000100:00100000:2.0:1763333188.595485:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333188.595575:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613894528 00000100:00100000:0.0:1763333188.595585:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613894528 00000100:00100000:0.0:1763333188.595901:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3309 00000100:00100000:0.0:1763333188.595912:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff6b3edc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+39:57516:x1848987613894528:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1763333188.596705:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff6b3edc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+40:57516:x1848987613894528:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 790us (1225us total) trans 8589935484 rc 0/0 00000100:00100000:0.0:1763333188.596714:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3309 00000100:00100000:0.0:1763333188.609677:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333188.609905:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613894784 00000100:00100000:1.0:1763333188.609915:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613894784 00000100:00100000:1.0:1763333188.609975:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9717 00000100:00100000:1.0:1763333188.609985:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff7dcfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+40:57511:x1848987613894784:12345-192.168.204.28@tcp:101:fsx.0 00010000:00010000:1.0:1763333188.610008:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763333188.610029:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c58bcd lrc: 2/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a4b8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333188.610147:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe48190200/0xb32e3ef184c58bd4 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333188.610163:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58b33 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a46b expref: 41 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333188.610171:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe48190200/0xb32e3ef184c58bd4 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333188.610203:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58b33 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a46b expref: 41 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333188.610216:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58b33 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a46b expref: 41 pid: 6519 timeout: 1392 lvb_type: 0 00000100:00100000:1.0:1763333188.610239:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff50048380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1848987627323008:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333188.610329:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4869d300 going to sleep for 11 seconds 00000100:00100000:2.0:1763333188.619644:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333188.619748:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613894912 00000100:00100000:0.0:1763333188.619757:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613894912 00010000:00010000:0.0:1763333188.619798:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58b33 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a46b expref: 42 pid: 6519 timeout: 1392 lvb_type: 0 00000100:00100000:0.0:1763333188.619831:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3204 00000100:00100000:0.0:1763333188.619841:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe480aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+42:2420:x1848987613894912:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333188.619857:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333188.619864:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58b33 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a46b expref: 42 pid: 6519 timeout: 1392 lvb_type: 0 00010000:00010000:0.0:1763333188.619876:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58b33 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a46b expref: 42 pid: 6519 timeout: 1392 lvb_type: 0 00010000:00010000:0.0:1763333188.619897:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:0.0:1763333188.619903:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92fe48190200/0xb32e3ef184c58bd4 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333188.619918:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe48190200/0xb32e3ef184c58bd4 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333188.619926:0:6504:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe48190200/0xb32e3ef184c58bd4 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 00010000:00010000:0.0:1763333188.619945:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333188.619998:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe480aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+42:2420:x1848987613894912:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 158us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333188.620006:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3204 00010000:00010000:1.0:1763333188.620110:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742f400/0xb32e3ef184c58b33 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a46b expref: 41 pid: 6519 timeout: 1392 lvb_type: 0 00000100:00100000:1.0:1763333188.620126:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff50048380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1848987627323008:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333188.620147:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92fe48190200/0xb32e3ef184c58bd4 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x55:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333188.620155:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92fe48190200/0xb32e3ef184c58bd4 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x55:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00010000:00010000:1.0:1763333188.620161:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe48190200/0xb32e3ef184c58bd4 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x55:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 00000004:00200000:1.0:1763333188.620181:0:6519:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x55:0x0]: returning size 121402 00010000:00010000:1.0:1763333188.620313:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4742e000/0xb32e3ef184c58bcd lrc: 0/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a4b8 expref: 42 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333188.620328:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe48190200/0xb32e3ef184c58bd4 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x55:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a4b8 expref: 41 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333188.620335:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:1.0:1763333188.620337:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1763333188.620340:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe48190200, rc 0) 00000100:00100000:1.0:1763333188.620408:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff7dcfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+41:57511:x1848987613894784:12345-192.168.204.28@tcp:101:fsx.0 Request processed in 10425us (10740us total) trans 8589935485 rc 0/0 00000100:00100000:1.0:1763333188.620416:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9717 00000100:00100000:2.0:1763333188.628521:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1763333188.634524:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613895040 00000100:00100000:1.0:1763333188.634539:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613895040 00000100:00100000:2.0:1763333188.637482:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9718 00000100:00100000:3.0:1763333188.637609:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe480a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+41:57511:x1848987613895040:12345-192.168.204.28@tcp:101:fsx.0 00010000:00010000:3.0:1763333188.637641:0:6521:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763333188.637668:0:6521:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c58be2 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a4bf expref: -99 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333188.637760:0:6521:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58be9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333188.637777:0:6521:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe48190200/0xb32e3ef184c58bd4 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a4b8 expref: 42 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333188.637785:0:6521:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58be9 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 00010000:00010000:3.0:1763333188.637820:0:6521:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92fe48190200/0xb32e3ef184c58bd4 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a4b8 expref: 42 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333188.637833:0:6521:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe48190200/0xb32e3ef184c58bd4 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a4b8 expref: 42 pid: 6519 timeout: 1392 lvb_type: 0 00000100:00100000:3.0:1763333188.637847:0:6521:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe42efb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1848987627323136:192.168.204.28@tcp:104: 00000100:00100000:3.0:1763333188.637936:0:6521:0:(client.c:2690:ptlrpc_set_wait()) set ffff92ff44fdf000 going to sleep for 11 seconds 00000100:00100000:3.0:1763333188.640184:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333188.640260:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613895168 00000100:00100000:2.0:1763333188.640269:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613895168 00000100:00100000:0.0:1763333188.640302:0:6521:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe42efb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1848987627323136:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333188.640303:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92fe48190200/0xb32e3ef184c58bd4 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a4b8 expref: 43 pid: 6519 timeout: 1392 lvb_type: 0 00010000:00010000:0.0:1763333188.640326:0:6521:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58be9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 00000100:00100000:2.0:1763333188.640345:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3205 00000100:00100000:2.0:1763333188.640398:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+43:2420:x1848987613895168:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333188.640412:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763333188.640418:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92fe48190200/0xb32e3ef184c58bd4 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a4b8 expref: 43 pid: 6519 timeout: 1392 lvb_type: 0 00010000:00010000:2.0:1763333188.640430:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92fe48190200/0xb32e3ef184c58bd4 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a4b8 expref: 43 pid: 6519 timeout: 1392 lvb_type: 0 00010000:00010000:2.0:1763333188.640451:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe48190200/0xb32e3ef184c58bd4 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a4b8 expref: 43 pid: 6519 timeout: 1392 lvb_type: 0 00010000:00010000:2.0:1763333188.640467:0:8423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:2.0:1763333188.640471:0:8423:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58be9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333188.640480:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58be9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333188.640486:0:8423:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58be9 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 00010000:00010000:2.0:1763333188.640504:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763333188.640562:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+42:2420:x1848987613895168:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 166us (385us total) trans 0 rc 0/0 00010000:00010000:0.0:1763333188.640579:0:6521:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58be9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333188.640586:0:6521:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58be9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 00000004:00200000:0.0:1763333188.640635:0:6521:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x55:0x0]: returning size 121402 00000004:00200000:0.0:1763333188.640640:0:6521:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763333188.640659:0:6521:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58be9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 00010000:00010000:0.0:1763333188.640688:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700fe00/0xb32e3ef184c58be2 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a4bf expref: 43 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333188.640704:0:6521:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92fe4700f000/0xb32e3ef184c58be9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a4bf expref: 42 pid: 6521 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333188.640712:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff92ff4ad5e600) 00010000:00010000:0.0:1763333188.640714:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763333188.640730:0:6521:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe4700f000, rc 0) 00000100:00100000:0.0:1763333188.640765:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe480a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+42:57511:x1848987613895040:12345-192.168.204.28@tcp:101:fsx.0 Request processed in 3270us (12256us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333188.640772:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9718 00000100:00100000:2.0:1763333188.641711:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3205 00000100:00100000:3.0:1763333188.648169:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333188.648754:0:28650:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613895296 00000100:00100000:2.0:1763333188.648765:0:28650:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613895296 00000100:00100000:2.0:1763333188.648820:0:28650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6915 00000100:00100000:2.0:1763333188.648828:0:28650:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:57511:x1848987613895296:12345-192.168.204.28@tcp:101:fsx.0 00010000:00010000:2.0:1763333188.648848:0:28650:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763333188.648868:0:28650:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85400/0xb32e3ef184c58bf0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a4c6 expref: -99 pid: 28650 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763333188.648889:0:28650:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x96:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763333188.648908:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333188.648914:0:28650:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333188.648922:0:28650:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85400/0xb32e3ef184c58bf0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->122879) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a4c6 expref: 19 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.648936:0:28650:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92fe45c85400/0xb32e3ef184c58bf0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->122879) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a4c6 expref: 19 pid: 28650 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.648947:0:28650:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92fe45c85400, rc 0) 00000100:00100000:2.0:1763333188.649014:0:28650:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:57511:x1848987613895296:12345-192.168.204.28@tcp:101:fsx.0 Request processed in 185us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1763333188.649020:0:28650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6915 00000100:00100000:3.0:1763333188.656381:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333188.656462:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613895552 00000100:00100000:0.0:1763333188.656472:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613895552 00000100:00100000:0.0:1763333188.656532:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3310 00000100:00100000:0.0:1763333188.656542:0:19668:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42efbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+41:57511:x1848987613895552:12345-192.168.204.28@tcp:35:fsx.0 00000001:00080000:0.0:1763333188.656776:0:19668:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935486 00000100:00100000:0.0:1763333188.656891:0:19668:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42efbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1370b1d7-8612-4b90-ab37-e53288bbf9fd+43:57511:x1848987613895552:12345-192.168.204.28@tcp:35:fsx.0 Request processed in 350us (547us total) trans 8589935487 rc 0/0 00000100:00100000:0.0:1763333188.656900:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3310 00000020:00080000:0.0:1763333188.656904:0:19668:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763333188.660012:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333188.660110:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613895680 00000100:00100000:0.0:1763333188.660119:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613895680 00000100:00100000:0.0:1763333188.660172:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6916 00000100:00100000:0.0:1763333188.660180:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50048380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:57511:x1848987613895680:12345-192.168.204.28@tcp:101:fsx.0 00010000:00010000:0.0:1763333188.660197:0:8611:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763333188.660213:0:8611:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c58bf7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x25d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd9dc1b5e3696a4cd expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333188.660251:0:8611:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe467be000/0xb32e3ef184c586e8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x25d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2dc expref: 20 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333188.660258:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333188.660260:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333188.660264:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c58bf7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x25d:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a4cd expref: 20 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333188.660294:0:8611:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe467be000/0xb32e3ef184c586e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x25d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2dc expref: 20 pid: 8406 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333188.660305:0:8611:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe467be000/0xb32e3ef184c586e8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x25d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2dc expref: 20 pid: 8406 timeout: 1392 lvb_type: 1 00000100:00100000:0.0:1763333188.660317:0:8611:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7dcfe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8611:1848987627323264:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333188.660424:0:8611:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe451980c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763333188.662313:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1763333188.662445:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613895808 00000100:00100000:2.0:1763333188.662452:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613895808 00010000:00010000:2.0:1763333188.662482:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe467be000/0xb32e3ef184c586e8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x25d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2dc expref: 21 pid: 8406 timeout: 1392 lvb_type: 1 00000100:00100000:2.0:1763333188.662522:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3206 00000100:00100000:2.0:1763333188.662531:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50049500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+21:2421:x1848987613895808:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763333188.662544:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1763333188.662556:0:8611:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7dcfe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8611:1848987627323264:192.168.204.28@tcp:104: 00010000:00010000:2.0:1763333188.662562:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe467be000/0xb32e3ef184c586e8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x25d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2dc expref: 21 pid: 8406 timeout: 1392 lvb_type: 1 00010000:00010000:2.0:1763333188.662578:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe467be000/0xb32e3ef184c586e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x25d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2dc expref: 21 pid: 8406 timeout: 1392 lvb_type: 1 00010000:00010000:2.0:1763333188.662781:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe467be000/0xb32e3ef184c586e8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x25d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a2dc expref: 21 pid: 8406 timeout: 1392 lvb_type: 1 00010000:00010000:0.0:1763333188.662818:0:8611:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c58bf7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x25d:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a4cd expref: 20 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.662819:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333188.662821:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763333188.662828:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c58bf7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a4cd expref: 20 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763333188.662841:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c58bf7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x25d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a4cd expref: 20 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333188.662870:0:8611:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ff77e7e000, rc 0) 00010000:00010000:2.0:1763333188.662879:0:8423:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff92ff77e7e000/0xb32e3ef184c58bf7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a4cd expref: 20 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763333188.662891:0:8423:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92fe480a9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8423:1848987627323392:192.168.204.28@tcp:105: 00000100:00100000:0.0:1763333188.663496:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50048380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+20:57511:x1848987613895680:12345-192.168.204.28@tcp:101:fsx.0 Request processed in 3316us (3490us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333188.663504:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6916 00000100:00100000:2.0:1763333188.663864:0:8423:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe49ad0840 going to sleep for 11 seconds 00000100:00100000:0.0:1763333188.671500:0:8423:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92fe480a9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8423:1848987627323392:192.168.204.28@tcp:105: 00000100:00100000:2.0:1763333188.671508:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:0.0:1763333188.671528:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763333188.671580:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50049500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2421:x1848987613895808:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 9049us (9273us total) trans 0 rc 0/0 00000100:00100000:0.0:1763333188.671590:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3206 00000100:00100000:3.0:1763333188.671672:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613896064 00000100:00100000:3.0:1763333188.671680:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613896064 00000100:00100000:3.0:1763333188.671727:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3311 00000100:00100000:3.0:1763333188.671736:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe480a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+250:57511:x1848987613896064:12345-192.168.204.28@tcp:35:fsx.0 00000001:00080000:3.0:1763333188.671972:0:6523:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294972608 00000100:00100000:3.0:1763333188.672063:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe480a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+252:57511:x1848987613896064:12345-192.168.204.28@tcp:35:fsx.0 Request processed in 327us (554us total) trans 4294972609 rc 0/0 00000100:00100000:3.0:1763333188.672073:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3311 00000020:00080000:3.0:1763333188.672077:0:6523:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763333188.676514:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1763333188.676652:0:19668:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613896320 00000100:00100000:0.0:1763333188.676663:0:19668:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613896320 00000100:00100000:3.0:1763333188.676943:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3312 00000100:00100000:3.0:1763333188.676969:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+43:57511:x1848987613896320:12345-192.168.204.28@tcp:35:fsx.0 00000100:00100000:3.0:1763333188.680572:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1370b1d7-8612-4b90-ab37-e53288bbf9fd+44:57511:x1848987613896320:12345-192.168.204.28@tcp:35:fsx.0 Request processed in 3605us (4053us total) trans 8589935488 rc 0/0 00000100:00100000:3.0:1763333188.680588:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3312 00010000:00010000:1.0:1763333189.200554:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1763333189.967695:0:35567:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_70a: @@@@@@ FAIL: fsx FLR file /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr failed 00010000:00010000:3.0:1763333190.224946:0:8421:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333190.757233:0:3639:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c58671 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x6:0x0].0x9645bb7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333190.757254:0:3639:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c58671 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x6:0x0].0x9645bb7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333190.757262:0:3639:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c58671 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x6:0x0].0x9645bb7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333190.757268:0:3639:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7fe00 already unused, calling callback (ffffffffc17b3550) 00010000:00010000:0.0:1763333190.757274:0:3639:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c58671 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x6:0x0].0x9645bb7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333190.757282:0:3639:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c58671 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x6:0x0].0x9645bb7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333190.757300:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x9645bb7c (ffff92fe43b44100) 00010000:00010000:0.0:1763333190.757304:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763333190.757310:0:3639:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c58671 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x6:0x0].0x9645bb7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00010000:00010000:0.0:1763333190.757316:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92ff77e7fe00/0xb32e3ef184c58671 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x6:0x0].0x9645bb7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12741 initiator: MDT1 00000001:00080000:3.0:1763333190.757672:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972609 is committed 00000001:00080000:3.0:1763333190.757691:0:7438:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294972607 is committed 00000004:00080000:3.0:1763333190.757698:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 990 committed 00000004:00080000:3.0:1763333190.757716:0:7438:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 987 committed 00000100:00100000:3.0:1763333190.757863:0:3653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff5004ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627323520:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1763333190.757929:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763333190.758084:0:8611:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627323520 00000100:00100000:0.0:1763333190.758091:0:8611:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627323520 00000100:00100000:0.0:1763333190.758146:0:8611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6917 00000100:00100000:1.0:1763333190.758234:0:3654:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7dcfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627323648:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763333190.758266:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763333190.758302:0:8406:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987627323648 00000100:00100000:1.0:1763333190.758306:0:8406:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987627323648 00000100:00100000:1.0:1763333190.758331:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6918 00000100:00100000:1.0:1763333190.758338:0:8406:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff50049c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1848987627323648:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1763333190.758386:0:8406:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:604 count 1 00010000:00010000:1.0:1763333190.758412:0:8406:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe48191800/0xb32e3ef184c58bfe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333190.758433:0:8406:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe48190e00/0xb32e3ef184c5842c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x25c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a203 expref: 18 pid: 17605 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333190.758442:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333190.758444:0:8406:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763333190.758448:0:8406:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe48191800/0xb32e3ef184c58bfe lrc: 4/0,1 mode: --/PW res: [0x280000400:0x25c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333190.758476:0:8406:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff92fe48190e00/0xb32e3ef184c5842c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x25c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a203 expref: 18 pid: 17605 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763333190.758495:0:8406:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff92fe48190e00/0xb32e3ef184c5842c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x25c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a203 expref: 18 pid: 17605 timeout: 1394 lvb_type: 1 00000100:00100000:1.0:1763333190.758506:0:8406:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff5004aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8406:1848987627323776:192.168.204.28@tcp:104: 00000100:00100000:1.0:1763333190.758572:0:8406:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe4869d900 going to sleep for 11 seconds 00000100:00080000:1.0:1763333190.758626:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1763333190.758629:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1763333190.758968:0:8611:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92fe42ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1848987627323520:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1763333190.758986:0:8611:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:604 count 1 00010000:00010000:0.0:1763333190.759003:0:8611:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58c05 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x25c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333190.759016:0:8611:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff92fe48191600/0xb32e3ef184c58425 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x25c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1fc expref: 17 pid: 17605 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333190.759022:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333190.759024:0:8611:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333190.759026:0:8611:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58c05 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x25c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333190.759048:0:8611:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff92fe48191600/0xb32e3ef184c58425 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x25c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1fc expref: 17 pid: 17605 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763333190.759057:0:8611:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff92fe48191600/0xb32e3ef184c58425 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x25c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1fc expref: 17 pid: 17605 timeout: 1394 lvb_type: 1 00000100:00100000:0.0:1763333190.759067:0:8611:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff92ff7dcfdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8611:1848987627323904:192.168.204.28@tcp:104: 00000100:00100000:0.0:1763333190.759096:0:8611:0:(client.c:2690:ptlrpc_set_wait()) set ffff92fe451980c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763333190.764198:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333190.764303:0:8406:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff5004aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8406:1848987627323776:192.168.204.28@tcp:104: 00010000:00010000:3.0:1763333190.764329:0:8406:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff92fe48191800/0xb32e3ef184c58bfe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333190.764540:0:8423:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613896448 00000100:00100000:0.0:1763333190.764550:0:8423:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613896448 00010000:00010000:0.0:1763333190.764597:0:8423:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff92fe48190e00/0xb32e3ef184c5842c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x25c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a203 expref: 19 pid: 17605 timeout: 1394 lvb_type: 1 00000100:00100000:0.0:1763333190.764640:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3207 00000100:00100000:0.0:1763333190.764650:0:8423:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff5004b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+19:2420:x1848987613896448:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763333190.764667:0:8423:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763333190.764672:0:8423:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff92fe48190e00/0xb32e3ef184c5842c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x25c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a203 expref: 19 pid: 17605 timeout: 1394 lvb_type: 1 00010000:00010000:0.0:1763333190.764685:0:8423:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff92fe48190e00/0xb32e3ef184c5842c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x25c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a203 expref: 19 pid: 17605 timeout: 1394 lvb_type: 1 00010000:00010000:0.0:1763333190.764711:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe48190e00/0xb32e3ef184c5842c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x25c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a203 expref: 19 pid: 17605 timeout: 1394 lvb_type: 1 00010000:00010000:0.0:1763333190.764728:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333190.764731:0:8423:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763333190.764735:0:8423:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff92fe48191800/0xb32e3ef184c58bfe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333190.764745:0:8423:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff92fe48191800/0xb32e3ef184c58bfe lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x25c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333190.764770:0:8423:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:1.0:1763333190.764813:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1763333190.764840:0:8423:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff5004b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2420:x1848987613896448:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 189us (661us total) trans 0 rc 0/0 00010000:00010000:1.0:1763333190.764844:0:8406:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff92fe48191800/0xb32e3ef184c58bfe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763333190.764852:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3207 00010000:00010000:1.0:1763333190.764860:0:8406:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff92fe48191800/0xb32e3ef184c58bfe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333190.764874:0:8406:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff92fe48191800/0xb32e3ef184c58bfe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333190.764882:0:8406:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff92fe48191800/0xb32e3ef184c58bfe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333190.764910:0:8406:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763333190.765320:0:6508:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763333190.765328:0:6508:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff92fe48191800/0xb32e3ef184c58bfe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333190.765337:0:6508:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92fe48191800 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:0.0:1763333190.765342:0:6508:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe48191800/0xb32e3ef184c58bfe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333190.765376:0:6508:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff92fe48191800/0xb32e3ef184c58bfe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333190.765392:0:6508:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff92fe48191800/0xb32e3ef184c58bfe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763333190.765399:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff92fe48191800/0xb32e3ef184c58bfe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333190.765419:0:8406:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff50049c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3654:x1848987627323648:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7078us (7149us total) trans 21474839095 rc 0/0 00010000:00010000:0.0:1763333190.765420:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333190.765424:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763333190.765428:0:6508:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763333190.765431:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6918 00000004:00080000:3.0:1763333190.765503:0:3654:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff7dcfe300/2, rc 0, transno 21474839095 00000100:00100000:3.0:1763333190.765510:0:3654:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7dcfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1848987627323648:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1763333190.767630:0:8611:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff7dcfdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8611:1848987627323904:192.168.204.28@tcp:104: 00010000:00010000:1.0:1763333190.767662:0:8611:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58c05 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x25c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763333190.772250:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1763333190.772491:0:6504:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848987613896576 00000100:00100000:3.0:1763333190.772502:0:6504:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848987613896576 00010000:00010000:3.0:1763333190.772559:0:6504:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff92fe48191600/0xb32e3ef184c58425 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x25c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1fc expref: 18 pid: 17605 timeout: 1394 lvb_type: 1 00000100:00100000:3.0:1763333190.772624:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3208 00000100:00100000:3.0:1763333190.772644:0:6504:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff92ff800dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+18:2421:x1848987613896576:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763333190.772662:0:6504:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763333190.772669:0:6504:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff92fe48191600/0xb32e3ef184c58425 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x25c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1fc expref: 18 pid: 17605 timeout: 1394 lvb_type: 1 00010000:00010000:3.0:1763333190.772685:0:6504:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff92fe48191600/0xb32e3ef184c58425 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x25c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1fc expref: 18 pid: 17605 timeout: 1394 lvb_type: 1 00010000:00010000:3.0:1763333190.772710:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92fe48191600/0xb32e3ef184c58425 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x25c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.28@tcp remote: 0xd9dc1b5e3696a1fc expref: 18 pid: 17605 timeout: 1394 lvb_type: 1 00010000:00010000:3.0:1763333190.772728:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333190.772730:0:6504:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763333190.772740:0:6504:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58c05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333190.772751:0:6504:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58c05 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x25c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763333190.772779:0:6504:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:1.0:1763333190.772920:0:6515:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1763333190.772937:0:8611:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58c05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333190.772948:0:8611:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58c05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333190.772960:0:8611:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58c05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333190.772970:0:8611:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58c05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333190.772989:0:8611:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763333190.774470:0:8611:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92fe42ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3653:x1848987627323520:12345-0@lo:6:osp-syn-1-1.0 Request processed in 15503us (16533us total) trans 17179871753 rc 0/0 00000100:00100000:1.0:1763333190.774484:0:8611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6917 00010000:00010000:1.0:1763333190.774520:0:8422:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763333190.774528:0:8422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58c05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333190.774540:0:8422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff92ff77e7ec00 already unused, calling callback (ffffffffc0b79b40) 00010000:00010000:1.0:1763333190.774545:0:8422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58c05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763333190.775564:0:6504:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff92ff800dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1370b1d7-8612-4b90-ab37-e53288bbf9fd+17:2421:x1848987613896576:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 2915us (3316us total) trans 0 rc 0/0 00000100:00100000:3.0:1763333190.775576:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3208 00000100:00100000:3.0:1763333190.777119:0:3653:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179871713 gen 2 00000004:00080000:3.0:1763333190.777130:0:3653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff92ff77a3f100, transno 17179871713 00000100:00100000:3.0:1763333190.778252:0:3653:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff92ff5004ad80 x1848987627323520/t17179871753(17179871753) o6->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1763333206 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1763333190.778269:0:3653:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff92ff5004ad80/2, rc 0, transno 17179871753 00010000:00010000:1.0:1763333190.778326:0:8422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58c05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333190.778362:0:8422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58c05 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333190.778371:0:8422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff92ff77e7ec00/0xb32e3ef184c58c05 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8611 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763333190.778398:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333190.778400:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763333190.778403:0:8422:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763333190.781592:0:3653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff92ff5004ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1848987627323520:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1763333191.251521:0:6507:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 69109 lines, 69109 kept, 0 dropped, 0 bad.